This paper designs a wireless video surveillance system based on ARM11 and Linux operating system. To improve processing speed, the system adopts ARM11 as the main processor, and the video capturing equipment is OV9650 camera, also uses hard-coding to compress the video data with H.264. Then it can transfer encoded data to remote server and display that. It realizes a wireless video surveillance platform, which has stable running, quick speed, lower expenditure and small volume. It has great practical value.