Through the analysis of the Audio and Video Standard intra prediction algorithm, a new optimization design method is put forward to the AVS encoder intra prediction module. Two dimensional filtering units were used in the design simplifying the reference data selection mechanism. Using the prediction unit array constructed by the basic unit PE improves the prediction speed. Design of systolic arrays is used to predict complex color Plane mode. The design based on the Verilog Hardware Design Language(HDL)is realized on FPGA and simulated in ModelSim. The results show that this design improves the coding efficiency and reduces the consumption of hardware resources and meet the requirements of real-time encoding of high-definition video.