A method of medical images classification based on LBP operator and BP neural network is proposed in this paper. The method uses direction texture spectrum descriptor to describe the texture features, making them as the samples input of neural network for training. Finally, the trained network is used to classify the medical images. Experimental results show it is effecitve for medical images classification.