Abstract: By using the deep learning method, we establish an automatic discriminant model to identify the growing phenological phase the of white tea in this study. In this experiment, we input image by the deep learning, extract the image feature by using convolution neural network (CNN), and then on the basis of the classification so as to realize the recognition of image white tea grows phenological period, fusion the meteorological characteristics to optimize the recognition effect, obtained the recognition model with higher accuracy.Through experiments, the model can accurately identify the phenological period of the white tea in the image.