Considering the clustering algorithms could explore the label information automatically, this paper proposes a new method in terms of polarimetric synthetic aperture radar (POLSAR) image classification, which named a clustering-wishart-auto-encoder (WAE) classification model. With considering the statistical distribution characteristic of the POLSAR image, the WAE classification model, which proposed by ourselves, could improve the classification performance of the POLSAR image to some extent. The clustering-WAE classification model, that embedded the K-means clustering algorithm into the objective function of the WAE model, has the ability to improve the network performance. Our proposed method could minimize the difference of intra-class data and maximize the difference of inter-class data, from which the obtained POLSAR image features will be more compact to their corresponding cluster centers. Via simultaneously considering the compactness and statistical distribution of data, our method is capable of improving the POLSAR image classification results. The effectiveness of our proposed classification model has been demonstrated on four real POLSAR data sets.