This paper, by using the short CURE clustering algorithm and image SIFT identification method, the establishment of a kind of image semantic clustering fusion model (image text clustering fusion model, referred to as ITCFM). The model is based on component method, the original image components, original text member, image clustering member, text clustering components, clustering fusion member five parts. In ITCM model for image semantic clustering characteristics on the basis of the description and extraction. The experimental results show that ITCM model can effectively to image to describe the high-level semantic, the image retrieval effect is good, and have stable retrieval performance.