At present, at most ports the code of each container is registered manually, which is of a great potential safety hazard and inefficient. In this paper we present a container-code recognition system, which use the geometrical clustering of connected component extracted by MSER descriptor and spatial structure template matching for location and various CNN-classifiers for identification. Experiments confirmed the robustness and accurateness of the recognition algorithm on real images from ports.