Camera calibration is one of the fundamental issues in computer vision and aims at determining the intrinsic and exterior camera parameters by using image features and the corresponding 3D features. This paper proposes a relationship model for camera calibration in which the geometric parameter and the lens distortion effect of camera are taken into account in order to unify the world coordinate system (WCS), the camera coordinate system (CCS) and the image coordinate system (ICS). Differential evolution is combined with particle swarm optimization algorithm to calibrate the camera parameters effectively. Experimental results show that the proposed algorithm has a good optimization ability to avoid local optimum and can complete the visual identification tasks accurately.