For patients with color vision defects, owing to the destruction of cone cells and loss of function, some color information is lost, hence changing the originally transmitted information by the image. The purpose of the traditional method of correction is to help patients distinguish between colors, but it does not take into account the problem of the saliency of the image. In this paper, we propose a saliency consistency-based image re-colorization for color blindness. We use image retrieval methods to select a large number of images and use co-saliency methods to detect salient areas of standard color images and color-blind simulated images. According to the detection results, an image with the same detection result was selected as the reference image. We grayscale the significantly changed image, recolor the grayscale image using the reference image, and the color scheme of the recolored image is similar to the reference image. The color matching scheme of the reference image makes the significance of the image basically unchanged in standard vision and color vision defects, thereby making the color blindness patient's perception of the image close to standard vision. We invite green blind patients to evaluate CVD simulation images with different recoloring methods subjectively. In addition, we use different evaluation criteria to evaluate the experimental results objectively. In the subjective evaluation and objective evaluation, the method proposed in this paper has achieved good results, which validates the effectiveness of our method.