This manuscript presents the design of a new approach of human skin color authentication. Skin color is one of the most popular soft biometric modalities. Since a soft biometric modality alone cannot reliably authenticate an individual, this new system is designed to combine skin color results with other pure biometric modalities to increase recognition performance. In the classification process, we first perform facial skin detection by segmentation using the thresholding method in the HSV color space. Then, the K-means algorithm of the clustering method is used to determine the dominant colors on the skin pixels in the RGB model. Variations according to the R, G and B components are recorded in a reference model to enable an individual’s identity to be predicted on the basis of 30 clusters. Experimental results are promising and give a false acceptance rate (FAR) of 29.47% and a false rejection rate (FRR) of 70.53%.