Biometric recognition system can use race classification to identify the human globally with a particular identity. This paper proposes Support Vector Machine and will compare the result with K-Nearest Neighbor for classification of people into two major races namely Indonesian western and eastern races. Firstly, the proposed classification method extracts the distinct primary facial feature and skin color model of the given face with Viola-Jones Algorithm to effectively classify the races. To increase the accuracy, the sample must not contain any background of other people skin, no movement and the pictures were taken from the mobile camera with no beauty filter.