Most hand detection and tracking algorithms can be only applied in the fairly simple and similar background. We propose to combine a modified object detection method proposed by Viola and Jones with the skin-color detection method to perform hand detection and tracking against complex background. Out experimental results show that the proposed method is effective in near real-time speed (15 frames per second.).