In order to resolve crashed accidents caused by fatigue or drowsiness various fatigue detecting algorithms are investigated. Aiming at the needs of large data, high transfer rate and complex operation, in this paper, we design a fatigue detection algorithm based on PERCLOS, moreover, design AVT Guppy F-080 C camera and 1394 cards as the core hardware system. The system can meet the real-time video capture, processing, display needs, fatigue detection algorithm can be used as the hardware platform.