The paper describes the use of thermal camera and IR night vision system for the detection of Pedestrians and objects that may cause accident at night time. As per the survey most of the accidents cause is due to low vision ability of human at night time, which leads to most dangerous and higher number of accidents at night with respect to day time. This system include the IR night vision camera which detects the object with the help of IR LED and photodiode pair, this camera have capability to detect the object up to 100m. The thermal camera detects the heat generated by any of the object like cars, Human animals etc. which gives us the facility to detect the object for higher range and with low reflective surface where IR night vision may fails. With the use of these two cameras mounted on car which helps the driver to drive safely. In this system, HOG (Histogram of orientated gradients) algorithm and support vector machine (SVM) is performed with the help of OpenCV in Matlab and EmguCV in Visual Basic 2012. The system is tested on the video recorded using these cameras, and got good and efficient result. And this system is cost efficient and easy to implement.