In this paper we present a proof of concept for non-contact extraction of vital signs using RGB and thermal images obtained from a smart phone. Using our method, heart rate, respiratory rate and forehead temperature can be measured concurrently. Face detection and tracking is leveraged in order to allow natural motion of patients. Heart rate is estimated via processing of visible band RGB video using Eulerian Video Magnification technique. Respiratory rate and the temperature is measured using thermal video. Experiments conducted with 11 healthy subjects indicate that heart rate and respiration rate can be measured with 92 and 94 percent accuracy, respectively.