Single-photon interference experiments are attempted in the time domain using true single-photon streams. Self-heterodyning beats are clearly observed by letting the field associated with a single photon interfere with itself on a field-quadratic detector, which is a time analogue of Young's two-slit interference experiment. The temporal first-order coherence of single-photon fields, i.e., transient interference fringes, develops as cumulative detection events are mapped point-by-point onto a virtual capture frame by properly correlating the time-series data. The ability to single out photon counts at a designated timing paves the way for digital heterodyning with faint light for such use as phase measurement and quantum information processing.