In the central visual pathway of binocular animals, the property of directional selectivity (DS) is first exhibited in striate cortex. In this study, we sought to determine the neural circuitry underlying the transformation from non-DS neurons to DS cortical cells. In a well established model, DS receptive fields (RFs) are derived from the sum of two non-DS inputs with 90° (quadrature) spatiotemporal phase differences. We explored possible input sources for this model, which include non-DS simple cells and lateral geniculate nucleus (LGN) neurons, by examination of spatiotemporal RFs of single cells and of pairs of cells. We find that distributions of non-DS simple RFs do not match the temporal predictions of the quadrature model because of a lack of long-latency responses. The long-latency inputs could potentially arise from lagged LGN afferents. However, analysis of cell pairs indicates that DS cells receive cortical input from non-DS simple cells for both short- and long-latency components, with temporal phase differences typically <90°. Furthermore, the distribution of minimum phase differences needed to generate DS cells overlaps that exhibited by non-DS simple cells. Considered together, these results are consistent with a linear model whereby DS simple cells are formed from simple-cell inputs, with temporal phase differences often less than quadrature.