Perceptual filling-in occurs when visual stimuli are recognized in impoverished viewing conditions. Whether missing information is filled-in during face perception and which stages might be involved in this process are still unresolved questions. Because an identity can be brought to mind by seeing eyes only, we hypothesized that missing information might be filled-in from a memory trace for the whole face identity. We presented participants with faces in phase 1 and later we presented eyes-only in phase 2. For some of these eyes in phase 2, the whole face had been presented in the previous phase, for others identical eyes had been presented. Event-related potentials (ERPs) revealed an N170 component that was more negative when eyes were preceded by a whole face in the previous phase compared to eyes preceded by identical eyes-only. A more positive-going late positive complex (LPC) was also found, suggesting enhanced retrieval of face memory representations when eyes were preceded by whole faces. Our results show that pre-existing representations of face identity can influence early stages of visual encoding, 170 ms after stimulus onset. These effects may reflect top-down modulation by memory on visual recognition processes by filling-in the missing facial information.