Recognizing familiar voices is something we do every day. In quiet environments, it is usually easy to recognize a familiar voice. In noisier environments, this can become a difficult task. This paper examines how robust listeners are at identifying familiar voices in noisy, changing environments and what factors may affect their recognition rates. While there is previous research addressing familiar speaker recognition, the research is limited due to the difficulty in obtaining appropriate data that eliminates speaker dependent traits, such as word choice, along with having corresponding listeners who are familiar with the speakers. The data used in this study were collected in such a fashion to mimic conversational, free-flow dialogue, but in a way to eliminate many variables such as word choice, intonation, or non-verbal cues. These data provide some of the most realistic test scenarios to-date for familiar speaker identification. A pure-tone hearing test was used to separate listeners into normal hearing and hearing impaired groups. It is hypothesized that the results of the Normal Hearing Group will be statistically better. Additionally, the aspect of familiar speaker recognition is addressed by having each listener rate his or her familiarity with each speaker. Two statistical approaches showed that the more familiar a listener is with a speaker, the more likely the listener will recognize the speaker.