Natural killer (NK) cells were previously considered to represent short-lived, innate lymphocytes. However, mouse models have revealed expansion and persistence of differentiated NK cell subsets in response to cytomegalovirus (CMV) infection, paralleling antigen-specific T cell differentiation. Congruently, analyses of humans have uncovered CMV-associated NK cell subsets characterized by epigenetic diversification processes that lead to altered target cell specificities and functional capacities. Here, focusing on responses to viruses, we review similarities and differences between mouse and human adaptive NK cells, identifying molecular analogies that may be key to transcriptional reprogramming and functional alterations. We discuss possible molecular mechanisms underlying epigenetic diversification and hypothesize that processes driving epigenetic diversification may represent a more widespread mechanism for fine-tuning and optimization of cellular immunity.