Epigenetic mechanisms regulate expression of the genome to generate various cell types during development or orchestrate cellular responses to external stimuli. Recent studies highlight that bacteria can affect the chromatin structure and transcriptional program of host cells by influencing diverse epigenetic factors (i.e., histone modifications, DNA methylation, chromatin-associated complexes, noncoding RNAs, and RNA splicing factors). In this article, we first review the molecular bases of the epigenetic language and then describe the current state of research regarding how bacteria can alter epigenetic marks and machineries. Bacterial-induced epigenetic deregulations may affect host cell function either to promote host defense or to allow pathogen persistence. Thus, pathogenic bacteria can be considered as potential epimutagens able to reshape the epigenome. Their effects might generate specific, long-lasting imprints on host cells, leading to a memory of infection that influences immunity and might be at the origin of unexplained diseases.