The brain is the central organ involved in perceiving and adapting to social and physical stressors via multiple interacting mediators, from the cell surface to the cytoskeleton to epigenetic regulation and nongenomic mechanisms. A key result of stress is structural remodeling of neural architecture, which may be a sign of successful adaptation, whereas persistence of these changes when stress ends indicates failed resilience. Excitatory amino acids and glucocorticoids have key roles in these processes, along with a growing list of extra- and intracellular mediators that includes endocannabinoids and brain-derived neurotrophic factor (BDNF). The result is a continually changing pattern of gene expression mediated by epigenetic mechanisms involving histone modifications and CpG methylation and hydroxymethylation as well as by the activity of retrotransposons that may alter genomic stability. Elucidation of the underlying mechanisms of plasticity and vulnerability of the brain provides a basis for understanding the efficacy of interventions for anxiety and depressive disorders as well as age-related cognitive decline.