In the present study, we report the discovery of a novel allosteric inhibitory site for p38α, a subclass of the mitogen-activated protein kinases (MAPK) family. The putative site was discovered after inspection of the crystallographic structure of the p38α-MK2 complex. MK2 (MAPK-activated protein kinase 2) is an interesting protein playing a dual role as modulator and substrate of p38α. This intriguing behavior is due to the ability of the two proteins to form distinctive heterodimers when p38α is phosphorylated or not. We hypothesized that the regulatory action of MK2 is due to its capability to keep p38α in an inactive conformation and consequently, we investigated the atomic structure of the p38α-MK2 complex to understand such regulatory behavior at the molecular level. After inspection of the complex structure, two peptides designed from the MK2 regulatory loop in contact with p38α with sequences Tyr1-Ser2-Asn3-His4-Gly5-Leu6 (peptide-1) and [Phe0]-peptide-1 (peptide-2) in their zwitterionic form were investigated for their phosphorylation inhibitory capability in vitro. Since both peptides exhibited inhibitory capability of the p38α kinase mediated phosphorylation of MEF2A, in a subsequent step we pursued the discovery of small molecule peptidomimetics. For this purpose we characterized in detail the peptide-p38α interaction using molecular dynamics simulations, leading to the definition of a pharmacophore for the peptide-protein interaction. This hypothesis was used as query for a in silico screening, leading to the discovery of a fused ring compound with micromolar inhibitory activity. Site-directed mutagenesis studies support that the compound binds to the putative novel allosteric site in p38α.