Inhibitors of histone deacetylases (HDACs) are nowadays part of the therapeutic arsenal mainly against cancers, with four compounds approved by the Food and Drug Administration. During the last five years, several groups have made continuous efforts to improve this class of compounds, designing more selective compounds or compounds with multiple capacities. After a survey of the HDAC biology and structures, this review summarizes the results of the chemists working in this field, and highlights when possible the behavior of the molecules inside their targets.