During a plant's lifecycle, the availability of nutrients in the soil is mostly heterogeneous in space and time. Plants are able to adapt to nutrient shortage or localized nutrient availability by altering their root system architecture to efficiently explore soil zones containing the limited nutrient. It has been shown that the deficiency of different nutrients induces root architectural and morphological changes that are, at least to some extent, nutrient specific. Here, we highlight what is known about the importance of individual root system components for nutrient acquisition and how developmental and physiological responses can be coupled to increase nutrient foraging by roots. In addition, we review prominent molecular mechanisms involved in altering the root system in response to local nutrient availability or to the plant's nutritional status.