We investigate the childhood determinants of adult height in populations, focusing on the respective roles of income and of disease. We develop a model of selection and scarring, in which the early life burden of nutrition and disease is not only responsible for mortality in childhood but also leaves a residue of long-term health risks for survivors, risks that express themselves in adult height, as well as in late-life disease. Across a range of European countries and the United States, we find a strong inverse relationship between post-neonatal (one month to one year) mortality, interpreted as a measure of the disease and nutritional burden in childhood, and the mean height of those children as adults. In pooled birth-cohort data over 30 years for the United States and eleven European countries, post-neonatal mortality in the year of birth accounts for more than 60 percent of the combined cross-country and cross-cohort variation in adult heights. The estimated effects are smaller but remain significant once we allow for country and birth-cohort effects. In the poorest and highest mortality countries of the world, there is evidence that child mortality is positively associated with adult height. That selection should dominate scarring at high mortality levels, and scarring dominate selection at low mortality levels, is consistent with the model for reasonable values of its parameters.