In this paper we use unique longitudinal data sources to study the relationship between poverty and fertility at household level in Albania, Ethiopia, Indonesia and Vietnam. These countries differ greatly in their history, average income, social structure, economic institutions and demographic features. We find that there is a substantial difference in the relative importance of the determinants of poverty dynamics and fertility; the persistence of high levels of fertility and poverty in Ethiopia is driven by lack of economic growth, high demand of children and poor access to family planning; education is a crucial element in reducing poverty and fertility, as is clear from Vietnam, Indonesia and Albania.