The so-called ovoo-cairns of Mongolia display a variety and pervasiveness that stimulated a rich anthropological analysis. However, their ancient history remains a challenging and scarcely frequented research topic. This paper introduces an archaeological focus combined with linguistic, historical, anthropological considerations to provide an alternative approach to the genealogy of the ovoos. Their multi-dimensional nature and persistent temporal aspects are investigated through the analysis of early written sources, local narratives, and the archaeological landscape. This is to substantiate the hypothesis that the origin of ovoos could lie far deeper in time than the Buddhist intensification of the 16th and 17th centuries. It could be connected with the ancient monumental tradition of piling (stone) objects in significant places of the sacred and pastoral landscapes of Mongolia. In particular, the possible intersection between present cairns and ancient funerary monumentality is investigated, taking into account three specific case studies of Late Prehistoric mounds that have been locally transformed into ovoos in the area of the Ih Bogd Mountain, in southern Mongolia (Bayanhongor Province). The “ovoo phenomenon” emerges as an exciting opportunity to analyse how people materially engage with and negotiate the local past within the landscape both in ancient and present times.