Abstract The Central Asian Orogenic Belt is a gigantic tectonic collage of numerous accreted terranes. However, its geodynamic evolution has been hotly debated primarily due to incomplete knowledge on the nature of these enigmatic terranes. This work presents new detrital zircon U–Pb and Hf isotopic data to constrain the crustal nature and origin of the Russian Altai, a critical segment of Altai-Mongolian terrane. The youngest zircon 206Pb/238U ages of 470 Ma constrain that the Terekta Formation, previously envisaged as Precambrian basement, was actually deposited after the Middle Ordovician. As for the three more sedimentary sequences above the Terekta Formation, they have youngest zircon 206Pb/238U ages of 425 Ma, 440 Ma and 380 Ma, respectively, indicating their depositions likely in the Late Silurian to Devonian. From all analyses, it is noted that many zircon U–Pb ages cluster at ca. 520 Ma and ca. 800 Ma, and these zircons display oscillatory zoning and have subhedral to euhedral morphology, which, collectively, suggests that adjacent Neoproterozoic to Paleozoic igneous rocks were possibly dominant in the sedimentary provenance. Additionally, a few rounded Archean to Mesoproterozoic zircon grains are characterized by complex texture, which are interpreted as recycling materials probably derived from the Tuva–Mongolian microcontinent. Precambrian rocks have not been identified in the Russian Altai, Chinese Altai and Mongolian Altai so far, therefore, Precambrian basement may not exist in the Altai-Mongolian terrane, but this terrane probably represents a large subduction–accretion complex built on the margin of the Tuva–Mongolian microcontinent in the Early Paleozoic. Multiple episodes of ridge–trench interaction may have caused inputs of mantle-derived magmas to trigger partial melting of the newly accreted crustal materials, which contributed to the accretionary complex. During accretionary orogenesis of the CAOB, formation of such subduction–accretion complex is likely ubiquitous, indicating continental crust growth by both lateral accumulation and vertical basaltic injection.