The Chinese Loess Plateau (CLP) covers an extensive area over 440,000 km2and provides an unprecedented terrestrial record of Neogene climate. However, it is still unclear whether the provenance of these loess deposits is uniform or contains spatial and temporal differences. Here this is addressed by comparing detrital‐zircon age spectra of typical loess and paleosol samples from three distant sites located at the western, middle, and southeastern parts of the CLP. Our results reveal that the zircon age spectra not only change between loess and paleosol layers but also vary from the western to the eastern CLP, at least during the last glacial cycle. The discrepancies of the zircon age spectra among different sites suggest that the loess provenance of CLP is heterogeneous and spatially variable, although it has been suggested that the mineralogical, elemental and isotopic compositions of loess deposits on CLP are highly homogenous spatially and in glacial‐interglacial cycles.