The terrestrial gross primary productivity (GPP) has increased over the past two decades. However, the climatic attribution and the physiological and phenological processes that control the trends in the GPP are still unclear. Here, we used remote-sensing-based vegetation GPP and phenology datasets, analyzed the spatial and temporal variation in the GPP, investigated the influence of the growing season length (GSL) and the maximum value of gross primary productivity (GPPmax) on the annual GPP, and quantified the effect of climate variables on the annual GPP. Our results identified a significant increase in the annual GPP (11.97 gC/m2/yr) during 2001–2020 in China’s deciduous forest. The GPPmax trend dominated the trends in the GPP, when compared with the GSL. Moreover, climate warming in summer contributes to the increase in the GPP and the GPPmax, while the extension of the GSL is primarily due to the temperature rise in spring. The annual GPP of the planted forest showed a higher increasing rate than the natural forest, due to the significant enhancement of the GPPmax and the high sensitivity of the GSL to climatic factors in the planted forest. Our findings provide a new perspective on the phenological and physiological causes of the trends in the GPP, and emphasize the importance of capturing the variability in the GPPmax when modeling the GPP.