From the perspective of rural revitalization, efforts to improve agricultural green total factor productivity is the key to achieve high-quality and efficient development of agricultural economy, and also an important starting point for building a modern agricultural power and Promoting Rural Revitalization Strategy. Based on the survey data of six cities in Northern Anhui, combined with the needs of green sustainable agricultural development and ecological civilization construction, SEM model and decision tree model were established to analyze the factors affecting the improvement of agricultural green total factor productivity, and explore the prospect and attitude of residents in six cities in Northern Anhui to the improvement of agricultural green total factor productivity. Finally, the paper puts forward targeted policy suggestions from six aspects of policy support, resource integration, technology transformation, public participation, environmental protection and market guidance, aiming to explore the feasible path for improving agricultural green total factor productivity in the six cities in Northern Anhui.