To develop a tool for evaluating the effectiveness of the integrated developmen of "Curriculum Ideology" and ideological and political courses in universities. Method: Guided by the theories of developmental psychology and educational psychology, expert opinion method (Delphi method) and analytic hierarchy process (AHP) were used to construct a evaluation index system for the effectiveness of the integrated development of "Curriculum Ideology" and ideological and political courses in Universities. Firstly, based on the results of three semi-structured interviews with 22 experts and focus group discussions, as well as pre-surveys with other 22 experts, the basic content of the evaluation index system has been preliminarily formulated. Then, Delphi method was used to conduct two rounds of consultation with another 65 experts, and the AHP was used to construct an evaluation index system. Finally, a questionnaire survey was conducted on 461 college students to determine the reliability and effectiveness of the evaluation index system. Results: The effective recovery rates of the two rounds of expert consultation were both 100%, with authoritative coefficients of 0.8267 and 0.8513 (P<0.05), and the coordination coefficients of expert opinions of 0.772 and 0.821, respectively. The coefficients of variation of each indicator were less than 0.15, and the full score rates were higher than 0.30. The final version of the constructed evaluation indicators includes 3 primary indicators, 11 secondary items, and 45 tertiary indicators. Conclusion: The construction method of the evaluation index system is scientific, the procedure is standardized, and the evaluation index system has good psychological measurement performance.