According to the existing problems that gravity data, digital elevation model are very difficult to obtain in China. The method of refining the geoid with the new "remove-restore" technique based on model geoid height calculated by EGM2008 and model geoid height, model height anomaly calculated by EGM96 are studied respectively. Verify the feasibility by using model geoid height of EGM2008 replace model height anomaly of EGM96 to refine quasi-geoid and comparing the accuracy of two methods, the results show that: The refined quasi-geoid with the new "remove - restore" technique based on model geoid height of EGM2008 have high precision, can achieve standards of general leveling surveying, and realizing refinement of quasi-geoid based on gravity field model without gravity data.