The Position and Orientation System (POS) is the core device of high-resolution aerial remote sensing systems, which can obtain the real-time object position and collect target attitude information. The goal of exceeding 0.015°/0.003° of its real-time heading/attitude measurement accuracy is unlikely to be achieved without gravity disturbance compensation. In this paper, a high-precision gravity data architecture for gravity disturbance compensation technology is proposed, and a gravity database with accuracy better than 1 mGal is constructed in the test area. Based on the “Block-Time Variation” Markov Model (B-TV-MM), a gravity disturbance compensation device is developed. The gravity disturbance compensation technology is applied to POS products for the first time, and is applied in the field of aerial remote sensing. Flight test results show that the heading accuracy and attitude accuracy of POS products are improved by at least 6% and 16%, respectively. The device can be used for the gravity disturbance compensation of various inertial technology products.