This paper presents a control strategy with a linear extended state observer (LESO) and Kalman filter to achieve a high performance of the motion control system. The moment of inertia of the system, which is variable with the robotic joint motion, is estimated in the established model. A LESO with variable gain is designed, which could estimate the states and the total disturbance of the plant without a precision mathematical model. The disturbance caused by variable load and unknown dynamics can be compensated based on the LESO, while the moment of inertia is variable. In order to restrain the process noise and measure the noise of the system, the Kalman filter was applied. Tracking differentiator was utilized to avoid the overshoot of the system for the step signal. The designed control strategy with the LESO and the Kalman filter could improve the tracking performance for the servo system with parametric uncertainties, unknown dynamics, and disturbances. The effectiveness of the proposed method is implemented and validated in the experiment of the robotic joint, for which desired servo tracking performance is achieved with the conditions of load variation and sudden disturbance.