An alternative to conventional techniques for compressing video data of moving objects is described. The method, known as track-based compression (TBC), detects, associates, and tracks moving objects between frames, sending only a small chip or ID around the moving object once the track has been established. The compression ratio achievable depends on scene content, sensor geometry, the degree to which the background can be stabilized, and other factors. Preliminary results range from 1,500:1 for oblique sensing geometries with significant parallax to more than 10,000:1 for near-nadir overhead and fixed ground-based surveillance video.