A new motion compensation technique that allows more than one motion vector inside each block is introduced. The technique uses the intensity information to determine which motion vector to apply at any given pixel. An efficient motion estimation algorithm is described that finds near optimal selections of motion vectors. The simulation results show a significant improvement in the prediction accuracy over the traditional one motion vector per block model.