Disparity estimation has been investigated for decades. Fully automatic methods have problems in texture-less regions, around object boundaries and in occlusions regions. In this paper, we exploit user input to address these problematic areas interactively. By drawing contours and polygons, we achieve sharp disparity discontinuities and smooth disparity planes in the disparity maps. Annotations are tracked quite accurately over a number of frames. Experimental results on Middlebury data set and our own stereo video suggest that the accuracy of disparity maps can be improved significantly with limited user input.