Repeatability is the prerequisite for scientific evaluation of wireless measurements. However, in real-world scenarios, the channel always slightly changes with time as, for example, trees move in the wind. In this paper, we propose a methodology that uses quantized channel state information and a technique similar to non-substractive SNR-dithering to quantify the repeatablility of wireless channels. Thereby, we introduce a new metric that allows for a comparison of different setups and scenarios in terms of repeatability. In a measurement campaign, we compare (1) a directional link to (2) an outdoor to indoor urban scenario with a fixed receiver and (3) the same scenario with the receiver moving in a circle, thereby experiencing the same high speed channel again and again.