In recent years, fade detection algorithms can classify fade scenes in massive video libraries have been developed. However, these algorithms misclassify some non-fade scenes as fade scenes, especially dissolve scenes and scenes with captions or flashing light sources. This paper proposes a new fade detection algorithm that uses similarity tendencies of luminance transitions to overcome such obstacles. To prevent detection accuracy degradation by letterboxing and captions, video frames are simplified. Then, fade candidates are detected by transition boundary detection using the angular and curvature characteristics of the luminance vectors. Finally, luminance flipping detection improves the detection accuracy by extracting the luminance retrograde phenomenon that occurs with flashing or light source movements. Through objective evaluation using $F_{1}$ score, the detection accuracy of the proposed algorithm was 0.884, which is an increase of 0.187 (21.2% improvement) compared with the average $F_{1}$ score of existing high-performance methods.