We systematically analyze the ambient contrast ratio (ACR) of liquid crystal displays (LCDs) and organic light-emitting diode (OLED) displays for smartphones, TVs, and public displays. The influencing factors such as display brightness, ambient light illuminance, and surface reflection are investigated in detail. At low ambient light conditions, high static contrast ratio plays a key role for ACR. As the ambient light increases, high brightness gradually takes over. These quantitative results set important guidelines for future display optimization. Meanwhile, to improve an OLED’s ACR at large oblique angles, we propose a new broadband and wide-view circular polarizer consisting of one linear polarizer and two biaxial films. Good performance is realized.