Granite residual soil is widely distributed in the southern coastal areas of China, and the slopes of granite residual soil are prone to instability and failure under the alternating action of rainfall and drying, which will cause great disasters to human society. In order to study the response mechanism of granite residual soil slopes under the alternating action of rainfall–drying–static–rainfall (RDSR), this study conducted indoor scaling model tests to analyze the response during dry and wet cycles. This study presented the response process of the slope under the influence of dry and wet cycles and discussed the change laws of slope deformation, water content, and matric suction. The results show that, under the alternating action of rainfall–drying–static–rainfall, 1) the network cracks on the slope form a dominant channel for rainwater seepage, which is the main reason for the rapid decline in soil anti-sliding ability within a short time; 2) at a rainfall intensity of 1.7–2.4 mm/min, the erosion effect of rain on the slope is obviously stronger than that of osmotic erosion, and the surface erosion failure of the granite residual soil slope tends to occur without an obvious sliding surface; 3) after the loss of matric suction over a certain period, the phenomenon of channeling and loss failure on the slope serve as a sufficient condition for slope instability failure but is not a necessary condition. The above research results are expected to provide the basis and reference for preventing and controlling landslide hazards in granite residual soil slopes under similar conditions.