A salient feature of mammalian sleep is the alternation between rapid eye movement (REM) and non-REM (NREM) sleep. However, how these two sleep stages influence each other and thereby regulate the timing of REM sleep episodes is still largely unresolved. Here, we developed a statistical model that specifies the relationship between REM and subsequent NREM sleep to quantify how REM sleep affects the following NREM sleep duration and its electrophysiological features in mice. We show that a lognormal mixture model well describes how the preceding REM sleep duration influences the amount of NREM sleep till the next REM sleep episode. The model supports the existence of two different types of sleep cycles: Short cycles form closely interspaced sequences of REM sleep episodes, whereas during long cycles, REM sleep is first followed by an interval of NREM sleep during which transitions to REM sleep are extremely unlikely. This refractory period is characterized by low power in the theta and sigma range of the electroencephalogram (EEG), low spindle rate and frequent microarousals, and its duration proportionally increases with the preceding REM sleep duration. Using our model, we estimated the propensity for REM sleep at the transition from NREM to REM sleep and found that entering REM sleep with higher propensity resulted in longer REM sleep episodes with reduced EEG power. Compared with the light phase, the buildup of REM sleep propensity was slower during the dark phase. Our data-driven modeling approach uncovered basic principles underlying the timing and duration of REM sleep episodes in mice and provides a flexible framework to describe the ultradian regulation of REM sleep in health and disease.