Stress is linked to health problems, increasing the need for immediate monitoring. Traditional methods like electrocardiograms or contact photoplethysmography require device attachment, causing discomfort, and ultra-short-term stress measurement research remains inadequate. This paper proposes a method for ultra-short-term stress monitoring using remote photoplethysmography (rPPG). Previous predictions of ultra-short-term stress have typically used pulse rate variability (PRV) features derived from time-segmented heart rate data. However, PRV varies at the same stress levels depending on heart rates, necessitating a new method to account for these differences. This study addressed this by segmenting rPPG data based on normal-to-normal intervals (NNIs), converted from peak-to-peak intervals, to predict ultra-short-term stress indices. We used NNI counts corresponding to average durations of 10, 20, and 30 s (13, 26, and 39 NNIs) to extract PRV features, predicting the Baevsky stress index through regressors. The Extra Trees Regressor achieved R2 scores of 0.6699 for 13 NNIs, 0.8751 for 26 NNIs, and 0.9358 for 39 NNIs, surpassing the time-segmented approach, which yielded 0.4162, 0.6528, and 0.7943 for 10, 20, and 30-s intervals, respectively. These findings demonstrate that using NNI counts for ultra-short-term stress prediction improves accuracy by accounting for individual bio-signal variations.