The relation between the phase difference spectrum and the response spectrum is studied in this paper. It is found that the phase difference spectrum influences the response spectrum through affecting the response motion’s envelope function shape of a single degree of freedom system. Decreasing the variance of phase difference spectrum causes the increasing of response spectrum when its mean value curve keeps the same, otherwise the situation is opposite. As the increase of the tangent of the mean value curve, the response spectrum decreases, otherwise it increases. The damping plays an important role while the phase difference spectrum influences the response spectrum. The effect of the phase difference spectrum on the absolute acceleration response spectrum becomes more and more obvious with the increase of the damping. On the other hand, the increase of damping weakens the effect of the phase difference spectrum on the amplification factor spectrum.