The calculation of the probability of a minor outbreak is crucial in analyzing a stochastic epidemic model. For stochastic epidemic models with fixed delays, the linear chain trick is applied to transform the delayed models into a family of ODE models with increasing shape parameters. We then prove that the well-established results on the probability of a minor outbreak for continuous-time Markov chain (CTMC) epidemic models also hold for the stochastic epidemic models with fixed delays. All theoretical results are verified by numerical simulations implemented by the delay stochastic simulation algorithm (DSSA) in Python. It is shown that DSSA is able to generate exact realizations for underlying delayed models in the context of mathematical epidemiology, and therefore, provides insights into the effect of delays during the outbreak phases of epidemics.