Recent research progress in the impact of abiotic stress on florets sterility was summarized in this review to reveal key processes in determining the floret sterility resulted from abiotic stress and their coherent connections. The spikelet fertility was mainly determined by four key processes, including behavior of tapetum, anther dehiscence and pollen release, pollen germination and fertilization. Abiotic stress affected these processes and led to the spikelet sterility. Abnormal changes at the early-stage of anther growth could impact the development of germ cell and fertilization. Damages of floret fertility caused by abiotic stress could be mitigated via some practices such as spraying exogenous plant growth substances or silicon fertilizer. Some research topics were suggested for future investigation, including the interactions of multiple stress factors on fertility, morphological and physiological effects on floral organ formation, differential responses of rice varieties to abiotic stress, and molecular mechanism of abiotic stress on floral organ development.