Male sterility refers to the phenomenon that stamens cannot grow normally and produce viable pollen grains in plants. Hybrid seed production by taking advantage of the trait of male sterility is an effective and quick strategy to increase crop yield. Up to date, the yield of rice (Oryza sativa L.), maize (Zea mays L.), wheat (Triticum aestivum L.) and other crops has been greatly increased based on hybrid vigor utilization. Soybean (Glycine max (L.) Merr.) is a self-pollination species, artificial emasculation is not only time-consuming, but also labor-intensive and economically impracticable. So far, large scale hybrid breeding has not been performed in soybean due to the shortage of male sterile lines suitable for hybrid production. Therefore, it is urgent to identify a stable male sterile system for the rapid utilization of heterosis in soybean. In this review, we summarize the progress on the discovery of soybean genic male sterility (GMS) mutants and GMS genes. Combining with the investigation of GMS genes in Arabidopsis, rice and maize, we provide important insights into the identification and potential utilization of GMS genes in soybean in the perspective of reverse genetics.