While many studies have provided significant insight into homolog pairing during meiosis, information on non-homologous pairing is much less abundant. In the present study, fluorescence in situ hybridization (FISH) was used to investigate non-homologous pairing in haploid rice during meiosis. At pachytene, non-homologous chromosomes paired and formed synaptonemal complexes. FISH analysis data indicated that chromosome pairing could be grouped into three major types: (1) single chromosome paired fold-back as the univalent structure, (2) two non-homologous chromosomes paired as the bivalent structure, and (3) three or more non-homologous chromosomes paired as the multivalent structure. In the survey of 70 cells, 65 contained univalents, 45 contained bivalents, and 49 contained multivalent. Moreover, chromosomes 9 and 10 as well as chromosomes 11 and 12 formed non-homologous bivalents at a higher frequency than the other chromosomes. However, chiasma was always detected in the bivalent only between chromosomes 11 and 12 at diakinesis or metaphase I, indicating the pairing between these two chromosomes leads non-homologous recombination during meiosis. The synaptonemal complex formation between non-homologs was further proved by immunodetection of RCE8, PAIR2, and ZEP1. Especially, ZEP1 only loaded onto the paired chromosomes other than the un-paired chromosomes at pachytene in haploid.