Rice panicle architecture displays remarkable diversity in branch number, branch length, and grain arrangement; however, much remains unknown about how such diversity in patterns is generated. Although several genes related to panicle branch number and panicle length have been identified, how panicle branch number and panicle length are coordinately regulated is unclear. Here, we show that panicle length and panicle branch number are independently regulated by the genes Prl5/OsGA20ox4, Pbl6/APO1, and Gn1a/OsCKX2. We produced near-isogenic lines (NILs) in the Koshihikari genetic background harboring the elite alleles for Prl5, regulating panicle rachis length; Pbl6, regulating primary branch length; and Gn1a, regulating panicle branching in various combinations. A pyramiding line carrying Prl5, Pbl6, and Gn1a showed increased panicle length and branching without any trade-off relationship between branch length or number. We successfully produced various arrangement patterns of grains by changing the combination of alleles at these three loci. Improvement of panicle architecture raised yield without associated negative effects on yield-related traits except for panicle number. Three-dimensional (3D) analyses by X-ray computed tomography (CT) of panicles revealed that differences in panicle architecture affect grain filling. Importantly, we determined that Prl5 improves grain filling without affecting grain number.