The highly transmissible variants of SARS-CoV-2, the causative pathogen of the COVID-19 pandemic, bring new waves of infection worldwide. Identification of effective therapeutic drugs to combat the COVID-19 pandemic is an urgent global need. RNA-dependent RNA polymerase (RdRp), an essential enzyme for viral RNA replication, is the most promising target for antiviral drug research since it has no counterpart in human cells and shows the highest conservation across coronaviruses. This review summarizes recent progress in studies of RdRp inhibitors, focusing on interactions between these inhibitors and the enzyme complex, based on structural analysis, and their effectiveness. In addition, we propose new possible strategies to address the shortcomings of current inhibitors, which may guide the development of novel efficient inhibitors to combat COVID-19.