RNA silencing is a sequence specific post-transcriptional mechanism regulating important biological processes including antiviral defense in plants. Argonaute (AGO) proteins, the catalytic subunits of the silencing complexes, are loaded with small RNAs to execute the sequence specific RNA cleavage or translational inhibition. Plants encode several AGO proteins and a few of them, especially AGO1 and AGO2, have been shown to be required for antiviral silencing. Previously, we have shown that the P1 protein of the sweet potato mild mottle virus (SPMMV) suppresses the primary RNA silencing response by inhibiting AGO1. To analyze the role of AGO2 in antiviral defense against the SPMMV, we performed a comparative study using a wild type and ago2−/− mutant Nicotiana benthamiana. Here we show that the AGO2 of N. benthamiana attenuates the symptoms of SPMMV infection. Upon SPMMV infection the levels of AGO2 mRNA and protein are greatly increased. Moreover, we found that AGO2 proteins are loaded with SPMMV derived viral small RNAs as well as with miRNAs. Our results indicate that AGO2 protein takes over the place of AGO1 to confer antiviral silencing. Finally, we provide a plausible explanation for the AGO2 mediated recovery of an SPMMV-infected sweet potato.