The Huangmao Island dumping area is adjacent to the Pearl River Estuary in the South China Sea. From its first dumping activity in 1986 to 2017, 6750 × 104 m3 dredged materials were dumped in this dumping area. Sediment pollution levels, ecological risk, and benthic communities in 2011–2017 were evaluated; the results showed that the concentrations of the heavy metals (HMs; except Hg) in surface sediments of the dumping area met the class I standard of marine sediment quality (GB 18668-2002). HMs in the surface sediments were relatively high in the northern and central areas but relatively low in the south of the dumping area. Speculation was that the spatial variation in HM concentrations might be caused by dumping activities. The Nemerow index implied that the contaminated area was mainly in the north of the dumping area (S1, S2, and S3), where the dumping amount was the largest. The potential ecological risk (Eir) indices of Zn, As, Cu, and Pb indicate that these metals posed a low risk to the ecosystem of the dumping area, whereas Cd and Hg posed a high risk at some stations. The geoaccumulation indices (Igeo) of Zn, As, Cu, and Pb specified no pollution or light pollution in the study area, whereas those of Cd and Hg in most years indicated mild contamination levels. Benthic organisms in the study area were arthropods, chordates, annelids, mollusks, echinoderms, nemertinean, coelenterate, and echiuran, among which arthropods were the most abundant. The abundance of taxa and density of benthic organisms had a little difference among the stations within the dumping area, but were significantly lower than those of the stations outside the dumping area. In addition, non-metric multidimensional scaling analysis confirmed that the observed patterns separated the stations within the dumping area from stations outside the dumping area. The evaluation results of the HMs revealed that the dumping area with a large dumping amount was more severely polluted. Dumping dredged materials seemed to have a negative impact on the benthic community in the dumping area.