This study evaluated heavy metal accumulation in cocoa farming environments and its impact on cocoa bean quality in Ghana’s Fanteakwa District, an area affected by illegal small-scale mining (galamsey). A total of 100 cocoa farmers from five communities were selected through convenient sampling. Data were gathered using structured questionnaires and laboratory analysis of soil and cocoa bean samples. Demographic data showed that most respondents were male (69%), aged 55–64 (61%), married (84%), and had basic education (79%). All respondents acknowledged the presence of illegal mining, with 65% strongly agreeing that their farms were healthier before its onset. Soil analysis using Atomic Absorption Spectrophotometry (AAS) revealed average concentrations of arsenic (0.8180 mg/kg), cadmium (0.7147 mg/kg), mercury (0.5900 mg/kg), lead (0.6187 mg/kg), zinc (28.8407 mg/kg), and copper (30.1807 mg/kg). Cocoa beans showed lower concentrations, all within international safety limits: arsenic (0.0305 mg/kg), cadmium (0.0261 mg/kg), mercury (0.0199 mg/kg), lead (0.0189 mg/kg), zinc (24.0647 mg/kg), and copper (18.5153 mg/kg). However, some soil cadmium levels exceeded FAO/WHO’s permissible limit of 1.4 mg/kg. A Pearson correlation of 0.207 (p = 0.536) indicated a weak, non-significant relationship between heavy metal levels and cocoa bean quality. While bean safety remains within acceptable standards, findings highlight environmental contamination risks. Farmers' perceptions and scientific evidence underscore the urgent need for regular monitoring and sustainable land-use practices to protect cocoa production in mining-impacted regions.