Background and aim The growing number of people with diabetes mellitus (DM) across the world is a public health concern. The diabetes epidemic involves enormous health costs to the patients, their careers, and society at large. Cardiovascular diseases such as atrial fibrillation (AF) often develop in the diabetic population. An increase in the P wave dispersion (PWD) has been established as an independent risk factor for the occurrence of AF, hence the present study was conducted to establish a possible relationship between PWD and the glycemic status of the individual to predict the occurrence of AF ahead of clinical symptomology. Methodology A comparative cross-sectional study was conducted at a tertiary care hospital after obtaining approval from the institutional ethics committee and written consent of each study subject. The main steps included the selection and categorization of the study population based on their glycemic status, collection of demographic data, performing ECGs calculating PWD using digital calipers, and recording the data systematically for evaluation. Results In this study, 234 patients with a mean age of 53.3 ± 13.1 years were studied, of which 121 (51.7%) were male and 113 (48.29%) were female. The 234 patients were divided into four groups based on their glycemic status - 74 uncontrolled DM patients (31.62%), 51 type 2 DM (T2DM) patients (21.78%), 56 prediabetes patients (23.93%), and 53 patients in the control group (22.64%; not a known case of diabetes with normal HbA1c and fasting blood sugar (FBS) levels). Minimal correlation was observed between FBS with PWD (r value 0.175) and age with PWD (r value 0.161), but statistical significance was observed only between age and PWD (p-value 0.014). The difference in means between the four different study groups was found to be not statistically significant (p-value- 0.104); hence, no intergroup variation was noted. Conclusion Advancing age and higher fasting blood sugars have shown minimal correlation with widening P-wave dispersion. With further studies involving larger populations, this can be a promising aid in identifying PWD as a probable early predictor of atrial arrhythmias among diabetic patients.