Vascular calcification is a prominent feature of atherosclerosis. The mineral composition and quantity within calcified arterial plaques remains unelucidated; therefore, the aim of this study was to analyze the mineral composition of such plaques. Calcified arterial plaques were obtained from patients with abdominal aortic aneurysms (AAAs) and carotid artery stenoses. Calcified aneurysmal plaques were obtained during the routine open repair of AAAs, while calcified carotid plaques were collected from patients who underwent carotid endarterectomy (CEA). Following the appropriate preparation of each sample, inductively coupled plasma atomic emission spectrometry (ICP-AES) was used to analyze the calcium and phosphate levels, while flame atomic absorption spectrometry (FAAS) was used to analyze the levels of iron and zinc. The levels of these mineral components were evaluated. In the aortic and carotid plaques, the mean calcium concentration was 9.83 and 11.94 wt.%, respectively, and the mean phosphate concentration was 4.31 and 6.08 wt.%, respectively. It was not possible to analyze the absolute concentration of iron in the carotid plaques due to the concentration being below the measurement limit. The zinc concentration was variable between samples. In conclusion, the main components of aortic and carotid plaques are calcium and phosphate. The mineral concentrations of the plaques in the present study may be used as reference values for further studies on vascular calcification. More studies are required to elucidate the correlation between the mineral components and vascular calcification.