Pancreatic cysts are common and often pose a management dilemma, as some cysts are pre-cancerous whereas others have little risk of developing into invasive cancers. We used supervised machine learning techniques to develop a comprehensive test, CompCyst, to guide the management of patients with pancreatic cysts. The test is based on selected clinical features, imaging characteristics, and cyst fluid genetic and biochemical markers. Using data from 436 patients with pancreatic cysts, we trained CompCyst to classify patients as those who required surgery, those who should be routinely monitored, and those who did not require further surveillance. We then tested CompCyst in an independent cohort of 426 patients, with histopathology was used as the gold standard. Pathology of the resected specimens was used as the diagnostic gold standard. We found that clinical management informed by the CompCyst test was more accurate than the management dictated by conventional clinical and imaging criteria alone. Application of the CompCyst test would have spared surgery in more than half of the patients who underwent unnecessary resection of their cysts. CompCyst therefore has the potential to reduce the patient morbidity and economic costs associated with current standard-of-care pancreatic cyst management practices.