The dataset contains multi-modal data from over 76,000 open access and de-identified case reports, including metadata, clinical cases, image captions and more than 139,000 images. Images and clinical cases belong to different medical specialties, such as oncology, cardiology, surgery and pathology. The structure of the dataset allows to easily map images with their corresponding article metadata, clinical case, captions and image labels. Details of the data structure can be found in the file data_dictionary.csv. More than 98,000 patients and 397,000 medical doctors and researchers were involved in the creation of the articles included in this dataset. The citation data of each article can be found in the metadata.parquet file. Refer to the examples showcased in this GitHub repository to understand how to optimize the use of this dataset. The license of the dataset as a whole is CC BY-NC-SA. However, its individual contents may have less restrictive license types (CC BY, CC BY-NC, CC0). For instance, regarding image files, 72K of them are CC BY, 33K are CC BY-NC, 32K are CC BY-NC-SA, and 20 of them are CC0.