
pmid: 39733351
arXiv: 2308.16139
Abstract Objectives The shape is commonly used to describe the objects. State-of-the-art algorithms in medical imaging are predominantly diverging from computer vision, where voxel grids, meshes, point clouds, and implicit surface models are used. This is seen from the growing popularity of ShapeNet (51,300 models) and Princeton ModelNet (127,915 models). However, a large collection of anatomical shapes (e.g., bones, organs, vessels) and 3D models of surgical instruments is missing. Methods We present MedShapeNet to translate data-driven vision algorithms to medical applications and to adapt state-of-the-art vision algorithms to medical problems. As a unique feature, we directly model the majority of shapes on the imaging data of real patients. We present use cases in classifying brain tumors, skull reconstructions, multi-class anatomy completion, education, and 3D printing. Results By now, MedShapeNet includes 23 datasets with more than 100,000 shapes that are paired with annotations (ground truth). Our data is freely accessible via a web interface and a Python application programming interface and can be used for discriminative, reconstructive, and variational benchmarks as well as various applications in virtual, augmented, or mixed reality, and 3D printing. Conclusions MedShapeNet contains medical shapes from anatomy and surgical instruments and will continue to collect data for benchmarks and applications. The project page is: https://medshapenet.ikim.nrw/.
ddc:004, FOS: Computer and information sciences, Technology, Computer Science - Machine Learning, 3D medical shapes, Image Processing, Computer Vision and Pattern Recognition (cs.CV), Medizin, SEGMENTATION, Computer Science - Computer Vision and Pattern Recognition, DISEASE, Imaging, Machine Learning (cs.LG), Engineering, benchmark, Computer vision and pattern recognition, 0903 Biomedical Engineering, Three-Dimensional/methods, Image Processing, Computer-Assisted, Computer-Assisted/methods, BRAIN, anatomy education, Brain Neoplasms, Databases (cs.DB), 004, [SDV] Life Sciences [q-bio], Sonstiges, machine learning, Brain Neoplasms/diagnostic imaging, Printing, Three-Dimensional, 3D medical shapes; anatomy education; augmented reality; benchmark; shapeomics; virtual reality;, shapeomics, virtual reality, Printing, diagnostic imaging [Brain Neoplasms], Life Sciences & Biomedicine, info:eu-repo/classification/ddc/004, Algorithms, MRI, methods [Imaging, Three-Dimensional], databases, [SPI] Engineering Sciences [physics], Biomedical Engineering, 610, Imaging, Three-Dimensional, Computer Science - Databases, [INFO.INFO-IM]Computer Science [cs]/Medical Imaging, Humans, Engineering, Biomedical, 4003 Biomedical engineering, Science & Technology, DATA processing & computer science, [INFO.INFO-CV]Computer Science [cs]/Computer Vision and Pattern Recognition [cs.CV], 68T01, augmented reality, Informatik, Three-Dimensional, Medical Informatics, ddc: ddc:610
ddc:004, FOS: Computer and information sciences, Technology, Computer Science - Machine Learning, 3D medical shapes, Image Processing, Computer Vision and Pattern Recognition (cs.CV), Medizin, SEGMENTATION, Computer Science - Computer Vision and Pattern Recognition, DISEASE, Imaging, Machine Learning (cs.LG), Engineering, benchmark, Computer vision and pattern recognition, 0903 Biomedical Engineering, Three-Dimensional/methods, Image Processing, Computer-Assisted, Computer-Assisted/methods, BRAIN, anatomy education, Brain Neoplasms, Databases (cs.DB), 004, [SDV] Life Sciences [q-bio], Sonstiges, machine learning, Brain Neoplasms/diagnostic imaging, Printing, Three-Dimensional, 3D medical shapes; anatomy education; augmented reality; benchmark; shapeomics; virtual reality;, shapeomics, virtual reality, Printing, diagnostic imaging [Brain Neoplasms], Life Sciences & Biomedicine, info:eu-repo/classification/ddc/004, Algorithms, MRI, methods [Imaging, Three-Dimensional], databases, [SPI] Engineering Sciences [physics], Biomedical Engineering, 610, Imaging, Three-Dimensional, Computer Science - Databases, [INFO.INFO-IM]Computer Science [cs]/Medical Imaging, Humans, Engineering, Biomedical, 4003 Biomedical engineering, Science & Technology, DATA processing & computer science, [INFO.INFO-CV]Computer Science [cs]/Computer Vision and Pattern Recognition [cs.CV], 68T01, augmented reality, Informatik, Three-Dimensional, Medical Informatics, ddc: ddc:610
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 17 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Top 10% | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Top 10% | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Top 10% |
