
Abstract Objectives To investigate the model-, code-, and data-sharing practices in the current radiomics research landscape and to introduce a radiomics research database. Methods A total of 1254 articles published between January 1, 2021, and December 31, 2022, in leading radiology journals (European Radiology, European Journal of Radiology, Radiology, Radiology: Artificial Intelligence, Radiology: Cardiothoracic Imaging, Radiology: Imaging Cancer) were retrospectively screened, and 257 original research articles were included in this study. The categorical variables were compared using Fisher’s exact tests or chi-square test and numerical variables using Student’s t test with relation to the year of publication. Results Half of the articles (128 of 257) shared the model by either including the final model formula or reporting the coefficients of selected radiomics features. A total of 73 (28%) models were validated on an external independent dataset. Only 16 (6%) articles shared the data or used publicly available open datasets. Similarly, only 20 (7%) of the articles shared the code. A total of 7 (3%) articles both shared code and data. All collected data in this study is presented in a radiomics research database (RadBase) and could be accessed at https://github.com/EuSoMII/RadBase. Conclusion According to the results of this study, the majority of published radiomics models were not technically reproducible since they shared neither model nor code and data. There is still room for improvement in carrying out reproducible and open research in the field of radiomics. Clinical relevance statement To date, the reproducibility of radiomics research and open science practices within the radiomics research community are still very low. Ensuring reproducible radiomics research with model-, code-, and data-sharing practices will facilitate faster clinical translation. Key Points • There is a discrepancy between the number of published radiomics papers and the clinical implementation of these published radiomics models. • The main obstacle to clinical implementation is the lack of model-, code-, and data-sharing practices. • In order to translate radiomics research into clinical practice, the radiomics research community should adopt open science practices.
Radiography, ddc:610, Artificial intelligence; Multiomics; Radiomics; Reproducibility of results, Radiomics, Imaging Informatics and Artificial Intelligence, Artificial Intelligence, Radiomics ; Imaging Informatics and Artificial Intelligence ; Radiography [MeSH] ; Reproducibility of Results [MeSH] ; Reproducibility of results ; Humans [MeSH] ; Artificial intelligence ; Multiomics ; Radiomics [MeSH] ; Retrospective Studies [MeSH] ; Artificial Intelligence [MeSH], Humans, Reproducibility of Results, Retrospective Studies
Radiography, ddc:610, Artificial intelligence; Multiomics; Radiomics; Reproducibility of results, Radiomics, Imaging Informatics and Artificial Intelligence, Artificial Intelligence, Radiomics ; Imaging Informatics and Artificial Intelligence ; Radiography [MeSH] ; Reproducibility of Results [MeSH] ; Reproducibility of results ; Humans [MeSH] ; Artificial intelligence ; Multiomics ; Radiomics [MeSH] ; Retrospective Studies [MeSH] ; Artificial Intelligence [MeSH], Humans, Reproducibility of Results, Retrospective Studies
| citations This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 36 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Top 10% | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Top 10% | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Top 1% |
