publication . Other literature type . Conference object . 2019

mirdata: Software for Reproducible Usage of Datasets

Bittner, Rachel; Fuentes, Magdalena; Rubinstein, David; Jansson, Andreas; Keunwoo Choi; Kell, Thor;
Open Access
  • Published: 04 Nov 2019
  • Publisher: Zenodo
Abstract
There are a number of efforts in the MIR community towards increased reproducibility, such as creating more open datasets, publishing code, and the use of common software libraries, e.g. for evaluation. However, when it comes to datasets, there is usually little guarantee that researchers are using the exact same data in the same way, which among other issues, makes comparisons of different methods on the "same" datasets problematic. In this paper, we first show how (often unknown) differences in datasets can lead to significantly different experimental results. We propose a solution to these problems in the form of an open source library, mirdata, which handles...
Download fromView all 3 versions
Zenodo
Other literature type . 2019
Provider: Datacite
ZENODO
Conference object . 2019
Provider: ZENODO
Zenodo
Other literature type . 2019
Provider: Datacite
Any information missing or wrong?Report an Issue