
arXiv: 2404.05779
Artificial Intelligence (AI) applications critically depend on data. Poor-quality data produces inaccurate and ineffective AI models that may lead to incorrect or unsafe use. Evaluation of data readiness is a crucial step in improving the quality and appropriateness of data usage for AI. R&D efforts have been spent on improving data quality. However, standardized metrics for evaluating data readiness for use in AI training are still evolving. In this study, we perform a comprehensive survey of metrics used to verify data readiness for AI training. This survey examines more than 140 papers published by ACM Digital Library, IEEE Xplore, journals such as Nature, Springer, and Science Direct, and online articles published by prominent AI experts. This survey aims to propose a taxonomy of data readiness for AI (DRAI) metrics for structured and unstructured datasets. We anticipate that this taxonomy will lead to new standards for DRAI metrics that would be used for enhancing the quality, accuracy, and fairness of AI training and inference.
FOS: Computer and information sciences, Computer Science - Machine Learning, Networking and Information Technology R&D (NITRD) (rcdc), AI-ready data, Computer Science - Artificial Intelligence, Generic health relevance (hrcs-hc), 08 Information and Computing Sciences (for), I.2.0, Machine Learning (cs.LG), 46 Information and Computing Sciences (for-2020), I.2.0; E.m, Artificial Intelligence (cs.AI), Information Systems (science-metrix), 46 Information and computing sciences (for-2020), data quality metrics, 4608 Human-Centred Computing (for-2020), Machine Learning and Artificial Intelligence (rcdc), Data readiness, E.m
FOS: Computer and information sciences, Computer Science - Machine Learning, Networking and Information Technology R&D (NITRD) (rcdc), AI-ready data, Computer Science - Artificial Intelligence, Generic health relevance (hrcs-hc), 08 Information and Computing Sciences (for), I.2.0, Machine Learning (cs.LG), 46 Information and Computing Sciences (for-2020), I.2.0; E.m, Artificial Intelligence (cs.AI), Information Systems (science-metrix), 46 Information and computing sciences (for-2020), data quality metrics, 4608 Human-Centred Computing (for-2020), Machine Learning and Artificial Intelligence (rcdc), Data readiness, E.m
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 14 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Top 10% | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Top 10% | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Top 10% |
