
Theoretical accounts of machine learning were largely developed at a time when learning systems exhibited limited empirical capability, framing learning in terms of statistical concentration, convergence-based guarantees, and classical notions of generalization. However, empirical machine learning systems now achieve robust and scalable performance in settings that do not conform to the assumptions underlying these theories, exposing a systematic misalignment between theoretical explanations and observed behavior. In this work, we re-examine several foundational concepts inherited from classical learning theory—including statistical concentration, convergence-based guarantees, classical generalization criteria, and likelihood-based formulations—and show why their traditional interpretations fail to account for empirical machine learning systems. We argue that the effectiveness of machine learning does not arise from probabilistic inference or mathematical guarantees, but from the expressive capacity of parameterized models interacting with data. From this perspective, machine learning is best understood as a data-driven engineering discipline, rather than as a mathematical theory of learning from samples.
Machine Learning, Artificial intelligence, Deep Learning, Machine learning, Statistics, FOS: Mathematics, Deep learning, Bayesian statistics
Machine Learning, Artificial intelligence, Deep Learning, Machine learning, Statistics, FOS: Mathematics, Deep learning, Bayesian statistics
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 0 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Average | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Average | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Average |
