It is a scientific truism nowadays that quantum mechanical predictions are of statistical or rather of probabilistic nature: a quantum theory assigns a probability distribution to each measurable quantity (observable) of a physical system prepared according to a given preparation prescription (state). Such sets of probability distributions represent the most general quantitative predictions of physical theories. The aim of this study is to determine all theoretical frameworks which yield such a kind of output taking the probabilistic nature of quantitative physical predictions as initial hypothesis. Astonishingly, this project succeeds with a minimal number of additional assumptions, which arise quite naturally in the course of the analysis, and which essentially amount to regularity conditions. The result is that there exist only two classes of physical theories providing quantitative probabilistic predictions: classical theories where observables are represented by real functions over a phase space and states are represented by probability measures upon the phase space, and quantum theories where observables are represented by selfadjoint operators acting on a complex Hilbert space and states are represented by state operators. On empirical grounds, classical theories cannot provide the all-encompassing, fundamental frame for the mathematical description of physical systems. Quantum theories remain, and there is no more complete formal frame for quantitative physical theories. As an additional result, it is shown that there exist physical systems which possess a quantum mechanical but no classical description; a prominent example is the spin system of two spin-1/2 particles. The classical hidden variables model, which J. Bell relates to this system in order to prove his theorem, cannot be a true description of it because no such classical model exists, and Bell's theorem loses its foundation.