
arXiv: 1612.00064
handle: 11250/2756432
AbstractWhen dealing with Bayesian inference the choice of the prior often remains a debatable question. Empirical Bayes methods offer a data‐driven solution to this problem by estimating the prior itself from an ensemble of data. In the nonparametric case, the maximum likelihood estimate is known to overfit the data, an issue that is commonly tackled by regularization. However, the majority of regularizations are ad hoc choices which lack invariance under reparametrization of the model and result in inconsistent estimates for equivalent models. We introduce a nonparametric, transformation‐invariant estimator for the prior distribution. Being defined in terms of the missing information similar to the reference prior, it can be seen as an extension of the latter to the data‐driven setting. This implies a natural interpretation as a trade‐off between choosing the least informative prior and incorporating the information provided by the data, a symbiosis between the objective and empirical Bayes methodologies.
FOS: Computer and information sciences, 62C12, 62G08, reference prior, 330, Statistics, maximum penalized likelihood estimator, 500 Naturwissenschaften und Mathematik::510 Mathematik::510 Mathematik, Jeffreys prior, information, Methodology (stat.ME), nonparametric inference, invariance, Statistics - Methodology
FOS: Computer and information sciences, 62C12, 62G08, reference prior, 330, Statistics, maximum penalized likelihood estimator, 500 Naturwissenschaften und Mathematik::510 Mathematik::510 Mathematik, Jeffreys prior, information, Methodology (stat.ME), nonparametric inference, invariance, Statistics - Methodology
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 3 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Top 10% | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Average | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Average |
