Subject: Physics - Data Analysis, Statistics and Probability | Statistics - Methodology | Condensed Matter - Statistical Mechanics
In this tutorial we review the essential arguments behing entropic inference. We focus on the epistemological notion of information and its relation to the Bayesian beliefs of rational agents. The problem of updating from a prior to a posterior probability distribution ... View more
 E. T. Jaynes, Phys. Rev. 106, 620 and 108, 171 (1957); R. D. Rosenkrantz (ed.), E. T. Jaynes: Papers on Probability, Statistics and Statistical Physics (Reidel, Dordrecht, 1983); E. T. Jaynes, Probability Theory: The Logic of Science (Cambridge University Press, Cambridge, 2003).
 J. E. Shore and R. W. Johnson, IEEE Trans. Inf. Theory IT-26, 26 (1980); IEEE Trans. Inf. Theory IT-27, 26 (1981).
 P. M. Williams, Brit. J. Phil. Sci. 31, 131 (1980).
 J. Skilling, “The Axioms of Maximum Entropy” in Maximum-Entropy and Bayesian Methods in Science and Engineering, G. J. Erickson and C. R. Smith (eds.) (Kluwer, Dordrecht, 1988).
 C. C. Rodr´ıguez, “Entropic priors” in Maximum Entropy and Bayesian Methods, edited by W. T. Grandy Jr. and L. H. Schick (Kluwer, Dordrecht, 1991).
 C. C. Rodr´ıguez, “Are we cruising a hypothesis space?” in Maximum Entropy and Bayesian Methods, edited by W. von der Linden, V. Dose, R. Fischer and R. Preuss (Kluwer, Dordrecht, 1999).
 A. Caticha, 'Maximum entropy, fluctuations and priors', in Bayesian Methods and Maximum Entropy in Science and Engineering, ed. by A. Mohammad-Djafari, AIP Conf. Proc. 568, 94 (2001) (arXiv.org/abs/mathph/0008017).
 A. Caticha, “Relative Entropy and Inductive Inference,” in Bayesian Inference and Maximum Entropy Methods in Science and Engineering, ed. by G. Erickson and Y. Zhai, AIP Conf. Proc. 707, 75 (2004) (arXiv.org/abs/physics/0311093).
 A. Caticha and A. Giffin, “Updating Probabilities”, Bayesian Inference and Maximum Entropy Methods in Science and Engineering, Ali Mohammad-Djafari (ed.), AIP Conf. Proc. 872, 31 (2006) (arxiv.org/abs/physics/0608185).
 A. Caticha, “Information and Entropy,” in Bayesian Inference and Maximum Entropy Methods in Science and Engineering, ed. by K. Knuth et al., AIP Conf. Proc. 954, 11 (2007) (arXiv.org/abs/0710.1068).