publication . Article . Other literature type . 2009

Some properties of Rényi entropy and Rényi entropy rate

Golshani, Leila; Pasha, Einollah; Yari, Gholamhossein;
Restricted
  • Published: 27 Jun 2009 Journal: Information Sciences, volume 179, pages 2,426-2,433 (issn: 0020-0255, Copyright policy)
  • Publisher: Elsevier BV
Abstract
In this paper, we define the conditional Renyi entropy and show that the so-called chain rule holds for the Renyi entropy. Then, we introduce a relation for the rate of Renyi entropy and use it to derive the rate of the Renyi entropy for an irreducible-aperiodic Markov chain. We also show that the bound for the Renyi entropy rate is simply the Shannon entropy rate.
Subjects
arXiv: Physics::Data Analysis; Statistics and ProbabilityPhysics::Physics and Society
free text keywords: Control and Systems Engineering, Theoretical Computer Science, Software, Information Systems and Management, Artificial Intelligence, Computer Science Applications, Min entropy, Maximum entropy probability distribution, Rényi entropy, Discrete mathematics, Entropy in thermodynamics and information theory, Differential entropy, Joint entropy, Entropy rate, Mathematics, Joint quantum entropy
Related Organizations
Powered by OpenAIRE Research Graph
Any information missing or wrong?Report an Issue