Conditional Rényi Entropies
- 27 April 2012
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Theory
- Vol. 58 (7), 4273-4277
- https://doi.org/10.1109/tit.2012.2192713
Abstract
There is no generally accepted definition of conditional Rényi entropy. The (unconditional) Rényi entropy depends on a parameter α, which for the case of min-entropy takes the value ∞. Even for this particular case, there are several proposals for the definition of conditional entropy. This paper describes three general definitions of conditional Rényi entropy that were found or suggested in the literature. Their properties are studied and their values, as a function of α, are compared. The particular case of min-entropy is widely used in cryptography as a security parameter; this case is studied in some detail.Keywords
This publication has 9 references indexed in Scilit:
- Some properties of Rényi entropy and Rényi entropy rateInformation Sciences, 2009
- Long memory and volatility clustering: Is the empirical evidence consistent across stock markets?Physica A: Statistical Mechanics and its Applications, 2008
- Conditional Computational Entropy, or Toward Separating Pseudoentropy from CompressibilityLecture Notes in Computer Science, 2007
- Renyi Entropy Measures of Heart Rate GaussianityIEEE Transactions on Biomedical Engineering, 2005
- Generalized statistics: yet another generalizationPhysica A: Statistical Mechanics and its Applications, 2004
- The world according to Rényi: thermodynamics of multifractal systemsAnnals of Physics, 2004
- The asymptotics of posterior entropy and error probability for Bayesian estimationIEEE Transactions on Information Theory, 1995
- Generalized cutoff rates and Renyi's information measuresIEEE Transactions on Information Theory, 1995
- A Mathematical Theory of CommunicationBell System Technical Journal, 1948