Binomial and Poisson distributions as maximum entropy distributions
- 1 July 2001
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Theory
- Vol. 47 (5), 2039-2041
- https://doi.org/10.1109/18.930936
Abstract
The binomial and the Poisson distributions are shown to be maximum entropy distributions of suitably defined sets. Poisson's law is considered as a case of entropy maximization, and also convergence in information divergence is established.Keywords
This publication has 12 references indexed in Scilit:
- Le Cam's Inequality and Poisson ApproximationsThe American Mathematical Monthly, 1994
- Game Theoretical Equilibrium, Maximum Entropy and Minimum Information DiscriminationPublished by Springer Science and Business Media LLC ,1993
- Approximation in Variation of the Distribution of a Sum of Independent Bernoulli Variables with a Poisson LawTheory of Probability and Its Applications, 1986
- A Semigroup Approach to Poisson ApproximationThe Annals of Probability, 1986
- Asymptotic Methods in Statistical Decision TheoryPublished by Springer Science and Business Media LLC ,1986
- Approximation of a Generalized Binomial DistributionTheory of Probability and Its Applications, 1978
- Some Elementary Results on Poisson Approximation in a Sequence of Bernoulli TrialsSIAM Review, 1978
- A General Poisson Approximation TheoremThe Annals of Probability, 1975
- $I$-Divergence Geometry of Probability Distributions and Minimization ProblemsThe Annals of Probability, 1975
- An approximation theorem for the Poisson binomial distributionPacific Journal of Mathematics, 1960