Electronic Journal of Probability
- Electron. J. Probab.
- Volume 15 (2010), paper no. 42, 1344-1369.
Compound Poisson Approximation via Information Functionals
An information-theoretic development is given for the problem of compound Poisson approximation, which parallels earlier treatments for Gaussian and Poisson approximation. Nonasymptotic bounds are derived for the distance between the distribution of a sum of independent integer-valued random variables and an appropriately chosen compound Poisson law. In the case where all summands have the same conditional distribution given that they are non-zero, a bound on the relative entropy distance between their sum and the compound Poisson distribution is derived, based on the data-processing property of relative entropy and earlier Poisson approximation results. When the summands have arbitrary distributions, corresponding bounds are derived in terms of the total variation distance. The main technical ingredient is the introduction of two "information functionals,'' and the analysis of their properties. These information functionals play a role analogous to that of the classical Fisher information in normal approximation. Detailed comparisons are made between the resulting inequalities and related bounds.
Electron. J. Probab., Volume 15 (2010), paper no. 42, 1344-1369.
Accepted: 31 August 2010
First available in Project Euclid: 1 June 2016
Permanent link to this document
Digital Object Identifier
Mathematical Reviews number (MathSciNet)
Zentralblatt MATH identifier
Primary: 60E15: Inequalities; stochastic orderings
Secondary: 60E07: Infinitely divisible distributions; stable distributions 60F05: Central limit and other weak theorems 94A17: Measures of information, entropy
This work is licensed under aCreative Commons Attribution 3.0 License.
Barbour, A. D.; Johnson, Oliver; Kontoyiannis, Ioannis; Madiman, Mokshay. Compound Poisson Approximation via Information Functionals. Electron. J. Probab. 15 (2010), paper no. 42, 1344--1369. doi:10.1214/EJP.v15-799. https://projecteuclid.org/euclid.ejp/1464819827