The Annals of Statistics

Measures of Information Based on Comparison with Total Information and with Total Ignorance

Erik N. Torgersen

Full-text: Open access


Two measures of content of information in statistical experiments are considered. They are both based on Le Cam's notion of deficiency of one experiment with respect to another. The measures are: (i) The deficiency of the given experiment with respect to a totally informative experiment. (ii) The deficiency of a totally uninformative experiment with respect to the given experiment. We shall here discuss the interpretations of such measures, establish inequalities for them and related quantities, and study their behaviour under replications. If the parameter set is finite then closed expressions for exponential rates of convergence, as the number of replications increase, are given. In particular the exponential rate of the minimax probability of not covering the true values of the parameter by an $r$-point confidence set is expressed in terms of Hellinger transforms. If convergence to the totally informative experiment takes place at all, then the speed of convergence is necessary exponential. Examples are given indicating various possibilities.

Article information

Ann. Statist., Volume 9, Number 3 (1981), 638-657.

First available in Project Euclid: 12 April 2007

Permanent link to this document

Digital Object Identifier

Mathematical Reviews number (MathSciNet)

Zentralblatt MATH identifier


Primary: 62B15: Theory of statistical experiments
Secondary: 62C05: General considerations

Risk replications exponential convergence confidence sets translation experiments


Torgersen, Erik N. Measures of Information Based on Comparison with Total Information and with Total Ignorance. Ann. Statist. 9 (1981), no. 3, 638--657. doi:10.1214/aos/1176345468.

Export citation