The Annals of Statistics

Measures of Information Based on Comparison with Total Information and with Total Ignorance

Erik N. Torgersen

Full-text: Open access

Abstract

Two measures of content of information in statistical experiments are considered. They are both based on Le Cam's notion of deficiency of one experiment with respect to another. The measures are: (i) The deficiency of the given experiment with respect to a totally informative experiment. (ii) The deficiency of a totally uninformative experiment with respect to the given experiment. We shall here discuss the interpretations of such measures, establish inequalities for them and related quantities, and study their behaviour under replications. If the parameter set is finite then closed expressions for exponential rates of convergence, as the number of replications increase, are given. In particular the exponential rate of the minimax probability of not covering the true values of the parameter by an $r$-point confidence set is expressed in terms of Hellinger transforms. If convergence to the totally informative experiment takes place at all, then the speed of convergence is necessary exponential. Examples are given indicating various possibilities.

Article information

Source
Ann. Statist., Volume 9, Number 3 (1981), 638-657.

Dates
First available in Project Euclid: 12 April 2007

Permanent link to this document
https://projecteuclid.org/euclid.aos/1176345468

Digital Object Identifier
doi:10.1214/aos/1176345468

Mathematical Reviews number (MathSciNet)
MR615440

Zentralblatt MATH identifier
0487.62006

JSTOR
links.jstor.org

Subjects
Primary: 62B15: Theory of statistical experiments
Secondary: 62C05: General considerations

Keywords
Risk replications exponential convergence confidence sets translation experiments

Citation

Torgersen, Erik N. Measures of Information Based on Comparison with Total Information and with Total Ignorance. Ann. Statist. 9 (1981), no. 3, 638--657. doi:10.1214/aos/1176345468. https://projecteuclid.org/euclid.aos/1176345468


Export citation