Open Access
1999 A LIMIT PROPERTY OF ARBITRARY DISCRETE INFORMATION SOURCES
Liu Wen
Taiwanese J. Math. 3(4): 539-546 (1999). DOI: 10.11650/twjm/1500407166

Abstract

In this paper the notion of stochastic conditional entropy is introduced, and the asymptotic relation between this notion and the relative entropy density is studied. A strong limit theorem which holds for arbitrary discrete information sources is obtained. In the proof an analytic technique to study the strong limit properties of discrete information sources is proposed.

Citation

Download Citation

Liu Wen. "A LIMIT PROPERTY OF ARBITRARY DISCRETE INFORMATION SOURCES." Taiwanese J. Math. 3 (4) 539 - 546, 1999. https://doi.org/10.11650/twjm/1500407166

Information

Published: 1999
First available in Project Euclid: 18 July 2017

zbMATH: 0954.94005
MathSciNet: MR1730987
Digital Object Identifier: 10.11650/twjm/1500407166

Subjects:
Primary: 60F15 , 94A17

Keywords: random conditional entropy , relative entropy density , Shannon-McMillan-Breiman theorem , strong limit theorem

Rights: Copyright © 1999 The Mathematical Society of the Republic of China

Vol.3 • No. 4 • 1999
Back to Top