- Volume 12, Number 3 (2006), 515-533.
Entropy for semi-Markov processes with Borel state spaces: asymptotic equirepartition properties and invariance principles
The aim of this paper is to define the entropy rate of a semi-Markov process with a Borel state space by extending the strong asymptotic equirepartition property (also called the ergodic theorem of information theory or Shannon-McMillan-Breiman theorem) to this class of non-stationary processes. The mean asymptotic equirepartition property (also called the Shannon-McMillan theorem) is also proven to hold. The relative entropy rate between two semi-Markov processes is defined. All earlier results concerning entropy for semi-Markov processes, jump Markov processes and Markov chains thus appear as special cases. Two invariance principles are established for entropy, one for the central limit theorem and the other for the law of the iterated logarithm.
Bernoulli, Volume 12, Number 3 (2006), 515-533.
First available in Project Euclid: 28 June 2006
Permanent link to this document
Digital Object Identifier
Mathematical Reviews number (MathSciNet)
Zentralblatt MATH identifier
asymptotic equirepartition property entropy rate functional central limit theorem functional law of the iterated logarithm invariance principle relative entropy semi-Markov processes Shannon-McMillan theorem Shannon-McMillan-Breiman theorem
Girardin, Valerie; Limnios, Nikolaos. Entropy for semi-Markov processes with Borel state spaces: asymptotic equirepartition properties and invariance principles. Bernoulli 12 (2006), no. 3, 515--533. doi:10.3150/bj/1151525134. https://projecteuclid.org/euclid.bj/1151525134