## The Annals of Probability

- Ann. Probab.
- Volume 14, Number 2 (1986), 459-479.

### Two-Sided Markov Chains

#### Abstract

Let $S$ be a countable set, and $a, b$ two distinct elements not in $S$. Let $\Omega$ be the set of functions $\omega: Z$ (integers) $\rightarrow S \cup \{a, b\}$ so that (i) $\omega (n) \in S$ for some $n$, (ii) $\omega (n) = a \Rightarrow \omega(m) = a$ for $m < n$, and (iii) $\omega(n) = b \Rightarrow \omega(m) = b$ for $m > n$. On $\Omega$, let $x(n)$ be the $n$th coordinate, $\theta_n$ the shift operator, and $\alpha = \inf\{n: x(n) \in S\}$. A measure $P$ on $\Omega$ is Markov if $\forall i \in S, n \in Z, P(x(n) = i) < \infty$, and $P(x(n + 1) = i\mid \sigma(x(k): k \leq n)) = P(x(n + 1) = i|x(n))$ on $\{x(n) \in S\}$. A Markov measure $P$ is called a two-sided Markov chain if there are substochastic matrices on $S, p$ and $q$, so that $\forall i, j \in S, n \in Z, P(x(n) = i, x(n + 1) = j) = P(x(n) = i)p(i, j) = P(x(n + 1) = j)q(j, i)$. It is shown that if $p$ is a certain kind of irreducible matrix then there exists an integer $d \geq 1$ and a real $\rho > 0$ so that $P \circ \theta^{-1}_{nd} = \rho^nP \forall n \in Z$. Of particular interest is the generalization of the case $d = 1$. A two-sided Markov chain is called quasistationary if there exists $\rho > 0$ with $P \circ \theta^{-1}_n = \rho^n P$. It is shown that if $\pi$ is a measure on $S$ and $\rho > 0$, and $p$ is a substochastic matrix on $S$, with $\pi p \leq \rho \pi$, then there exists a quasistationary chain with $p$ as forward transition, $P(x(0) = i) = \pi(i),$ and $P \circ \theta^{-1}_n = \rho^n P. P$ is used to prove the Riesz decomposition theorem for $\pi$. Finally, it is shown under certain verifiable assumptions, that a quasistationary chain, restricted to $\{\alpha \leq 0\}$, is an extended chain, with transition $p$, which is a certain kind of approximate $p$-chain in the sense of Hunt.

#### Article information

**Source**

Ann. Probab., Volume 14, Number 2 (1986), 459-479.

**Dates**

First available in Project Euclid: 19 April 2007

**Permanent link to this document**

https://projecteuclid.org/euclid.aop/1176992526

**Digital Object Identifier**

doi:10.1214/aop/1176992526

**Mathematical Reviews number (MathSciNet)**

MR832019

**Zentralblatt MATH identifier**

0594.60070

**JSTOR**

links.jstor.org

**Subjects**

Primary: 60J10: Markov chains (discrete-time Markov processes on discrete state spaces)

Secondary: 60J45: Probabilistic potential theory [See also 31Cxx, 31D05]

**Keywords**

two-sided Markov chain quasistationary chain extended chain

#### Citation

Atkinson, Bruce W. Two-Sided Markov Chains. Ann. Probab. 14 (1986), no. 2, 459--479. doi:10.1214/aop/1176992526. https://projecteuclid.org/euclid.aop/1176992526