The Annals of Applied Probability
- Ann. Appl. Probab.
- Volume 7, Number 3 (1997), 822-836.
Estimating the state of a noisy continuous time Markov chain when dynamic sampling is feasible
A continuous time Markov chain is observed with Gaussian white noise added to it. To the well-known problem of continuously estimating the current state of the chain, we introduce the additional option of continuously varying the sampling rates, as long as some restriction (or cost) on the average sampling rate is satisfied. The optimal solution to this "dynamic sampling" problem is presented and analyzed in closed form for the two-state symmetric case. It is shown that the resulting dynamic sampling procedure has a much lower asymptotic average error rate compared to the one obtained when sampling at a constant rate. Alternatively, the dynamic sampling procedure can provide the same error rate using a much lower average sampling rate. The relative efficiency of the dynamic sampling procedure may in fact tend to infinity in some extreme cases.
Ann. Appl. Probab., Volume 7, Number 3 (1997), 822-836.
First available in Project Euclid: 16 October 2002
Permanent link to this document
Digital Object Identifier
Mathematical Reviews number (MathSciNet)
Zentralblatt MATH identifier
Primary: 62M20: Prediction [See also 60G25]; filtering [See also 60G35, 93E10, 93E11] 93E20: Optimal stochastic control 60J27: Continuous-time Markov processes on discrete state spaces 60J60: Diffusion processes [See also 58J65]
Assaf, David. Estimating the state of a noisy continuous time Markov chain when dynamic sampling is feasible. Ann. Appl. Probab. 7 (1997), no. 3, 822--836. doi:10.1214/aoap/1034801256. https://projecteuclid.org/euclid.aoap/1034801256