The Annals of Statistics
- Ann. Statist.
- Volume 40, Number 5 (2012), 2697-2732.
Asymptotic properties of the maximum likelihood estimation in misspecified hidden Markov models
Full-text: Open access
Abstract
Let $(Y_{k})_{k\in\mathbb{Z}}$ be a stationary sequence on a probability space $(\Omega,\mathcal{A},\mathbb{P})$ taking values in a standard Borel space $\mathsf{Y}$. Consider the associated maximum likelihood estimator with respect to a parametrized family of hidden Markov models such that the law of the observations $(Y_{k})_{k\in\mathbb{Z}}$ is not assumed to be described by any of the hidden Markov models of this family. In this paper we investigate the consistency of this estimator in such misspecified models under mild assumptions.
Article information
Source
Ann. Statist., Volume 40, Number 5 (2012), 2697-2732.
Dates
First available in Project Euclid: 4 February 2013
Permanent link to this document
https://projecteuclid.org/euclid.aos/1359987535
Digital Object Identifier
doi:10.1214/12-AOS1047
Mathematical Reviews number (MathSciNet)
MR3097617
Zentralblatt MATH identifier
1373.62436
Subjects
Primary: 62M09: Non-Markovian processes: estimation
Secondary: 62F12: Asymptotic properties of estimators
Keywords
Strong consistency hidden Markov models maximum likelihood estimator misspecified models state space models
Citation
Douc, Randal; Moulines, Eric. Asymptotic properties of the maximum likelihood estimation in misspecified hidden Markov models. Ann. Statist. 40 (2012), no. 5, 2697--2732. doi:10.1214/12-AOS1047. https://projecteuclid.org/euclid.aos/1359987535
References
- [1] Barron, A. R. (1985). The strong ergodic theorem for densities: Generalized Shannon–McMillan–Breiman theorem. Ann. Probab. 13 1292–1303.Mathematical Reviews (MathSciNet): MR806226
Zentralblatt MATH: 0608.94001
Digital Object Identifier: doi:10.1214/aop/1176992813
Project Euclid: euclid.aop/1176992813 - [2] Baum, L. E. and Petrie, T. (1966). Statistical inference for probabilistic functions of finite state Markov chains. Ann. Math. Statist. 37 1554–1563.Mathematical Reviews (MathSciNet): MR202264
Zentralblatt MATH: 0144.40902
Digital Object Identifier: doi:10.1214/aoms/1177699147
Project Euclid: euclid.aoms/1177699147 - [3] Budhiraja, A. and Ocone, D. (1997). Exponential stability of discrete-time filters for bounded observation noise. Systems Control Lett. 30 185–193.Mathematical Reviews (MathSciNet): MR1455877
- [4] Cappé, O., Moulines, E. and Rydén, T. (2005). Inference in Hidden Markov Models. Springer, New York.Mathematical Reviews (MathSciNet): MR2159833
- [5] Churchill, G. (1992). Hidden Markov chains and the analysis of genome structure. Computers and Chemistry 16 107–115.
- [6] Douc, R., Fort, G., Moulines, E. and Priouret, P. (2009). Forgetting the initial distribution for hidden Markov models. Stochastic Process. Appl. 119 1235–1256.Mathematical Reviews (MathSciNet): MR2508572
Zentralblatt MATH: 1159.93357
Digital Object Identifier: doi:10.1016/j.spa.2008.05.007 - [7] Douc, R. and Matias, C. (2001). Asymptotics of the maximum likelihood estimator for general hidden Markov models. Bernoulli 7 381–420.Mathematical Reviews (MathSciNet): MR1836737
Digital Object Identifier: doi:10.2307/3318493
Project Euclid: euclid.bj/1080004757 - [8] Douc, R., Moulines, E., Olsson, J. and van Handel, R. (2011). Consistency of the maximum likelihood estimator for general hidden Markov models. Ann. Statist. 39 474–513.Mathematical Reviews (MathSciNet): MR2797854
Zentralblatt MATH: 1209.62194
Digital Object Identifier: doi:10.1214/10-AOS834
Project Euclid: euclid.aos/1297779854 - [9] Douc, R., Moulines, É. and Rydén, T. (2004). Asymptotic properties of the maximum likelihood estimator in autoregressive models with Markov regime. Ann. Statist. 32 2254–2304.Mathematical Reviews (MathSciNet): MR2102510
Zentralblatt MATH: 1056.62028
Digital Object Identifier: doi:10.1214/009053604000000021
Project Euclid: euclid.aos/1098883789 - [10] Fomby, T. B. and Hill, R. C., eds. (2003). Maximum Likelihood Estimation of Misspecified Models: Twenty Years Later. Advances in Econometrics 17. Elsevier, Amsterdam.Mathematical Reviews (MathSciNet): MR2531667
- [11] Fredkin, D. R. and Rice, J. A. (1987). Correlation functions of a function of a finite-state Markov process with application to channel kinetics. Math. Biosci. 87 161–172.Mathematical Reviews (MathSciNet): MR929996
Zentralblatt MATH: 0632.92003
Digital Object Identifier: doi:10.1016/0025-5564(87)90072-1 - [12] Fuh, C.-D. (2006). Efficient likelihood estimation in state space models. Ann. Statist. 34 2026–2068.Mathematical Reviews (MathSciNet): MR2283726
Digital Object Identifier: doi:10.1214/009053606000000614
Project Euclid: euclid.aos/1162567642 - [13] Fuh, C.-D. (2010). Reply to “On some problems in the article Efficient likelihood estimation in state space models” by Cheng-Der Fuh [Ann. Statist. 34 (2006) 2026–2068] [MR2604693]. Ann. Statist. 38 1282–1285.Mathematical Reviews (MathSciNet): MR2604694
Digital Object Identifier: doi:10.1214/09-AOS748A
Project Euclid: euclid.aos/1266586631 - [14] Genon-Catalot, V. and Laredo, C. (2006). Leroux’s method for general hidden Markov models. Stochastic Process. Appl. 116 222–243.Mathematical Reviews (MathSciNet): MR2197975
Zentralblatt MATH: 1099.60022
Digital Object Identifier: doi:10.1016/j.spa.2005.10.005 - [15] Huber, P. J. (1967). The behavior of maximum likelihood estimates under nonstandard conditions. In Proc. Fifth Berkeley Sympos. Math. Statist. and Probability (Berkeley, Calif., 1965/66), Vol. I: Statistics 221–233. Univ. California Press, Berkeley, CA.
- [16] Hull, J. and White, A. (1987). The pricing of options on assets with stochastic volatilities. J. Finance 42 281–300.
- [17] Jensen, J. L. (2010). On some problems in the article Efficient likelihood estimation in state space models by Cheng-Der Fuh [Ann. Statist. 34 (2006) 2026–2068] [MR2283726]. Ann. Statist. 38 1279–1281.Mathematical Reviews (MathSciNet): MR2604693
Digital Object Identifier: doi:10.1214/09-AOS748A
Project Euclid: euclid.aos/1266586630 - [18] Juang, B. H. and Rabiner, L. R. (1991). Hidden Markov models for speech recognition. Technometrics 33 251–272.Mathematical Reviews (MathSciNet): MR1132665
Digital Object Identifier: doi:10.1080/00401706.1991.10484833 - [19] Kleptsyna, M. L. and Veretennikov, A. Y. (2008). On discrete time ergodic filters with wrong initial data. Probab. Theory Related Fields 141 411–444.Mathematical Reviews (MathSciNet): MR2391160
Zentralblatt MATH: 1141.60337
Digital Object Identifier: doi:10.1007/s00440-007-0089-7 - [20] Le Gland, F. and Mevel, L. (2000). Basic properties of the projective product with application to products of column-allowable nonnegative matrices. Math. Control Signals Systems 13 41–62.Mathematical Reviews (MathSciNet): MR1742139
Zentralblatt MATH: 0941.93012
Digital Object Identifier: doi:10.1007/PL00009860 - [21] Le Gland, F. and Mevel, L. (2000). Exponential forgetting and geometric ergodicity in hidden Markov models. Math. Control Signals Systems 13 63–93.Mathematical Reviews (MathSciNet): MR1742140
Zentralblatt MATH: 0941.93053
Digital Object Identifier: doi:10.1007/PL00009861 - [22] Leroux, B. G. (1992). Maximum-likelihood estimation for hidden Markov models. Stochastic Process. Appl. 40 127–143.Mathematical Reviews (MathSciNet): MR1145463
Zentralblatt MATH: 0738.62081
Digital Object Identifier: doi:10.1016/0304-4149(92)90141-C - [23] Mamon, R. S. and Elliott, R. J., eds. (2007). Hidden Markov Models in Finance. International Series in Operations Research & Management Science 104. Springer, New York.Mathematical Reviews (MathSciNet): MR2407726
- [24] Mevel, L. and Finesso, L. (2004). Asymptotical statistics of misspecified hidden Markov models. IEEE Trans. Automat. Control 49 1123–1132.
- [25] Meyn, S. P. and Tweedie, R. L. (1993). Markov Chains and Stochastic Stability. Springer, London.Mathematical Reviews (MathSciNet): MR1287609
- [26] Petrie, T. (1969). Probabilistic functions of finite state Markov chains. Ann. Math. Statist. 40 97–115.Mathematical Reviews (MathSciNet): MR239662
Digital Object Identifier: doi:10.1214/aoms/1177697807
Project Euclid: euclid.aoms/1177697807 - [27] Van Handel, R. (2008). Discrete time nonlinear filters with informative observations are stable. Electron. Commun. Probab. 13 562–575.Mathematical Reviews (MathSciNet): MR2461532
Zentralblatt MATH: 1189.60133
Digital Object Identifier: doi:10.1214/ECP.v13-1423 - [28] Walters, P. (1982). An Introduction to Ergodic Theory. Graduate Texts in Mathematics 79. Springer, New York.Mathematical Reviews (MathSciNet): MR648108
- [29] White, H. (1982). Maximum likelihood estimation of misspecified models. Econometrica 50 1–25.
- You have access to this content.
- You have partial access to this content.
- You do not have access to this content.
More like this
- Nonparametric regression on hidden $\Phi$-mixing variables: Identifiability and consistency of a pseudo-likelihood based estimation procedure
Dumont, Thierry and Le Corff, Sylvain, Bernoulli, 2017 - Long-term stability of sequential Monte Carlo methods under verifiable conditions
Douc, Randal, Moulines, Eric, and Olsson, Jimmy, The Annals of Applied Probability, 2014 - On Consistency of a Class of Estimators for Exponential Families of Markov Random Fields on the Lattice
Comets, Francis, The Annals of Statistics, 1992
- Nonparametric regression on hidden $\Phi$-mixing variables: Identifiability and consistency of a pseudo-likelihood based estimation procedure
Dumont, Thierry and Le Corff, Sylvain, Bernoulli, 2017 - Long-term stability of sequential Monte Carlo methods under verifiable conditions
Douc, Randal, Moulines, Eric, and Olsson, Jimmy, The Annals of Applied Probability, 2014 - On Consistency of a Class of Estimators for Exponential Families of Markov Random Fields on the Lattice
Comets, Francis, The Annals of Statistics, 1992 - Asymptotics of the maximum likelihood estimator for general hidden Markov models
Douc, Randal and Matias, Catherine, Bernoulli, 2001 - The maximizing set of the asymptotic normalized log-likelihood for partially observed Markov chains
Douc, Randal, Roueff, François, and Sim, Tepmony, The Annals of Applied Probability, 2016 - Asymptotic normality of the maximum likelihood estimator in
state space models
Jensen, Jens Ledet and Petersen, Niels Væver, The Annals of Statistics, 1999 - Consistency of the maximum likelihood estimator for general hidden Markov models
Douc, Randal, Moulines, Eric, Olsson, Jimmy, and van Handel, Ramon, The Annals of Statistics, 2011 - Asymptotically optimal estimation in misspecified time series models
Dahlhaus, R. and Wefelmeyer, W., The Annals of Statistics, 1996 - Maximum likelihood estimation of hidden Markov processes
Frydman, Halina and Lakner, Peter, The Annals of Applied Probability, 2003 - Local linear spatial quantile regression
Hallin, Marc, Lu, Zudi, and Yu, Keming, Bernoulli, 2009