The Annals of Statistics

Change-point estimation under adaptive sampling

Yan Lan, Moulinath Banerjee, and George Michailidis

Full-text: Open access


We consider the problem of locating a jump discontinuity (change-point) in a smooth parametric regression model with a bounded covariate. It is assumed that one can sample the covariate at different values and measure the corresponding responses. Budget constraints dictate that a total of n such measurements can be obtained. A multistage adaptive procedure is proposed, where at each stage an estimate of the change point is obtained and new points are sampled from its appropriately chosen neighborhood. It is shown that such procedures accelerate the rate of convergence of the least squares estimate of the change-point. Further, the asymptotic distribution of the estimate is derived using empirical processes techniques. The latter result provides guidelines on how to choose the tuning parameters of the multistage procedure in practice. The improved efficiency of the procedure is demonstrated using real and synthetic data. This problem is primarily motivated by applications in engineering systems.

Article information

Ann. Statist., Volume 37, Number 4 (2009), 1752-1791.

First available in Project Euclid: 18 June 2009

Permanent link to this document

Digital Object Identifier

Mathematical Reviews number (MathSciNet)

Zentralblatt MATH identifier

Primary: 62F12: Asymptotic properties of estimators 62K99: None of the above, but in this section

Adaptive sampling change point estimation multistage procedure Skorokhod topology two-stage procedure zoom-in


Lan, Yan; Banerjee, Moulinath; Michailidis, George. Change-point estimation under adaptive sampling. Ann. Statist. 37 (2009), no. 4, 1752--1791. doi:10.1214/08-AOS602.

Export citation


  • Basseville, M. and Nikiforov, I. (1993). Detection of Abrupt Changes: Theory and Application. Prentice Hall, Englewood Cliffs, NJ.
  • Billingsley, P. (1999). Convergence of Probability Measures. Wiley, New York.
  • Dempfle, A. and Stute, W. (2002). Nonparametric estimation of a discontinuity in regression. Statist. Neerlandica 56 233–242.
  • Ferger, D. (2004). A continuous mapping theorem for the arg max-functional in the nonunique case. Statist. Neerlandica 58 83–96.
  • Ferger, D. (2005). On the minimizing point of the incorrectly centered empirical process and its limit distribution in nonregular experiments. ESAIM Probab. Stat. 9 307–322.
  • Gijbels, I., Hall, P. and Kneip, A. (1999). On the estimation of jump points in smooth curves. Ann. Inst. Statist. Math. 51 231–251.
  • Hall, P. and Molchanov, I. S. (2003). Sequential methods for design-adaptive estimation of discontinuities in regression curves and surfaces. Ann. Statist. 31 921–941.
  • Hung, Y. C. and Michailidis, G. (2008). Modeling, analysis and simulation of switched processing systems. In ACM Transactions on Modeling, Analysis and Simulation 18 article 12.
  • Kosorok, M. R. (2008). Introduction to Empirical Processes and Semiparametric Inference. Springer, New York.
  • Kosorok, M. R. and Song, R. (2007). Inference under right censoring for transformation models with a change-point based on a covariate threshold. Ann. Statist. 35 957–989.
  • Koul, H. L. and Qian, L. (2002). Asymptotics of maximum likelihood estimator in a two-phase linear regression model. J. Statist. Plann. Inference 108 99–119.
  • Lai, T. L. (2001). Sequential analysis: Some classical problems and new challenges. Statist. Sinica 11 303–408.
  • Lan, Y., Banerjee, M. and Michailidis, G. (2007). Change-point estimation under adaptive sampling. Technical report, Dept. Statistics, Univ. Michigan. Available at
  • Loader, C. R. (1996). Change point estimation using nonparametric regression. Ann. Statist. 24 1667–1678.
  • Müller, H.-G. (1992). Change-points in nonparametric regression analysis. Ann. Statist. 20 737–761.
  • Müller, H.-G. and Song, K.-S. (1997). Two-stage change-point estimators in smooth regression models. Statist. Probab. Lett. 34 323–335.
  • Pons, O. (2003). Estimation in a Cox regression model with a change-point according to a threshold in a covariate. Ann. Statist. 31 442–463.
  • Ritov, Y. (1990). Asymptotic efficient estimation of the change point with unknown distributions. Ann. Statist. 18 1829–1839.
  • Talagrand, M. (1994). Sharper bounds for Gaussian and empirical processes. Ann. Probab. 22 20–76.
  • Van de Geer, S. (2000). Empirical Processes in M-Estimation. Cambridge Series in Statistical and Probabilistic Mathematics. Cambridge Univ. Press, Cambridge, UK.