The Annals of Statistics

On the $\mathbb{L}_{p}$-error of monotonicity constrained estimators

Cécile Durot

Full-text: Open access

Abstract

We aim at estimating a function λ:[0,1]→ℝ, subject to the constraint that it is decreasing (or increasing). We provide a unified approach for studying the $\mathbb {L}_{p}$-loss of an estimator defined as the slope of a concave (or convex) approximation of an estimator of a primitive of λ, based on n observations. Our main task is to prove that the $\mathbb {L}_{p}$-loss is asymptotically Gaussian with explicit (though unknown) asymptotic mean and variance. We also prove that the local $\mathbb {L}_{p}$-risk at a fixed point and the global $\mathbb {L}_{p}$-risk are of order np/3. Applying the results to the density and regression models, we recover and generalize known results about Grenander and Brunk estimators. Also, we obtain new results for the Huang–Wellner estimator of a monotone failure rate in the random censorship model, and for an estimator of the monotone intensity function of an inhomogeneous Poisson process.

Article information

Source
Ann. Statist., Volume 35, Number 3 (2007), 1080-1104.

Dates
First available in Project Euclid: 24 July 2007

Permanent link to this document
https://projecteuclid.org/euclid.aos/1185303999

Digital Object Identifier
doi:10.1214/009053606000001497

Mathematical Reviews number (MathSciNet)
MR2341699

Zentralblatt MATH identifier
1129.62024

Subjects
Primary: 62G05: Estimation 62G07: Density estimation 62G08: Nonparametric regression 62N02: Estimation

Keywords
Central limit theorem drifted Brownian motion inhomogeneous Poisson process least concave majorant monotone density monotone failure rate monotone regression

Citation

Durot, Cécile. On the $\mathbb{L}_{p}$-error of monotonicity constrained estimators. Ann. Statist. 35 (2007), no. 3, 1080--1104. doi:10.1214/009053606000001497. https://projecteuclid.org/euclid.aos/1185303999


Export citation

References

  • Barlow, R. E., Bartholomew, D. J., Bremner, J. M. and Brunk, H. D. (1972). Statistical Inference Under Order Restrictions. The Theory and Application of Isotonic Regression. Wiley, London.
  • Brunk, H. D. (1958). On the estimation of parameters restricted by inequalities. Ann. Math. Statist. 29 437–454.
  • Brunk, H. D. (1970). Estimation of isotonic regression. In Nonparametric Techniques in Statistical Inference (M. L. Puri, ed.) 177–195. Cambridge Univ. Press.
  • Durot, C. (2002). Sharp asymptotics for isotonic regression. Probab. Theory Related Fields 122 222–240.
  • Grenander, U. (1956). On the theory of mortality measurement. II. Skand. Actuarietidskr. 39 125–153.
  • Groeneboom, P. (1985). Estimating a monotone density. In Proc. Berkeley Conference in Honor of Jerzy Neyman and Jack Kiefer (L. Le Cam and R. Olshen, eds.) 2 539–555. Wadsworth, Belmont, CA.
  • Groeneboom, P. (1989). Brownian motion with a parabolic drift and Airy functions. Probab. Theory Related Fields 81 79–109.
  • Groeneboom, P., Hooghiemstra, G. and Lopuhaä, H. P. (1999). Asymptotic normality of the $L_1$-error of the Grenander estimator. Ann. Statist. 27 1316–1347.
  • Huang, J. and Wellner, J. A. (1995). Estimation of a monotone density or monotone hazard rate under random censoring. Scand. J. Statist. 22 3–33.
  • Komlós, J., Major, P. and Tusnády, G. (1975). An approximation of partial sums of independent RV's, and the sample DF. Z. Wahrsch. Verw. Gebiete 32 111–131.
  • Kulikov, V. N. and Lopuhaä, H. P. (2005). Asymptotic normality of the $L_k$-error of the Grenander estimator. Ann. Statist. 33 2228–2255.
  • Major, P. and Rejtö, L. (1988). Strong embedding of the estimator of the distribution function under random censorship. Ann. Statist. 16 1113–1132.
  • Prakasa Rao, B. L. S. (1969). Estimation of a unimodal density. Sankhyā Ser. A 31 23–36.
  • Reboul, L. (2005). Estimation of a function under shape restrictions. Applications to reliability. Ann. Statist. 33 1330–1356.
  • Sakhanenko, A. I. (1985). Estimates in the invariance principle. Limit Theorems of Probability Theory 175 27–44. Trudy Inst. Mat. 5. (In Russian.)
  • Shorack, G. R. and Wellner, J. A. (1986). Empirical Processes with Applications to Statistics. Wiley, New York.
  • Woodroofe, M. and Sun, J. (1993). A penalized maximum likelihood estimate of $f(0+)$ when $f$ is nonincreasing. Statist. Sinica 3 501–515.