The Annals of Statistics

The limit distribution of the $L_{\infty}$-error of Grenander-type estimators

Cécile Durot, Vladimir N. Kulikov, and Hendrik P. Lopuhaä

Full-text: Open access

Enhanced PDF (333 KB)

Abstract

Let $f$ be a nonincreasing function defined on $[0,1]$. Under standard regularity conditions, we derive the asymptotic distribution of the supremum norm of the difference between $f$ and its Grenander-type estimator on sub-intervals of $[0,1]$. The rate of convergence is found to be of order $(n/\log n)^{-1/3}$ and the limiting distribution to be Gumbel.

Article information

Source
Ann. Statist., Volume 40, Number 3 (2012), 1578-1608.

Dates
First available in Project Euclid: 5 September 2012

Permanent link to this document
https://projecteuclid.org/euclid.aos/1346850066

Digital Object Identifier
doi:10.1214/12-AOS1015

Mathematical Reviews number (MathSciNet)
MR3015036

Zentralblatt MATH identifier
1257.62017

Subjects
Primary: 62E20: Asymptotic distribution theory 62G20: Asymptotic properties
Secondary: 62G05: Estimation 62G07: Density estimation

Keywords
Supremum distance extremal limit theorem least concave majorant monotone density monotone regression monotone failure rate

Citation

Durot, Cécile; Kulikov, Vladimir N.; Lopuhaä, Hendrik P. The limit distribution of the $L_{\infty}$-error of Grenander-type estimators. Ann. Statist. 40 (2012), no. 3, 1578--1608. doi:10.1214/12-AOS1015. https://projecteuclid.org/euclid.aos/1346850066


Export citation

References

  • [1] Anevski, D. and Hössjer, O. (2006). A general asymptotic scheme for inference under order restrictions. Ann. Statist. 34 1874–1930.
    Mathematical Reviews (MathSciNet): MR2283721
    Zentralblatt MATH: 1246.62019
    Digital Object Identifier: doi:10.1214/009053606000000443
    Project Euclid: euclid.aos/1162567637
  • [2] Balabdaoui, F., Jankowski, H., Pavlides, M., Seregin, A. and Wellner, J. A. (2011). On the Grenander estimator at zero. Statist. Sinica 21 873–899.
    Mathematical Reviews (MathSciNet): MR2829859
    Zentralblatt MATH: 1214.62037
    Digital Object Identifier: doi:10.5705/ss.2011.038a
  • [3] Banerjee, M. and Wellner, J. A. (2001). Likelihood ratio tests for monotone functions. Ann. Statist. 29 1699–1731.
    Mathematical Reviews (MathSciNet): MR1891743
    Zentralblatt MATH: 1043.62037
    Digital Object Identifier: doi:10.1214/aos/1015345959
    Project Euclid: euclid.aos/1015345959
  • [4] Brunk, H. D. (1958). On the estimation of parameters restricted by inequalities. Ann. Math. Statist. 29 437–454.
    Mathematical Reviews (MathSciNet): MR132632
    Zentralblatt MATH: 0087.34302
    Digital Object Identifier: doi:10.1214/aoms/1177706621
    Project Euclid: euclid.aoms/1177706621
  • [5] Brunk, H. D. (1970). Estimation of isotonic regression. In Nonparametric Techniques in Statistical Inference (Proc. Sympos., Indiana Univ., Bloomington, Ind., 1969) 177–197. Cambridge Univ. Press, London.
    Mathematical Reviews (MathSciNet): MR277070
  • [6] Durot, C. (2002). Sharp asymptotics for isotonic regression. Probab. Theory Related Fields 122 222–240.
    Mathematical Reviews (MathSciNet): MR1894068
    Zentralblatt MATH: 0992.60028
    Digital Object Identifier: doi:10.1007/s004400100171
  • [7] Durot, C. (2007). On the $\mathbbL_p$-error of monotonicity constrained estimators. Ann. Statist. 35 1080–1104.
    Mathematical Reviews (MathSciNet): MR2341699
    Zentralblatt MATH: 1129.62024
    Digital Object Identifier: doi:10.1214/009053606000001497
    Project Euclid: euclid.aos/1185303999
  • [8] Durot, C., Kulikov, V. N. and Lopuhaä, H. P. (2012). Supplement to “The limit distribution of the $L_\infty$-error of Grenander-type estimators.” DOI:10.1214/12-AOS1015SUPP.
  • [9] Eggermont, P. P. B. and LaRiccia, V. N. (2000). Maximum likelihood estimation of smooth monotone and unimodal densities. Ann. Statist. 28 922–947.
    Mathematical Reviews (MathSciNet): MR1792794
    Zentralblatt MATH: 1105.62332
    Digital Object Identifier: doi:10.1214/aos/1015952005
    Project Euclid: euclid.aos/1015952005
  • [10] Grenander, U. (1956). On the theory of mortality measurement. II. Skand. Aktuarietidskr. 39 125–153.
    Mathematical Reviews (MathSciNet): MR93415
    Zentralblatt MATH: 0077.33715
  • [11] Groeneboom, P. (1985). Estimating a monotone density. In Proceedings of the Berkeley Conference in Honor of Jerzy Neyman and Jack Kiefer, Vol. II (Berkeley, Calif., 1983) 539–555. Wadsworth, Belmont, CA.
    Mathematical Reviews (MathSciNet): MR822052
  • [12] Groeneboom, P. (1989). Brownian motion with a parabolic drift and Airy functions. Probab. Theory Related Fields 81 79–109.
    Mathematical Reviews (MathSciNet): MR981568
    Digital Object Identifier: doi:10.1007/BF00343738
  • [13] Groeneboom, P. (2011). Vertices of the least concave majorant of Brownian motion with parabolic drift. Electron. J. Probab. 16 2234–2258.
    Mathematical Reviews (MathSciNet): MR2861676
    Zentralblatt MATH: 1246.60106
    Digital Object Identifier: doi:10.1214/EJP.v16-959
  • [14] Groeneboom, P., Hooghiemstra, G. and Lopuhaä, H. P. (1999). Asymptotic normality of the $L_1$ error of the Grenander estimator. Ann. Statist. 27 1316–1347.
    Mathematical Reviews (MathSciNet): MR1740109
    Zentralblatt MATH: 1105.62342
    Digital Object Identifier: doi:10.1214/aos/1018031211
    Project Euclid: euclid.aos/1017938928
  • [15] Groeneboom, P. and Wellner, J. A. (1992). Information Bounds and Nonparametric Maximum Likelihood Estimation. DMV Seminar 19. Birkhäuser, Basel.
    Mathematical Reviews (MathSciNet): MR1180321
    Zentralblatt MATH: 0757.62017
  • [16] Hooghiemstra, G. and Lopuhaä, H. P. (1998). An extremal limit theorem for the argmax process of Brownian motion minus a parabolic drift. Extremes 1 215–240.
    Mathematical Reviews (MathSciNet): MR1814624
    Digital Object Identifier: doi:10.1023/A:1009962823531
  • [17] Huang, J. and Wellner, J. A. (1995). Estimation of a monotone density or monotone hazard under random censoring. Scand. J. Stat. 22 3–33.
    Mathematical Reviews (MathSciNet): MR1334065
  • [18] Huang, Y. and Zhang, C.-H. (1994). Estimating a monotone density from censored observations. Ann. Statist. 22 1256–1274.
    Mathematical Reviews (MathSciNet): MR1311975
    Zentralblatt MATH: 0821.62016
    Digital Object Identifier: doi:10.1214/aos/1176325628
    Project Euclid: euclid.aos/1176325628
  • [19] Jonker, M. A. and van der Vaart, A. W. (2001). A semi-parametric model for censored and passively registered data. Bernoulli 7 1–31.
    Mathematical Reviews (MathSciNet): MR1811742
    Digital Object Identifier: doi:10.2307/3318600
    Project Euclid: euclid.bj/1080572337
  • [20] Komlós, J., Major, P. and Tusnády, G. (1975). An approximation of partial sums of independent $\mathrmRV$’s and the sample $\mathrmDF$. I. Z. Wahrsch. Verw. Gebiete 32 111–131.
  • [21] Kosorok, M. R. (2008). Bootstrapping the Grenander estimator. In Beyond Parametrics in Interdisciplinary Research: Festschrift in Honor of Professor Pranab K. Sen (N. Balakrishnan, E. Pena and M. Silvapulle, eds.). Inst. Math. Stat. Collect. 1 282–292. IMS, Beachwood, OH.
    Mathematical Reviews (MathSciNet): MR2462212
    Digital Object Identifier: doi:10.1214/193940307000000202
  • [22] Kulikov, V. N. and Lopuhaä, H. P. (2005). Asymptotic normality of the $L_k$-error of the Grenander estimator. Ann. Statist. 33 2228–2255.
    Mathematical Reviews (MathSciNet): MR2211085
    Zentralblatt MATH: 1086.62063
    Digital Object Identifier: doi:10.1214/009053605000000462
    Project Euclid: euclid.aos/1132936562
  • [23] Kulikov, V. N. and Lopuhaä, H. P. (2006). The behavior of the NPMLE of a decreasing density near the boundaries of the support. Ann. Statist. 34 742–768.
    Mathematical Reviews (MathSciNet): MR2283391
    Zentralblatt MATH: 1092.62044
    Digital Object Identifier: doi:10.1214/009053606000000100
    Project Euclid: euclid.aos/1151418239
  • [24] Lopuhaä, H. P. and Nane, G. F. (2011). Shape constrained nonparametric estimators of the baseline distribution in $\operatornameCox$ proportional hazards model. Unpublished manuscript.
  • [25] Mammen, E. (1991). Estimating a smooth monotone regression function. Ann. Statist. 19 724–740.
    Mathematical Reviews (MathSciNet): MR1105841
    Zentralblatt MATH: 0737.62038
    Digital Object Identifier: doi:10.1214/aos/1176348117
    Project Euclid: euclid.aos/1176348117
  • [26] Pal, J. K. (2009). End-point estimation for decreasing densities: Asymptotic behaviour of the penalized likelihood ratio. Scand. J. Stat. 36 764–781.
    Mathematical Reviews (MathSciNet): MR2573307
    Digital Object Identifier: doi:10.1111/j.1467-9469.2009.00647.x
  • [27] Prakasa Rao, B. L. S. (1969). Estimation of a unimodal density. Sankhyā Ser. A 31 23–36.
    Mathematical Reviews (MathSciNet): MR267677
  • [28] Prakasa Rao, B. L. S. (1970). Estimation for distributions with monotone failure rate. Ann. Math. Statist. 41 507–519.
    Mathematical Reviews (MathSciNet): MR260133
    Zentralblatt MATH: 0214.45903
    Digital Object Identifier: doi:10.1214/aoms/1177697091
    Project Euclid: euclid.aoms/1177697091
  • [29] Sakhanenko, A. I. (1985). Estimates in an invariance principle. In Limit Theorems of Probability Theory. Trudy Inst. Mat. 5 27–44, 175. “Nauka” Sibirsk. Otdel., Novosibirsk.
    Mathematical Reviews (MathSciNet): MR821751
  • [30] Sen, B., Banerjee, M. and Woodroofe, M. (2010). Inconsistency of bootstrap: The Grenander estimator. Ann. Statist. 38 1953–1977.
    Mathematical Reviews (MathSciNet): MR2676880
    Zentralblatt MATH: 1202.62057
    Digital Object Identifier: doi:10.1214/09-AOS777
    Project Euclid: euclid.aos/1278861239
  • [31] van der Vaart, A. W. and van der Laan, M. J. (2003). Smooth estimation of a monotone density. Statistics 37 189–203.
    Mathematical Reviews (MathSciNet): MR1986176
    Digital Object Identifier: doi:10.1080/0233188031000124392
  • [32] Woodroofe, M. and Sun, J. (1993). A penalized maximum likelihood estimate of $f(0+)$ when $f$ is nonincreasing. Statist. Sinica 3 501–515.
    Mathematical Reviews (MathSciNet): MR1243398
  • [33] Zil’berburg, K. L. (2007). Estimation of a monotone function observed in white noise. Zap. Nauchn. Sem. S.-Peterburg. Otdel. Mat. Inst. Steklov. (POMI) 341 124–133, 231.
    Mathematical Reviews (MathSciNet): MR2363588

Supplemental materials

  • Supplementary material: Supplement to “The limit distribution of the $L_{\infty}$-error of Grenander-type estimators”. Supplement A: The supremum of the limiting process. Supplement B: Preliminary results for the inverse process. Supplement C: Points of jump.
    Digital Object Identifier: doi:10.1214/12-AOS1015SUPP
    Supplemental PDF (202 KB)

The Institute of Mathematical Statistics

The Annals of Statistics

New content alerts

Email RSS ToC RSS Article
  • You have access to this content.
  • You have partial access to this content.
  • You do not have access to this content.
Turn Off MathJax

What is MathJax?

More like this

+ See more