The Annals of Statistics

Optimal Plug-in Estimators for Nonparametric Functional Estimation

Larry Goldstein and Karen Messer

Full-text: Open access


Consider the problem of estimating the value of a functional $\Lambda(f)$ for $f$ an unknown density or regression function. The straightforward plug-in estimator $\Lambda(\hat f)$ with $\hat f$ a particular estimate of $f$ achieves the optimal rate of convergence in the sense of Stone over bounded subsets of a Sobolev space for a broad class of linear and nonlinear functionals. For many functionals the rate calculation depends on a Frechet-like derivative of the functional, which may be obtained using elementary calculus. For some classes of functionals, $\hat f$ is undersmoothed relative to what would be used to estimate $f$ optimally. Examples for which a plug-in estimator is optimal include $L^q$ norms of regression or density functions and their derivatives and the expected integrated squared bias. When interested in computing estimates over classes of functions which satisfy certain restrictions, such as strict positivity or boundary conditions, the plug-in estimator may or may not be optimal, depending on the functional and the function class. The functional calculus establishes conditions under which the plug-in estimator remains optimal, and sometimes suggests an appropriate modification when it does not.

Article information

Ann. Statist., Volume 20, Number 3 (1992), 1306-1328.

First available in Project Euclid: 12 April 2007

Permanent link to this document

Digital Object Identifier

Mathematical Reviews number (MathSciNet)

Zentralblatt MATH identifier


Primary: 62G05: Estimation
Secondary: 62G20: Asymptotic properties

Nonparametric regression functionals optimal rates plug-in estimators


Goldstein, Larry; Messer, Karen. Optimal Plug-in Estimators for Nonparametric Functional Estimation. Ann. Statist. 20 (1992), no. 3, 1306--1328. doi:10.1214/aos/1176348770.

Export citation