Open Access
October2000 Data sharpening methods for bias reduction in nonparametric regression
Edwin Choi, Peter Hall, Valentin Rousson
Ann. Statist. 28(5): 1339-1355 (October2000). DOI: 10.1214/aos/1015957396


We consider methods for kernel regression when the explanatory and/or response variables are adjusted prior to substitution into a conven- tional estimator.This “data-sharpening” procedure is designed to preserve the advantages of relatively simple, low-order techniques, for example, their robustness against design sparsity problems, yet attain the sorts of bias reductions that are commonly associated only with high-order methods.We consider Nadaraya–Watson and local-linear methods in detail, although data sharpening is applicable more widely. One approach in particular is found to give excellent performance. It involves adjusting both the explanatory and the response variables prior to substitution into a local linear estimator. The change to the explanatory variables enhances resistance of the estimator to design sparsity, by increasing the density of design points in places where the original density had been low. When combined with adjustment of the response variables, it produces a reduction in bias by an order of magnitude. Moreover, these advantages are available in multivariate settings. The data-sharpening step is simple to implement, since it is explicitly defined. It does not involve functional inversion, solution of equations or use of pilot bandwidths.


Download Citation

Edwin Choi. Peter Hall. Valentin Rousson. "Data sharpening methods for bias reduction in nonparametric regression." Ann. Statist. 28 (5) 1339 - 1355, October2000.


Published: October2000
First available in Project Euclid: 12 March 2002

zbMATH: 1105.62336
MathSciNet: MR1805786
Digital Object Identifier: 10.1214/aos/1015957396

Primary: 62G07
Secondary: 62H05

Keywords: bandwidth , curse of dimensionality , design sparsity , explanatory variables , kernel methods , local-linear estimator , local-polynomial methods , Nadaraya-Watson estimator , response variables , smoothing

Rights: Copyright © 2000 Institute of Mathematical Statistics

Vol.28 • No. 5 • October2000
Back to Top