The Annals of Statistics

Fitting a bivariate additive model by local polynomial regression

Jean D. Opsomer and David Ruppert

Full-text: Open access

Abstract

While the additive model is a popular nonparametric regression method, many of its theoretical properties are not well understood, especially when the backfitting algorithm is used for computation of the estimators. This article explores those properties when the additive model is fitted by local polynomial regression. Sufficient conditions guaranteeing the asymptotic existence of unique estimators for the bivariate additive model are given. Asymptotic approximations to the bias and the variance of a homoscedastic bivariate additive model with local polynomial terms of odd and even degree are computed. This model is shown to have the same rate of convergence as that of univariate local polynomial regression.

Article information

Source
Ann. Statist., Volume 25, Number 1 (1997), 186-211.

Dates
First available in Project Euclid: 10 October 2002

Permanent link to this document
https://projecteuclid.org/euclid.aos/1034276626

Digital Object Identifier
doi:10.1214/aos/1034276626

Mathematical Reviews number (MathSciNet)
MR1429922

Zentralblatt MATH identifier
0869.62026

Subjects
Primary: 62G07: Density estimation
Secondary: 62H99: None of the above, but in this section

Keywords
Additive model local polynomial regression optimal rates existence backfitting

Citation

Opsomer, Jean D.; Ruppert, David. Fitting a bivariate additive model by local polynomial regression. Ann. Statist. 25 (1997), no. 1, 186--211. doi:10.1214/aos/1034276626. https://projecteuclid.org/euclid.aos/1034276626


Export citation

References

  • Buja, A., Hastie, T. J. and Tibshirani, R. J. (1989). Linear smoothers and additive models. Ann. Statist. 17 453-555.
  • Burman, P. (1990). Estimation of generalized additive models. J. Multivariate Anal. 32 230-255.
  • Chambers, J. M. and Hastie, T. J., eds. (1992). Statistical models in S. Wadsworth and Brooks/Cole, Pacific Grove, CA.
  • Chen, Z. (1993). Fitting multivariate regression functions by interaction spline models. J. Roy. Statist. Soc. Ser. B 55 473-491.
  • Cleveland, W. and Devlin, S. (1988). Locally weighted regression: an approach to regression analysis by local fitting. J. Amer. Statist. Assoc. 83 596-610.
  • Fan, J., Gasser, T., Gijbels, I., Brockmann, M. and Engel, J. (1993). Local poly nomial fitting: a standard for nonparametric regression. Mimeo Series 2302, Institute of Statistics, Univ. North Carolina, Chapel Hill.
  • Fan, J. and Gijbels, I. (1994). Adaptive order poly nomial fitting: bandwidth robustification and bias reduction. Unpublished manuscript.
  • Friedman, J. H. and Stuetzle, W. (1981). Projection pursuit regression. J. Amer. Statist. Assoc. 76 817-823.
  • Gu, C., Bates, D. M., Chen, Z. and Wahba, G. (1989). The computation of gcv functions through householder tridiagonalization with application to the fitting of interaction spline models. SIAM J. Matrix Anal. Appl. 10 457-480.
  • H¨ardle, W., Hall, P. and Marron, J. S. (1988). How far are automatically chosen regression smoothing parameters from their optimum? J. Amer. Statist. Assoc. 83 86-95.
  • H¨ardle, W. and Hall, P. (1993). On the backfitting algorithm for additive regression models. Statist. Neerlandica 47 43-57.
  • Hastie, T. J. and Tibshirani, R. J. (1990). Generalized Additive Models. Chapman and Hall, Washington, DC.
  • Horn, R. A. and Johnson, C. A. (1985). Matrix Analy sis. Cambridge Univ. Press.
  • Linton, O. and Nielsen, J. P. (1995). A kernel method of estimating structured nonparametric regression based on marginal integration. Biometrika 82 93-100.
  • Opsomer, J.-D. (1995). Optimal bandwidth selection for fitting an additive model by local poly nomial regression. Ph.D. dissertation, Cornell Univ.
  • Opsomer, J.-D. and Ruppert, D. (1995). A fully automated bandwidth selection method for fitting additive models. Preprint 95-32, Dept. Statistics, Iowa State Univ.
  • Pollard, D. (1984). Convergence of Stochastic Processes. Springer, New York.
  • Ruppert, D. and Wand, M. P. (1994). Multivariate locally weighted least squares regression. Ann. Statist. 22 1346-1370.
  • Stone, C. J. (1985). Additive regression and other nonparametric models. Ann. Statist. 13 689- 705.
  • Wahba, G. (1986). Partial and interaction splines for the semiparametric estimation of functions of several variables. In Computer Science and Statistics: Proceedings of the 18th Sy mposium on the Interface (T. J. Boardman, ed.) 75-80. Amer. Statist. Assoc., Alexandria, VA.