Bernoulli

  • Bernoulli
  • Volume 7, Number 4 (2001), 669-697.

Testing additivity by kernel-based methods - what is a reasonable test?

Holger Dette and Carsten Von Lieres Und Wilkau

Full-text: Open access

Abstract

In the common nonparametric regression model with high-dimensional predictor, several tests for the hypothesis of an additive regression are investigated. The corresponding test statistics are based either on the differences between a fit under the assumption of additivity and a fit in the general model, or on residuals under the assumption of additivity. For all tests asymptotic normality is established under the null hypothesis of additivity and under fixed alternatives with different rates of convergence corresponding to both cases. These results are used for a comparison of the different methods. It is demonstrated that a statistic based on an empirical L2-distance of the Nadaraya-Watson and the marginal integration estimator yields the (asymptotically) most efficient procedure, if these are compared with respect to the asymptotic behaviour under fixed and local alternatives. The finite-sample properties of the proposed procedures are investigated by means of a simulation study, which qualitatively confirms the asymptotic results.

Article information

Source
Bernoulli, Volume 7, Number 4 (2001), 669-697.

Dates
First available in Project Euclid: 17 March 2004

Permanent link to this document
https://projecteuclid.org/euclid.bj/1079559469

Mathematical Reviews number (MathSciNet)
MR2002j:62054

Zentralblatt MATH identifier
1005.62037

Keywords
additive models curse of dimensionality dimension reduction marginal integration estimate test of additivity

Citation

Dette, Holger; Von Lieres Und Wilkau, Carsten. Testing additivity by kernel-based methods - what is a reasonable test?. Bernoulli 7 (2001), no. 4, 669--697. https://projecteuclid.org/euclid.bj/1079559469


Export citation

References

  • [1] Alcalá, J.T., Christóbal, J.A. and González-Manteiga, W. (1999) Goodness-of-fit test for linear models based on local polynomials. Statist. Probab. Lett., 42, 39-46.
  • [2] Andrews, D.W.K. and Whang, Y.-J. (1990) Additive interactive regression models: circumvention of the curse of dimensionality. Econometric Theory, 6, 466-479.
  • [3] Azzalini, A. and Bowman, A. (1993) On the use of nonparametric regression for checking linear relationships. J. Roy. Statist. Soc. Ser. B, 55, 549-557. Abstract can also be found in the ISI/STMA publication
  • [4] Barry, D. (1993) Testing for additivity of a regression function. Ann. Statist., 21, 235-254. Abstract can also be found in the ISI/STMA publication
  • [5] Berger, J.O. and Delampady, M. (1987) Testing precise hypotheses. Statist. Sci., 2, 317-352.
  • [6] Buja, A., Hastie, T. and Tibshirani, R. (1989) Linear smoothers and additive models. Ann. Statist., 17, 453-555. Abstract can also be found in the ISI/STMA publication
  • [7] Dette, H. (1999) A consistent test for the functional form of a regression based on a difference of variance estimators. Ann. Statist., 27, 1012-1040. Abstract can also be found in the ISI/STMA publication
  • [8] Dette, H. and Munk, A. (1998) Validation of linear regression models. Ann. Statist., 26, 778-800. Abstract can also be found in the ISI/STMA publication
  • [9] Eubank, R.L., Hart, J.D., Simpson, D.G. and Stefanski, L.A. (1995) Testing for additivity in nonparametric regression. Ann. Statist., 23, 1896-1920. Abstract can also be found in the ISI/STMA publication
  • [10] Fan, J., Härdle, W. and Mammen, E. (1998) Direct estimation of low-dimensional components in additive models. Ann. Statist., 26, 943-971. Abstract can also be found in the ISI/STMA publication
  • [11] Friedman, J.H. and Stuetzle, W. (1981) Projection pursuit regression. J. Amer. Statist. Assoc., 76, 817-823.
  • [12] González-Manteiga, W. and Cao, R. (1993) Testing the hypothesis of a general linear model using nonparametric regression estimation. Test, 2, 161-188.
  • [13] Gozalo, P.L. and Linton, O.B. (2001) Testing additivity in generalized nonparametric regression models with estimated parameters. J. Econometrics. To appear. Abstract can also be found in the ISI/STMA publication
  • [14] Härdle, W. and Mammen, E. (1993) Comparing nonparametric versus parametric regression fits. Ann. Statist., 21, 1926-1947.
  • [15] Hall, P. (1984) Central limit theorem for integrated square error of multivariate nonparametric density estimators. J. Multivariate Anal., 14, 1-16.
  • [16] Hastie, T.J. and Tibshirani, R.J. (1990) Generalized Additive Models. London: Chapman & Hall.
  • [17] Hengartner, N.W. (1996) Rate optimal estimation of additive regression via the integration method in the presence of many covariates. Preprint, Department of Statistics, Yale University.
  • [18] Hjellvik, V. and Tjøstheim, D. (1995) Nonparametric tests of linearity for time series. Biometrika, 82, 351-368. Abstract can also be found in the ISI/STMA publication
  • [19] Li, K.-C. (1991) Sliced inverse regression for dimension reduction. J. Amer. Statist. Assoc., 86, 316-342. Abstract can also be found in the ISI/STMA publication
  • [20] Linton, O.B. and Nielsen, J.P. (1995) A kernel method of estimating structured nonparametric regression based on marginal integration. Biometrika, 82, 93-100. Abstract can also be found in the ISI/STMA publication
  • [21] Linton, O.B. and Härdle, W. (1996) Estimation of additive regression models with known links. Biometrika, 83, 529-540. Abstract can also be found in the ISI/STMA publication
  • [22] Linton, O.B. (1997) Efficient estimation of additive nonparametric regression models. Biometrika, 84, 469-473. Abstract can also be found in the ISI/STMA publication
  • [23] Linton, O.B. (2000) Efficient estimation of generalized additive nonparametric regression models. Econometric Theory, 16, 502-523. Abstract can also be found in the ISI/STMA publication
  • [24] Mammen, E., Linton, O.B. and Nielsen, J. (1999) The existence and asymptotic properties of a backfitting projection algorithm under weak conditions. Ann. Statist., 27, 1443-1490. Abstract can also be found in the ISI/STMA publication
  • [25] Nadaraya, E.A. (1965) On non-parametric estimates of density functions and regression curves. Theory Probab. Appl., 10, 186-190.
  • [26] Nielsen, J.P. and Linton, O.B. (1998) An optimization interpretation of integration and backfitting estimators for separable nonparametric models. J. Roy. Statist. Soc. Ser. B, 60, 217-222.
  • [27] Opsomer, J.D. and Ruppert, D. (1997) Fitting a bivariate additive model by local polynomial regression. Ann. Statist., 25, 186-211. Abstract can also be found in the ISI/STMA publication
  • [28] Severance-Lossin, E. and Sperlich, S. (1999) Estimation of derivatives for additive separable models. Statistics, 33, 241-265.
  • [29] Silverman, B.W. (1978) Weak and strong uniform consistency of the kernel estimate of a density and its derivatives. Ann. Statist., 6, 177-184.
  • [30] Sperlich, S., Linton, O.B. and Härdle, W. (1999) Integration and backfitting methods in additive models - finite sample properties and comparison. Test, 8, 419-458. Abstract can also be found in the ISI/STMA publication
  • [31] Sperlich, S., Tjøstheim, D. and Yang, L. (1999) Nonparametric estimation and testing of interaction in additive models. Econometric Theory. To appear. Abstract can also be found in the ISI/STMA publication
  • [32] Staudte, R.S. and Sheather, S.J. (1990) Robust Estimation and Testing. New York: Wiley.
  • [33] Stone, C.J. (1985) Additive regression and other nonparametric models. Ann. Statist., 13, 689-705.
  • [34] Tjøstheim, D. (1994) Nonlinear time series: a selective review. Scand. J. Statist., 21, 97-130.
  • [35] Tjøstheim, D. and Auestad, B.H. (1994) Nonparametric identification of nonlinear time series: projections. J. Amer. Statist. Assoc., 89, 1398-1409.
  • [36] Tukey, J. (1949) One degree of freedom for non-additivity. Biometrics, 5, 232-242.
  • [37] Watson, G.S. (1964) Smooth regression analysis. Sankhya, Ser. A, 26, 359-372.
  • [38] Wu, C.F.Y. (1986) Jackknife, bootstrap and other resampling methods in regression analysis. Ann. Statist., 14, 1261-1295.
  • [39] Zheng, J.X. (1996) A consistent test of functional form via nonparametric estimation techniques. J. Econometrics, 75, 263-289. Abstract can also be found in the ISI/STMA publication