The Annals of Statistics

Model checks for regression: an innovation process approach

Winfried Stute, Silke Thies, and Li-Xing Zhu

Full-text: Open access

PDF File (144 KB)

Abstract

In the context of regression analysis it is known that the residual cusum process may serve as a basis for the construction of various omnibus, smooth and directional goodness-of-fit tests. Since a deeper analysis requires the decomposition of the cusums into their principal components and this is difficult to obtain, we propose to replace this process by its innovation martingale. It turns out that the resulting tests are (asymptotically) distribution free under composite null models and may be readily performed. A simulation study is included which indicates that the distributional approximations already work for small to moderate sample sizes.

Article information

Source
Ann. Statist., Volume 26, Number 5 (1998), 1916-1934.

Dates
First available in Project Euclid: 21 June 2002

Permanent link to this document
https://projecteuclid.org/euclid.aos/1024691363

Digital Object Identifier
doi:10.1214/aos/1024691363

Mathematical Reviews number (MathSciNet)
MR1673284

Zentralblatt MATH identifier
0930.62044

Subjects
Primary: 62G30 60G44
Secondary: 62G10: Hypothesis testing

Keywords
Residual cusum process innovation process goodness-of-fit tests

Citation

Stute, Winfried; Thies, Silke; Zhu, Li-Xing. Model checks for regression: an innovation process approach. Ann. Statist. 26 (1998), no. 5, 1916--1934. doi:10.1214/aos/1024691363. https://projecteuclid.org/euclid.aos/1024691363


Export citation

References

  • Chang, N. M. (1990). Weak convergence of a self-consistent estimator of a survival function with doubly censored data. Ann. Statist. 18 391-404.
    Zentralblatt MATH: 0706.62044
    Mathematical Reviews (MathSciNet): MR1041399
    Project Euclid: euclid.aos/1176347506
  • Devroy e, L. P. and Wagner, T. J. (1980). Distribution-free consistency results in nonparametric discrimination and regression function estimation. Ann. Statist. 8 231-239.
    Mathematical Reviews (MathSciNet): MR81k:62051
    Zentralblatt MATH: 0431.62025
    Project Euclid: euclid.aos/1176344949
  • Durbin, J. (1973). Weak convergence of the sample distribution function when parameters are estimated. Ann. Statist. 1 279-290.
    Mathematical Reviews (MathSciNet): MR50:11586
    Zentralblatt MATH: 0256.62021
    Project Euclid: euclid.aos/1176342365
  • Khmaladze, E. V. (1981). Martingale approach in the theory of goodness-of-fit tests. Theory Probab. Appl. 26 240-257.
    Mathematical Reviews (MathSciNet): MR83m:62041
    Zentralblatt MATH: 0454.60049
  • Khmaladze, E. V. (1988). An innovation approach to goodness-of-fit tests in Rm. Ann. Statist. 16 1503-1516.
    Mathematical Reviews (MathSciNet): MR964936
    Zentralblatt MATH: 0671.62048
    Project Euclid: euclid.aos/1176351051
  • Maronna, R. A. and Yohai, V. J. (1981). Asy mptotic behavior of general M-estimates for regression and scale with random carriers. Z. Wahrsch. Verw. Gebiete 58 7-20.
    Mathematical Reviews (MathSciNet): MR635268
  • Pollard, D. (1984). Convergence of Stochastic Processes. Springer, New York.
    Mathematical Reviews (MathSciNet): MR86i:60074
    Zentralblatt MATH: 0544.60045
  • Shorack, G. R. and Wellner, J. A. (1986). Empirical Processes with Applications to Statistics. Wiley, New York.
    Mathematical Reviews (MathSciNet): MR88e:60002
  • Spiegelman, C. and Sacks, J. (1980). Consistent window estimation in nonparametric regression. Ann. Statist. 8 240-246.
    Mathematical Reviews (MathSciNet): MR81f:62070
    Zentralblatt MATH: 0432.62066
    Project Euclid: euclid.aos/1176344950
  • Stone, C. (1977). Consistent nonparametric regression. Ann. Statist. 5 595-620.
    Mathematical Reviews (MathSciNet): MR56:1574
    Zentralblatt MATH: 0366.62051
    Project Euclid: euclid.aos/1176343886
  • Stute, W. (1994). Universally consistent conditional U-statistics. Ann. Statist. 22 460-473.
    Mathematical Reviews (MathSciNet): MR96c:62099
    Zentralblatt MATH: 0818.62049
    Project Euclid: euclid.aos/1176325378
  • Stute, W. (1997). Nonparametric model checks for regression. Ann. Statist. 25 613-641.
    Mathematical Reviews (MathSciNet): MR99f:62066
    Zentralblatt MATH: 0926.62035
    Project Euclid: euclid.aos/1031833666
  • Stute, W. and Gonz´alez Manteiga, W. (1990). Nearest neighbor smoothing in linear regression. J. Multivariate Anal. 34 61-74.
    Mathematical Reviews (MathSciNet): MR91i:62089
    Zentralblatt MATH: 0699.62068
  • Stute, W., Gonz´alez Manteiga, W. and Presedo Quindimil, M. (1998). Bootstrap approximations in model checks for regression. J. Amer. Statist. Assoc. 93 141-149.
    Mathematical Reviews (MathSciNet): MR99e:62070
    Zentralblatt MATH: 0902.62027
    JSTOR: links.jstor.org

The Institute of Mathematical Statistics

The Annals of Statistics

New content alerts

Email RSS ToC RSS Article
  • You have access to this content.
  • You have partial access to this content.
  • You do not have access to this content.
Turn Off MathJax

What is MathJax?

More like this

+ See more