The Annals of Statistics

A Comparison of Generalized Cross Validation and Modified Maximum Likelihood for Estimating the Parameters of a Stochastic Process

Michael L. Stein

Full-text: Open access

Abstract

Wahba compared the performance of generalized cross validation (GCV) and modified maximum likelihood (MML) procedures for choosing the smoothing parameter of a smoothing spline. This work makes a more careful study of the two procedures when the stochastic model motivating the modified maximum likelihood estimate is correct. In particular, it is shown that in the case of the linear smoothing spline with equally spaced observations, both estimates are asymptotically normal with the GCV estimate having twice the asymptotic variance of the MML estimate. The impact of using these estimates on the subsequent predictions is also calculated. Conjectures on how these results should generalize to higher order smoothing splines are developed. These conjectures suggest that the penalty for using GCV instead of MML when the stochastic model is correct is greater for higher order smoothing splines, both in terms of the efficiency in estimating the smoothing parameter and the impact on subsequent predictions.

Article information

Source
Ann. Statist., Volume 18, Number 3 (1990), 1139-1157.

Dates
First available in Project Euclid: 12 April 2007

Permanent link to this document
https://projecteuclid.org/euclid.aos/1176347743

Digital Object Identifier
doi:10.1214/aos/1176347743

Mathematical Reviews number (MathSciNet)
MR1062702

Zentralblatt MATH identifier
0734.62091

JSTOR
links.jstor.org

Subjects
Primary: 62M20: Prediction [See also 60G25]; filtering [See also 60G35, 93E10, 93E11]
Secondary: 60G15: Gaussian processes 62G05: Estimation

Keywords
Brownian motion spline smoothing kriging

Citation

Stein, Michael L. A Comparison of Generalized Cross Validation and Modified Maximum Likelihood for Estimating the Parameters of a Stochastic Process. Ann. Statist. 18 (1990), no. 3, 1139--1157. doi:10.1214/aos/1176347743. https://projecteuclid.org/euclid.aos/1176347743


Export citation