The Annals of Statistics

Default priors for Gaussian processes

Rui Paulo

Full-text: Open access

Enhanced PDF (264 KB)

Abstract

Motivated by the statistical evaluation of complex computer models, we deal with the issue of objective prior specification for the parameters of Gaussian processes. In particular, we derive the Jeffreys-rule, independence Jeffreys and reference priors for this situation, and prove that the resulting posterior distributions are proper under a quite general set of conditions. A proper flat prior strategy, based on maximum likelihood estimates, is also considered, and all priors are then compared on the grounds of the frequentist properties of the ensuing Bayesian procedures. Computational issues are also addressed in the paper, and we illustrate the proposed solutions by means of an example taken from the field of complex computer model validation.

Article information

Source
Ann. Statist., Volume 33, Number 2 (2005), 556-582.

Dates
First available in Project Euclid: 26 May 2005

Permanent link to this document
https://projecteuclid.org/euclid.aos/1117114329

Digital Object Identifier
doi:10.1214/009053604000001264

Mathematical Reviews number (MathSciNet)
MR2163152

Zentralblatt MATH identifier
1069.62030

Subjects
Primary: 62F15: Bayesian inference
Secondary: 62M30: Spatial processes 60G15: Gaussian processes

Keywords
Gaussian process Jeffreys prior reference prior integrated likelihood frequentist coverage posterior propriety computer model

Citation

Paulo, Rui. Default priors for Gaussian processes. Ann. Statist. 33 (2005), no. 2, 556--582. doi:10.1214/009053604000001264. https://projecteuclid.org/euclid.aos/1117114329


Export citation

References

  • Bayarri, M. J., Berger, J. O., Higdon, D., Kennedy, M. C., Kottas, A., Paulo, R., Sacks, J., Cafeo, J. A., Cavendish, J., Lin, C. H. and Tu, J. (2002). A framework for validation of computer models. Technical Report 128, National Institute of Statistical Sciences.
  • Berger, J. O. and Bernardo, J. M. (1992). On the development of reference priors (with discussion). In Bayesian Statistics 4 (J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith, eds.) 35–60. Oxford Univ. Press.
  • Berger, J. O., De Oliveira, V. and Sansó, B. (2001). Objective Bayesian analysis of spatially correlated data. J. Amer. Statist. Assoc. 96 1361–1374.
  • Bernardo, J. M. (1979). Reference posterior distributions for Bayesian inference (with discussion). J. Roy. Statist. Soc. Ser. B 41 113–147.
    Zentralblatt MATH: 0428.62004
    Digital Object Identifier: doi:10.1111/j.2517-6161.1979.tb01066.x
  • Cressie, N. A. C. (1993). Statistics for Spatial Data, revised ed. Wiley, New York.
    Zentralblatt MATH: 1347.62005
  • Fuentes, M. (2003). Testing for separability of spatio-temporal covariance functions. Technical Report 2545, Dept. Statistics, North Carolina State Univ.
  • Gelman, A., Carlin, J. B., Stern, H. S. and Rubin, D. B. (1995). Bayesian Data Analysis. Chapman and Hall, London.
    Zentralblatt MATH: 1279.62004
  • Harville, D. A. (1974). Bayesian inference for variance components using only error contrasts. Biometrika 61 383–385.
    Zentralblatt MATH: 0281.62072
    Digital Object Identifier: doi:10.1093/biomet/61.2.383
  • Harville, D. A. (1997). Matrix Algebra from a Statistician's Perspective. Springer, Berlin.
    Mathematical Reviews (MathSciNet): MR1467237
    Zentralblatt MATH: 0881.15001
  • Kass, R. and Wasserman, L. (1996). The selection of prior distributions by formal rules. J. Amer. Statist. Assoc. 91 1343–1370.
    Zentralblatt MATH: 0884.62007
    Digital Object Identifier: doi:10.1080/01621459.1996.10477003
  • Kennedy, M. C. and O'Hagan, A. (2000). Predicting the output from a complex computer code when fast approximations are available. Biometrika 87 1–13.
  • Kennedy, M. C. and O'Hagan, A. (2001). Bayesian calibration of computer models. J. R. Stat. Soc. Ser. B Stat. Methodol. 63 425–464.
  • Sacks, J., Welch, W. J., Mitchell, T. J. and Wynn, H. P. (1989). Design and analysis of computer experiments (with discussion). Statist. Sci. 4 409–435.
    Zentralblatt MATH: 0955.62619
    Digital Object Identifier: doi:10.1214/ss/1177012413
    Project Euclid: euclid.ss/1177012413
  • Short, M. and Carlin, B. (2003). Multivariate spatiotemporal CDFs with measurement error. Technical Report 2003-015, Division of Biostatistics, Univ. Minnesota.
    Zentralblatt MATH: 1331.62447
    Digital Object Identifier: doi:10.1214/06-BA120
  • Tong, Y. L. (1990). The Multivariate Normal Distribution. Springer, Berlin.
    Zentralblatt MATH: 0689.62036

The Institute of Mathematical Statistics

The Annals of Statistics

New content alerts

Email RSS ToC RSS Article
  • You have access to this content.
  • You have partial access to this content.
  • You do not have access to this content.
Turn Off MathJax

What is MathJax?

More like this

+ See more