## The Annals of Statistics

- Ann. Statist.
- Volume 22, Number 3 (1994), 1142-1160.

### Posterior Predictive $p$-Values

#### Abstract

Extending work of Rubin, this paper explores a Bayesian counterpart of the classical $p$-value, namely, a tail-area probability of a "test statistic" under a null hypothesis. The Bayesian formulation, using posterior predictive replications of the data, allows a "test statistic" to depend on both data and unknown (nuisance) parameters and thus permits a direct measure of the discrepancy between sample and population quantities. The tail-area probability for a "test statistic" is then found under the joint posterior distribution of replicate data and the (nuisance) parameters, both conditional on the null hypothesis. This posterior predictive $p$-value can also be viewed as the posterior mean of a classical $p$-value, averaging over the posterior distribution of (nuisance) parameters under the null hypothesis, and thus it provides one general method for dealing with nuisance parameters. Two classical examples, including the Behrens-Fisher problem, are used to illustrate the posterior predictive $p$-value and some of its interesting properties, which also reveal a new (Bayesian) interpretation for some classical $p$-values. An application to multiple-imputation inference is also presented. A frequency evaluation shows that, in general, if the replication is defined by new (nuisance) parameters and new data, then the Type I frequentist error of an $\alpha$-level posterior predictive test is often close to but less than $\alpha$ and will never exceed $2\alpha$.

#### Article information

**Source**

Ann. Statist., Volume 22, Number 3 (1994), 1142-1160.

**Dates**

First available in Project Euclid: 11 April 2007

**Permanent link to this document**

https://projecteuclid.org/euclid.aos/1176325622

**Digital Object Identifier**

doi:10.1214/aos/1176325622

**Mathematical Reviews number (MathSciNet)**

MR1311969

**Zentralblatt MATH identifier**

0820.62027

**JSTOR**

links.jstor.org

**Subjects**

Primary: 62F03: Hypothesis testing

Secondary: 62A99: None of the above, but in this section

**Keywords**

Bayesian $p$-value Behrens-Fisher problem discrepancy multiple imputation nuisance parameter pivot $p$-value significance level tail-area probability test variable Type I error

#### Citation

Meng, Xiao-Li. Posterior Predictive $p$-Values. Ann. Statist. 22 (1994), no. 3, 1142--1160. doi:10.1214/aos/1176325622. https://projecteuclid.org/euclid.aos/1176325622