## Institute of Mathematical Statistics Lecture Notes - Monograph Series

### Parametric Mixture Models for Estimating the Proportion of True Null Hypotheses and Adaptive Control of FDR

#### Abstract

Estimation of the proportion or the number of true null hypotheses is an important problem in multiple testing, especially when the number of hypotheses is large. Wu, Guan and Zhao [Biometrics 62 (2006) 735–744] found that nonparametric approaches are too conservative. We study two parametric mixture models (normal and beta) for the distributions of the test statistics or their p-values to address this problem. The components of the mixture are the null and alternative distributions with mixing proportions π0 and 1−π0, respectively, where π0 is the unknown proportion to be estimated. The normal model assumes that the test statistics from the true null hypotheses are i.i.d. N(0, 1) while those from the alternative hypotheses are i.i.d. N(δ, 1) with δ≠0. The beta model assumes that the p-values from the null hypotheses are i.i.d. U[0, 1] and those from the alternative hypotheses are i.i.d. Beta(a, b) with a<1<b. All parameters are assumed to be unknown. Three methods of estimation of π0 are developed for each model. The methods are compared via simulation with each other and with Storey’s [J. Roy. Statist. Soc. Ser. B 64 (2002) 297–304] nonparametric method in terms of the bias and mean square error of the estimators of π0 and the achieved FDR. Robustness of the estimators to the model violations is also studied by generating data from other models. For the normal model, the parametric methods perform better compared to Storey’s method with the EM method (Dempster, Laird and Rubin [Roy. Statist. Soc. Ser. B 39 (1977) 1–38]) performing best overall when the assumed model holds; however, it is not very robust to significant model violations. For the beta model, the parametric methods do not perform as well because of the difficulties of estimation of parameters, and Storey’s nonparametric method turns out to be the winner in many cases. Therefore the beta model is not recommended for use in practice. An example is given to illustrate the methods.

#### Chapter information

Source
Javier Rojo, ed., Optimality: The Third Erich L. Lehmann Symposium (Beachwood, Ohio, USA: Institute of Mathematical Statistics, 2009), 304-325

Dates
First available in Project Euclid: 3 August 2009

Permanent link to this document
https://projecteuclid.org/euclid.lnms/1249305336

Digital Object Identifier
doi:10.1214/09-LNMS5718

Zentralblatt MATH identifier
1271.62034

Subjects
Primary: 62F10: Point estimation
Secondary: 62F12: Asymptotic properties of estimators

Rights
Copyright © 2009, Institute of Mathematical Statistics

#### Citation

Rojo, Javier. Parametric Mixture Models for Estimating the Proportion of True Null Hypotheses and Adaptive Control of FDR. Optimality, 304--325, Institute of Mathematical Statistics, Beachwood, Ohio, USA, 2009. doi:10.1214/09-LNMS5718. https://projecteuclid.org/euclid.lnms/1249305336