Open Access
August 2007 On the performance of FDR control: Constraints and a partial solution
Zhiyi Chi
Ann. Statist. 35(4): 1409-1431 (August 2007). DOI: 10.1214/009053607000000037


The False Discovery Rate (FDR) paradigm aims to attain certain control on Type I errors with relatively high power for multiple hypothesis testing. The Benjamini–Hochberg (BH) procedure is a well-known FDR controlling procedure. Under a random effects model, we show that, in general, unlike the FDR, the positive FDR (pFDR) of the BH procedure cannot be controlled at an arbitrarily low level due to the limited evidence provided by the observations to separate false and true nulls. This results in a criticality phenomenon, which is characterized by a transition of the procedure’s power from being positive to asymptotically 0 without any reduction in the pFDR, once the target FDR control level is below a positive critical value. To address the constraints on the power and pFDR control imposed by the criticality phenomenon, we propose a procedure which applies BH-type procedures at multiple locations in the domain of $p$-values. Both analysis and simulations show that the proposed procedure can attain substantially improved power and pFDR control.


Download Citation

Zhiyi Chi. "On the performance of FDR control: Constraints and a partial solution." Ann. Statist. 35 (4) 1409 - 1431, August 2007.


Published: August 2007
First available in Project Euclid: 29 August 2007

zbMATH: 1125.62075
MathSciNet: MR2351091
Digital Object Identifier: 10.1214/009053607000000037

Primary: 62G10 , 62H15
Secondary: 60G35

Keywords: Bahadur representation , Benjamini–Hochberg , FDR , multiple hypothesis testing , pFDR , power

Rights: Copyright © 2007 Institute of Mathematical Statistics

Vol.35 • No. 4 • August 2007
Back to Top