Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Yoav Benjamini, Yosef Hochberg · Journal of the Royal Statistical Society Series B (Statistical Methodology) · 1995
SUMMARY The common approach to the multiplicity problem calls for controlling the familywise error rate (FWER). This approach, though, has faults, and we point out a few. A different approach to problems of multiple significance testing is presented. It calls for controlling the expected proportion of falsely rejected hypotheses — the false discovery rate. This error rate is equivalent to the FWER when all hypotheses are true but is smaller otherwise. Therefore, in problems where the control of the false discovery rate rather than that of the FWER is desired, there is potential for a gain in power. A simple sequential Bonferronitype procedure is proved to control the false discovery rate for independent test statistics, and a simulation study shows that the gain in power is substantial. The use of the new procedure and the appropriateness of the criterion are illustrated with examples.
Cited by 108,168 works. doi:10.1111/j.2517-6161.1995.tb02031.x
Authors
References
- A Simple Sequentially Rejective Multiple Test Procedure
- A Sharper Bonferroni Procedure for Multiple Tests of Significance
- Multiple Comparison Procedures
- An Improved Bonferroni Procedure for Multiple Tests of Significance
- Statistical Problems in the Reporting of Clinical Trials
- A Stagewise Rejective Multiple Test Procedure Based on a Modified Bonferroni Test
- Multiple Comparison Procedures
- Comparing the Means of Several Groups
- More powerful procedures for multiple significance testing
- Multiple Comparison Procedures: The Practical Solution