Resampling-based empirical Bayes multiple testing procedures for controlling generalized tail probability and expected value error rates: Focus on the false discovery rate and simulation study

Biometrical Journal

Volumn 50, Issue 5, 2008, Pages 716-744

  Dudoit, Sandrine ^a   Gilbert, Houston N ^a   Van Der Laan, Mark J ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Adaptive; Adjusted p value; Alternative hypothesis; Bootstrap; Correlation; Cut off; Empirical Bayes; False discovery rate; Generalized expected value error rate; Generalized tail probability error rate; Joint distribution; Linear step up procedure

Indexed keywords

ECONOMIC AND SOCIAL EFFECTS; ERROR ANALYSIS; ERROR STATISTICS; PROBABILITY DISTRIBUTIONS;

ADAPTIVE; ADJUSTED P-VALUES; ALTERNATIVE HYPOTHESIS; BOOTSTRAP; CORRELATION; CUT-OFF; EMPIRICAL BAYES; ERROR RATE; EXPECTED VALUES; FALSE DISCOVERY RATE; GENERALIZED EXPECTED VALUE ERROR RATE; GENERALIZED TAIL PROBABILITY ERROR RATE; JOINT DISTRIBUTIONS; LINEAR STEP-UP PROCEDURE; PROBABILITY ERRORS; TAIL PROBABILITY;

STATISTICAL TESTS;

EID: 54549110274     PISSN: 03233847     EISSN: 15214036     Source Type: Journal    
DOI: 10.1002/bimj.200710473     Document Type: Article

References (23)

1. Benjamini, Y. and Hochberg, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society, Series B 57, 289-300.
2. Benjamini, Y. and Hochberg, Y. (2000). On the adaptive control of the false discovery rate in multiple testing with independent statistics. Journal of Educational and Behavioral Statistics 25, 60-83.
3. Benjamini, Y., Krieger, A. M., and Yekutieli, D. (2006). Adaptive linear step-up false discovery rate controlling procedures. Biometrika 93, 491-507.
4. Benjamini, Y. and Yekutieli, D. (2001). The control of the false discovery rate in multiple testing under dependency. Annals of Statistics 29, 1165-1188.
5. Birkner, M. D., Pollard, K. S., van der Laan, M. J., and Dudoit, S. (2005). Multiple testing procedures and applications to genomics. Technical Report 168, Division of Biostatistics, University of California, Berkeley, Berkeley, CA 94720-7360.
6. Dudoit, S. and van der Laan, M. J. (2008). Multiple Testing Procedures with Applications to Genomics. Springer Series in Statistics. Springer, New York.
7. Dudoit, S., van der Laan, M. J., and Birkner, M. D. (2004a). Multiple testing procedures for controlling tail probability error rates. Technical Report 166, Division of Biostatistics, University of California, Berkeley, Berkeley, CA 94720-7360.
8. Dudoit, S., van der Laan, M. J., and Pollard, K. S. (2004b). Multiple testing. Part I. Single-step procedures for control of general Type I error rates. Statistical Applications in Genetics and Molecular Biology 3, Article 13.
9. Efron, B., Tibshirani, R., Storey, J. D., and Tusher, V. (2001). Empirical Bayes analysis of a microarray experiment. Journal of the American Statistical Association 96, 1151-1160.
10. Genovese, C. R. and Wasserman, L. (2004a). Exceedance control of the false discovery proportion. Technical Report 807, Department of Statistics, Carnegie Mellon University, Pittsburgh, PA 15213.
11. Genovese, C. R. and Wasserman, L. (2004b). A stochastic process approach to false discovery control. Annals of Statistics 32, 1035-1061.
12. Golub, T. R., Slonim, D. K., Tamayo, P., Huard, C., Gaasenbeek, M., Mesirov, J. P., Coller, H., Loh, M., Downing, J. R., Caligiuri, M. A., Bloomfield, C. D., and Lander, E. S. (1999). Molecular classification of cancer: Class discovery and class prediction by gene expression monitoring. Science 286, 531-537.
13. Lehmann, E. L. and Romano, J. P. (2005). Generalizations of the familywise error rate. Annals of Statistics 33, 1138-1154.
14. Pollard, K. S., Birkner, M. D., van der Laan, M. J., and Dudoit, S. (2005a). Test statistics null distributions in multiple testing: Simulation studies and applications to genomics. Journal de la Société Française de Statistique 146, 77-115. Numéro double spécial Statistique et Biopuces.
15. Pollard, K. S., Dudoit, S., and van der Laan, M. J. (2005b). Multiple testing procedures: The multtest package and applications to genomics. In Gentleman, R. C., Carey, V. J., Huber, W., Irizarry, R. A., and Dudoit, S., editors, Bioinformatics and Computational Biology Solutions Using R and Bioconductor, chapter 15, pages 249-271. Springer, New York.
16. Pollard, K. S. and van der Laan, M. J. (2004). Choice of a null distribution in resampling-based multiple testing. Journal of Statistical Planning and Inference 125, 85-100.
17. Storey, J. D. (2002). A direct approach to false discovery rates. Journal of the Royal Statistical Society, Series B 64, 479-498.
18. Storey, J. D., Taylor, J. E., and Siegmund, D. O. (2004). Strong control, conservative point estimation and simultaneous conservative consistency of false discovery rates: A unified approach. Journal of the Royal Statistical Society, Series B 66, 187-205.
19. Storey, J. D. and Tibshirani, R. (2003). Statistical significance for genomewide studies. Proceedings of the National Academy of Sciences 100, 9440-9445.
20. van der Laan, M. J., Birkner, M. D., and Hubbard, A. E. (2005). Empirical Bayes and resampling based multiple testing procedure controlling tail probability of the proportion of false positives. Statistical Applications in Genetics and Molecular Biology 4, Article 29.
21. van der Laan, M. J., Dudoit, S., and Pollard, K. S. (2004a). Augmentation procedures for control of the generalized family-wise error rate and tail probabilities for the proportion of false positives. Statistical Applications in Genetics and Molecular Biology 3, Article 15.
22. van der Laan, M. J., Dudoit, S., and Pollard, K. S. (2004b). Multiple testing. Part II. Step-down procedures for control of the family-wise error rate. Statistical Applications in Genetics and Molecular Biology 3, Article 14.
23. van der Laan, M. J. and Hubbard, A. E. (2006). Quantile-function based null distribution in resampling based multiple testing. Statistical Applications in Genetics and Molecular Biology 5, Article 14.