Control of generalized error rates in multiple testing

Annals of Statistics

Volumn 35, Issue 4, 2007, Pages 1378-1408

  Romano, Joseph P ^a   Wolf, Michael ^b  

^a STANFORD UNIVERSITY   (United States)

^b UNIVERSITY OF ZURICH   (Switzerland)

Author keywords

Bootstrap; False discovery proportion; False discovery rate; Generalized familywise error rate; Multiple testing; Step down procedure

Indexed keywords

EID: 39749098114     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/009053606000001622     Document Type: Article

References (35)

1. BENJAMINI, Y. and HOCHBERG, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. J. Roy. Statist. Soc. Ser. B 57 289-300.
2. BENJAMINI, Y. and YEKUTIELI, D. (2001). The control of the false discovery rate in multiple testing under dependency. Ann. Statist. 29 1165-1188.
3. BERAN, R. (1984). Bootstrap methods in statistics. Jahresber. Deutsch. Math.-Verein. 86 14-30.
4. BERAN, R. (1986). Simulated power functions. Ann. Statist. 14 151-173.
5. BERAN, R. (1988). Balanced simultaneous confidence sets. J. Amer. Statist. Assoc. 83 679-686.
6. BERAN, R. (1988). Prepivoting test statistics: A bootstrap view of asymptotic refinements. J. Amer. Statist. Assoc. 83 687-697.
7. DAVISON, A. C. and HINKLEY, D. V. (1997). Bootstrap Methods and Their Application. Cambridge Univ. Press.
8. DUDOIT, S., VAN DER LAAN, M. J. and BIRKNER, M. D. (2004). Multiple testing procedures for controlling tail probability error rates. Working Paper 166, Div. Biostatics, Univ. California, Berkeley. Available at www.bepress.com/ucbbiostat/paper166.
9. DUDOIT, S., VAN DER LAAN, M. J. and POLLARD, K. S. (2004). Multiple testing. I. Single-step procedures for the control of general type I error rates. Stat. Appl. Genet. Mol. Biol. 3 article 13. Available at www.bepress.com/sagmb/vol3/iss1/art13.
10. GENOVESE, C. R. and WASSERMAN, L. (2004). A stochastic process approach to false discovery control. Ann. Statist. 32 1035-1061.
11. HALL, P. (1992). The Bootstrap and Edgeworth Expansion. Springer, New York.
12. HALL, P. and WILSON, S. (1991). Two guidelines for bootstrap hypothesis testing. Biometrics 47 757-762.
13. HOLM, S. (1979). A simple sequentially rejective multiple test procedure. Scand. J. Statist. 6 65-70.
14. HOMMEL, G. and HOFFMAN, T. (1988). Controlled uncertainty. In Multiple Hypothesis Testing (P. Bauer, G. Hommel and E. Sonnemann, eds.) 154-161. Springer, Heidelberg.
15. KORN, E. L., TROENDLE, J. F., MCSHANE, L. M. and SIMON, R. (2004). Controlling the number of false discoveries: Application to high-dimensional genomic data. J. Statist. Plann. Inference 124 379-398.
16. LAHIRI, S. N. (2003). Resampling Methods for Dependent Data. Springer, New York.
17. LEHMANN, E. L. and ROMANO, J. P. (2005). Generalizations of the familywise error rate. Ann. Statist. 33 1138-1154.
18. LEHMANN, E. L. and ROMANO, J. P. (2005). Testing Statistical Hypotheses, 3rd ed. Springer, New York.
19. LEHMANN, E. L., ROMANO, J. P. and SHAFFER, J. P. (2005). On optimality of stepdown and stepup multiple test procedures. Ann. Statist. 33 1084-1108.
20. PERONE PACIFICO, M., GENOVESE, C. R., VERDINELLI, I. and WASSERMAN, L. (2004). False discovery control for random fields. J. Amer. Statist. Assoc. 99 1002-1014.
21. POLITIS, D. N., ROMANO, J. P. and WOLF, M. (1999). Subsampling. Springer, New York.
22. POLLARD, K. S. and VAN DER LAAN, M. J. (2003). Multiple testing for gene expression data: An investigation of null distributions with consequences for the permutation test. In Proc. 2003 International Multi-Conference in Computer Science and Engineering, METMBS'03 Conference 3-9.
23. ROGERS, J. and HSU, J. (2001). Multiple comparisons of biodiversity. Biom. J. 43 617-625.
24. ROMANO, J. P. (1988). A bootstrap revival of some nonparametric distance tests. J. Amer. Statist. Assoc. 83 698-708.
25. ROMANO, J. P. and SHAIKH, A. M. (2006). On stepdown control of the false discovery proportion. In Optimality: The Second Erich L. Lehmann Symposium (J. Rojo, ed.) 33-50. IMS, Beachwood, OH.
26. ROMANO, J. P. and SHAIKH, A. M. (2006). Stepup procedures for control of generalizations of the familywise error rate. Ann. Statist. 34 1850-1873.
27. ROMANO, J. P. and WOLF, M. (2005). Control of generalized error rates in multiple testing. Working Paper 245, IEW, Univ. Zurich. Available at www.iew.unizh.ch/wp/index.php.
28. ROMANO, J. P. and WOLF, M. (2005). Exact and approximate step-down methods for multiple hypothesis testing. J. Amer. Statist. Assoc. 100 94-108.
29. ROMANO, J. P. and WOLF, M. (2005). Stepwise multiple testing as formalized data snooping. Econometrica 73 1237-1282.
30. SARKAR, S. K. (2002). Some results on false discovery rate in stepwise multiple testing procedures. Ann. Statist. 30 239-257.
31. SHAO, J. and TU, D. (1995). The Jackknife and Bootstrap. Springer, New York.
32. TU, W. and ZHOU, X. (2000). Pairwise comparisons of the means of skewed data. J. Statist. Plann. Inference 88 59-74.
33. VAN DER LAAN, M. J., BIRKNER, M. D. and HUBBARD, A. E. (2005). Empirical Bayes and resampling based multiple testing procedure controlling tail probability of the proportion of false positives. Stat. Appl. Genet. Mol. Biol. 4 article 29. Available at www.bepress.com/sagmb/vol4/iss1/art29.
34. VAN DER LAAN, M. J., DUDOIT, S. and POLLARD, K. S. (2004). Augmentation procedures for control of the generalized family-wise error rate and tail probabilities for the proportion of false positives. Stat. Appl. Genet. Mol. Biol. 3 article 15. Available at www.bepress.com/sagmb/vol3/iss1/art15.
35. WESTFALL, P. H. and YOUNG, S. S. (1993). Resampling-Based Multiple Testing: Examples and Methods for P-Value Adjustment. Wiley, New York.