The control of the false discovery rate in multiple testing under dependency

Annals of Statistics

Volumn 29, Issue 4, 2001, Pages 1165-1188

  Benjamini, Yoav ^a   Yekutieli, Daniel ^a  

^a TEL AVIV UNIVERSITY   (Israel)

Author keywords

Discrete test statistics; FDR; Hochberg's procedure; MTP2 densities; Multiple comparisons procedures; Multiple endpoints many to one comparisons; Positive regression dependency; Simes' equality; Unidimensional latent variables

Indexed keywords

EID: 0035733108     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/aos/1013699998     Document Type: Article

References (43)

1. ABRAMOVICH, F. and BENJAMINI, Y. (1996). Adaptive thresholding of wavelet coefficients. Comput. Statist. Data Anal. 22 351-361.
2. BARINAGA, M. (1994). From fruit flies, rats, mice: evidence of genetic influence. Science 264 1690-1693.
3. BENJAMINI, Y. and HOCHBERG, Y. (1995). Controlling the false discovery rate: a practical and powerful approach to multiple testing. J. Roy. Statist. Soc. Ser. B 57 289-300.
4. BENJAMINI, Y. and HOCHBERG, Y. (1997). Multiple hypotheses testing with weights. Scand. J. Statist. 24 407-418.
5. BENJAMINI, Y. and HOCHBERG, Y. (2000). The adaptive control of the false discovery rate in multiple hypotheses testing. J. Behav. Educ. Statist. 25 60-83.
6. BENJAMINI, Y., HOCHBERG, Y. and KLING, Y. (1993). False discovery rate control in pairwise comparisons. Working Paper 93-2, Dept. Statistics and O.R., Tel Aviv Univ.
7. BENJAMINI, Y., HOCHBERG, Y. and KLING, Y. (1997). False discovery rate control in multiple hypotheses testing using dependent test statistics. Research Paper 97-1, Dept. Statistics and O.R., Tel Aviv Univ.
8. BENJAMINI, Y. and WEI, L. (1999). A step-down multiple hypotheses testing procedure that controls the false discovery rate under independence. J. Statist. Plann. Inference 82 163-170.
9. CHANG, C. K., ROM, D. M. and SARKAR, S. K. (1996). A modified Bonferroni procedure for repeated significance testing. Technical Report 96-01, Temple Univ.
10. EATON, M. L. (1986). Lectures on topics in probability inequalities. CWI Tract 35.
11. HOCHBERG, Y. (1988). A sharper Bonferroni procedure for multiple tests of significance. Biometrika 75 800-803.
12. HOCHBERG, Y. and HOMMEL, G. (1998). Step-up multiple testing procedures. Encyclopedia Statist. Sci. (Supp.) 2.
13. HOCHBERG, Y. and ROM, D. (1995). Extensions of multiple testing procedures based on Simes' test. J. Statist. Plann. Inference 48 141-152.
14. HOCHBERG, Y. and TAMHANE, A. (1987). Multiple Comparison Procedures. Wiley, New York.
15. HOLLAND, P. W. and ROSENBAUM, P. R. (1986). Conditional association and unidimensionality in monotone latent variable models. Ann. Statist. 14 1523-1543.
16. HOLM, S. (1979). A simple sequentially rejective multiple test procedure. Scand. J. Statist 6 65-70.
17. HOMMEL, G. (1988). A stage-wise rejective multiple test procedure based on a modified Bonferroni test. Biometrika 75 383-386.
18. HSU, J. (1996). Multiple Comparisons Procedures. Chapman and Hall, London.
19. KARLIN, S. and RINOTT, Y. (1980). Classes of orderings of measures and related correlation inequalities I. Multivariate totally positive distributions. J. Multivariate Statist. 10 467-498.
20. KARLIN, S. and RINOTT, Y. (1981). Total positivity properties of absolute value multinormal variable with applications to confidence interval estimates and related probabilistic inequalities. Ann. Statist. 9 1035-1049.
21. LANDER E. S. and BOTSTEIN D. (1989). Mapping Mendelian factors underlying quantitative traits using RFLP linkage maps. Genetics 121 185-190.
22. LANDER, E. S. and KRUGLYAK L. (1995). Genetic dissection of complex traits: guidelines for interpreting and reporting linkage results. Nature Genetics 11 241-247.
23. LEHMANN, E. L. (1966). Some concepts of dependence. Ann. Math. Statist. 37 1137-1153.
24. NEEDLEMAN, H., GUNNOE, C., LEVITON, A., REED, R., PRESIE, H., MAHER, C. and BARRET, P. (1979). Deficits in psychologic and classroom performance of children with elevated dentine lead levels. New England J. Medicine 300 689-695.
25. PATERSON, A. H. G., POWLES, T. J., KANIS, J. A., MCCLOSKEY, E., HANSON, J. and ASHLEY, S. (1993). Double-blind controlled trial of oral clodronate in patients with bone metastases from breast cancer. J. Clinical Oncology 1 59-65.
26. ROSENBAUM, P. R. (1984). Testing the conditional independence and monotonicity assumptions of item response theory. Psychometrika 49 425-436.
27. SARKAR, T. K. (1969). Some lower bounds of reliability. Technical Report, 124, Dept. Operation Research and Statistics, Stanford Univ.
28. 2 random variables: a proof of Simes' conjecture. Ann. Statist. 26 494-504
29. SARKAR, S. K. and CHANG, C. K. (1997). The Simes method for multiple hypotheses testing with positively dependent test statistics. J. Amer. Statist. Assoc. 92 1601-1608.
30. SEEGER, (1968). A note on a method for the analysis of significances en mass. Technometrics 10 586-593.
31. SEN, P. K. (1999a). Some remarks on Simes-type multiple tests of significance. J. Statist. Plann. Inference, 82 139-145.
32. SEN, P. K. (1999b). Multiple comparisons in interim analysis. J. Statist. Plann. Inference 82 5-23.
33. SHAFFER, J. P. (1995). Multiple hypotheses-testing. Ann. Rev. Psychol 46 561-584.
34. SIMES, R. J. (1986). An improved Bonferroni procedure for multiple tests of significance. Biometrika 73 751-754.
35. STEEL, R. G. D. and TORRIE, J. H. (1980). Principles and Procedures of Statistics: A Biometrical Approach, 2nd ed. McGraw-Hill, New York.
36. TAMHANE, A. C. (1996). Multiple comparisons. In Handbook of Statistics (S. Ghosh and C. R. Rao, eds.) 13 587-629. North-Holland, Amsterdam.
37. TAMHANE, A. C. and DUNNETT, C. W. (1999). Stepwise multiple test procedures with biometric applications. J. Statist. Plann. Inference 82 55-68.
38. TROENDLE, J. (2000). Stepwise normal theory tests procedures controlling the false discovery rate. J. Statist. Plann. Inference 84 139-158.
39. WASSMER, G., REITMER, P., KIESER, M. and LEHMACHER, W. (1999). Procedures for testing multiple endpoints in clinical trials: an overview. J. Statist. Plann. Inference 82 69-81.
40. WELLER, J. I., SONG, J. Z., HEYEN, D. W., LEWIN, H. A. and RON, M. (1998). A new approach to the problem of multiple comparison in the genetic dissection of complex traits. Genetics 150 1699-1706.
41. WESTFALL, P. H. and YOUNG, S. S. (1993). Resampling Based Multiple Testing, Wiley, New York.
42. WILLIAMS, V. S. L., JONES, L. V. and TUKEY, J. W. (1999). Controlling error in multiple comparisons, with special attention to the National Assessment of Educational Progress. J. Behav. Educ. Statist. 24 42-69.
43. YEKUTIELI, D. and BENJAMINI, Y. (1999). A resampling based false discovery rate controlling multiple test procedure. J. Statist. Plann. Inference 82 171-196.