Discovering the false discovery rate

Journal of the Royal Statistical Society. Series B: Statistical Methodology

Volumn 72, Issue 4, 2010, Pages 405-416

  Benjamini, Yoav ^a  

^a TEL AVIV UNIVERSITY   (Israel)

Author keywords

'Testimation'; False coverage rate; Multiple comparisons

Indexed keywords

EID: 78650405375     PISSN: 13697412     EISSN: 14679868     Source Type: Journal    
DOI: 10.1111/j.1467-9868.2010.00746.x     Document Type: Article

References (55)

1. Abramovich, F. and Benjamini, Y. (1996) Adaptive thresholding of wavelet coefficients. Computnl Statist. Data Anal., 22, 351-361.
2. Abramovich, F., Benjamini, Y., Donoho, D. and Johnstone, I. M. (2006) Adapting to unknown sparsity by controlling the false discovery rate. Ann. Statist., 34, 584-653.
3. Benjamini, Y. (2010) Simultaneous and selective inference: current successes and future challenges. Biometr. J., to be published.
4. Benjamini, Y. and Gavrilov, Y. (2009) A simple forward selection procedure based on false discovery rate control. Ann. Appl. Statist., 3, 179-198.
5. Benjamini, Y., Heller, R. and Yekutieli, Y. (2009) Selective inference in complex research. Phil. Trans. R. Soc. Lond. A, 367, 4255-4271.
6. Benjamini, Y. and Hochberg, Y. (1995) Controlling the false discovery rate: a practical and powerful approach to multiple testing. J. R. Statist. Soc. B, 57, 289-300.
7. Benjamini, Y. and Hochberg, Y. (2000) On the adaptive control of the false discovery rate in multiple testing with independent statistics. J. Educ. Behav. Statist., 25, 60-83.
8. Benjamini, Y., Krieger, M. A. and Yekutieli, D. (2006) Adaptive linear step-up procedures that control the false discovery rate. Biometrika, 93, 491-507.
9. Benjamini, Y. and Yekutieli, Y. (2001) The control of the False Discovery Rate in multiple testing under dependency. Ann. Statist., 29, 1165-1188.
10. Benjamini, Y. and Yekutieli, Y. (2005) False discovery rate controlling confidence intervals for selected parameters. J. Am. Statist. Ass., 100, 71-80.
11. Blanchard, G. and Roquain, E. (2009) Adaptive FDR control under independence and dependence. J. Mach. Learn. Res., 10, 2837-2871.
12. Donoho, D. and Jin, J. S. (2004) Higher criticism for detecting sparse heterogeneous mixtures. Ann. Statist., 32, 962-994.
13. Donoho, D. and Jin, J. (2006) Asymptotic minimaxity of false discovery rate thresholding for sparse exponential data. Ann. Statist., 34, 2980-3018.
14. Efron, B. (2008) Microarrays, empirical Bayes and the two groups model. Statist. Sci., 23, 1-22.
15. Gavrilov, Y., Benjamini, Y. and Sarkar, S. (2009) An adaptive step-down procedure with proven FDR control under independence. Ann. Statist., 37, 619-629.
16. Genovese, C. and Wasserman, L. (2002) Operating characteristics and extensions of the false discovery rate procedure. J. R. Statist. Soc. B, 64, 499-517.
17. Hochberg, Y. and Benjamini, Y. (1990) More powerful procedures for multiple significance testing. Statist. Med., 9, 811-818.
18. Van Der Laan, M. J. and Dudoit, S. (2007) Multiple Testing Procedures with Applications to Genomics. New York: Springer.
19. Reiner-Benaim, A. (2007) FDR control by the BH procedure for two-sided correlated tests with implications to gene expression data analysis. Biometr. J., 49, 107-126.
20. Sarkar, S. K. (1998) Some probability inequalities for ordered MTP2 random variables: a proof of Sime's conjecture. Ann. Statist., 26, 494-504.
21. Schweder, T. and Spjøtvoll, E. (1982) Plots of p-values to evaluate many tests simultaneously. Biometrika, 69, 493-502.
22. Soriç, B. (1989) Statistical ''discoveries'' and effect size estimation. J. Am. Statist. Ass., 84, 608-610.
23. Storey, J. D. (2002) A direct approach to false discovery rates. J. R. Statist. Soc. B, 64, 479-498.
24. Storey, J. D., Taylor, J. E. and Siegmund, D. (2004) Strong control, conservative point estimation and simultaneous conservative consistency of false discovery rates: a unified approach. J. R. Statist. Soc. B, 66, 187-205.
25. Storey, J. D. and Tibshirani, R. J. (2003) Statistical significance for genome-wide experiments. Proc. Natn. Acad. Sci. USA, 100, 9440-9445.
26. Yekutieli, D. (2010) Adjusted Bayesian inference for selected parameters. Preprint arXiv: 0801.0499v4.
27. Yekutieli, D. and Benjamini, Y. (1999) Resampling based False Discovery Rate controlling procedure for dependent test statistics. J. Statist. Planng Inf., 82, 171-196.
28. Benjamini, Y. and Heller, R. (2007) False discovery rates for spatial signals. J. Am. Statist. Ass., 102, 1272-1281.
29. Benjamini, Y. and Hochberg, Y. (1995) Controlling the false discovery rate: a practical and powerful approach to multiple testing. J. R. Statist. Soc. B, 57, 289-300.
30. Benjamini, Y. and Hochberg, Y. (1997) Multiple hypothesis testing with weights. Scand. J. Statist., 24, 407-418.
31. Benjamini, Y. and Yekutieli, D. (2001) The control of the false discovery rate in multiple testing under dependency. Ann. Statist., 29, 1165-1188.
32. Berger, R. L. (1982) Multiparameter hypothesis testing and acceptance sampling. Technometrics, 24, 295-300.
33. Cook, R. J. and Farewell, V. T. (1996) Multiplicity considerations in the design and analysis of clinical trials. J. R. Statist. Soc. A, 159, 93-110.
34. Cox, D. R. (1965) A remark on multiple comparison methods. Technometrics, 7, 223-224.
35. Dudoit, S., Yang, Y. H., Callow, M. J. and Speed, T. P. (2002) Statistical methods for identifying differentially expressed genes in replicated cdna microarray experiments. Statist. Sin., 12, 111-139.
36. Genovese, C. R., Lazar, N. A. and Nichols, T. (2002) Thresholding of statistical maps in functional neuroimaging using false discovery rate. Neuroimage, 15, 870-878.
37. Genovese, C. R., Roeder, K. and Wasserman, L. (2006) False discovery control with P-value weighting. Biometrika, 93, 509-524.
38. Green, G. (2008) Statistical methods for the analysis of microarray data. PhD Thesis Lancaster University, Lancaster.
39. Hu, J. X., Zhao, H. and Zhou, H. H. (2009) Multiple hypothesis testing with groups. Technical Report. Yale University, New Haven.
40. Jones, H. E., Ohlssen, D. I. and Spiegelhalter, D. J. (2008) Control of the false discovery rate accounts for multiple testing in comparisons of healthcare providers. J. Clin. Epidem., 61, 232-240.
41. Meinshausen, N. (2008) Hierarchical testing of variable importance. Biometrika, 95, 265-278.
42. O'Brien, P. C. (1984) Procedures for comparing samples with multiple endpoints. Biometrics, 40, 1079-1087.
43. Pacificoa, M. P., Genovese, C., Verdinelli, J. and Wasserman, L. (2007) Scan clustering: a false discovery approach. J. Multiv. Anal., 98, 1441-1469.
44. Patti, M. E., Butte, A. J., Crunkhorn, S., Cusi, K., Berria, R., Kashyap, S., Miyazaki, Y., Kohane, I., Costello, M., Saccone, R., Landaker, E. J., Goldfine, A. B., Mun, E., DeFronzo, R., Finlayson, J., Kahn, C. R. and Mandarino, L. J. (2003) Coordinated reduction of genes of oxidative metabolism in humans with insulin resistance and diabetes: potential role of pgc1and nrf1. Proc. Natn. Acad. Sci. USA, 100, 8466-8471.
45. Reiner-Benaim, A., Yekutieli, D., Letwin, N. E., Elmer, G. I., Lee, N. H., Kafkafi, N. and Benjamini, Y. (2007) Associating quantitative behavioral traits with gene expression in the brain: searching for diamonds in the hay. Bioinformatics, 23, 2239-2246.
46. Storey, J. D. (2002) A direct approach to false discovery rates. J. R. Statist. Soc. B, 64, 479-498.
47. Storey, J. D. and Tibshirani, R. (2003) Statistical significance for genomewide studies. Proc. Natn. Acad. Sci. USA, 100, 9440-9445.
48. Tuke, J., Glonek, G. F. V. and Solomon, P. J. (2008) Gene profiling for determining pluripotent genes in a time course microarray experiment. Biostatistics, 10, 80-93.
49. Tusher, V. G., Tibshirani, R. and Chu, G. (2001) Significance analysis of microarrays applied to the ionizing radiation response. Proc. Natn. Acad. Sci. USA, 98, 5116-5121.
50. Wacholder, S., Chanock, S., Garcia-Closas, M., El Ghormi, L. and Rothman, N. (2004) Assessing the probability that a positive report is false: an approach for molecular epidemiology studies. J. Natn. Cancer Inst., 96, 434-442.
51. Weisberg, S., McCann, D., Desai, M., Rosenbaum, M., Leibel, R. L. and Ferrante, A. W. (2003) Obesity is associated with macrophage accumulation in adipose tissue. J. Clin. Investgn, 112, 1796-1808.
52. Wellek, S. (2002) Testing Statistical Hypotheses of Equivalence. New York: Chapman and Hall.
53. Wilkinson, L. (1999) Statistical methods in psychology journals-guidelines and explanations. Am. Psychol., 54, 594-604.
54. Yekutieli, D. (2008) Hierarchical false discovery rate controlling methodology. J. Am. Statist. Ass., 103, 309-316.
55. Zehetmayer, S., Bauer, P. and Posch, M. (2005) Two-stage designs for experiments with a large number of hypotheses. Bioinformatics, 21, 3771-3777.