Estimating the number of true null hypotheses in multiple hypothesis testing

Statistics and Computing

Volumn 24, Issue 3, 2014, Pages 399-416

  Hwang, Yi Ting ^a   Kuo, Hsun Chih ^b   Wang, Chun Chao ^a   Lee, Meng Feng ^a  

^a NATIONAL TAIPEI UNIVERSITY   (Taiwan)

^b NATIONAL CHENGCHI UNIVERSITY   (Taiwan)

Author keywords

Adaptive FDR controlling procedure; False discovery rate; Multiple hypothesis testing; Number of true null hypotheses; Sensitivity

Indexed keywords

EID: 84898539731     PISSN: 09603174     EISSN: None     Source Type: Journal    
DOI: 10.1007/s11222-013-9377-5     Document Type: Article

References (33)

1. Benjamini, Y., Hochberg, Y.: Controlling the false discovery rate: a practical and powerful approach to multiple testing. J. R. Stat. Soc., Ser. B 57, 289-300 (1995).
2. Benjamini, Y., Hochberg, Y.: On the adaptive control of the false discovery rate in multiple testing with independent statistics. J. Educ. Behav. Stat. 25, 60-83 (2000).
3. Benjamini, Y., Liu, W.: A step-down multiple hypotheses testing procedure that controls the false discovery rate under independence. J. Stat. Plan. Inference 82, 163-170 (1999a).
4. Benjamini, Y., Liu, W.: A distribution-free multiple test procedure that controls the false discovery rate. Unpublished manuscript (1999b).
5. Benjamini, Y., Yekutieli, D.: The control of the false discovery rate in multiple testing under dependency. Ann. Stat. 29, 1165-1188 (2001).
6. Benjamini, Y., Krieger, A. M., Yekutieli, A.: Adaptive linear step-up procedures that control the false discovery rate. Biometrika 93(3), 491-507 (2006).
7. Gavrilov, Y., Benjamini, Y., Sarkar, S. K.: An adaptive step-down procedure with proven FDR control under independence. Ann. Stat. 37, 619-629 (2009).
8. Ge, Y., Dudoit, S., Speed, T. P.: Resampling-based multiple testing for microarray data hypothesis. Test 12, 1-44 (2003).
9. Genovese, C., Wasserman, L.: A stochastic process approach to false discovery control. Ann. Stat. 32, 1035-1061 (2004).
10. Holm, S.: A simple sequentially rejective multiple test procedure. Scand. J. Stat. 6, 65-70 (1979).
11. Hochberg, Y.: A sharper Bonferroni procedure for multiple tests of significance. Biometrika 75, 800-803 (1988).
12. Hochberg, Y., Benjamini, Y.: More powerful procedures for multiple significance testing. Stat. Med. 9, 811-818 (1990).
13. Hsueh, H. M., Chen, J. J., Kodell, R. L.: Comparison of methods for estimating the number of true null hypotheses in multiplicity testing. J. Biopharm. Stat. 13, 675-689 (2003).
14. Hsueh, H. M., Tsai, C. A., Chen, J. J.: Incorporating the number of true null hypotheses to improve power in multiple testing: application to gene microarray data. J. Stat. Comput. Simul. 77, 757-767 (2007).
15. Hwang, Y. T.: Estimating the number of true null hypotheses in multiple hypotheses testing. J. Stat. Comput. Simul. 81, 207-220 (2011).
16. Hwang, Y. T., Lai, J. J., Ou, S. T.: Evaluations of FWER-controlling methods in multiple hypothesis testing. J. Appl. Stat. 37, 1681-1694 (2010).
17. Hwang, Y. T., Chu, S. K., Ou, S. T.: Evaluations of FDR-controlling methods in multiple hypothesis testing. Stat. Comput. 21, 569-583 (2011).
18. Langaas, M., Lindqvist, B. H., Ferkingstad, E.: Estimating the proportion of true null hypotheses, with application to DNA microarray data. J. R. Stat. Soc., Ser. B 67, 555-572 (2005).
19. Liu, F., Sarkar, S. K.: A new adaptive method to control the false discovery rate. In: Bhattacharjee, M., Dhar, S. K., Subramanian, S. (eds.) Recent Advances in Biostatistics: False Discovery Rates, Survival Analysis, and Related Topics. Series in Biostatistics, vol. 4, pp. 3-26. World Scientific, New Jersey (2011).
20. Lu, X., Perkins, D. L.: Resampling strategy to improve the estimation of number of null hypotheses in FDR control under strong correlation structure. BMC Bioinform. 8, 157-169 (2007).
21. Meinshausen, N.: False discovery control for multiple tests of association under general dependence. Scand. J. Stat. 33(2), 227-237 (2006).
22. Meinshausen, N., Rice, J.: Estimating the proportion of false null hypotheses among a large number of independently tested hypotheses. Ann. Stat. 34, 373-393 (2006).
23. Miller, C. J., Genovese, C., Nichol, R. C., Wasserman, L., Connolly, A., Reichart, D., Hopkins, A., Schneider, J., Moore, A.: Controlling the false-discovery rate in astrophysical data analysis. Astron. J. 122, 3492-3505 (2001).
24. Pawian, Y., Michiels, S., Koscielny, S., Gusnanto, A., Ploner, A.: False discovery rate, sensitivity and sample size for microarray studies. Bioinformatics 21, 3017-3024 (2005).
25. Pounds, S. B.: Estimation and control of multiple testing error rates for microarray studies. Brief. Bioinform. 7, 25-36 (2006).
26. R Development Core Team: R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna (2008). http://www. R-project. org. ISBN 3-900051-07-0.
27. Schweder, T., Spjøtvoll, E.: Plots of p-values to evaluate many test simultaneously. Biometrika 69, 493-502 (1982).
28. Seeger, P.: A note on a method for the analysis of significance en masse. Technometrics 10, 583-593 (1968).
29. Storey, J. D.: A direct approach to false discovery rates. J. R. Stat. Soc., Ser. B 64, 479-498 (2002).
30. Storey, J. D., Taylor, J. E., Siegmund, D.: Strong control, conservative point estimation, and simultaneous conservative consistency of false discovery rates: a unified approach. J. R. Stat. Soc., Ser. B 66, 187-205 (2004).
31. Turkheimer, F. E., Smith, C. B., Schmidt, K.: Estimation of the number of true null hypotheses in multivariate analysis of neuroimaging data. NeuroImage 13, 920-930 (2001).
32. Wang, C. C., Lin, Y. H., Hwang, Y. T.: A robust estimation of the proportion of true null hypotheses based on a beta mixture model. J. Chin. Stat. Assoc. 49, 1-17 (2011).
33. Yekutieli, D., Benjamini, Y.: Resampling-based false discovery rate controlling multiple test procedures for correlated test statistics. J. Stat. Plan. Inference 82, 171-196 (1999).