MMCTest-A safe algorithm for implementing multiple monte carlo tests

Scandinavian Journal of Statistics

Volumn 41, Issue 4, 2014, Pages 1083-1101

  Gandy, Axel ^a   Hahn, Georg ^a  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

Benjamini Hochberg; Bonferroni correction; Bootstrap; False discovery rate; Multiple comparisons; Resampling; Sequential algorithm

Indexed keywords

EID: 84920367101     PISSN: 03036898     EISSN: 14679469     Source Type: Journal    
DOI: 10.1111/sjos.12085     Document Type: Article

References (29)

1. Benjamini, Y. & Hochberg, Y. (1995). Controlling the false discovery rate: a practical and powerful approach to multiple testing. J. R. Stat. Soc. Ser. B Stat. Methodol. 57, (1), 289-300.
2. Besag, J. & Clifford, P. (1991). Sequential Monte Carlo p-values. Biometrika 78, (2), 301-304.
3. Bonferroni, C.E. (1936). Teoria statistica delle classi e calcolo delle probabilità. Pubbl. d. R. Ist. Super. di Sci. Econom. e Commerciali di Firenze 8, 3-62.
4. Clopper, C.J. & Pearson, E.S. (1934). The use of confidence or fiducial limits illustrated in the case of the binomial. Biometrika 26, (4), 404-413.
5. Cohen, O., Ashkenazy, H., Burstein, D. & Pupko, T. (2012). Uncovering the co-evolutionary network among prokaryotic genes. Bioinformatics 28, i389-i394.
6. Farcomeni, A. (2007). Some results on the control of the false discovery rate under dependence. Scand. J. Stat. 34, (2), 275-297.
7. Farcomeni, A. (2009). Generalized augmentation to control the false discovery exceedance in multiple testing. Scand. J. Stat. 36, (3), 501-517.
8. Finner, H., Gontscharuk, V. & Dickhaus, T. (2012). False discovery rate control of step-up-down tests with special emphasis on the asymptotically optimal rejection curve. Scand. J. Stat. 39, (2), 382-397.
9. Gandy, A. (2009). Sequential implementation of Monte Carlo tests with uniformly bounded resampling risk. J. Amer. Statist. Assoc. 104, (488), 1504-1511.
10. Gandy, A. & Rubin-Delanchy, P. (2013). An algorithm to compute the power of Monte Carlo tests with guaranteed precision. Ann. Statist. 41, (1), 125-142.
11. Gleser, L.J. (1996). Comment on 'Bootstrap Confidence Intervals' by T. J. DiCiccio and B. Efron. Statist. Sci. 11, 219-221.
12. Guo, W. & Peddada, S. (2008). Adaptive choice of the number of bootstrap samples in large scale multiple testing. Stat. Appl. Genet. Mol. Biol. 7, (1), 1-16.
13. Gusenleitner, D., Howe, E.A., Bentink, S., Quackenbush, J. & Culhane A.C. (2012). iBBiG: iterative binary bi-clustering of gene sets. Bioinformatics 28, (19), 2484-2492.
14. Hoeffding, W. (1963). Probability inequalities for sums of bounded random variables. J. Amer. Statist. Assoc. 58, (301), 13-30.
15. Jiang, H. & Salzman, J. (2012). Statistical properties of an early stopping rule for resampling-based multiple testing. Biometrika 99, (4), 973-980.
16. Jiao, S. & Zhang, S. (2010). A mixture model based approach for estimating the FDR in replicated microarray data. Journal of Biomedical Science and Engineering 20, (11), 317-321.
17. Knijnenburg, T.A., Daran, J.-M.G., van den Broek, M.A., Daran-Lapujade P.A.S., de Winde, J.H., Pronk, J.T., Reinders, M.J.T. & Wessels, L.F.A. (2009). Combinatorial effects of environmental parameters on transcriptional regulation in Saccharomyces cerevisiae: a quantitative analysis of a compendium of chemostat-based transcriptome data. BMC Genomics 10, (53).
18. Lage-Castellanos, A., Martínez-Montes, E., Hernández-Cabrera, J.A. & Galán, L. (2010). False discovery rate and permutation test: an evaluation in ERP data analysis. Stat. Med. 29, 63-74.
19. Li, J., Tai, B.C. & Nott, D.J. (2009). Confidence interval for the bootstrap P-value and sample size calculation of the bootstrap test. J. Nonparametr. Stat. 21, (5), 649-661.
20. Meinshausen, N. (2006). False discovery control for multiple tests of association under general dependence. Scand. J. Stat. 33, (2), 227-237.
21. Nusinow, D.P., Kiezun, A., O'Connell, D.J., Chick, J.M., Yue, Y., Maas, R.L., Gygi, S.P. & Sunyaev, S.R. (2012). Network-based inference from complex proteomic mixtures using SNIPE. Bioinformatics 28, (23), 3115-3122.
22. Pekowska, A., Benoukraf, T., Ferrier, P. & Spicuglia, S. (2010). A unique H3K4me2 profile marks tissue-specific gene regulation. Genome Research 20, (11), 1493-1502.
23. Pounds, S. & Cheng, C. (2006). Robust estimation of the false discovery rate. Bioinformatics 22, (16), 1979-1987.
24. Rahmatallah, Y., Emmert-Streib, F. & Glazko, G. (2012). Gene set analysis for self-contained tests: complex null and specific alternative hypotheses. Bioinformatics 28, (23), 3073-3080.
25. Sandve, G.K., Ferkingstad, E. & Nygard, S. (2011). Sequential Monte Carlo multiple testing. Bioinformatics 27, (23), 3235-3241.
26. Tamhane, A.C. & Liu, L. (2008). On weighted Hochberg procedures. Biometrika 95, (2), 279-294.
27. van Wieringen, W.N., van de Wiel, M.A. & van der Vaart, A.W. (2008). A test for partial differential expression. J. Amer. Statist. Assoc. 103, (483), 1039-1049.
28. Westfall, P. & Young, S. (1993). Resampling-based multiple testing: examples and methods for p-value adjustment. Wiley, New York.
29. Westfall, P.H. & Troendle, J.F. (2008). Multiple testing with minimal assumptions. Biom. J. 50, (5), 745-755.