Multiple testing. Part I. Single-step procedures for control of general type I error rates

Statistical Applications in Genetics and Molecular Biology

Volumn 3, Issue 1, 2004, Pages

  Dudoit, Sandrine ^a   Van Der Laan, Mark J ^a   Pollard, Katherine S ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Adjusted p value; Asymptotic control; Bootstrap; Consistency; Cut off; F statistic; Generalized family wise error rate; Multiple testing; Null distribution; Null hypothesis; Quantile; Single step; T statistic; Test statistic; Type I error rate

Indexed keywords

ANALYTICAL ERROR; ARTICLE; GENETIC ALGORITHM; GENOME ANALYSIS; HEALTH STATISTICS; HYPOTHESIS; NORMAL DISTRIBUTION; PROBABILITY; STATISTICAL ANALYSIS; ALGORITHM; ERROR; FAMILY; GENOMICS; PARAMETER; SIMULATION; STATISTICS;

EID: 14044252027     PISSN: 15446115     EISSN: 15446115     Source Type: Journal    
DOI: 10.2202/1544-6115.1040     Document Type: Article

References (34)

1. Y. Benjamini and Y. Hochberg. Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of the Royal Statistical Society, Series B, 57:289-300, 1995.
2. R. Beran. Balanced simultaneous confidence sets. Journal of the American Statistical Association, 83:679-686, 1988.
3. S. Dudoit, J. P. Shaffer, and J. C. Boldrick. Multiple hypothesis testing in microarray experiments. Statistical Science, 18(1):71-103, 2003.
4. S. Dudoit, Y. H. Yang, M. J. Callow, and T. P. Speed. Statistical methods for identifying differentially expressed genes in replicated cDNA microarray experiments. Statistica Sinica, 12(1):111-139, 2002.
5. B. Efron, R. Tibshirani, J. D. Storey, and V. Tusher. Empirical Bayes analysis of a microarray experiment. Journal of the American Statistical Association, 96:1151-1160, 2001.
6. H. Finner. Stepwise multiple test procedures and control of directional errors. Annals of Statistics, 27:274-289, 1999.
7. Y. Ge, S. Dudoit, and T. P. Speed. Resampling-based multiple testing for microarray data analysis. TEST, 12(1):1-44, 2003.
8. C. R. Genovese and L. Wasserman. A stochastic process approach to false discovery rates. Technical Report 762, Department of Statistics, Carnegie Mellon University, January 2003.
9. R. D. Gill. Non- and semi-parametric maximum likelihood estimators and the von Mises method. I. Scand. J. Statist., 16(2):97-128, 1989. With a discussion by J. A. Wellner and J. Præstgaard and a reply by the author.
10. R. D. Gill, M. J. van der Laan, and J. A. Wellner. Inefficient estimators of the bivariate survival function for three models. Ann. Inst. H. Poincaré Probab. Statist., 31(3):545-597, 1995.
11. T. R. Golub, D. K. Slonim, P. Tamayo, C. Huard, M. Gaasenbeek, J. P. Mesirov, H. Coller, M.L. Loh, J. R. Downing, M. A. Caligiuri, C. D. Bloomfield, and E. S. Lander. Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. Science, 286:531-537, 1999.
12. Y. Hochberg. A sharper Bonferroni procedure for multiple tests of significance. Biometrika, 75:800-802, 1988.
13. Y. Hochberg and A. C. Tamhane. Multiple Comparison Procedures. Probability and Mathematical Statistics. Wiley-Interscience, 1987.
14. S. Holm. A simple sequentially rejective multiple test procedure. Scand. J. Statist., 6:65-70, 1979.
15. E. L. Korn, J. F. Troendle, L. M. McShane, and R. Simon. Controlling the number of false discoveries: application to high-dimensional genomic data. Journal of Statistical Planning and Inference, 2004. URL linus.nci.nih.gov/~brb/ TechReport.htm. (To appear).
16. E. Manduchi, G. R. Grant, S. E. McKenzie, G. C. Overton, S. Surrey, and C. J. Stoeckert. Generation of patterns from gene expression data by assigning confidence to differentially expressed genes. Bioinformatics, 16:685-698, 2000.
17. K. S. Pollard, M. D. Birkner, S. Dudoit, and M. J. van der Laan. Multiple testing. Part IV. Assessment of multiple testing procedures: Simulation studies and applications to genomic data analysis. Technical report, Division of Biostatistics, University of California, Berkeley, 2004. (In preparation).
18. K. S. Pollard and M. J. van der Laan. Choice of a null distribution in resampling-based multiple testing. Journal of Statistical Planning and Inference, 2004. URL www.bepress.com/ucbbiostat/paper121. (To appear).
19. P. H. Ramsey. Power differences between pairwise multiple comparisons. Journal of the American Statistical Association, 73:479-485, 1978.
20. A. Reiner, D. Yekutieli, and Y. Benjamini. Identifying differentially expressed genes using false discovery rate controlling procedures. Bioinformatics, 19(3):368-375, 2003.
21. S. R. Searle. Linear Models. John Wiley & Sons, 1971.
22. J. P. Shaffer. Multiple hypothesis testing. Annu. Rev. Psychol., 46:561-584, 1995.
23. J. P. Shaffer. Multiplicity, directional (Type III) errors, and the null hypothesis. Psychological Methods, 7:356-369, 2002.
24. R. J. Simes. An improved Bonferroni procedure for multiple tests of significance. Biometrika, 73:751-754, 1986.
25. J. F. Troendle. A stepwise resampling method of multiple hypothesis testing. Journal of the American Statistical Association, 90:370-378, 1995.
26. J. F. Troendle. A permutational step-up method of testing multiple outcomes. Biometrics, 52:846-859, 1996.
27. V. Goss Tusher, R. Tibshirani, and G. Chu. Significance analysis of microarrays applied to transcriptional responses to ionizing radiation. Proc. Natl. Acad. Sci., 98:5116-5121, 2001.
28. M. J. van der Laan, S. Dudoit, and K. S. Pollard. Augmentation procedures for control of the generalized family-wise error rate and tail probabilities for the proportion of false positives. Statistical Applications in Genetics and Molecular Biology, 2004a. URL www.bepress.com/sagmb. (To appear).
29. M. J. van der Laan, S. Dudoit, and K. S. Pollard. Multiple testing. Part II. Step-down procedures for control of the family-wise error rate. Statistical Applications in Genetics and Molecular Biology, 2004b. URL www.bepress.com/ sagmb. (To appear).
30. A. W. van der Vaart and J. Wellner. Weak Convergence and Empirical Processes. Springer-Verlag, New York, 1996.
31. P. H. Westfall. Resampling-based multiple testing for microarray data analysis. TEST, 12(1), 2003. (Discussion).
32. P. H. Westfall and S. S. Young. Resampling-based multiple testing: Examples and methods for p-value adjustment. John Wiley & Sons, 1993.
33. P. H. Westfall, D. V. Zaykin, and S. S. Young. Multiple tests for genetic effects in association studies. In S. Looney, editor, Biostatistical Methods, volume 184 of Methods in Molecular Biology, pages 143-168. Humana Press, Toloway, NJ, 2001.
34. Y. Xiao, M. R. Segal, D. Rabert, A. H. Ahn, P. Anand, L. Sangameswaran, D. Hu, and C. A. Hunt. Assessment of differential gene expression in human peripheral nerve injury. BioMed Central Genomics, 3(1):28, 2002.