To how many simultaneous hypothesis tests can normal, student's t or bootstrap calibration be applied?

Journal of the American Statistical Association

Volumn 102, Issue 480, 2007, Pages 1282-1288

  Fan, Jianqing ^a,b   Hall, Peter ^c   Yao, Qiwei ^d,e  

^a Princeton University   (United States)

^b CHINESE ACADEMY OF SCIENCES   (China)

^c UNIVERSITY OF MELBOURNE   (Australia)

^d LONDON SCHOOL OF ECONOMICS   (United Kingdom)

^e Peking University   (China)

Author keywords

Bonferroni's inequality; Edgeworth expansion; Genetic data; Large deviation expansion; Level accuracy; Microarray data; Quantile estimation; Skewness; Student's t statistic

Indexed keywords

EID: 38349049320     PISSN: 01621459     EISSN: None     Source Type: Journal    
DOI: 10.1198/016214507000000969     Document Type: Article

References (34)

1. Benjamini, Y., and Hochberg, Y. (1995), "Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing," Journal of the Royal Statistical Society, Ser. B, 57, 289-300.
2. Benjamini, Y., and Yekutieli, D. (2001), "The Control of the False Discovery Rate in Multiple Testing Under Dependency," The Annals of Statistics, 29, 1165-1188.
3. Bentkus, V., and Götze, F. (1996), "The Berry-Esseen Bound for Student's Statistic," The Annals of Statistics, 24, 491-503.
4. Bickel, P. J., and Levina, E. (2004), "Some Theory for Fisher's Linear Discriminant, 'Naive Bayes,' and Some Alternatives When There Are Many More Variables Than Observations," Bernoulli, 10, 989-1010.
5. Clarke, S., and Hall, P. (2007), "Robustness of Multiple Testing Procedures Against Independence," unpublished manuscript.
6. Donoho, D. L., and Jin, J. (2004), "Higher Criticism for Detecting Sparse Heterogeneous Mixtures," The Annals of Statististics, 32, 962-994.
7. Dudoit, S., Shaffer, J. P., and Boldrick, J. C. (2003), "Multiple Hypothesis Testing in Microarray Experiments," Statistical Science, 18, 71-103.
8. Efron, B. (2004), "Large-Scale Simultaneous Hypothesis Testing: The Choice of a Null Hypothesis," Journal of the American Statistical Association, 99, 96-104.
9. _ (2007), "Correlation and Large-Scale Simultaneous Significance Testing," Journal of the American Statistical Association, 102, 93-103.
10. Fan, J., and Li, R. (2006), "Statistical Challenges With High Dimensionality: Feature Selection in Knowledge Discovery," in Proceedings of the International Congress of Mathematicians, Vol. III, eds. M. Sanz-Sole, J. Soria, J. L. Varona, and J. Verdera, Zurich: European Mathematical Society, pp. 595-622.
11. Fan, J., Chen, Y., Chan, H. M., Tam, P., and Ren, Y. (2005a), "Removing Intensity Effects and Identifying Significant Genes for Affymetrix Arrays in MIF-Uppressed Neuroblastoma Cells," Proceeding of the National Academy of Science USA, 102, 17751-17756.
12. Fan, J., Peng, H., and Huang, T. (2005b), "Semilinear High-Dimensional Model for Normalization of Microarray Data: A Theoretical Analysis and Partial Consistency" (with discussion), Journal of the American Statistical Association, 100, 781-813.
13. Fan, J., Tam, P., Vande Woude, G., and Ren, Y. (2004), "Normalization and Analysis of cDNA Micro-Arrays Using Within-Array Replications Applied to Neuroblastoma Cell Response to a Cytokine," Proceedings of the National Academy of Science USA, 101, 1135-1140.
14. Finner, H., and Roters, M. (1998), "Asymptotic Comparison of Step-Down and Step-Up Multiple Test Procedures Based on Exchangeable Test Statistics," The Annals of Statistics, 26, 505-524.
15. _ (1999), "Asymptotic Comparison of the Critical Values of Step-Down and Step-Up Multiple Comparison Procedures," Journal of Statistical Planning and Inference, 79, 11-30.
16. _ (2000), "On the Critical Value Behaviour of Multiple Decision Procedures," Scandinavian Journal of Statistics, 27, 563-573.
17. _ (2001), "On the False Discovery Rate and Expected Type I Errors," Biomertical Journal, 43, 985-1005.
18. _ (2002), "Multiple Hypotheses Testing and Expected Number of Type I Errors," The Annals of Statistics, 30, 220-238.
19. Genovese, C., and Wasserman, L. (2004), "A Stochastic Process Approach to False Discovery Control," The Annals of Statistics, 32, 1035-1061.
20. Hall, P. (1990), "On the Relative Performance of Bootstrap and Edgeworth Approximations of a Distribution Function," Journal of Multivariate Analysis, 35, 108-129.
21. Hall, P., and Wang, Q. (2007), "Strong Approximations of Level Exceedences Related to Multiple Hypothesis Testing," unpublished manuscript.
22. Hu, J., and He, X. (2007), "Enhanced Quantile Normalization of Microarray Data to Reduce Loss of Information in the Gene Expression Profile," Biometrics, 63, 50-59.
23. Huang, J., Wang, D., and Zhang, C. (2005), "A Two-Way Semi-Linear Model for Normalization and Significant Analysis of cDNA Microarray Data," Journal of the American Statistical Association, 100, 814-829.
24. Korosok, M. R., and Ma, S. (2007), "Marginal Asymptotics for the 'Large p, Small n' Paradigm: With Applications to Microarray Data, The Annals of Statistics, 35, 1458-1486.
25. Lehmann, E. L., and Romano, J. P. (2005), "Generalizations of the Family wise Error Rate," The Annals of Statistics, 33, 1138-1154.
26. Lehmann, E. L., Romano, J. P., and Shaffer, J. P. (2005), "On Optimality of Stepdown and Stepup Multiple Test Procedures," The Annals of Statistics, 33, 1084-1108.
27. Pollard, D. (1984), Convergence of Stochastic Processes, New York: Springer.
28. Reiner, A., Yekutieli, D., and Benjamini, Y. (2003), "Identifying Differentially Expressed Genes Using False Discovery Rate Controlling Procedures," Bioinformatics, 19, 368-375.
29. Sarkar, S. K. (2002), "Some Results on False Discovery Rate in Stepwise Multiple Testing Procedures," The Annals of Statistics, 30, 239-257.
30. _ (2006), "False Discovery and False Nondiscovery Rates in Single-Step Multiple Testing Procedures," The Annals of Statistics, 34, 394-415.
31. Shao, Q.-M. (1999), "A Cramer-Type Large Deviation Result for Student's t-Statistic," Journal of Theoretic Probability, 12, 385-398.
32. Storey, J. D., Taylor, J. E., and Siegmund, D. (2004). "Strong Control, Conservative Point Estimation, and Simultaneous Conservative Consistency of False Discovery Rates: A Unified Approach," Journal of the Royal Statistical Society, Ser. B, 66, 187-205.
33. van derLaan, M. J., and Bryan, J. (2001), "Gene Expression Analysis With the Parametric Bootstrap," Biostatistics, 2, 445-461.
34. Wang, Q. (2005), "Limit Theorems for Self-Normalized Large Deviations," Electronic Journal of Probability, 10, 1260-1285.