Robustness and accuracy of methods for high dimensional data analysis based on Student's t-statistic

Journal of the Royal Statistical Society. Series B: Statistical Methodology

Volumn 73, Issue 3, 2011, Pages 283-301

  Delaigle, Aurore ^a   Hall, Peter ^a,b   Jin, Jiashun ^c  

^a UNIVERSITY OF MELBOURNE   (Australia)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Bootstrap; Central limit theorem; Classification; Dimension reduction; Higher criticism; Large deviation probability; Moderate deviation probability; Ranking; Second order accuracy; Skewness; Tail probability; Variable selection

Indexed keywords

EID: 79955031842     PISSN: 13697412     EISSN: 14679868     Source Type: Journal    
DOI: 10.1111/j.1467-9868.2010.00761.x     Document Type: Article

References (43)

1. Adamczak, R. (2008) A tail inequality for suprema of unbounded empirical processes with applications to Markov chains. Electron. J. Probab., 13, 1000-1034.
2. Almirantis, Y. and Provata, A. (1999) Long- and short-range correlations in genome organization. J. Statist. Phys., 97, 233-262.
3. Benjamini, Y. and Hochberg, Y. (1995) Controlling the false discovery rate: a practical and powerful approach to multiple testing. J. R. Statist. Soc. B, 57, 289-300.
4. Bernhard, G., Klein, M. and Hommel, G. (2004) Global and multiple test procedures using ordered p-values-a review. Statist. Pap., 45, 1-14.
5. Blair, R. C., Troendle, J. F. and Beck, R. W. (1996) Control of familywise errors in multiple endpoint assessments via stepwise permutation tests. Statist. Med., 15, 1107-1121.
6. Cai, T. and Jin, J. (2010) Optimal rate of convergence of estimating the null density and the proportion of non-null effects in large-scale multiple testing. Ann. Statist., 38, 100-145.
7. Clarke, S. and Hall, P. (2009) Robustness of multiple testing procedures against dependence. Ann. Statist., 37, 332-358.
8. David, J.-P., Strode, C., Vontas, J., Nikou, D., Vaughan, A., Pignatelli, P. M., Louis, P., Hemingway, J. and Ranson, J. (2005) The Anopheles gambiae detoxification chip: a highly specific microarray to study metabolic-based insecticide resistance in malaria vectors. Proc. Natn. Acad. Sci.USA, 102, 4080-4084.
9. Delaigle, A. and Hall, P. (2009) Higher criticism in the context of unknown distribution, non-independence and classification. In Perspectives in Mathematical Sciences I: Probability and Statistics (eds N. Sastry, M. Delampady, B. Rajeev and T. S. S. R. K. Rao ), pp. 109-138. Singapore: World Scientific Press.
10. Delaigle, A., Hall, P. and Jin, J. (2010) Robustness and accuracy of methods for high dimensional data analysis based on Student's t statistic-long version. University of Melbourne, Melbourne. (Available from .)
11. Donoho, D. L. and Jin, J. (2004) Higher criticism for detecting sparse heterogeneous mixtures. Ann. Statist., 32, 962-994.
12. Donoho, D. L. and Jin, J. (2006) Asymptotic minimaxity of false discovery rate thresholding for sparse exponential data. Ann. Statist., 34, 2980-3018.
13. Dudoit, S., Shaffer, J. P. and Boldrick, J. C. (2003) Multiple hypothesis testing in microarray experiments. Statist. Sci., 18, 73-103.
14. Efron, B. (1987) Better bootstrap confidence intervals (with discussion). J. Am. Statist. Ass., 82, 171-200.
15. Fan, J., Hall, P. and Yao, Q. (2007) To how many simultaneous hypothesis tests can normal, Student's t or bootstrap calibration be applied? J. Am. Statist. Ass., 102, 1282-1288.
16. Fan, J. and Lv, J. (2008) Sure independence screening for ultrahigh dimensional feature space (with discussion). J. R. Statist. Soc. B, 70, 849-911.
17. Finner, H. and Roters, M. (2002) Multiple hypotheses testing and expected number of type I errors. Ann. Statist., 30, 220-238.
18. Genovese, C. and Wasserman, L. (2004) A stochastic process approach to false discovery control. Ann. Statist., 32, 1035-1061.
19. Giné, E., Götze, F. and Mason, D. M. (1997) When is the Student t-statistic asymptotically standard normal? Ann. Probab., 25, 1514-1531.
20. Hall, P. (1988) Theoretical comparison of bootstrap confidence intervals (with discussion). Ann. Statist., 16, 927-985.
21. Hall, P. (1990) On the relative performance of bootstrap and Edgeworth approximations of a distribution function. J. Multiv. Anal., 35, 108-129.
22. Hall, P. and Wang, Q. (2004) Exact convergence rate and leading term in central limit theorem for Student's t statistic. Ann. Probab., 32, 1419-1437.
23. Hall, P. and Wang, Q. (2010) Strong approximations of level exceedences related to multiple hypothesis testing. Bernoulli, 16, 418-434.
24. n-balls. Math. Meth. Statist., 7, 401-428.
25. Ingster, Yu. I. (2001) Adaptive detection of a signal of growing dimension: I, Meeting on Mathematical Statistics. Math. Meth. Statist., 10, 395-421.
26. Jin, J. (2008) Proportion of non-zero normal means: universal oracle equivalences and uniformly consistent estimators (with discussion). J. R. Statist. Soc. B, 70, 461-493.
27. Jin, J. and Cai, T. (2007) Estimating the null and the proportion of non-null effects in large-scale multiple comparisons. J. Am. Statist. Ass., 102, 496-506.
28. Kesselman, H. J., Cribbie, R. and Holland, B. (2002) Controlling the rate of Type I error over a large set of statistical tests. Br. J. Math. Statist. Psychol., 55, 27-39.
29. Kulinskaya, E. (2009) On fuzzy familywise error rate and false discovery rate procedures for discrete distributions. Biometrika, 96, 201-211.
30. Lang, T. A. and Secic, M. (1997) How to Report Statistics in Medicine: Annotated Guidelines for Authors. Philadelphia: American College of Physicians.
31. Lehmann, E. L., Romano, J. P. and Shaffer, J. P. (2005) On optimality of stepdown and stepup multiple test procedures. Ann. Statist., 33, 1084-1108.
32. Linnik, Ju. V. (1961) Limit theorems for sums of independent quantities, taking large deviations into account: I. Teor. Veroj. Primen., 7, 145-163.
33. Mansilla, R., De Castillo, N., Govezensky, T., Miramontes, P., José, M. and Coho, G. (2004) Long-range correlation in the whole human genome. Universidad Nacional Autonoma de México, México. (Available from .)
34. Petrov, V. V. (1975) Sums of Independent Random Variables. Berlin: Springer.
35. Pigeot, I. (2000) Basic concepts of multiple tests-a survey. Statist. Pap., 41, 3-36.
36. Sarkar, S. K. (2006) False discovery and false nondiscovery rates in single-step multiple testing procedures. Ann. Statist., 34, 394-415.
37. Shao, Q.-M. (1999) A Cramér type large deviation result for Student's t-statistic. J. Theor. Probab., 12, 385-398.
38. Storey, J. D. (2002) A direct approach to false discovery rates. J. R. Statist. Soc. B, 64, 479-498.
39. Student (1908) The probable error of a mean. Biometrika, 6, 1-25.
40. Takada, T., Hasegawa, T., Ogura, H., Tanaka, M., Yamada, H., Komura, H. and Ishii, Y. (2001) Statistical filter for multiple test noise on fMRI. Syst. Comput. Jpn, 32, 16-24.
41. Tamhane, A. C. and Dunnett, C. W. (1999) Stepwise multiple test procedures with biometric applications. J. Statist. Planng Inf., 82, 55-68.
42. Wang, Q. and Hall, P. (2009) Relative errors in central limit theorems for Student's t statistic, with applications. Statist. Sin., 19, 343-354.
43. Wu, W. B. (2008) On false discovery control under dependence. Ann. Statist., 36, 364-380.