Global testing under sparse alternatives: ANOVA, multiple comparisons and the higher criticism

Annals of Statistics

Volumn 39, Issue 5, 2011, Pages 2533-2556

  Arias Castro, Ery ^a   Candès, Emmanuel J ^b   Plan, Yaniv ^c  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b STANFORD UNIVERSITY   (United States)

^c CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Analysis of variance; Compressive sensing; Detecting a sparse signal; Higher criticism; Incoherence; Minimax detection; Random matrices; Suprema of Gaussian processes

Indexed keywords

EID: 82655189988     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/11-AOS910     Document Type: Article

References (40)

1. AKRITAS, M. G. and PAPADATOS, N. (2004). Heteroscedastic one-way ANOVA and lack-offit tests. J. Amer. Statist. Assoc. 99 368-382. MR2062823 (Pubitemid 38750473)
2. ARIAS-CASTRO, E.,CANDÈS, E. J. and PLAN, Y. Supplement to "Global testing under sparse alternatives: ANOVA, multiple comparisons and the higher criticism." DOI:10.1214/11- AOS910SUPP.
3. BERMAN, S. M. (1964). Limit theorems for the maximum term in stationary sequences. Ann. Math. Statist. 35 502-516. MR0161365
4. CANDÈS, E. J., ROMBERG, J. and TAO, T. (2006). Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information. IEEE Trans. Inform. Theory 52 489-509. MR2236170 (Pubitemid 43174093)
5. CANDES, E. J. and TAO, T. (2006). Near-optimal signal recovery from random projections: Universal encoding strategies? IEEE Trans. Inform. Theory 52 5406-5425. MR2300700 (Pubitemid 46445381)
6. CASTAGNA, J. P., SUN, S. and SIEGFRIED, R. W. (2003). Instantaneous spectral analysis: Detection of low-frequency shadows associated with hydrocarbons. The Leading Edge 22 120-127.
7. CHURCHILL, G. (2002). Fundamentals of experimental design for cDNA microarrays. Nature Genetics 32 490-495. (Pubitemid 35435151)
8. DEO, C. M. (1972). Some limit theorems for maxima of absolute values of Gaussian sequences. Sankhya Ser. A 34 289-292. MR0334319
9. DONOHO, D. and JIN, J. (2004). Higher criticism for detecting sparse heterogeneous mixtures. Ann. Statist. 32 962-994. MR2065195 (Pubitemid 41250290)
10. DONOHO, D. L. (2006). Compressed sensing. IEEE Trans. Inform. Theory 52 1289-1306. MR2241189
11. DONOHO, D. L. and HUO, X. (2001). Uncertainty principles and ideal atomic decomposition. IEEE Trans. Inform. Theory 47 2845-2862. MR1872845 (Pubitemid 33053488)
12. DUARTE, M., DAVENPORT, M.,WAKIN, M. and BARANIUK, R. (2006). Sparse signal detection from incoherent projections. In 2006 IEEE International Conference on Acoustics, Speech and Signal Processing, 2006. ICASSP 2006 Proceedings 3 III-III.
13. DUDOIT, S., SHAFFER, J. P. and BOLDRICK, J. C. (2003). Multiple hypothesis testing in microarray experiments. Statist. Sci. 18 71-103. MR1997066 (Pubitemid 41461823)
14. EFRON, B., TIBSHIRANI, R., STOREY, J. D. and TUSHER, V. (2001). Empirical Bayes analysis of a microarray experiment. J. Amer. Statist. Assoc. 96 1151-1160. MR1946571 (Pubitemid 33695570)
15. FISHER, R. A. (1973). Statistical Methods for Research Workers, 14th ed. - revised and enlarged. Hafner, New York. MR0346954
16. GOEMAN, J. J., VAN DE GEER, S. A. and VAN HOUWELINGEN, H. C. (2006). Testing against a high dimensional alternative. J. R. Stat. Soc. Ser. B Stat. Methodol. 68 477-493. MR2278336 (Pubitemid 43742901)
17. GRIBONVAL, R. andBACRY, E. (2003). Harmonic decomposition of audio signals with matching pursuit. IEEE Trans. Signal Process. 51 101-111. MR1956096
18. HALL, P. and JIN, J. (2008). Properties of higher criticism under strong dependence. Ann. Statist. 36 381-402. MR2387976
19. HALL, P. and JIN, J. (2010). Innovated higher criticism for detecting sparse signals in correlated noise. Ann. Statist. 38 1686-1732. MR2662357
20. HAUPT, J. and NOWAK, R. (2007). Compressive sampling for signal detection. In IEEE Int. Conf. on Acoustics, Speech, and Signal Processing (ICASSP) 3 III-1509-III-1512.
21. HONIG, M. (2009). Advances in Multiuser Detection. Wiley, Hoboken, NJ.
22. INGSTER, Y. I. (1998). Minimax detection of a signal for ln-balls. Math. Methods Statist. 7 401-428 (1999). MR1680087
23. INGSTER, Y. I., TSYBAKOV, A. B. and VERZELEN, N. (2010). Detection boundary in sparse regression. Electron. J. Stat. 4 1476-1526. MR2747131
24. JAMES, D., CLYMER, B. D. and SCHMALBROCK, P. (2001). Texture detection of simulated microcalcification susceptibility effects in magnetic resonance imaging of breasts. Journal of Magnetic Resonance Imaging 13 876-881. (Pubitemid 32479945)
25. JIN, J. (2003). Detecting and estimating sparse mixtures. Ph.D. thesis, Stanford Univ.
26. KERR, M.,MARTIN, M. andCHURCHILL, G. (2000). Analysis of variance for gene expression microarray data. J. Comput. Biol. 7 819-837.
27. LEDOUX, M. (2001). The Concentration of Measure Phenomenon. Mathematical Surveys and Monographs 89. Amer. Math. Soc., Providence, RI. MR1849347
28. LEHMANN, E. L. and ROMANO, J. P. (2005). Testing Statistical Hypotheses, 3rd ed. Springer, New York. MR2135927
29. LEMMENS, P. W. H. and SEIDEL, J. J. (1973). Equiangular lines. J. Algebra 24 494-512. MR0307969
30. MALLAT, S. (2009). A Wavelet Tour of Signal Processing: The Sparse Way, 3rd ed. Academic Press, Amsterdam. MR2479996
31. MALLAT, S. and ZHANG, Z. (1993).Matching pursuits with time-frequency dictionaries. IEEE Trans. Signal Process. 41 3397-3415.
32. MATHEW, T. and SINHA, B. K. (1988). Optimum tests for fixed effects and variance components in balanced models. J. Amer. Statist. Assoc. 83 133-135. MR0941007
33. MCCARTHY, M., ABECASIS, G., CARDON, L., GOLDSTEIN, D., LITTLE, J., IOANNIDIS, J. and HIRSCHHORN, J. (2008). Genome-wide association studies for complex traits: Consensus, uncertainty and challenges. Nature Reviews Genetics 9 356-369. (Pubitemid 351556063)
34. MENG, J., LI, H. andHAN, Z. (2009). Sparse event detection in wireless sensor networks using compressive sensing. In 43rd Annual Conference on Information Sciences and Systems (CISS), 2009 181-185.
35. MONTGOMERY, D. C. (2009). Design and Analysis of Experiments, 7th ed. Wiley, Hoboken, NJ. MR2552961
36. PIANTADOSI, S. (2005). Clinical Trials: A Methodologic Perspective, 2nd ed.Wiley, Hoboken, NJ. MR2154988
37. SLONIM, D. (2002). From patterns to pathways: Gene expression data analysis comes of age. Nature Genetics 32 502-508. (Pubitemid 35435153)
38. STROHMER, T. and HEATH, R. W., JR. (2003). Grassmannian frames with applications to coding and communication. Appl. Comput. Harmon. Anal. 14 257-275. MR1984549
39. WILLER, C., SANNA, S., JACKSON, A., SCUTERI, A., BONNYCASTLE, L., CLARKE, R., HEATH, S., TIMPSON, N.,NAJJAR, S. and STRINGHAM, H. ET AL. (2008). Newly identified loci that influence lipid concentrations and risk of coronary artery disease. Nature Genetics 40 161-169. (Pubitemid 351171403)
40. ZHANG, G., ZHANG, S. and WANG, Y. (2000). Application of adaptive time-frequency decomposition in ultrasonic NDE of highly-scattering materials. Ultrasonics 38 961-964. (Pubitemid 32033645)