Optimal detection of heterogeneous and heteroscedastic mixtures

Journal of the Royal Statistical Society. Series B: Statistical Methodology

Volumn 73, Issue 5, 2011, Pages 629-662

  Tony Cai, T ^a   Jessie Jeng, X ^a   Jin, Jiashun ^b  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

^b CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Detection boundary; Higher criticism; Likelihood ratio test; Optimal adaptivity; Sparsity

Indexed keywords

EID: 80054739578     PISSN: 13697412     EISSN: 14679868     Source Type: Journal    
DOI: 10.1111/j.1467-9868.2011.00778.x     Document Type: Article

References (25)

1. Burnashev, M. V. and Begmatov, I. A. (1991) On a problem of detecting a signal that leads to stable distributions. Theor. Probab. Appl., 35, 556-560.
2. Cai, T., Jin, J. and Low, M. (2007) Estimation and confidence sets for sparse normal mixtures. Ann. Statist., 35 2421-2449.
3. Cayon, L., Jin, J. and Treaster, A. (2005) Higher Criticism statistic: detecting and identifying non-Gaussianity in the WMAP First Year data. Mnthly Notes R. Astron. Soc., 362, 826-832.
4. Delaigle, A., Hall, P. and Jin, J. (2011) Robustness and accuracy of methods for high dimensional data analysis based on Student's t-statistic. J. R. Statist. Soc. B, 73, 283-301.
5. Donoho, D. and Jin, J. (2004) Higher criticism for detecting sparse heterogeneous mixtures. Ann. Statist., 32, 962-994.
6. Donoho, D. and Jin, J. (2008) Higher Criticism thresholding: optimal feature selection when useful features are rare and weak. Proc. Natn. Acad. Sci. USA, 105, 14790-14795.
7. Donoho, D. and Jin, J. (2009) Feature selection by Higher Criticism thresholding: optimal phase diagram. Phil. Trans. R. Soc. Lond. A, 367, 4449-4470.
8. Hall, P. and Jin, J. (2008) Properties of Higher Criticism under long-range dependence. Ann. Statist., 36, 381-402.
9. Hall, P. and Jin, J. (2010) Innovated Higher Criticism for detecting sparse signals in correlated noise. Ann. Statist., 38, 1686-1732.
10. Hall, P., Pittelkow, Y. and Ghosh, M. (2008) Theoretical measures of relative performance of classifiers for high dimensional data with small sample sizes. J. R. Statist. Soc. B, 70, 159-173.
11. Hopkins, A. M., Miller, C. J., Connolly, A. J., Genovese, C., Nichol, R. C. and Wasserman, L. (2002) A new source detection algorithm using the false-discovery rate. Astron. J., 123, 1086-1094.
12. Ingster, Y. I. (1997) Some problems of hypothesis testing leading to infinitely divisible distribution. Math. Meth. Statist., 6, 47-69.
13. Ingster, Y. I. (1999) Minimax detection of a signal for -balls. Math. Meth. Statist., 7, 401-428.
14. Jager, L. and Wellner, J. (2007) Goodness-of-fit tests via phi-divergences. Ann. Statist., 35, 2018-2053.
15. Ji, P. and Jin, J. (2010) UPS delivers optimal phase diagram in high dimensional variable selection. Manuscript. (Available from)
16. Jin, J. (2003) Detecting and estimating sparse mixtures. PhD Thesis Department of Statistics, Stanford University, Stanford.
17. Jin, J. (2004) Detecting a target in very noisy data from multiple looks. In A Festschrift for Herman Rubin, 255-286.Beachwood: Institute of Mathematical Statistics.
18. Jin, J. (2009) Impossibility of successful classification when useful features are rare and weak. Proc. Natn. Acad. Sci. USA, 106, 8856-8864.
19. Kulldorff, M., Heffernan, R., Hartan, J., Assuncao, R. and Mostashari, F. (2005) A space-time permutation scan statistic for disease outbreak detection. PLOS Med., 2, no. 3, e59.
20. Meinshausen, N. and Buhlmann, P. (2006) High dimensional graphs and variable selection with the lasso. Ann. Statist., 34, 1436-1462.
21. Shorack, G. R. and Wellner, J. A. (2009) Empirical Processes with Applications to Statistics. Philadelphia: Society for Industrial and Applied Mathematics.
22. Sun, W. and Cai, T. T. (2007) Oracle and adaptive compound decision rules for false discovery rate control. J. Am. Statist. Ass., 102, 901-912.
23. Wasserman, L. (2006) All of Nonparametric Statistics. New York: Springer.
24. Xie, J., Cai, T. and Li, H. (2011) Sample size and power analysis for sparse signal recovery in genome-wide association studies. Biometrika, 98, 273-290.
25. Zou, H. (2006) The adaptive lasso and its oracle properties. J. Am. Statist. Ass., 101, 1418-1429.