Optimal rates of convergence for estimating the null density and proportion of nonnull effects in large-scale multiple testing

Annals of Statistics

Volumn 38, Issue 1, 2010, Pages 100-145

  Cai, Tony ^a   Jin, Jiashun ^b  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

^b CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Characteristic function; Empirical characteristic function; Fourier analysis; Minimax lower bound; Multiple testing; Null distribution; Proportion of nonnull effects; Rate of convergence; Two point argument

Indexed keywords

EID: 73949087537     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/09-AOS696     Document Type: Article

References (33)

1. ABRAMOVICH, F., BENJAMINI, Y., DONOHO, D. and JOHNSTONE, I. (2006). Adapting to unknown sparsity by controlling the false discovery rate. Ann. Statist. 34 584-653. MR2281879
2. BENJAMINI, Y. and HOCHBERG, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. J. Roy. Statist. Soc. Ser. B 57 289-300. MR1325392
3. BENJAMINI, Y. and HOCHBERG, Y. (2000). On the adaptive control of the false discovery rate in multiple testing with independent statistics. J. Educ. Behav. Statist. 25 60-83.
4. BENJAMINI, Y., KRIEGER, A. M. and YEKUTIELI, D. (2006). Adaptive linear step-up procedures that controls the false discovery rate. Biometrika 93 491-507. MR2261438
5. BLANCHARD, G. and ROQUAIN, É. (2007). Adaptive FDR control under independence and dependence. Available at arxiv:0707.0536v2.
6. CAI, T., JIN, J. and LOW, M. (2007). Estimation and confidence sets for sparse normal mixtures. Ann. Statist. 35 2421-2449. MR2382653
7. CELISSE, A. and ROBIN, S. (2008). A leave-p-out based estimation of the proportion of null hypotheses. Available at arxiv:0804.1189. MR2411944
8. DONOHO, D. and JIN, J. (2004). Higher criticism for detecting sparse heterogeneous mixtures. Ann. Statist. 32 962-994. MR2065195
9. DONOHO, D. and JIN, J. (2006). Asymptotic minimaxity of false discovery rate thresholding for sparse exponential data. Ann. Statist. 34 2980-3018. MR2329475
10. DONOHO, D. and LIU, R. C. (1991). Geometrizing rates of convergence, II. Ann. Statist. 19 633-667. MR1105839
11. EFRON, B. (2004). Large-scale simultaneous hypothesis testing: The choice of a null hypothesis. J. Amer. Statist. Assoc. 99 96-104. MR2054289
12. EFRON, B. (2008). Microarrays, empirical Bayes and the two-groups model. Statist. Sci. 23 1-22. MR2431866
13. EFRON, B., TIBSHIRANI, R., STOREY, J. and TUSHER, V. (2001). Empirical Bayes analysis of a microarray experiment. J. Amer. Statist. Assoc. 96 1151-1160. MR1946571
14. ERDELYI, A. (1956). Asymptotic Expansions. Dover, New York. MR0078494
15. FAN, J. (1991). On the optimal rates of convergence for nonparametric deconvolution problems. Ann. Statist. 19 1257-1272. MR1126324
16. FINNER, H., DICKHAUS, T. and ROTERS, M. (2009). On the false discovery rate and on asymptotically optimal rejection curve. Ann. Statist. 37 596-618. MR2502644
17. GENOVESE, C. andWASSERMAN, L. (2004). A stochastic process approach to false discovery control. Ann. Statist. 32 1035-1061. MR2065197 (Pubitemid 41250292)
18. IBRAGIMOV, I.A., NEMIROVSKII, A. S. and KHAS'MINSKII, R. Z. (1986). Some problems on nonparametric estimation in Gaussian white noise. Theory Probab. Appl. 31 391-406. MR0866866
19. JIN, J. and CAI, T. (2006). Estimating the null and the proportion of nonnull effects in large-scale multiple comparisons. Available at arxiv.math/0611108v1. MR2325113
20. JIN, J. and CAI, T. (2007). Estimating the null and the proportion of nonnull effects in large-scale multiple comparisons. J. Amer. Statist. Assoc. 102 495-506. MR2325113
21. JIN, J. (2008). Proportion of nonzero normal means: Universal oracle equivalences and uniformly consistent estimations. J. R. Stat. Soc. Ser. B Stat. Methodol. 70(3) 461-493.
22. MALLAT, S. (1998). A Wavelet Tour of Signal Processing, 2nd ed. Academic Press, New York. MR1614527
23. MEINSHAUSEN, M. and RICE, J. (2006). Estimating the proportion of false null hypothesis among a large number of independent tested hypotheses. Ann. Statist. 34 373-393. MR2275246
24. MÜLLER, P., PARMIGIANI, G., ROBERT, C. and ROUSSEAU, J. (2004). Optimal sample size for multiple testing: The case of gene expression microarrays. J. Amer. Statist. Assoc. 99 990-1001. MR2109489
25. NEWTON, M.,KENDZIORSKI, C., RICHMOND, C., BLATTNER, F. and TSUI, K. (2001). On differential variability of expression ratios: Improving statistical inference about gene expression changes from microarray data. J. Comput. Biol. 8 37-52.
26. NEUVIAL, P. (2008). Asymptotic properties of false discovery rate controlling procedures under independence. Electron. J. Stat. 2 1065-1110. MR2460858
27. SILVERMAN, B. W. (1986). Density Estimation for Statistics and Data Analysis. Chapman and Hall, London. MR0848134
28. STOREY, J. D. (2002). A direct approach to false discovery rate. J. R. Stat. Soc. Ser. B Stat. Methodol. 64 479-498. MR1924302
29. SUN, W. and CAI, T. (2007). The oracle and compound decision rules for false discovery rate control. J. Amer. Statist. Assoc. 102 901-912. MR2411657
30. SWANEPOEL, J. W. H. (1999). The limiting behavior of a modified maximal symmetric 2s-spacing with applications. Ann. Statist. 27 24-35. MR1701099
31. VAN DER LAAN, M., DUDOIT, S. and POLLARD, K. (2004). Multiple testing (III): Augmentation procedures for control of the generalized family-wise error rate and tail probabilities for the proportion of false positives. Technical report, Dept. Biostatistics, Univ. California, Berkeley.
32. WEST, M. (1987). On scale mixtures of normal distributions. Biometrika 3 646-648. MR0909372
33. ZHANG, C.-H. (1990). Fourier methods for estimating mixing densities and distributions. Ann. Statist. 18 806-831. MR1056338