Adapting to unknown sparsity by controlling the false discovery rate

Annals of Statistics

Volumn 34, Issue 2, 2006, Pages 584-653

  Abramovich, Felix ^a   Benjamini, Yoav ^a   Donoho, David L ^b   Johnstone, Iain M ^b  

^a TEL AVIV UNIVERSITY   (Israel)

^b STANFORD UNIVERSITY   (United States)

Author keywords

Minimax estimation; Model selection; Multiple comparisons; Smoothing parameter selection; Thresholding; Wavelet denoising

Indexed keywords

EID: 33746242092     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/009053606000000074     Document Type: Article

References (43)

1. ABRAMOVICH, F. and BENJAMINI, Y. (1995). Thresholding of wavelet coefficients as multiple hypotheses testing procedure. Wavelets and Statistics. Lecture Notes in Statist. 103 5-14, Springer, Berlin.
2. ABRAMOVICH, F. and BENJAMINI, Y. (1996). Adaptive thresholding of wavelet coefficients. Comput. Statist. Data Anal. 22 351-361. MR1411575
3. ABRAMOVICH, F., BENJAMINI, Y., DONOHO, D. and JOHNSTONE, I. M. (2005). Adapting to unknown sparsity by controlling the false discovery rate. (Extended version.) Available atwww.arXiv.org/abs/math.st/0505374.
4. AKAIKE, H. (1973). Information theory and an extension of the maximum likelihood principle. In Second International Symposium on Information Theory (B. N. Petrov and F. Czáki, eds.) 267-281. Akadémiai Kiadó, Budapest. MR0483125
5. BENEDETTO, J. and ANTHONY, T. (1993). A wavelet auditory model and data compression. Appl. Comput. Harmon. Anal. 1 3-28.
6. BENJAMINI, Y. and HOCHBERG, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. J. Roy. Statist. Soc. Ser. B 57 289-300. MR1325392
7. BENJAMINI, Y. and HOCHBERG, Y. (2000). On the adaptive control of the false discovery rate in multiple testing with independent statistics. J. Educational and Behavioral Statistics 25 60-83.
8. BENJAMINI, Y., KRIEGER, A. M. and YEKUTIELI, D. (2006). Adaptive linear step-up procedures that control the false discovery rate. Biometrika. To appear.
9. BENJAMINI, Y. and YEKUTIELI, D. (2001). The control of the false discovery rate in multiple testing under dependency. Ann. Statist. 29 1165-1188. MR1869245
10. BIRGÉ, L. and MASSART, P. (2001). Gaussian model selection. J. Eur. Math. Soc. 3 203-268. MR1848946
11. BREIMAN, L. and FREEDMAN, D. (1983). How many variables should be entered in a regression equation? J. Amer. Statist. Assoc. 78 131-136. MR0696857
12. DEVORE, R. A., JAWERTH, B. and LUCIER, B. (1992). Image compression through wavelet transform coding. IEEE Trans. Inform. Theory 38 719-746. MR1162221
13. DONOHO, D. L. (1995). De-noising by soft-thresholding. IEEE Trans. Inform. Theory 41 613-627. MR1331258
14. DONOHO, D. L. and JOHNSTONE, I. M. (1994). Ideal denoising in an orthonormal basis chosen from a library of bases. C. R. Acad. Sci. Paris Ser. I Math. 319 1317-1322. MR1310679
15. q-error. Probab. Theory Related Fields 99 277-303. MR1278886
16. DONOHO, D. L. and JOHNSTONE, I. M. (1995). Adapting to unknown smoothness via wavelet shrinkage. J. Amer. Statist. Assoc. 90 1200-1224. MR1379464
17. DONOHO, D. L., JOHNSTONE, I. M., HOCH, J. C. and STERN, A. S. (1992). Maximum entropy and the nearly black object (with discussion). J. Roy. Statist. Soc. Ser. B. 54 41-81. MR1157714
18. DONOHO, D. L., JOHNSTONE, I. M., KERKYACHARIAN, G. and PICARD, D. (1995). Wavelet shrinkage: Asymptopia? (with discussion). J. Roy. Statist. Soc. Ser. B 57 301-369. MR1323344
19. EFRON, B. (1986). How biased is the apparent error rate of a prediction rule? J. Amer. Statist. Assoc. 81 461-170. MR0845884
20. EFRON, B., TIBSHIRANI, R. J., STOREY, J. D. and TUSHER, V. (2001). Empirical Bayes analysis of a microarray experiment. J. Amer. Statist. Assoc. 96 1151-1160. MR1946571
21. FIELD, D. J. (1987). Relation between the statistics of natural images and the response properties of cortical cells. J. Opt. Soc. Amer. A 4 2379-2394.
22. FOSTER, D. P. and GEORGE, E. I. (1994). The risk inflation criterion for multiple regression. Ann. Statist. 22 1947-1975. MR1329177
23. FOSTER, D. P. and STINE, R. A. (1999). Local asymptotic coding and the minimum description length. IEEE Trans. Inform. Theory 45 1289-1293. MR1686271
24. GENOVESE, C. and WASSERMAN, L. (2004). A stochastic process approach to false discovery control. Ann. Statist. 32 1035-1061. MR2065197
25. GEORGE, E. I. and FOSTER, D. P. (2000). Calibration and empirical Bayes variable selection. Biometrika 87 731-747. MR1813972
26. HOCHBERG, Y. and TAMHANE, A. (1987). Multiple Comparison Procedures. Wiley, New York. MR0914493
27. HOMMEL, G. (1988). A stagewise rejective multiple test procedure based on a modified Bonferroni test. Biometrika 75 383-386.
28. HUANG, J. and MUMFORD, D. (1999). Statistics of natural images and models. In Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition 1 541-547.
29. JOHNSTONE, I. M. (1994). Minimax Bayes, asymptotic minimax and sparse wavelet priors. In Statistical Decision Theory and Related Topics V (S. Gupta and J. Berger, eds.) 303-326. Springer, New York. MR1286310
30. JOHNSTONE, I. M. and SILVERMAN, B. W. (2004). Needles and straw in haystacks: Empirical Bayes estimates of possibly sparse sequences. Ann. Statist. 32 1594-1649. MR2089135
31. MALLOWS, C. L. (1973). Some comments on Cp. Tecknometrics 15 661-675.
32. POLLARD, D. (1984). Convergence of Stochastic Processes. Springer, New York. MR0762984
33. RUDERMAN, D. L. (1994). The statistics of natural images. Network: Computation in Neural Systems 5 517-548.
34. SARKAR, S. K. (2002). Some results on false discovery rate in stepwise multiple testing procedures. Ann. Statist. 30 239-257. MR1892663
35. SCHWARZ, G. (1978). Estimating the dimension of a model. Ann. Statist. 6 461-464. MR0468014
36. SEEGER, P. (1968). A note on a method for the analysis of significances en masse. Technometrics 10 586-593.
37. SHAFFER, J. (1995). Multiple hypothesis testing. Ann. Rev. Psychology 46 561-584.
38. SIMES, R. (1986). An improved Bonferroni procedure for multiple tests of significance. Biometrika 73 751-754. MR0897872
39. SIMONCELLI, E. P. (1999). Bayesian denoising of visual images in the wavelet domain. Bayesian Inference in Wavelet Based Models. Lecture Notes in Statist. 141 292-308. Springer, New York.
40. STOREY, J. D. (2002). A direct approach to false discovery rates. J. R. Stat. Soc. Ser. B Stat. Methodol. 64 479-498. MR1924302
41. STOREY, J. D., TAYLOR, J. E. and SIEGMUND, D. (2004). Strong control, conservative point estimation and simultaneous conservative consistency of false discovery rates: A unified approach. J. R. Stat. Soc. Ser. B Stat. Methodol. 66 187-205. MR2035766
42. TIBSHIRANI, R. and KNIGHT, K. (1999). The covariance inflation criterion for adaptive model selection. J. R. Stat. Soc. Ser. B Stat. Methodol. 61 529-546. MR1707859
43. VAN DE GEER, S. (1990). Estimating a regression function. Ann. Statist. 18 907-924. MR1056343