Empirical bayes selection of wavelet thresholds

Annals of Statistics

Volumn 33, Issue 4, 2005, Pages 1700-1752

  Johnstone, Iain M ^a   Silverman, Bernard W ^b  

^a STANFORD UNIVERSITY   (United States)

^b UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

Adaptivity; Bayesian inference; Nonparametric regression; Smoothing; Sparsity

Indexed keywords

EID: 18444410406     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/009053605000000345     Document Type: Article

References (51)

1. ABRAMOVICH, F., AMATO, U. and ANGELINI, C. (2004). On optimality of Bayesian wavelet estimators. Scand. J. Statist. 31 217-234.
2. ABRAMOVICH, F. and BENJAMINI, Y. (1995). Thresholding of wavelet coefficients as a multiple hypotheses testing procedure. Wavelets and Statistics. Lecture Notes in Statist. 103 5-14, Springer, Berlin.
3. ABRAMOVICH, F., BENJAMINI, Y., DONOHO, D. and JOHNSTONE, I. (2005). Adapting to unknown sparsity by controlling the false discovery rate. Ann. Statist. To appear. Available at www-stat.stanford.edu/~imj.
4. ABRAMOVICH, F., SAPATINAS, T. and SILVERMAN, B. W. (1998). Wavelet thresholding via a Bayesian approach. J. R. Stat. Soc. Ser. B Stat. Methodol. 60 725-749.
5. ABRAMOVICH, F. and SILVERMAN, B. W. (1998). Wavelet decomposition approaches to statistical inverse problems. Biometrika 85 115-129.
6. ANTONIADIS, A., JANSEN, M., JOHNSTONE, I. M. and SILVERMAN, B. W. (2004). EbayesThresh: MATLAB software for Empirical Bayes thresholding. Available at www-lmc.imag.fr/lmc-sms/Anestis.Antoniadis/EBayesThresh.
7. BENJAMINI, Y. and HOCHBERG, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. J. Roy. Statist. Soc. Ser. B 57 289-300.
8. BENJAMINI, Y. and YEKUTIELI, D. (2001). The control of the false discovery rate in multiple testing under dependency. Ann. Statist. 29 1165-1188.
9. BIRGÉ, L. and MASSART, P. (2001). Gaussian model selection. J. Eur. Math. Soc. 3 203-268.
10. CAI, T. T. and SILVERMAN, B. W. (2001). Incorporating information on neighboring coefficients into wavelet estimation. Sankhyā Ser. B 63 127-148.
11. CHIPMAN, H. A., KOLACZYK, E. D. and MCCULLOCH, R. E. (1997). Adaptive Bayesian wavelet shrinkage. J. Amer. Statist. Assoc. 92 1413-1421.
12. CLYDE, M. and GEORGE, E. I. (2000). Flexible empirical Bayes estimation for wavelets. J. R. Stat. Soc. Ser. B Stat. Methodol. 62 681-698.
13. CLYDE, M., PARMIGIANI, G. and VIDAKOVIC, B. (1998). Multiple shrinkage and subset selection in wavelets. Biometrika 85 391-401.
14. COHEN, A., DAUBECHIES, I. and VIAL, P. (1993). Wavelets on the interval and fast wavelet transforms. Appl. Comput. Harmon. Anal. 1 54-81.
15. COIFMAN, R. R. and DONOHO, D. L. (1995). Translation-invariant de-noising. Wavelets and Statistics. Lecture Notes in Statist. 103 125-150, Springer, Berlin.
16. DAUBECHIES, I. (1992). Ten Lectures on Wavelets. SIAM, Philadelphia.
17. DELYON, B. and JUDITSKY, A. (1996). On minimax wavelet estimators. Appl. Comput. Harmon. Anal. 3 215-228.
18. DONOHO, D. L. and JOHNSTONE, I. M. (1994). Spatial adaptation via wavelet shrinkage. Biometrika 81 425-455.
19. DONOHO, D. L. and JOHNSTONE, I. M. (1995). Adapting to unknown smoothness via wavelet shrinkage. J. Amer. Statist. Assoc. 90 1200-1224.
20. DONOHO, D. L. and JOHNSTONE, I. M. (1999). Asymptotic minimaxity of wavelet estimators with sampled data. Statist. Sinica 9 1-32.
21. DONOHO, D. L., JOHNSTONE, I. M., KERKYACHARIAN, G. and PICARD, D. (1995). Wavelet shrinkage: Asymptopia? (with discussion). J. Roy. Statist. Soc. Ser. B 57 301-369.
22. DONOHO, D. L., JOHNSTONE, I. M., KERKYACHARIAN, G. and PICARD, D. (1997). Universal near minimaxity of wavelet shrinkage. In Festschrift for Lucien Le Cam (D. Pollard, E. Torgersen and G. L. Yang, eds.) 183-218, Springer, Berlin.
23. EFROMOVICH, S. (1999). Quasi-linear wavelet estimation. J. Amer. Statist. Assoc. 94 189-204.
24. GEORGE, E. I. and FOSTER, D. P. (1998). Empirical Bayes variable selection. In Proc. Workshop on Model Selection. Special Issue of Rassegna di Metodi Statistici ed Applicazioni (W. Racugno, ed.) 79-108. Pitagora Editrice, Bologna.
25. GEORGE, E. I. and FOSTER, D. P. (2000). Calibration and empirical Bayes variable selection. Biometrika 87 731-748.
26. 0. In Proc. 1992 IEEE International Symposium on Circuits and Systems 2 963-966. IEEE Press, Piscataway, NJ.
27. JOHNSTONE, I. M. (1999). Wavelet shrinkage for correlated data and inverse problems: Adaptivity results. Statist. Sinica 9 51-83.
28. JOHNSTONE, I. M. (2003). Threshold selection in transform shrinkage. In Statistical Challenges in Modern Astronomy III (E. D. Feigelson and G. J. Babu, eds.) 343-360. Springer, New York.
29. JOHNSTONE, I. M. (2004). Function estimation and Gaussian sequence models. Draft of a monograph.
30. JOHNSTONE, I. M. and SILVERMAN, B. W. (1997). Wavelet threshold estimators for data with correlated noise. J. Roy. Statist. Soc. Ser. B 59 319-351.
31. JOHNSTONE, I. M. and SILVERMAN, B. W. (1998). Empirical Bayes approaches to mixture problems and wavelet regression. Technical report, Dept. Statistics, Stanford Univ.
32. JOHNSTONE, I. M. and SILVERMAN, B. W. (2004). Boundary coiflets for wavelet shrinkage in function estimation. J. Appl. Probab. 41A 81-98.
33. JOHNSTONE, I. M. and SILVERMAN, B. W. (2004). Needles and straw in haystacks: Empirical Bayes estimates of possibly sparse sequences. Ann. Statist. 32 1594-1649.
34. JOHNSTONE, I. M. and SILVERMAN, B. W. (2005). EbayesThresh: R programs for empirical Bayes thresholding. J. Statist. Software 12(8) 1-38. With accompanying software and manual.
35. LIANG, K.-Y. and ZEGER, S. L. (1986). Longitudinal data analysis using generalized linear models. Biometrika 73 13-22.
36. MALLAT, S. (1999). A Wavelet Tour of Signal Processing, 2nd expanded ed. Academic Press, San Diego, CA.
37. MEYER, Y. (1992). Wavelets and Operators. Cambridge Univ. Press.
38. MÜLLER, P. and VIDAKOVIC, B., eds. (1999). Bayesian Inference in Wavelet-Based Models. Lecture Notes in Statist. 141, Springer, New York.
39. NASON, G. P. (1996). Wavelet shrinkage using cross-validation. J. Roy. Statist. Soc. Ser. B 58 463-479.
40. NASON, G. P. (1998). WaveThresh3 Software. Dept. Mathematics, Univ. Bristol, UK. Available from the CRAN Archive.
41. PAUL, D. (2004). Adaptive estimation in linear inverse problems using penalized model selection. Technical report, Dept. Statistics, Stanford Univ.
42. PENSKY, M. (2005). Frequentist optimality of Bayesian wavelet shrinkage rules for Gaussian and non-Gaussian noise. Ann. Statist. To appear.
43. POLZEHL, J. and SPOKOINY, V. (2000). Adaptive weights smoothing with applications to image restoration. J. R. Stat. Soc. Ser. B Stat. Methodol. 62 335-354.
44. TORTILLA, J., STRELA, V., WAINWRIGHT, M. J. and SIMONCELLI, E. P. (2003). Image denoising using scale mixtures of Gaussians in the wavelet domain. IEEE Trans. Image Process. 12 1338-1351.
45. R DEVELOPMENT CORE TEAM (2004). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. Available at www.R-project.org.
46. SILVERMAN, B. W. (1999). Wavelets in statistics: Beyond the standard assumptions. R. Soc. Lond. Philos. Trans. Ser. A Math. Phys. Eng. Sci. 357 2459-2473.
47. TRIEBEL, H. (1983). Theory of Function Spaces. Birkhäuser, Basel.
48. VIDAKOVIC, B. (1998). Wavelet-based nonparametric Bayes methods. Practical Nonparametric and Semiparametric Bayesian Statistics. Lecture Notes in Statist. 133 133-155. Springer, New York.
49. VIDAKOVIC, B. (1999). Statistical Modeling by Wavelets. Wiley, New York.
50. WAINWRIGHT, M. J., SIMONCELLI, E. P. and WILLSKY, A. S. (2001). Random cascades on wavelet trees and their use in analyzing and modeling natural images. Appl. Comput. Harmon. Anal. 11 89-123.
51. ZHANG, C.-H. (2005). General empirical Bayes wavelet methods and exactly adaptive minimax estimation. Ann. Statist. 33 54-100.