General empirical bayes wavelet methods and exactly adaptive minimax estimation

Annals of Statistics

Volumn 33, Issue 1, 2005, Pages 54-100

  Zhang, Cun Hui ^a  

^a RUTGERS UNIVERSITY   (United States)

Author keywords

Adaptation; Besov space; Empirical Bayes; Minimax estimation; Nonparametric regression; Threshold estimate; Wavelet; White noise

Indexed keywords

EID: 18444396908     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/009053604000000995     Document Type: Article

References (56)

1. ABRAMOVICH, F., BENJAMINI, Y., DONOHO, D. L. and JOHNSTONE, I. M. (2000). Adapting to unknown sparsity by controlling the false discovery rate. Technical Report 2000-19, Dept. Statistics, Stanford Univ.
2. BARRON, A., BIRGÉ, L. and MASSART, P. (1999). Risk bounds for model selection via penalization. Probab. Theory Related Fields 113 301-413.
3. BERGER, J. O. (1985). Statistical Decision Theory and Bayesian Analysis. Springer, New York.
4. BREIMAN, L., FRIEDMAN, J., OLSHEN, R. and STONE, C. (1984). Classification and Regression Trees. Wadsworth, Belmont, CA.
5. BROWN, L. D., CAI, T. T., Low, M. and ZHANG, C.-H. (2002). Asymptotic equivalence theory for nonparametric regression with random design. Ann. Statist. 30 688-707.
6. BROWN, L. D. and Low, M. G. (1996). Asymptotic equivalence of nonparametric regression and white noise. Ann. Statist. 24 2384-2398.
7. BROWN, L. D., Low, M. G. and ZHAO, L. H. (1997). Superefficiency in nonparametric function estimation. Ann. Statist. 25 2607-2625.
8. CAI, T. T. ( 1999). Adaptive wavelet estimation: A block thresholding and oracle inequality approach. Ann. Statist. 27 898-924.
9. CAI, T. T. (2000). On adaptability and information-pooling in nonparametric function estimation. Technical report, Dept. Statistics, Univ. Pennsylvania.
10. CAVALIER, L. and TSYBAK.OV, A. B. (2001 ). Penalized blockwise Stein's method, monotone oracles and sharp adaptive estimation. Math. Methods Statist. 10 247-282.
11. CAVALIER, L. and TSYBAKOV, A. B. (2002). Sharp adaptation for inverse problems with random noise. Probab. Theory Related Fields 123 323-354.
12. CHUI, C. K. (1992). An Introduction to Wavelets. Academic Press, San Diego, CA.
13. DAUBECHIES, I. (1992). Ten Lectures on Wavelets. SIAM, Philadelphia.
14. DONOHO, D. L. and JOHNSTONE, I. M. (1994a). Ideal spatial adaptation via wavelet shrinkage. Biometrika 81 425-455.
15. DONOHO, D. L. and JOHNSTONE, I. M. (1994b). Minimax risk over ℓ-balls for ℓ-error. Probab. Theory Related Fields 99 277-303.
16. DONOHO, D. L. and JOHNSTONE, I. M. (1995). Adapting to unknown smoothness via wavelet shrinkage. J. Amer. Statist. Assoc. 90 1200-1224.
17. DONOHO, D. L. and JOHNSTONE, I. M. (1998). Minimax estimation via wavelet shrinkage. Ann. Statist. 26879-921.
18. DONOHO, D. L., JOHNSTONE, I. M., KERKYACHARIAN, G. and PICARD, D. (1995). Wavelet shrinkage: Asymptopia? (with discussion). J. Roy. Statist. Soc. Ser. B 57 301-369.
19. DONOHO, D. L., JOHNSTONE, I. M., KERKYACHARIAN, G. and PICARD, D. (1996). Density estimation by wavelet thresholding. Ann. Statist. 24 508-539.
20. DUBUC, S. (1986). Interpolation through an iterative scheme. J. Math. Anal. Appl. 114 185-204.
21. EFROMOVICH, S. (1985). Nonparametric estimation of a density of unknown smoothness. Theory Probab. Appl. 30 557-568.
22. EFROMOVICH, S. (1999). Nonparametric Curve Estimation. Springer, New York.
23. EFROMOVICH, S. and PINSKER, M. S. (1984). An adaptive algorithm for nonparametric filtering. Automat. Remote Control 11 58-65.
24. EFROMOVICH, S. and PINSKER, M. S. (1986). An adaptive algorithm for minimax nonparametric estimation of a spectral density. Problems Inform. Transmission 22 62-76.
25. EFRQN, B. and MORRIS, C. (1973). Stein's estimation rule and its competitors-an empirical Bayes approach. J. Amer. Statist. Assoc. 68 117-130.
26. FOSTER, D. P. and GEORGE, E. I. (1994). The risk inflation criterion for multiple regression. Ann. Statist. 22 1947-1975.
27. FOSTER, D. P., STINE, R. A. and WYNER, A. J. (2002). Universal codes for finite sequences of integers drawn from a monotone distribution. IEEE Trans. Inform. Theory 48 1713-1720.
28. FRIEDMAN, J. (1991). Multivariate adaptive regression splines (with discussion). Ann. Statist. 19 1-141.
29. FRICDMAN, J. and SILVERMAN, B. W. (1989). Flexible parsimonious smoothing and additive modeling. Technometrics 31 3-21.
30. 2. Problems Inform. Transmission 28 44-54.
31. GRAMA, I. and NUSSBAUM, M. (1998). Asymptotic equivalence for nonparametric generalized linear models. Probab. Theory Related Fields 111 167-214.
32. HALL, P., KERKYACHARIAN, G. and PICARD, D. (1998). Block threshold rules for curve estimation using kernel and wavelet methods. Ann. Statist. 26 922-942.
33. HALL, P., KERKYACHARIAN, G. and PICARD, D. (1999). On the minimax optimally of block thresholding wavelet estimators. Statist. Sinica 9 33-49.
34. HALL, P. and PATIL, P. (1995). Formulae for mean integrated squared error of nonlinear wavelet-based density estimators. Ann. Statist. 23 905-928.
35. HALL, P. and PATIL, P. (1996). Effect of threshold rules on performance of wavelet-based curve estimators. Statist. Sinica 6 331-345.
36. HÄRDLE, W., KERKYACHARIAN, G., PICARD, D. and TSYBAKOV, A. (1998). Wavelets, Approximation, and Statistical Applications. Lecture Notes in Statist. 129. Springer, New York.
37. HASTIE, T., TIBSHIRANI, R. and FRIEDMAN, J. H. (2001). The Elements of Statistical Learning: Data Mining, Inference, and Prediction. Springer, New York.
38. IBRAGIMOV, I. A. and KHAS' MINSKII, R. Z. (1981). Statistical Estimation: Asymptotic Theory. Springer, New York.
39. JAMES, W. and STEIN, C. (1961). Estimation with quadratic loss. Proc. Fourth Berkeley Symp. Math. Statist. Probab. 1 361-379. Univ. California Press, Berkeley.
40. JOHNSTONE, I. M., KERKYACHARIAN, G. and PICARD, D. (1992). Estimation d'une densité de probabilité par méthode d'ondelettes. C. R. Acad. Sci. Paris Sér. I Math. 315 211-216.
41. JOHNSTONE, I. M. and SILVERMAN, B. W. (1998). Empirical Bayes approaches to mixture problems and wavelet regression. Technical report, Dept. Statistics, Stanford Univ. Available at http://www-stat.stanford.edu/people/faculty/johnstone/techreports.html.
42. JOHNSTONE, I. M. and SILVERMAN, B. W. (2004). Needles and hay in haystacks: Empirical Bayes estimates of possibly sparse sequences. Ann. Statist. 32 1594-1649.
43. JOHNSTONE, I. M. and SILVERMAN, B. W. (2005). Empirical Bayes selection of wavelet thresholds. Ann. Statist. 33. To appear.
44. JUDITSKY, A. (1997). Wavelet estimators: Adapting to unknown smoothness. Math. Methods Statist. 6 1-25.
45. LEPSKI, O. V., MAMMEN, E. and SPOKOINY, V. G. (1997). Optimal spatial adaptation to inhomogeneous smoothness: An approach based on kernel estimates with variable bandwidth selectors. Ann. Statist. 25 929-947.
46. MORRIS, C. N. (1983). Parametric empirical Bayes inference: Theory and applications (with discussion). J. Amer. Statist. Assoc. 78 47-65.
47. NUSSBAUM, M. (1996). Asymptotic equivalence of density estimation and Gaussian white noise. Ann. Statist. 24 2399-2430.
48. ROBBINS, H. (1951). Asymptotically subminimax solutions of compound statistical decision problems. Proc. Second Berkeley Symp. Math. Statist. Probab. 131-148. Univ. California Press, Berkeley.
49. ROBBINS, H. (1956). An empirical Bayes approach to statistics. Proc. Third Berkeley Symp. Math. Statist. Probab. 1 157-163. Univ. California Press, Berkeley.
50. ROBBINS, H. (1983). Some thoughts on empirical Bayes estimation. Ann. Statist. 11 713-723.
51. TEIN, C. (1956). Inadmissibility of the usual estimator for the mean of a multivariate normal distribution. Proc. Third Berkeley Symp. Math. Statist. Probab. 1 197-206. Univ. California Press, Berkeley.
52. STEIN, C. (1981). Estimation of the mean of a multivariate normal distribution. Ann. Statist. 9 1135-1151.
53. STONE, C. J. (1994). The use of polynomial splines and their tensor products in multivariate function estimation (with discussion). Ann. Statist. 22 118-184.
54. ZHANG, C.-H. (1990). Fourier methods for estimating mixing densities and distributions. Ann. Statist. 18806-831.
55. ZHANG, C.-H. (1997). Empirical Bayes and compound estimation of normal means. Statist. Sinica 7 181-193.
56. ZHANG, C.-H. (2000). General empirical Bayes wavelet methods. Technical Report 2000-007, Dept. Statistics, Rutgers Univ. Available at http://stat.rutgers.edu/~cunhui/papers.