Minimax estimation via wavelet shrinkage

Annals of Statistics

Volumn 26, Issue 3, 1998, Pages 879-921

  Donoho, David L ^b   Johnstone, Iain M ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b STANFORD UNIVERSITY   (United States)

Author keywords

Besov; H lder; Minimax Bayes estimation; Minimax decision theory; Nonlinear estimation; Nonparametric regression; Orthonormal bases of compactly supported wavelets; Renormalization; Sobolev; Triebel spaces; White noise approximation; White noise model

Indexed keywords

EID: 0032334093     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/aos/1024691081     Document Type: Article

References (64)

1. BERGH, J. and LÖFSTRÖM, J. (1976). Interpolation spaces: An Introduction. Springer, New York.
2. BICKEL, P. J. (1983). Minimax estimation of a normal mean subject to doing well at a point. In Recent Advances in Statistics (M. H. Rizvi, J. S. Rustagi and D. Siegmund, eds.) 511-528. Academic Press, New York.
3. BIRGÉ, L. and MASSART, P. (1997). From model selection to adaptive estimation. In Festschrift for Lucien Le Cam: Research Papers in Probability and Statistics (E. T. D. Pollard and G. Yang, eds.) 55-87. Springer, New York.
4. BREIMAN, L., FRIEDMAN, J., OLSHEN, R. and STONE, C. (1983). CART: Classification and Regression Trees. Wadsworth, Belmont, CA.
5. BROWN, L. D. and LOW, M. G. (1996). Asymptotic equivalence of nonparametric regression and white noise. Ann. Statist. 24 2384-2398.
6. CHUI, C. K. (1992). An Introduction to Wavelets. Academic Press, San Diego.
7. COHEN, A., DAUBECHIES, I., JAWERTH, B. and VIAL, P. (1993). Multiresolution analysis, wavelets, and fast algorithms on an interval. C. R. Acad. Sci. Paris Sér. I Math. 316 417-421.
8. COHEN, A., DAUBECHIES, I. and VIAL, P. (1993). Wavelets and fast wavelet transform on an interval. Appl. Comput. Harmon. Anal. 1 54-81.
9. DAUBECHIES, I. (1988). Orthonormal bases of compactly supported wavelets. Comm. Pure Appl. Math. 41 909-996.
10. DAUBECHIES, I. (1992). Ten Lectures on Wavelets. SIAM, Philadelphia.
11. DESLAURIERS, G. and DUBUC, S. (1987). Interpolation dyadique. In Fractals, Dimensions non-entières et applications. Masson, Paris.
12. DESLAURIERS, G. and DUBUC, S. (1989). Symmetric iterative interpolation processes. Constr. Approx. 5 49-68.
13. DEVORE, R. and POPOV, V. (1988). Interpolation of Besov spaces. Trans. Amer. Math. Soc. 305 397-414.
14. DONOHO, D. (1992). De-noising via soft-thresholding. IEEE Trans. Inform. Theory 41 613-627.
15. DONOHO, D. (1994). Asymptotic minimax risk for sup-norm loss; solution via optimal recovery. Probab. Theory Related Fields 99 145-170.
16. DONOHO, D. (1995). Nonlinear solution of linear inverse problems by wavelet-vaguelette decomposition. Appl. Comput. Harmon. Anal. 2 101-126.
17. p-balls. Technical Report 322, Dept. Statistics, Stanford Univ.
18. DONOHO, D. L. and JOHNSTONE, I. M. (1994a). Ideal spatial adaptation via wavelet shrinkage. Biometrika 81 425-455.
19. q-error. Probab. Theory Related Fields 99 277-303.
20. DONOHO, D. L. and JOHNSTONE, I. M. (1995). Adapting to unknown smoothness via wavelet shrinkage. J. Amer. Statist. Assoc. 90 1200-1224.
21. DONOHO, D. L. and JOHNSTONE, I. M. (1997). Asymptotic minimaxity of wavelet estimators with sampled data. Technical Report, Dept. Statistics, Stanford Univ.
22. DONOHO, D. L., JOHNSTONE, I. M., KERKYACHARIAN, G. and PICARD, D. (1995). Wavelet shrinkage: Asymptopia? (with discussion). J. Roy. Statist. Soc. Ser. B 57 301-369.
23. DONOHO, D. L., JOHNSTONE, I. M., KERKYACHARIAN, G. and PICARD, D. (1996). Density estimation by wavelet thresholding. Ann. Statist. 24 508-539.
24. DONOHO, D. L., LIU, R. C. and MACGIBBON, K. B. (1990). Minimax risk over hyperrectangles, and implications. Ann. Statist. 18 1416-1437.
25. DONOHO, D. L. and NUSSBAUM, M. (1990). Minimax quadratic estimation of a quadratic functional. J. Complexity 6 290-323.
26. DUBUC, S. (1986). Interpolation through an iterative scheme. J. Math. Anal. Appl. 114 185-204.
27. EFROIMOVICH, S. and PINSKER, M. (1981). Estimation of square-integrable density on the basis of a sequence of observations. Problems Inform. Transmission 17 182-195. (In Russian in Problemy Peredatsii Informatsii 17 50-68.)
28. EFROIMOVICH, S. and PINSKER, M. (1981). Estimation of square-integrable density on the basis of a sequence of observations. Problems Inform. Transmission 17 182-195. (In Russian in Problemy Peredatsii Informatsii 17 50-68.)
29. EFROIMOVICH, S. and PINSKER, M. (1982). Estimation of square-integrable probability density of a random variable. Problems Inform. Transmission 18 175-189. (In Russian in Problemy Peredatsii Informatsii 18 19-38.)
30. EFROIMOVICH, S. and PINSKER, M. (1982). Estimation of square-integrable probability density of a random variable. Problems Inform. Transmission 18 175-189. (In Russian in Problemy Peredatsii Informatsii 18 19-38.)
31. FEICHTINGER, H. and GRÖCHENIG, K. (1989). Banach spaces related to integrable group representations and their atomic decompositions. I. J. Funct. Anal. 86 307-340.
32. FRAZIER, M. and JAWERTH, B. (1985). Decomposition of Besov spaces. Indiana Univ. Math. J. 34 777-799.
33. FRAZIER, M. and JAWERTH, B. (1986). The φ-transform and applications to distribution spaces. Function Spaces and Applications. Lecture Notes in Math. 1302 223-246. Springer, Berlin.
34. FRAZIER, M. and JAWERTH, B. (1990). A discrete transform and decomposition of distribution spaces. J. Funct. Anal. 93 34-170.
35. FRAZIER, M., JAWERTH, B. and WEISS, G. (1991). Littlewood-Paley Theory and the Study of Function Spaces. Amer. Math. Soc., Providence, RI.
36. n. In Constructive Theory of Functions, Conference Varna (B. Sendov, ed.) 174-183. Bulgarian Acad. Sci., Sofia.
37. IBRAGIMOV, I. A. and KHAS'MINSKII, R. Z. (1981). Statistical Estimation: Asymptotic Theory. Springer, New York.
38. IBRAGIMOV, I. A. and KHAS'MINSKII, R. Z. (1982). Bounds for the risks of non-parametric regression estimates. Theory Probab. Appl. 27 84-99.
39. JAFFARD, S. (1989). Estimation hölderiennes ponctuelle des fonctions au moyen des coefficients d'ondelettes. C. R. Acad. Sci. Paris Sér. I Math. 308 79-81.
40. JOHNSTONE, I. M. (1994). Minimax Bayes, asymptotic minimax and sparse wavelet priors. In Statistical Decision Theory and Related Topics V (S. Gupta and J. Berger, eds.) 303-326. Springer, New York.
41. JOHNSTONE, I., KERKYACHARIAN, G. and PICARD, D. (1992). Estimation d'une densité de probabilité par méthode d'ondelettes. C. R. Acad. Sci. Paris Ser. A 315 211-216.
42. KAISER, G. (1994). A Friendly Guide to Wavelets. Springer, New York.
43. KERKYACHARIAN, G. and PICARD, D. (1992). Density estimation in Besov spaces. Statist. Probab. Lett. 13 15-24.
44. LE CAM, L. (1986). Asymptotic Methods in Statistical Decision Theory. Springer, Berlin.
45. LEMARIÉ, P. and MEYER, Y. (1986). Ondelettes et bases Hilbertiennes. Rev. Mat. Iberoamericana 2 1-18.
46. LEPSKI, O., MAMMEN, E. and SPOKOINY, V. (1997). Optimal spatial adaptation to inhomogeneous smoothness; an approach based on kernel estimates with variable bandwidth selectors. Ann. Statist. 25 929-947.
47. 2(R). Trans. Amer. Math. Soc. 315 69-87.
48. MALLAT, S. G. (1989b). Multifrequency channel decompositions of images and wavelet models. IEEE Trans. on Acoust. Signal Speech Process. 37 2091-2110.
49. MALLAT, S. G. (1989c). A theory for multiresolution signal decomposition: the wavelet representation, IEEE Transactions on Pattern Analysis and Machine Intelligence 11 674-693.
50. MEYER, Y. (1990a). Ondelettes et Opérateurs I. Hermann, Paris. (English translation published by Cambridge Univ. Press.)
51. MEYER, Y. (1990b). Ondelettes et Opérateurs II. Opérateurs de Calderón-Zygmund. Hermann, Paris.
52. MEYER, Y. (1991). Ondelettes sur l'intervalle. Rev. Mat. Iberoamericana 7 115-133.
53. MÜLLER, H.-G. and STADTMULLER, U. (1987). Variable bandwidth kernel estimators of regression curves. Ann. Statist. 15 182-201.
54. NEMIROVSKII, A. (1985). Nonparametric estimation of smooth regression functions. Izv. Akad. Nauk. SSR Teckhn. Kibernet. 3 50-60 (in Russian). J. Comput. System Sci. 23 1-11 (1986) (in English).
55. NEMIROVSKII, A. (1985). Nonparametric estimation of smooth regression functions. Izv. Akad. Nauk. SSR Teckhn. Kibernet. 3 50-60 (in Russian). J. Comput. System Sci. 23 1-11 (1986) (in English).
56. NEMIROVSKII, A., POLYAK, B. and TSYBAKOV, A. (1985). Rate of convergence of nonpararnetric estimates of maximum-likelihood type. Problems Inform. Transmission 21 258-272.
57. 2. Ann. Statist. 13 984-997.
58. PEETRE, J. (1975). New Thoughts on Besov Spaces I. Duke Univ.
59. PINSKER, M. (1980). Optimal filtering of square integrable signals in Gaussian white noise. Problems Inform. Transmission 16 120-133. (In Russian in Problemy Peredatsii Informatsii 16 52-68.)
60. PINSKER, M. (1980). Optimal filtering of square integrable signals in Gaussian white noise. Problems Inform. Transmission 16 120-133. (In Russian in Problemy Peredatsii Informatsii 16 52-68.)
61. SPECKMAN, P. (1985). Spline smoothing and optimal rates of convergence in nonparametric regression models. Ann. Statist. 13 970-983.
62. STONE, C. (1982). Optimal global rates of convergence for nonparametric estimators. Ann. Statist. 10 1040-1053.
63. TRIEBEL, H. (1983). Theory of Function Spaces. Birkhäuser, Basel.
64. WALTER, G. (1994). Wavelets and Other Orthogonal Systems with Applications. Chemical Rubber Company, Boca Raton, FL.