De-Noising by Soft-Thresholding

IEEE Transactions on Information Theory

Volumn 41, Issue 3, 1995, Pages 613-627

  Donoho, David L ^a,b  

^a STANFORD UNIVERSITY   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

adaptive estimation; Empirical wavelet transform; minimax estimation; optimal recovery

Indexed keywords

ERRORS; ESTIMATION; INFORMATION THEORY; PROBABILITY; SIGNAL FILTERING AND PREDICTION; STATISTICAL METHODS; WHITE NOISE;

ADAPTIVE ESTIMATION; DE NOISING; ESTIMATOR; GAUSSIAN RANDOM VARIABLES; MINIMAX ESTIMATION; OPTIMAL RECOVERY; SMOOTHNESS MEASURES; SOFT THRESHOLDING;

WAVELET TRANSFORMS;

EID: 0029307534     PISSN: 00189448     EISSN: 15579654     Source Type: Journal    
DOI: 10.1109/18.382009     Document Type: Article

References (46)

1. T. W. Anderson, “The integral of a symmetric unimodal function,” Trans. Amer. Math. Soc., vol. 6, no. 2, pp. 170–176, 1955.
2. G. Birkhoff and G. C. Rota, Ordinary Differential Equations. New York: Wiley, 1969.
3. A. Cohen, I. Daubechies, and J. C. Feauveau, “Biorthogonal bases of compactly supported wavelets,” Commun. Pure Appl. Math., vol. 45, pp. 485–560, 1990.
4. A. Cohen, I. Daubechies, B. Jawerth, and P. Vial, “Multiresolution analysis, wavelets, and fast algorithms on an interval,” Compt. Rend. Acad. Sci. Paris, pt. A, vol. 316, pp. 417–421, 1992.
5. G. Deslauriers and S. Dubuc, “Symmetric iterative interpolation processes,” Constr. Approx., vol. 5, pp. 49–68, 1989.
6. D. L. Donoho, “Statistical estimation and optimal recovery,” Annals Stat., vol. 22, pp. 238–270, 1994.
7. —, “Asymptotic minimax risk for sup norm loss; solution via optimal recovery,” Prob. Theory Related Fields, vo. 99, pp. 145–170, 1994.
8. —, “Nonlinear solution of linear inverse problems via wavelet-vaguelette decomposition,” to appear in Appl. Computat. Harmonic Anal. 1995.
9. —, “Interpolating wavelet transforms,” to appear in Appl. Computat. Harmonic Anal., 1994.
10. —, “Smooth wavelet decompositions with blocky coefficient kernels,” in Recent Advances in Wavelet Analysis, L.L. Schumaker and G. Webb, Eds. Boston, MA: Academic Press, 1993, pp. 259–308.
11. —, “Unconditional bases are optimal bases for data compression and for statistical estimation,” Appl. Computat. Harmonic Anal. vol. 1, pp. 100–115, 1993.
12. D. L. Donoho and I. M. Johnstone, “Ideal spatial adaptation via wavelet shrinkage,” Biometrika, vol. 81, pp. 425–455, 1994.
13. —, “Neo-classical minimax theorems, thresholding, and adaptation,” to appear in Bernoulli, 1995.
14. —, “Minimax estimation by wavelet shrinkage,” to appear, Ann. Statist., 1995.
15. —, “Adapting to unknown smoothness by wavelet shrinkage,” to appear, J. Amer. Statist. Assoc., 1995.
16. D. L. Donoho, I. M. Johnstone, G. Kerkyacharian, and D. Picard, “Wavelet shrinkage: Asymptopia?” to appear in J Roy. Stat. Soc., ser B, vol. 57, pp. 301–369, 1995.
17. D. L. Donoho, R. C. Liu, and K. B. MacGibbon, “Minimax risk over hyperrectangles, and implications,” Ann. Statist., vol. 18, pp. 1416–1437, 1990.
18. S. Y. Efroimovich, and M. S. Pinsker, “A learning algorithm for nonparametric filtering,” Automat, i Telemeh., vol. 11, pp. 58–65, 1984 (in Russian).
19. M. Frazier and B. Jawerth, “Decomposition of Besov spaces,” Indiana Univ. Math. J., pp. 777–799, 1985.
20. —, “A discrete transform and decomposition of distribution spaces,” J. Funct. Anal., vol. 93, pp. 34–170, 1990.
21. M. Frazier, B. Jawerth, and G. Weiss, “Littlewood—Paley theory and the study of function spaces,” in NSF-CBMS Regional Conf. Series in Mathematics, vol. 79. Providence, RI: American Math. Soc., 1991.
22. S. Van de Geer, “A new approach to least-squares estimation, with applications,” Ann. Statist., vol. 15, pp. 587–602, 1988.
23. G. K. Golubev, “Adaptive asymptotically minimax estimates of smooth signals,” Probl. Pered. Inform., vol. 23, pp. 57–67, 1987.
24. I. M. Johnstone and P. G. Hall, “Empirical functionals and efficient smoothing parameter selection,” J. Roy. Stat. Soc., pt. B, vol. 54, 1992.
25. I. M. Johnstone, G. Kerkyacharian, and D. Picard, “Estimation d'une densité de probabilité par méthode d'ondelettes,” Compt. Rend. Acad. Sci. Paris (A), 1992.
26. G. Kerkyacharian and D. Picard, “Density estimation in Besov spaces,” Stat. Prob. Lett., vol. 13, pp. 15–24, 1992.
27. M. R. Leadbetter, G. Lindgren, and H. Rootzen, Extremes and Related Properties of Random Sequences and Processes. New York: Springer-Verlag, 1983.
28. P. G. Lemarié and Y. Meyer, “Ondelettes et bases Hilbertiennes,” Revista Mathematica Ibero-Americana, vol. 2, pp. 1–18, 1986.
29. O. V. Lepskii, “Asymptotic minimax estimation with prescribed properties,” Theory. Prob. Appl., vol. 34, pp. 604–615, 1990.
30. K. C. Li, “From Stein's unbiased risk estimates to the method of generalized cross validation,” Ann. Statist., vol. 13, pp. 1352–1377, 1985.
31. J. Lu, Y. Xu, J. B. Weaver, and D. M. Healy, Jr., “Noise reduction by constrained reconstructions in the wavelet-transform domain,” Dep. Math., Dartmouth Univ., 1992.
32. S. Mallat and W. L. Hwang, “Singularity detection and processing with wavelets,” IEEE Trans. Inform. Theory, vol. 38, no. 2, pp. 617–643, 1992.
33. Y. Meyer, Ondelettes et opérateurs I: Ondelettes. Paris, France: Hermann, 1990. (English translation: Wavelets and Operators. Cambridge, UK: Cambridge Univ. Press, 1993.)
34. —, “Ondelettes sur l'intervalle,” Revista Mat. Ibero-Americana, vol. 7, pp. 115–134, 1991.
35. C. Micchelli and T. J. Rivlin, “A survey of optimal recovery,” in Optimal Estimation in Approximation Theory, C. Micchelli and T. J. Rivlin, Eds. New York: Plenum, 1977, pp. 1–54.
36. A. S. Nemirovskii, “Nonparametric estimation of smooth regression functions,” Izv. Akad. Nauk. SSR Teckhn. Kibernet., vol. 3, pp. 50–60, 1986 (in Russian). J. Comput. Syst. Sci., vol. 23, no. 6, pp. 1–11, 1986 (in English).
37. A. S. Nemirovskii, B. T. Polyak, and A. B. Tsybakov, “Rate of convergence of nonparametric estimates of maximum-likelihood type,” Probl. Inform. Trans., vol. 21, pp. 258–272, 1985.
38. A. S. Nemirovskii, unpublished manuscript, Math. Sci. Res. Inst., Berkeley, CA 1991.
39. M. Nussbaum, “Spline smoothing in regression models and asymptotic efficiency in L2,” Annals Stat., vol. 13, pp. 984–997, 1985.
40. M. S. Pinsker, “Optimal filtering of square integrable signals in Gaussian white noise,” Probl. Pered. Inform., vol. 16, pp. 52–68, 1980 (in Russian); Probl. Inform. Trans., pp. 120–133, 1980 (in English).
41. E. P. Simoncelli, W. T. Freeman, E. H. Adelson, and D. J. Heeger, “Shiftable multiscale transforms,” IEEE Trans. Inform. Theory, vol. 38, no. 2, pp. 587–607, 1992.
42. B. W. Silverman, “Some properties of a test for multimodality based on kernel density estimation,” in Probability, Statistics, and Analysis, J.F.C. Kingman and G.E.H. Reuter, Eds. Cambridge, UK: Cambridge Univ. Press, 1983.
43. C. J. Stone, “Optimal global rates of convergence for nonparametric estimators,” Ann. Statist., vol. 10, pp. 1040–1053, 1982.
44. J. Traub, G. Wasilkowski, and H. Wozniakowski, Information-Based Complexity. Reading, MA: Addison-Wesley, 1988.
45. G. Wahba and S. Wold, “A completely automatic French curve,” Commun. Statist., vol. 4, pp. 1–17, 1975.
46. G. Wahba, Spline Methods for Observational Data. Philadelphia, PA: SIAM, 1990.