Image denoising using scale mixtures of Gaussians in the wavelet domain

IEEE Transactions on Image Processing

Volumn 12, Issue 11, 2003, Pages 1338-1351

  Portilla, Javier ^a   Strela, Vasily ^b   Wainwright, Martin J ^c   Simoncelli, Eero P ^d  

^a UNIVERSITY OF GRANADA   (Spain)

^b DREXEL UNIVERSITY   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

^d NEW YORK UNIVERSITY   (United States)

Author keywords

Bayesian estimation; Gaussian scale mixtures; Hidden Markov model; Natural images; Noise removal; Overcomplete representations; Statistical models; Steerable pyramid

Indexed keywords

COMPUTER SIMULATION; ERRORS; ESTIMATION; GAUSSIAN NOISE (ELECTRONIC); MARKOV PROCESSES; MATHEMATICAL MODELS; PERFORMANCE; STATISTICAL METHODS; VECTORS; WHITE NOISE;

ADDITIVE WHITE GAUSSIAN NOISE; BAYESIAN LEAST SQUARES ESTIMATE; GAUSSIAN VECTOR; HIDDEN MARKOV MODEL; HIDDEN POSITIVE SCALAR MULTIPLIER; IMAGE DENOISING;

IMAGE PROCESSING;

EID: 0242636409     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2003.818640     Document Type: Article

References (58)

1. D. Andrews and C. Mallows, "Scale mixtures of normal distributions," J. R. Statist. Soc, vol. 36, p. 99, 1974.
2. M. J. Wainwright and E. P. Simoncelli, "Scale mixtures of Gaussians and the statistics of natural images," in Adv. Neural Information Processing Systems, S. A. Solla, T. K. Leen, and K. R. Müller, Eds. Cambridge, MA: MIT Press, 2000, vol. 12, pp. 855-861.
3. M. J. Wainwright, E. P. Simoncelli, and A. S. Willsky, "Random cascades on wavelet trees and their use in modeling and analyzing natural imagery," Appl. Comput. Harmon. Anal., vol. 11, no. 1, pp. 89-123, July 2001.
4. D. L. Ruderman, "The statistics of natural images," Network: Comput. Neural Syst., vol. 5, pp. 517-548, 1996.
5. D. J. Field, "Relations between the statistics of natural images and the response properties of cortical cells," J. Opt. Soc. Amer. A, vol. 4, no. 12, pp. 2379-2394, 1987.
6. J. G. Daugman, "Entropy reduction and decorrelation in visual coding by oriented neural receptive fields," IEEE Trans. Biomed. Eng., vol. 36, no. 1, pp. 107-114, 1989.
7. S. G. Mallat, "A theory for multiresolution signal decomposition: The wavelet representation," IEEE Pattern Anal. Machine Intell., vol. 11, pp. 674-693, July 1989.
8. B. A. Olshausen and D. J. Field, "Emergence of simple-cell receptive field properties by learning a sparse code for natural images," Nature, vol. 381, pp. 607-609, 1996.
9. A. J. Bell and T. J. Sejnowski, "The 'independent components' of natural scenes are edge filters," Vis. Res., vol. 37, no. 23, pp. 3327-3338, 1997.
10. J. P. Rossi, "Digital techniques for reducing television noise," JSMPTE, vol. 87, pp. 134-140, 1978.
11. D. L. Donoho and I. M. Johnstone, "Ideal spatial adaptation by wavelet shrinkage," Biometrika, vol. 81, no. 3, pp. 425-455, 1994.
12. D. Leporini and J. C. Pesquet, "Multiscale regularization in Besov spaces," in Proc. 31st Asilomar Conf. on Signals, Systems and Computers, Pacific Grove, CA, Nov. 1998.
13. E. P. Simoncelli and E. H. Adelson, "Noise removal via Bayesian wavelet coring," in Proc. 3rd Int. Conf. on Image Processing, vol. I, Lausanne, Switzerland, Sept. 1996, pp. 379-382.
14. H. A. Chipman, E. D. Kolaczyk, and R. M. McCulloch, "Adaptive Bayesian wavelet shrinkage," J. Amer. Statist. Assoc., vol. 92, no. 440, pp. 1413-1421, 1997.
15. F. Abramovich, T. Sapatinas, and B. W. Silverman, "Wavelet thresholding via a Bayesian approach," J. R. Statist. Soc. B, vol. 60, pp. 725-749, 1998.
16. E. P. Simoncelli, "Bayesian denoising of visual images in the wavelet domain," in Bayesian Inference in Wavelet Based Models, P. Müller and B. Vidakovic, Eds. New York: Springer-Verlag, 1999, vol. 141, ch. 18, pp. 291-308.
17. P. Moulin and J. Liu, "Analysis of multiresolution image denoising schemes using a generalized Gaussian and complexity priors," IEEE Trans. Inform. Theory, vol. 45, pp. 909-919, 1999.
18. A. Hyvarinen, "Sparse code shrinkage: Denoising of non-Gaussian data by maximum likelihood estimation," Neural Comput., vol. 11, no. 7, pp. 1739-1768, 1999.
19. J. Starck, E. J. Candes, and D. L. Donoho, "The curvelet transform for image denoising," IEEE Trans. Image Processing, vol. 11, pp. 670-684, June 2002.
20. B. Wegmann and C. Zetzsche, "Statistical dependence between orientation filter outputs used in an human vision based image code," in Proc. Visual Comm. Image Processing, vol. 1360, Lausanne, Switzerland, 1990, pp. 909-922.
21. E. P. Simoncelli. Statistical models for images: Compression, restoration and synthesis. presented at Proc. 31st Asilomar Conf. on Signals, Systems and Computers. [Online]. Available: http://www.cns.nyu.edu/~eero/publications.html
22. R. W. Buccigrossi and E. P. Simoncelli, "Image compression via joint statistical characterization in the wavelet domain," IEEE Trans. Image Processing, vol. 8, pp. 1688-1701, Dec. 1999.
23. H. Brehm and W. Stammler, "Description and generation of spherically invariant speech-model signals," Signal Process., vol. 12, pp. 119-141, 1987.
24. T. Bollersley, K. Engle, and D. Nelson, "ARCH models," in Handbook of Econometrics V, B. Engle and D. McFadden, Eds., 1994.
25. M. S. Crouse, R. D. Nowak, and R. G. Baraniuk, "Wavelet-based statistical signal processing using hidden Markov models," IEEE Trans. Signal Processing, vol. 46, pp. 886-902, Apr. 1998.
26. J. Romberg, H. Choi, and R. Baraniuk, "Bayesian tree-structured image modeling using Wavelet-domain hidden Markov models," IEEE Trans. Image Processing, vol. 10, July 2001.
27. S. M. LoPresto, K. Ramchandran, and M. T. Orchard, "Wavelet image coding based on a new generalized Gaussian mixture model," in Proc. Data Compression Conf., Snowbird, UT, Mar. 1997.
28. M. K. Mihçak, I. Kozintsev, K. Ramchandran, and P. Moulin, "Low-complexity image denoising based on statistical modeling of wavelet coefficients," IEEE Trans. Signal Processing, vol. 6, pp. 300-303, Dec. 1999.
29. J. S. Lee, "Digital image enhancement and noise filtering by use of local statistics," IEEE Pattern Anal. Machine Intell., vol. PAMI-2, pp. 165-168, Mar. 1980.
30. H. Robbins, "The empirical Bayes approach to statistical decision problems," Ann. Math. Statist., vol. 35, pp. 1-20, 1964.
31. M. Malfait and D. Roose, "Wavelet-based image denoising using a Markov random field a priori model," IEEE Trans. Image Processing, vol. 6, pp. 549-565, Apr. 1997.
32. S. G. Chang, B. Yu, and M. Vetterli, "Spatially adaptive wavelet thresholding with context modeling for image denoising," in Proc. 5th IEEE Int. Conf. Image Processing, Chicago, IL, Oct. 1998.
33. F. Abramovich, T. Besbeas, and T. Sapatinas, "Empirical Bayes approach to block wavelet function estimation," Comput. Statist. Data Anal., vol. 39, pp. 435-451, 2002.
34. V. Strela, J. Portilla, and E. Simoncelli, "Image denoising using a local Gaussian scale mixture model in the wavelet domain," Proc. SPIE Wavelet Applications in Signal and Image Processing VIII, vol. 4119, pp. 363-371, Dec. 2000.
35. X. Li and M. T. Orchard, "Spatially adaptive image denoising under overcomplete expansion," in Proc. IEEE Int. Conf. Image Processing, Vancouver, BC, Canada, Sept. 2000.
36. J. Portilla, V. Strela, M. Wainwright, and E. Simoncelli, "Adaptive Wiener denoising using a Gaussian scale mixture model in the wavelet domain," in Proc. 8th IEEE Int. Conf. Image Processing, Thessaloniki, Greece, Oct. 7-10, 2001, pp. 37-40.
37. R. R. Coifman and D. L. Donoho, "Translation-invariant de-noising," in Wavelets and Statistics, A. Antoniadis and G. Oppenheim, Eds. San Diego, CA: Springer-Verlag, 1995, Lecture notes.
38. E. P. Simoncelli, W. T. Freeman, E. H. Adelson, and D. J. Heeger, "Shiftable multi-scale transforms," IEEE Trans. Inform. Theory, vol. 38, pp. 587-607, Mar. 1992.
39. W. T. Freeman and E. H. Adelson, "The design and use of steerable filters," IEEE Pattern Anal. Machine Intell., vol. 13, no. 9, pp. 891-906, 1991.
40. A. B. Watson, "The cortex transform: Rapid computation of simulated neural images," Comput. Vis. Graphics Image Process., vol. 39, pp. 311-327, 1987.
41. E. J. Candes and D. L. Donoho, "Ridgelets: A key to higher-dimensional intermittency?," Phil. Trans. R. Soc. Lond A, vol. 357, pp. 2495-2509, 1999.
42. N. Kingsbury, "Complex wavelets for shift invariant analysis and filtering of signals," Appl. Comput. Harmon. Anal., vol. 10, no. 3, pp. 234-253, May 2001.
43. V. Strela, "Denoising via block Wiener filtering in wavelet domain," in Proc. 3rd Eur. Congr. Math., Barcelona, Spain, July 2000.
44. G. E. P. Box and C. Tiao, Bayesian Inference in Statistical Analysis. Reading, MA: Addison-Wesley, 1992.
45. M. Figueiredo and R. Nowak, "Wavelet-based image estimation: An empirical Bayes approach using Jeffrey's noninformative prior," IEEE Trans. Image Processing, vol. 10, pp. 1322-1331, Sept. 2001.
46. J. Shapiro, "Embedded image coding using zerotrees of wavelet coefficients," IEEE Trans. Signal Processing, vol. 41, pp. 3445-3462, Dec. 1993.
47. D. L. Ruderman, "Origins of scaling in natural images," Vis. Res., vol. 37, pp. 3385-3398, 1997.
48. A. Tabernero, J. Portilla, and R. Navarro, "Duality of log-polar image representations in the space and the spatial-frequency domains," IEEE Trans. Signal Processing, vol. 47, pp. 2469-2479, Sept. 1999.
49. L. Sendur and I. W. Selesnick, "Bivariate shrinkage functions for wavelet-based denoising exploiting interscale dependency," IEEE Trans. Signal Processing, vol. 50, pp. 2744-2756, Nov. 2002.
50. ____, "Bivariate shrinkage with local variance estimation," IEEE Signal Processing Lett., vol. 9, pp. 438-441, Dec. 2002.
51. A. Pižurica, W. Philips, I. Lemahieu, and M. Acheroy, "A joint inter- and intrascale statistical model for Bayesian wavelet based image denoising," IEEE Trans. Image Processing, vol. 11, pp. 545-557, May 2002.
52. J. L. Starck, D. L. Donoho, and E. Candes, "Very high quality image restoration," Proc. SPIE, vol. 4478, pp. 9-19, August 2001.
53. J. Portilla, V. Strela, M. Wainwright, and E. Simoncelli, "Image Denoising Using Gaussian Scale Mixtures in the Wavelet Domain," Courant Inst. of Math. Sci., New York University, Tech. Rep. TR2002-831, 2002.
54. J. Portilla and E. P. Simoncelli, "Image restoration using Gaussian scale mixtures in the wavelet domain," in Proc. IEEE Int. Conf. on Image Proc., Barcelona, Spain, Sept. 2003.
55. P. D. Kovesi, "Image features from phase congruency," J. Comput. Vis. Res., vol. 1, no. 3, Summer 1999.
56. J. Portilla and E. P. Simoncelli, "A parametric texture model based on joint statistics of complex wavelet coefficients," Int. J. Comput. Vis., vol. 40, no. 1, pp. 49-71, 2000.
57. A. Chambolle, R. A. DeVore, N. Lee, and B. J. Lucier, "Nonlinear wavelet image processing: Variational problems, compression, and noise removal through wavelet shrinkage," IEEE Trans. Image Processing, vol. 7, pp. 319-335, Mar. 1998.
58. B. Vidakovic, "Nonlinear wavelet shrinkage with Bayes rules and Bayes factors," J. Amer. Statist. Assoc., vol. 93, pp. 173-179, 1998.