The estimation of Laplace random vectors in additive white Gaussian noise

IEEE Transactions on Signal Processing

Volumn 56, Issue 8 I, 2008, Pages 3482-3496

  Selesnick, Selesnick ^a  

^a POLYTECHNIC UNIVERSITY   (United States)

Author keywords

Denoising; Estimation; Laplace distribution

Indexed keywords

BLOCK CODES; ERROR ANALYSIS; FOOD ADDITIVES; GAUSSIAN NOISE (ELECTRONIC); IMAGE PROCESSING; LAPLACE TRANSFORMS; PACKET NETWORKS; QUADRATURE AMPLITUDE MODULATION; RANDOM PROCESSES; TRELLIS CODES; TURBO CODES; VECTORS; WHITE NOISE;

ADDITIVE WHITE GAUSSIAN NOISE; COMPUTATIONALLY EFFICIENT; DENOISING; IMAGE DE-NOISING; INCOMPLETE GAMMA FUNCTIONS; LAPLACE DISTRIBUTION; MAXIMUM A-POSTERIORI; MINIMUM MEAN-SQUARE ERROR; MMSE ESTIMATORS; RANDOM VECTORS;

ESTIMATION;

EID: 48849100788     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2008.920488     Document Type: Article

References (67)

1. A. Achim and E. E. Kuruoǧlu, "Image denoising using bivariate α-stable distributions in the complex wavelet domain," IEEE Signal Process. Lett., vol. 12, pp. 17-20, Jan. 2005.
2. A. Achim, P. Tsakalides, and A. Bezerianos, "SAR image denoising via Bayesian wavelet shrinkage based on heavy-tailed modeling," IEEE Trans. Geosci. Remote Sens., vol. 41, no. 8, pp. 1773-1784, Aug. 2003.
3. T. I. Alecu, S. Voloshynovskiy, and T. Pun, "Denoising with infinite mixture of Gaussians," presented at the Eur. Signal Process. Conf. (EUSIPCO), Antalya, Turkey, Sep. 2005.
4. T. J. Barnard and D. D. Weiner, "NonGaussian clutter modeling with generalized spherically invariant random vectors," IEEE Trans. Signal Process., vol. 44, no. 10, pp. 2384-2390, 1996.
5. K. A. Birney and T. R. Fischer, "On the modeling of DCT and subband image data for compression," IEEE Trans. Image Process., vol. 4, no. 2, pp. 186-193, Feb. 1995.
6. L. Boubchir and M. J. Fadili, "A closed-form nonparametric Bayesian estimator in the wavelet-domain of images using an approximate α-stable prior," Pattern Recognit.Letters, vol. 27, no. 12, pp. 1370-1382, Sep. 2006.
7. M. T. Boudjelkha and M. A. Chaudhry, "On the approximation of a generalized incomplete Gamma function arising in heat conduction problems," J. Math. Anal. Appl., vol. 248, no. 2, pp. 509-519, Aug. 2000.
8. H. Brehm and W. Stammler, "Description and generation of spherically invariant speech-model signals," Signal Process., vol. 12, no. 2, pp. 119-141, Mar. 1987.
9. T. Cai and B. W. Silverman, "Incorporating information on neighboring coefficients into wavelet estimation," Sankhya: Ind. J. Stat. B, vol. 63, pp. 127-148, 2001.
10. S. G. Chang, B. Yu, and M. Vetterli, "Adaptive wavelet thresholding for image denoising and compression," IEEE Trans. Image Process., vol. 9, no. 9, pp. 1532-1546, Sep. 2000.
11. S. G. Chang, B. Yu, and M. Vetterli, "Spatially adaptive wavelet thresholding with context modelling for image denoising," IEEE Trans. Image Process., vol. 9, no. 9, pp. 1522-1531, Sep. 2000.
12. M. A. Chaudhry and S. M. Zubair, "Generalized incomplete Gamma functions with applications," J. Comput. Appl. Math., vol. 55, no. 1, pp. 99-124, 1994.
13. M. A. Chaudhry and S. M. Zubair, On a Class of Incomplete Gamma Functions with Applications. New York: Chapman & Hall, 2001.
14. H. Chipman, E. Kolaczyk, and R. McCulloch, "Adaptive Bayesian wavelet shrinkage," J. Am. Stat. Assoc., vol. 92, no. 439, pp. 1413-1421, Dec. 1997.
15. D. Cho and T. D. Bui, "Multivariate statistical modeling for image denoising using wavelet transforms," Signal Process.: Image Commun. vol. 20, no. 1, pp. 77-89, Jan. 2005.
16. M. Clyde and E. I. George, "Empirical bayes estimation in wavelet nonparametric regression," in Bayesian Inference in Wavelet Based Models, P. Muller and B. Vidakovic, Eds. New York: Springer-Verlag, 1999, pp. 309-322.
17. E. Conte, M. Lops, and G. Ricci, "Radar detection in K-distributed clutter," IEE Proceedings - Radar, Sonar and Navigation, vol. 141, no. 2, pp. 116-118, 1994.
18. M. S. Crouse, R. D. Nowak, and R. G. Baraniuk, "Wavelet-based signal processing using hidden Markov models," IEEE Trans. Signal Process. vol. 46, no. 4, pp. 886-902, Apr. 1998.
19. I. Daubechies, Ten Lectures on Wavelets. Singapore: SIAM, 1992.
20. G. Deng, "Generalized Wiener estimation algorithms based on a family of heavy-tailed distributions," in Proc. IEEE Int. Conf. Image Process. (ICIP), 2005, pp. 457-460.
21. S. Durand and J. Froment, "Reconstruction of wavelet coefficients using total variation minimization," SIAM J. Sci. Comput., vol. 24, no. 5, pp. 1754-1767, 2003.
22. T. Eltoft, T. Kim, and T.-W. Lee, "On the multivariate Laplace distribution," IEEE Signal Process. Lett., vol. 13, no. 5, pp. 300-303, May 2006.
23. I. L. Eom and Y. S. Kim, "Wavelet-based denoising with nearly arbitrarily shaped windows," IEEE Signal Process. Lett., vol. 11, no. 12, pp. 937-940, Dec. 2003.
24. J. M. Fadili and L. Boubchir, "Analytical form for a Bayesian wavelet estimator of images using the Bessel K form densities," IEEE Trans. Image Process., vol. 14, no. 2, pp. 231-240, Feb. 2005.
25. M. A. T. Figueiredo and R. D. Nowak, "Wavelet-based image estimation: An empirical Bayes approach using Jeffrey's noninformative prior," IEEE Trans. Image Process., vol. 10, no. 11, pp. 1322-1331, Nov. 2001.
26. S. Gazor and W. Zhang, "Speech enhancement employing Laplacian-Gaussian mixture," IEEE Trans. Signal Process., vol. 13, no. 5, pp. 896-904, Sep. 2005.
27. P. V. Gehler and M. Welling, "Product of "edge-perts"," Adv. Neural Inf. Process. Syst., vol. 18, pp. 419-426, 2005.
28. U. Grenander and A. Srivastava, "Probability models for clutter in natural images," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 4, pp. 424-429, Apr. 2001.
29. M. Hansen and B. Yu, "Wavelet thresholding via MDl for natural images," IEEE Trans. Inf. Theory, vol. 46, no. 8, pp. 1778-1788, Aug. 2000.
30. J. Huang, "Statistics of Natural Images and Models," Ph.D. dissertation, Brown Univ., Providence, RI, 2000.
31. A. Hyvärinen, "Sparse code shrinkage: Denoising of nonGaussian data by maximum likelihood estimation," Neural Comput., vol. 11, pp. 1739-1768, 1999.
32. A. Hyvärinen, E. Oja, and P. Hoyer, "Image denoising by sparse code shrinkage," in Intelligent Signal Process., S. Haykin and B. Kosko, Eds. Piscataway, NJ: IEEE Press, 2001.
33. M. Jansen and A. Bultheel, "Empirical Bayes approach to improve wavelet thresholding for image noise reduction," J. Amer. Statist. Assoc. (JASA), vol. 96, no. 454, pp. 629-639, Jun. 2001.
34. R. Jenssen, T. A. Øigård, T. Eltoft, and A. Hanssen, "Sparse code shrinkage using the normal inverse Gaussian density mode," in Proc. Int. Workshop Independent Component Analysis and Blind Signal Separation (ICA2001), San Diego, CA, Dec. 2001, pp. 212-217.
35. I. M. Johnstone and B. W. Silverman, "Empirical Bayes selection of wavelet thresholds," Ann. Statist., vol. 33, no. 4, pp. 1700-1752, 2005.
36. M. Kazubek, "Wavelet domain image denoising by thresholding and Wiener filtering," IEEE Signal Process. Lett., vol. 10, no. 11, pp. 324-326, Nov. 2003.
37. S. Kotz, T. Kozubowski, and K. Podgorski, The Laplace Distribution and Generalizations. New York: Birkhauser, 2001.
38. J. Liu and P. Moulin, "Information-theoretic analysis of interscale and intrascale dependencies between image wavelet coefficients," IEEE Trans. Image Process., vol. 10, no. 11, pp. 1647-1658, Nov. 2001.
39. D. Lorenz, "Wavelet shrinkage in signal and image processiing - An investigation of relations and equivalences," Ph.D. dissertation, Univ. Bremen, Bremen, Germany, 2005.
40. T. Lotter and P. Vary, "Noise reduction by joint maximum a posteriori spectral amplitude and phase estimation with super-Gaussian speech model," in Proc. Eur. Signal Process. Conf. (EUSIPCO), Vienna, Austria, Sep. 2004, pp. 1457-1460.
41. F. Luisier, T. Blu, and M. Unser, "A new SURE approach to image denoising: Interscale orthonormal wavelet thresholding," IEEE Trans. Image Process., vol. 16, no. 3, pp. 593-606, Mar. 2007.
42. S. Mallat, "A theory for multiresolution signal decomposition: The wavelet representation," IEEE Trans. Pattern Anal. Mach. Intel., vol. 11, no. 7, pp. 674-693, Jul. 1989.
43. R. Martin, "Speech enhancement based on minimum mean-square error estimation and supergaussian prior," IEEE Trans. Speech Audio Process., vol. 13, no. 5, pp. 845-856, Sep. 2005.
44. B. Matalon, M. Elad, and M. Zibulevsky, "Improved denoising of images using modelling of a redundant contourlet transform," in Proc. SPIE, Wavelets XI, San Diego, CA, Jul. 2005, vol. 5914.
45. M. K. Mihcak, I. Kozintsev, K. Ramchandran, and P. Moulin, "Low-complexity image denoising based on statistical modeling of wavelet coefficients," IEEE Signal Process. Lett., vol. 6, no. 12, pp. 300-303, Dec. 1999.
46. P. Moulin and J. Liu, "Analysis of multiresolution image denoising schemes using generalized Gaussian and complexity priors," IEEE Trans. Inf. Theory, vol. 45, no. 4, pp. 909-919, Apr. 1999.
47. M. Nikolova, "Estimées locales fortement homogénes," Comptes Rendus Acad. Sci. Paris - Ser. I, vol. 325, pp. 665-670, 1997.
48. R. Öktem, L. Yaroslavsky, K. Egiazarian, and J. Astola, "Transform domain approaches for image denoising," J. Electron. Imag., vol. 11, no. 2, pp. 149-156, Apr. 2002.
49. H.-J. Park and T.-W. Lee, "Modeling nonlinear dependencies in natural images using mixture of Laplacian distribution," in Adv. Neural Information Processing Systems, L. Saul, Y. Weiss, and L. Bottou, Eds. Cambridge, MA: MIT Press, 2005, vol. 17, pp. 1041-1048.
50. A. Pizurica and W. Philips, "Estimating probability of presence of a signal of interest in multiresolution single- and multiband image denoising," IEEE Trans. Image Process., vol. 15, no. 3, pp. 654-665, Mar. 2006.
51. A. Pizurica, W. Philips, I. Lemahieu, and M. Acheroy, "A joint inter- and intrascale statistical model for Bayesian wavelet based image denoising," IEEE Trans. Image Process., vol. 11, no. 5, pp. 545-557, May 2002.
52. J. Portilla, V. Strela, M. J. Wainwright, and E. P. Simoncelli, "Image denoising using scale mixtures of Gaussians in the wavelet domain," IEEE Trans. Image Process., vol. 12, no. 11, pp. 1338-1351, Nov. 2003.
53. M. Rangaswamy, "Statistical analysis of the nonhomogeneity detector for nonGaussian interference backgrounds," IEEE Trans. Signal Process. vol. 53, no. 6, pp. 2101-2111, Jun. 2005.
54. F. Ruggeri and B. Vidakovic, "Bayesian modeling in the wavelet domain," in Handbook of Statistics 25: Bayesian Thinking, Modeling and Computation, D. Dey and C. R. Rao, Eds. The Netherlands: North Holland, 2005.
55. I. W. Selesnick, "Laplace random vectors, Gaussian noise, and the generalized incomplete Gamma function," in Proc. IEEE Int. Conf. Image Process. (ICIP), Atlanta, Oct. 2006, pp. 2097-2100.
56. I. W. Selesnick, "Modeling and estimation of wavelet coefficients using elliptically contoured multivariate Laplace vectors," in Proc. SPIE Wavelets XII, Aug. 26-29, 2007, vol. 6701.
57. L. Sendur and I. W. Selesnick, "Bivariate shrinkage functions for wavelet-based denoising exploiting interscale dependency," IEEE Trans. Signal Process., vol. 50, no. 11, pp. 2744-2756, Nov. 2002.
58. L. Sendur and I. W. Selesnick, "Bivariate shrinkage with local variance estimation," IEEE Signal Process. Lett., vol. 9, no. 12, pp. 438-441, Dec. 2002.
59. L. Sendur and I. W. Selesnick, "Multivariate shrinkage functions for wavelet-based denoising," in Proc. Asilomar Conf. Sig., Sys. Comp. Nov. 2002, vol. 1, pp. 953-957.
60. F. Shi and I. W. Selesnick, "An elliptically contoured exponential mixture model for wavelet based image denoising," Appl. Comput. Harmon. Anal., vol. 23, no. 1, pp. 131-151, Jul. 2007.
61. P.-L. Shui and Y.-B. Zhao, "Image denoising algorithm using doubly local Wiener filtering with block-adaptive windows in wavelet domain," Signal Process., vol. 87, no. 7, pp. 1721-1734, Jul. 2007.
62. E. P. Simoncelli, "Modelling the joint statistics of images in the wavelet domain," Proc. SPIE, vol. 313, no. 1, pp. 188-195, 1999.
63. E. P. Simoncelli and E. H. Adelson, "Noise removal via Bayesian wavelet coring," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), Sep. 16-19, 1996, vol. 1, pp. 379-382.
64. A. Srivastava, "Stochastic models for capturing image variability," IEEE Signal Process. Mag., vol. 19, no. 5, pp. 63-76, Sep. 2002.
65. P. Tsakalides, P. Reveliotis, and C. L. Nikias, "Scalar quantization of heavy-tailed signals," IEE Vis. Image Signal Process., vol. 147, no. 5, pp. 475-484, Oct. 2000.
66. B. Vidakovic, Statistical Modeling by Wavelets. New York: Wiley, 1999.
67. K. Yao, "A representation theorem and its applications to spherically invariant random processes," IEEE Trans. Inf. Theory, vol. IT-19, no. 5, pp. 600-608, May 1973.