Video denoising based on a spatiotemporal gaussian scale mixture model

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 20, Issue 7, 2010, Pages 1032-1040

  Varghese, Gijesh ^a   Wang, Zhou ^b  

^a MAXIM INTEGRATED PRODUCTS   (United States)

^b UNIVERSITY OF WATERLOO   (Canada)

Author keywords

Bayesian estimation; Cross correlation (CC); Gaussian scale mixture (GSM); Image restoration; Motion estimation; Statistical image modeling; Video denoising

Indexed keywords

BAYESIAN ESTIMATIONS; CROSS CORRELATIONS; GAUSSIAN SCALE MIXTURES; IMAGE RESTORATION; STATISTICAL IMAGE MODELING; VIDEO DE-NOISING;

ALGORITHMS; BAYESIAN NETWORKS; GAUSSIAN DISTRIBUTION; IMAGE RECONSTRUCTION; MIXTURES; MOTION COMPENSATION; MOTION ESTIMATION; RESTORATION; VIDEO RECORDING; VIDEO SIGNAL PROCESSING; WAVELET TRANSFORMS;

ESTIMATION;

EID: 77954840127     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2010.2051366     Document Type: Article

References (50)

1. J. C. Brailean, R. P. Kleihorst, S. Efstratiadis, A. K. Katsaggelos, and R. L. Lagendijk, "Noise reduction filters for dynamic image sequences: A review," Proc. IEEE, vol. 83, no. 9, pp. 1272-1292, Sep. 1995.
2. D. L. Donoho, "De-noising by soft-thresholding," IEEE Trans. Inform. Theory, vol. 41, no. 3, pp. 613-627, May 2005.
3. E. P. Simoncelli and E. H. Adelson, "Noise removal via Bayesian wavelet coring," in Proc. IEEE Int. Conf. Image Proc., vol. 1. Sep. 1996, pp. 379-382.
4. F. Jin, P. Fieguth, and L. Winger, "Wavelet video denoising with regularized multiresolution motion estimation," Eup. Assoc. Speech, Signal, Image Process. J. Appl. Singal Process., vol. 2006, no. 72705, pp. 1-11, 2006.
5. V. Zlokolica, A. Pizurica, and W. Philips, "Wavelet-domain video denoising based on reliability measures," IEEE Trans. Circuits Syst. Video Tech., vol. 16, no. 8, pp. 993-1007, Aug. 2006. (Pubitemid 44335213)
6. W. I. Selesnick and K. Y. Li, "Video denoising using 2-D and 3-D dualtree complex wavelet transforms," in Proc. SPIE, Wavelets: Appl. Signal Image Process. X, vol. 5207. Nov. 2003, pp. 607-618.
7. D. Rusanovskyy and K. Egiazarian, "Video denoising algorithm in sliding 3-D DCT domain," in Proc. ACIVS, Sep. 2005, pp. 618-625.
8. N. Lian, V. Zagorodnov, and Y. Tan, "Video denoising using vector estimation of wavelet coefficients," in Proc. IEEE Int. Sym. Circuits Syst., May 2006, pp. 2673-2676.
9. S. M. M. Rahman, M. O. Ahmad, and M. N. S. Swamy, "Video denois-ing based on inter-frame statistical modeling of wavelet coefficients," IEEE Trans. Circuits Syst. Video Tech., vol. 17, no. 2, pp. 187-198, Feb. 2007.
10. A. Pizurica, V. Zlokolica, and W. Philips, "Combined wavelet domain and temporal video denoising," in Proc. IEEE Conf. Adv. Video Signal-Based Surveillance, Jul. 2003, pp. 334-341.
11. E. J. Balster, Y. F. Zheng, and R. L. Ewing, "Combined spatial and temporal domain wavelet shrinkage algorithm for video denoising," IEEE Trans. Circuits Syst. Video Tech., vol. 16, no. 2, pp. 220-230, Feb. 2006.
12. A. Buades, B. Coll, and J. Morel, "Denoising image sequences does not require motion estimation," in Proc. IEEE Conf. Adv. Video Signal-Based Surveillance, Sep. 2005, pp. 70-74.
13. A. Buades, B. Coll, and J. Morel, "Nonlocal image and movie denois-ing," Int. J. Comput. Vision, vol. 76, no. 2, pp. 123-139, 2008.
14. K. Dabov, A. Foi, and K. Egiazarian, "Video denoising by sparse 3-D transform-domain collaborative filtering," in Proc. Eur. Signal Process. Conf., Sep. 2007, pp. 145-149.
15. J. Boulanger, C. Kervrann, and P. Bouthemy, "Space-time adaptation for patch-based image sequence restoration," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 6, pp. 1096-1102, Jun. 2007.
16. M. Protter and M. Elad, "Image sequence denoising via sparse and redundant representations," IEEE Trans. Image Process., vol. 18, no. 1, pp. 27-36, Jan. 2009.
17. X. Li and Y. Zheng, "Patch-based video processing: A variational Bayesian approach," IEEE Trans. Circuits Syst. Video Tech., vol. 19, no. 1, pp. 27-40, Jan. 2009.
18. J. Portilla, V. Strela, M. J. Wainwright, and E. P. Simoncelli, "Image denoising using scale mixtures of Gaussians in the wavelet domain," IEEE Trans. Image Process., vol. 12, no. 11, pp. 1338-1351, Nov. 2003.
19. D. L. Ruderman, "The statistics of natural images," Netw.: Comput. Neural Syst., vol. 5, no. 4, pp. 517-548, 1996.
20. E. P. Simoncelli and B. Olshausen, "Natural image statistics and neural representation," Annua. Rev. Neurosci., vol. 24, pp. 1193-1216, May 2001.
21. D. W. Dong and J. J. Atick, "Statistics of natural time-varying images," Network: Comput. Neural Syst., vol. 6, no. 3, pp. 345-358, 1995.
22. J. H. van Hateren and D. L. Ruderman, "Independent component analysis of natural image sequences yields spatio-temporal filters similar to simple cells in primary visual cortex," in Proc. R. Soc. Lond. B, vol. 265. 1998, pp. 2315-2320.
23. B. A. Olshausen, "Learning sparse, overcomplete representations of time-varying natural images," in Proc. IEEE Int. Conf. Image Proc., vol. 1. Sep. 2003, pp. 41-44.
24. Z. Wang and Q. Li, "Statistics of natural image sequences: Temporal motion smoothness by local phase correlations," in Proc. Human Vision Electron. Imag. IX, SPIE, vol. 7240. Jan. 2009, pp. 72400W-1-72400W-12.
25. M. S. Crouse, R. D. Nowak, and R. G. Baraniuk, "Wavelet-based statistical signal processing using hidden Markov models," IEEE Trans. Signal Process., vol. 46, no. 4, pp. 886-902, Apr. 1998.
26. J. Romberg, H. Choi, and R. Baraniuk, "Bayesian tree-structured image modeling using wavelet-domain hidden Markov models," IEEE Trans. Image Process., vol. 10, no. 7, pp. 1056-1068, Jul. 2001. (Pubitemid 32650882)
27. D. Andrews and C. Mallows, "Scale mixtures normal distributions," J. R. Statist. Soc., vol. 36, p. 99, 1974.
28. M. J. Wainwright and E. P. Simoncelli, "Scale mixtures of Gaussians and the statistics of natural images," Adv. Neural Inform. Process. Syst., vol. 12, pp. 855-861, 2000.
29. Z. Wang and Q. Li, "Video quality assessment using a statistical model of human visual speed perception," J. Opt. Soc. Am. A, vol. 24, pp. B61-B69, Dec. 2007.
30. S. Zhu and K.-K. Ma, "A new diamond search algorithm for fast block-matching motion estimation," IEEE Trans. Image Process., vol. 9, no. 2, pp. 287-290, Feb. 2000.
31. B. K. P. Horn and B. G. Rhunck, "Determining optical flow," Artificial Intell., vol. 17, pp. 185-203, Apr. 1981.
32. J. L. Barron, D. J. Fleet, and S. S. Beauchemin, "Performance of optical flow techniques," Int. J. Comput. Vision, vol. 12, pp. 1573-1405, Feb. 1994.
33. D. J. Fleet and A. D. Jepson, "Computation of component image velocity from local phase information," Int. J. Comput. Vision, vol. 5, no. 1, pp. 77-104, 1990.
34. T. S. Huang and R. Y. Tsai, "Motion estimation," in Image Sequence Analysis, T. S. Huang, Ed. Berlin, Germany: Springer-Verlag, 1981, pp. 1-18.
35. R. Manduchi and G. A. Mian, "Accuracy analysis for correlation-based image registration algorithms," in Proc. IEEE Int. Sym. Circuits Syst., 1993, pp. 834-837.
36. A. M. Tekalp, Digital Video Processing. Upper Saddle River, NJ: Prentice Hall, 1995.
37. H. Foroosh, J. B. Zerubia, and M. Berthod, "Extension of phase correlation to subpixel registration," IEEE Trans. Image Process., vol. 11, no. 3, pp. 188-200, Mar. 2002.
38. G. E. P. Box and G. C. Tiao, Bayesian Inference in Statistical Analysis. Reading, MA: Wiley-Interscience, 1992.
39. M. Figueiredo and R. Nowak, "Wavelet-based image estimation: An empirical Bayes approach using Jeffrey's noninformative prior," IEEE Trans. Image Process., vol. 10, no. 9, pp. 1322-1331, Sep. 2001.
40. S. Mallat, A Wavelet Tour of Signal Processing. Cambridge, U.K.: Academic Press, 1999.
41. E. P. Simoncelli, W. T. Freeman, E. H. Adelson, and D. J. Heeger, "Shiftable multiscale transforms," IEEE Trans. Inform. Theory, vol. 38, no. 2, pp. 587-607, Mar. 1992.
42. D. Robinson and P. Milanfar, "Fundamental performance limits in image registration," IEEE Trans. Image Process., vol. 13, no. 9, pp. 1185-1199, Sep. 2004.
43. S. Alliney and C. Morandi, "Digital image registration using projections," IEEE Trans. Pattern Anal. Mach. Intell., vol. 8, no. 2, pp. 222-233, Mar. 1986.
44. W. K. Pratt, "Correlation techniques for image registration," IEEE Trans. Aerosp. Electron. Syst., vol. 10, no. 3, pp. 353-358, May 1974.
45. Video Sequence Database [Online]. Available: http://www.cipr.rpi.edu/ resource/sequences
46. Z. Wang and A. C. Bovik, "A universal image quality index," IEEE Signal Process. Lett., vol. 9, no. 3, pp. 81-84, Mar. 2002.
47. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, "Image quality assessment: From error visibility to structural similarity," IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, Apr. 2004.
48. Z. Wang, L. Lu, and A. C. Bovik, "Video quality assessment based on structural distortion measurement," Signal Process.: Image Commun. (special issue on objective video quality metrics), vol. 19, pp. 121-132, Feb. 2004.
49. Z. Wang and A. C. Bovik, "Mean squared error: Love it or leave it? A new look at signal fidelity measures," IEEE Signal Process. Mag., vol. 26, no. 1, pp. 98-117, Jan. 2009.
50. V. Zlokolica. Results of "Wavelet-domain video denoising based on reliability measures." Universiteit Gent: Department of Telecommunications and Information Processing [Online]. Available: http://telin.ugent.be/ ∼vzlokoli/Results J