An improved motion-compensated 3-D LLMMSE filter with spatiotemporally adaptive filtering support

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 17, Issue 12, 2007, Pages 1714-1727

  Yin, Hai Bing ^a   Fang, Xiang Zhong ^b   Wei, Zhang ^b   Yang, X K ^b  

^a Chinese JiLiang University   (China)

^b SHANGHAI JIAO TONG UNIVERSITY   (China)

Author keywords

LLMMSE; Motion compensated spatiotemporal filter; Spatial filtering support; Temporal filtering support

Indexed keywords

ADAPTIVE FILTERING; ALGORITHMS; INTELLIGENT SYSTEMS; MEAN SQUARE ERROR; PIXELS;

FILTERING PERFORMANCE; SPATIAL FILTERING SUPPORT; TEMPORAL FILTERING SUPPORT;

MOTION COMPENSATION;

EID: 36549037592     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2007.904590     Document Type: Article

References (41)

1. J. C. Brailean, R. P. Kleihorst, S. Efstratiadis, A. K. Katsaggelos, and R. L. Lagendijk, "Noise reduction filters for dynamic image sequences: A review," Proc. IEEE, vol. 83, pp. 1270-1291, Sept. 1995.
2. L. Tenze, S. Carrato, and S. Olivieri, "Design and real-time implementation of a low-cost noise reduction system for video applications," Signal Processing, pp. 453-466, Vol. 84, 2004.
3. Francisco J. Gallegos-Funes and Volodymyr I. Ponomaryov, "Real-time image filtering scheme based on robust estimators in presence of impulsive noise," Real-Time Imaging, vol. 10, pp. 69-80, 2004.
4. J. S. Kim and H. W. Park, "Adaptive 3-D median fltering for restoration of an image sequence corrupted by impulse noise," Signal Processing: Image Communication, Vol. 6, pp. 657-668, 2001.
5. G. R. Arce, "Multistage order statistic filters for image sequence processing," IEEE Trans. Signal Processing, vol.39, pp. 1146-1163, 1991.
6. A. Buades, B. Coll, J. M. Morel, "A review of image denoising algorithms, with a new one," Multiscale Modeling and Simulation (SIAM interdisciplinary journal), vol. 4, no. 2, pp. 90-530, 2005.
7. A. Buades, B. Coll, J. M. Morel, "The staircasing effect in neighborhood filters and its solution", IEEE Transactions on Image Processing, Vol. 15 (6), pp. 1499-1505, 2006.
8. A. Buades, B. Coll, J. M. Morel, Denoising Image Sequences does not Require Motion Estimation, IEEE Conference on Advanced Video and Signal Based Surveillance, pp.70-74, 2005.
9. C. Tomasi and R. Manduchi, Bilateral Filtering for Gray and Color Images. In: International Conference on Computer Vision, pp. 839-846, 1998.
10. S. M. Smith and J. M. Brady, "SUSAN - A new approach to low level image processing," Int. J. Comput. Vis., vol. 23, no. 1, pp. 45-78, 1997.
11. P. Skocir, B. Marusic, and J. Tasic, "A Three-Dimensional Extension of the SUSAN Filter for Wavelet Video Coding Artifact Removal," In: Electrotechnical Conference, MELECON 2002. 11th Mediterranean, pp. 395-398, 2002.
12. L. P. Yaroslavsky, Digital Picture Processing - An Introduction. New York: Springer-Verlag, 1985.
13. M. K. Özkan, M. I. Sezan, A. M. Tekalp, "Adaptive Motion compensated Filtering of Noisy Image Sequences," IEEE Trans. Circuits Syst. Video Technol., vol.3, NO.4, pp.277-290, August. 1993.
14. J. Boyce, "Noise reduction of image sequences using adaptive motion compensated frame averaging," in IEEE Int. Conf. Acoustics, Speech, Signal Processing, San Francisco, CA, Mar. 1992, pp.461-464.
15. J. Kim and John W. Woods, "Spatio-Temporal Adaptive 3-D Kalman Filter for Video," IEEE Transactions on Image Processing, Vol. 6, no. 3, March, 1997.
16. J. W. Woods and J. Kim, "Motion compensated spatiotemporal Kalman filter," in Motion Analysis and Image Sequence Processing (R. L. Lagendijk and M. I. Sezan. Eds.). Norwell, MA: Kluwer. 1993. ch. 12.
17. C-M. Fan and N. M. Namazi, Simultaneous Motion Estimation and Filtering of Image Sequences, IEEE Transactions on Image Processing, Vol. 8, no. 12, December, 1999.
18. J. C. Brailean and A. K. Katsaggelos, "Simultaneous recursive displacement estimation and restoration of noisy-blurred image sequence," IEEE Trans. on Image Processing, vol. 4, pp. 1236-1251, Sept. 1995.
19. S. M. Mahbubur Rahman, M. Omair Ahmad, and M. N. S. Swamy, "Video Denoising Based on Inter-frame Statistical Modeling of Wavelet Coefficients," IEEE Trans. Circuits Syst. Video Technol, vol. 17, pp. 187-198, Feb. 2007.
20. R. P. Kleihorst, R. L. Lagendijk, and J. Biemond, "Noise reduction of image sequences using motion compensation and signal decomposition," IEEE Trans. Image Processing, vol. 4, pp. 274-284, Mar. 1995.
21. A. Gangal, T. Kayikcioglu, and B. Dizdaroglu, An improved motion-compensated restoration method for damaged color motion picture films, Signal Processing: Image Communication, vol. 19, pp. 353-368, 2004.
22. S. D. Kim and J. B. Ra, "Efficient block-based video encoder embedding a Wiener filter for noisy video sequences," Journal of visual communication and image representation, vol. 14, pp.22-40, 2003.
23. H. Y. Cheong, A. M. Tourapis, J. Llach, J. Boyce, "Adaptive Spatio-Temporal Filtering for Video De-Noising," IEEE Conference on Image Processing, pp: 965-968, 2004.
24. D. H. Kim, R. H. Park, S Yang, Noise reduction of image sequences using H.264/AVC variable block-size motion compensation, IEEE Conference on Consumer Electronics, 2006.
25. B. C. Song, N. H. Kim, K. W. Chun, Transform-Domain Wiener Filtering for H. 264/AVC Video Encoding and its Implementation, IEEE Conference on Image Processing, Vol: 3, pp: III- 529-532, Sept. 2005.
26. J. S. Lee, "Digital image enhancement and noise filtering by use of local statistics," IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-2, pp. 165-168, Mar. 1980.
27. D. T. Kuan, A. A. Sawchuk, T. C. Strand, and P. Chavel, "Adaptive noise smoothing filter for images with signal-dependent noise," IEEE Trans. Pattern Anal. Machine Intell, vol. PAMI-7, pp. 165-177, Mar. 1985.
28. M. K. Özkan, A. T. Erdem, M. I. Sezan, A. M. Tekalp, "Efficient Multiframe Wiener restoration of blurred and noisy image sequence," IEEE Trans. on Image Processing, vol. 1, pp. 453-476, Oct. 1992.
29. K. J. Boo and N.K. Bose, "A Motion-compensated spatio-temporal filter for image sequences with signal-dependent noise," IEEE Trans. Circuits Syst. Video Technol., vol. 8, pp.287-298, June. 1998.
30. M. I. Sezan, M. K. Özkan, and S. V. Fogel, "Temporally adaptive filtering of noisy image sequences using a robust motion estimation algorithm," IEEE Conf. Acoust., Speech, and Signal Process., pp. 2429-2432, May 1991.
31. F. Dekeyser, P. Bouthemy, and P. Perez, "Spatio-temporal Wiener Filtering of Image Sequences Using a Parametric Motion Model," IEEE Conference on Image Processing, vol. 1, pp. 208-211, 2000.
32. S. V. Fogel, "Estimation of velocity vector field from time-varying image sequences," Computer Vision, Graphics, and Image Processing:Image Understanding, vol. 53, pp. 253-287, May 1991.
33. M. Bierling, "Displacement estimation by hierarchical block-matching," in Proc. SPIE Visual Communications and Image Processing '88, pp. 942-951, 1998.
34. R. M. Armitano, R. W. Schafer, "Robust Block-matching Motion Estimation Techniques for Noisy Sources," in Proc IEEE, pp. 2685-2688, 1997.
35. H. B. Yin, X. Z. Fang, H. Yang, S. Y. Yu, and X. K. Yang, "Motion vector smoothing for true motion estimation," IEEE Conf. Acoust., Speech, and Signal Process., vol: 2, pp: 241-244, April, 2006.
36. R. B. Paranjape, T. F. Rabie, R. M. Rangayyan, "Image restoration by adaptive neighborhood noise subtraction," Applied Optics, vol. 33, no. 14, pp. 2861-2869, May 1994.
37. R. M. Rangayyan and A. Das, "Filtering multiplicative noise in images using adaptive region-based statistics," Journal of Electronic Imaging, vol. 7(1), pp. 222-230, January 1998.
38. K. Konstantinides, B. Natarajan, and G. S. Yovanof, "Noise estimation and filtering using block-based singular value decomposition," IEEE Trans. Image Porcessing, vol.6, no.3, pp.479-483, March 1997.
39. V. Zlokolica, A. Pizurica, and W. Philips, Noise Estimation for Video Processing Based on SpatioTemporal Gradients, IEEE Signal Processing Letters, Vol: 13(6), June. 2006.
40. B. C. Song and K. W. Chun, "Motion-compensated noise estimation for efficient pre-filtering in a video encoder," IEEE International Conference on Image Processing, Vol: 2, pp. 211-214, Sept. 2003.
41. B. C. Song and K. W. Chun, Noise Power Estimation for Effective De-Noising in a Video Encoder, IEEE Int. Conf. Acoust., Speech, and Signal Process., vol: 2, pp: 357-360, March, 2005.