New coding tools for illumination and focus mismatch compensation in multiview video coding

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 17, Issue 11, 2007, Pages 1519-1534

  Kim, Jae Hoon ^a,b   Lai, PoLin ^a,b   Lopez, Joaquin ^c   Ortega, Antonio ^a,b   Su, Yeping ^d   Yin, Peng ^e   Gomila, Cristina ^e  

^a IEEE   (United States)

^b University of Southern California   (United States)

^c Mavrix Technology   (United States)

^d SHARP LABORATORIES OF AMERICA   (United States)

^e Thomson Corporate Research   (United States)

Author keywords

Adaptive filtering; Cross view prediction; H.264 AVC; Illumination compensation (IC); Multiview video coding (MVC)

Indexed keywords

CROSS VIEW CODING; CROSS VIEW PREDICTION; ILLUMINATION COMPENSATION (IC); MULTIVIEW VIDEO CODING (MVC);

ADAPTIVE FILTERING; ADAPTIVE SYSTEMS; CAMERAS; IMAGE CODING;

LIGHTING;

EID: 35648933996     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2007.909976     Document Type: Article

References (46)

1. "Call for proposals on multi-view video coding," ISO/IEC-JTC1/SC29/WG11 MPEG Document N7327, Jul. 2005.
2. MPEG press release ISO/IEC-JTC1/SC29/WG11 MPEG Document N8195, Jul. 2006.
3. "Submissions received in CfP on multi-view video coding," ISO/IEC-JTC1/SC29/WG11 MPEG Document M12969, Jan. 2006.
4. M. Gilge, "Motion estimation by scene adaptive block matching and illumination correction," in Proc. Image Process. Algorithms and Techn., R. J. Moorhead and K. S. Pennington, Eds., Canada, June 1990, vol. 1244, pp. 355-366.
5. S. H. Kim and R.-H. Park, "Fast local motion-compensation algorithm for video sequences with brightness variations," IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 4, Apr. 2003.
6. W. Niehsen and S. Simon, "Block motion estimation using orthogonal projection," in Proc. IEEE Int. Conf. on Image Process. (ICIP), Lausanne, Switzerland, Sep. 1996, pp. I.16-I.19.
7. K. Kamikura, H. Watanabe, H. Jozawa, H. Kotera, and S. Ichinose, "Global brightness-variation compensation for video coding," IEEE Trans. Circuits Syst. Video Technol., vol. 8, no. 8, Dec. 1998.
8. Y. Altunbasak, R. Mersereau, and A. Patti, "A fast parametric motion estimation algorithm with illumination and lens distortion correction," IEEE Trans. Image Process., vol. 12, no. 4, pp. 395-408, Apr. 2003.
9. D. Liu, Y. He, S. Li, Q. Huang, and W. Gao, "Linear transform based motion compensated prediction for luminance intensity changes," in Proc. of IEEE Int. Symp. on Circuits Syst. (ISCAS), Beijing, China, May 2005, pp. I.304-I.307.
10. J. Lopez, J. Kim, A. Ortega, and G. Chen, "Block-based illumination compensation and search techniques for multiview video coding," in Picture Coding Symp. (PCS) 2004, Dec. 2004.
11. J. M. Boyce, "Weighted prediction in the H.264/MPEG AVC video coding standard," in Proc. of IEEE Int. Symp. on Circuits Syst. (ISCAS), Vancouver, Canada, May 2004, pp. III 789-792.
12. P. Yin, A. M. Tourapis, and J. Boyce, "Localized weighted prediction for video coding," in Proc. IEEE Int. Symp. on Circuits Syst. (ISCAS), May 2005, pp. 4365-4368.
13. M. Budagavi, "Video compression, using blur compensation," in Proc. IEEE Int. Conf. on Image Processing (ICIP), Genoa, Italy, Sept. 2005, pp. II.882-II.885.
14. T. Wedi, "Adaptive interpolation filter for motion compensated prediction," in Proc. IEEE ICIP, Rochester, NY, Sep. 2002, pp. II.509-II.512.
15. T. Wedi, "Adaptive interpolation filters and high-resolution displacements for video coding," IEEE Trans. Circuits Syst. Video Technol., vol. 16, no. 4, pp. 484-491, Apr. 2006.
16. Y. Vatis, B. Edler, D. T. Nguyen, and J. Ostermann, "Motion-and aliasing-compensated prediction using a two-dimensional non-separable adaptive wiener interpolation filter," in Proc. IEEE ICIP, Genoa, Italy, Sept. 2005, pp. II.894-II.897.
17. P. Lai, Y. Su, P. Yin, C. Gomila, and A. Ortega, "Adaptive filtering for cross-view prediction in multi-view video coding," in Proc. SPIE Visual Commun. Image Processing (VCIP), San Jose, CA, Jan./Feb. 30-1, 2006.
18. E. H. Adelson and J. R. Bergen, "The plenoptic function and the elements of early vision," in Computational Models of Visual Processing, M. Landy and J. A. Movshon, Eds., Jul. 1991.
19. J. Lopez, "Block-based compression techniques for multiview video coding," Master's thesis, Univ. Politecnica de Catalunya, Barcelona, Spain, 2005.
20. D. Marpe, H. Schwarz, and T. Wiegand, "Context-based adaptive binary arithmetic coding in the H.264/AVC video compression standard," IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 7, pp. 620-636, Jul. 2003.
21. T. Wiegand, G. J. Sullivan, G. Bjontegaard, and A. Luthra, "Overview of the H.264/AVC video coding standard," IEEE Trans. Circuits Systems and Video Technologies, vol. 13, no. 7, pp. 560-576, July 2003.
22. Software implementation of H.264: JM Version 10.2 The Image Communication Group at Heinrich Hertz Institute, July 2006 [Online], Available: http:iphome.hhi.de/suehring/tml/index.htm
23. "Description of core experiments in MVC," ISO/IEC JTC1/SC29/WG11 MPEG Document W8019, Jul. 2005.
24. Y. Su, P. Yin, C. Gomila, J. Kim, P. Lai, and A. Ortega, "Thomson's response to MVC CfP," ISO/IEC-JTC1/SC29/WG11 MPEG Document M12969/2, Jan. 2006.
25. J. Kim, P. Lai, A. Ortega, Y. Su, P. Yin, C. Gomila, and P. Pandit, "Results of CE2 on multi-view video coding," ISO/IEC JTC1/SC29/WG11 MPEG Document M13317, Apr. 2006.
26. J. Kim, P. Lai, A. Ortega, Y. Su, P. Yin, and C. Gomila, "Results of CE2 on multi-view video coding," ISO/IEC JTC1/SC29/WG11 MPEG Document M13720, Jul. 2006.
27. A. Vetro, Y. Su, H. Kimata, and A. Smolic, "Joint multiview video model (JMVM) 2.0," ISO/IEC JTC1/SC29/WG11 MPEG Document N8459, Oct. 2006.
28. Y. Lee, J. Hur, Y. Lee, K. Han, S. Cho, N. Hur, J. Kim, J. Kim, P. Lai, A. Ortega, Y. Su, P. Yin, and C. Gomila, "CE11: Illumination compensation," Joint Video Team (JVT) of ISO/IEC MPEG and ITU-T VCEG JVT-U052, Oct. 2006.
29. R. C. Gonzalez and R. E. Woods, Digital Image Processing, 2nd ed. Reading, MA: Addison-Wesley, 2002.
30. W. K. Pratt, Digital Image. Processing, 3rd ed. Hoboken, NJ: Wiley-Interscience, 2001.
31. Y. Vatis and J. Ostermann, "Locally adaptive non-separable interpolation filter for H.264/AVC," in Proc. IEEE ICIP, Atlanta, GA, Oct. 2006.
32. D. A. Forsyth and J. Ponce, Computer Vision: A Modern Approach., Upper Saddle River, NJ: Prentice Hall, 2003.
33. T. Aach and A. Kaup, "Disparity-based segmentation of stereoscopic foreground/background image sequences," IEEE Trans. Commun., vol. 42, no. 2/3/4, pp. 673-679, Feb.-Apr 1994.
34. E. Francois and B. Chupeau, "Depth-based segmentation," IEEE Trans. Circuits Syst. Video Technol., vol. 7, pp. 237-239, Jun. 1997.
35. E. Izquierdo, "Disparity/segmentation analysis: Matching with an adaptive window and depth-driven segmentation," IEEE Trans. Circuits Syst. Video Technol., vol. 9, no. 4, pp. 589-607, Jun. 1999.
36. E. Redner and H. Walker, "Mixture densities, maximum likelihood and the EM algorithm," SIAM Rev., vol. 26, no. 2, Apr. 1984.
37. Z. Wang, G. Liu, and L. Liu, "A fast and accurate video object detection and segmentation method in the compressed domain," in Proc. IEEE Int. Conf. on Neural Networks and Signal Process., Nanjing, China, Dec. 2003, pp. II.1209-II.1212.
38. R. V. Babu, K. R. Ramakrishnan, and S. H. Srinivasan, "Video object segmentation: A compressed domain approach," IEEE Trans. Circuits Syst. Video Technol., vol. 14, no. 4, pp. 462-474, Apr. 2004.
39. K. Y. Wong and M. E. Spetsakis, "Motion segmentation by EM clustering of good features," in Proc. IEEE Comput. Vision and Pattern Recogn. Workshop (CVPR), Washington, DC, Jun. 2004, pp. 166-173.
40. C. A. Bouman, "Cluster: An unsupervised algorithm, for modeling Gaussian mixture," Jul. 2005 [Online]. Available: http:cobweb.ecn.purdue. edu/bouman/software/cluster
41. A. Dempster, N. Laird, and D. Rubin, "Maximum, likelihood from incomplete data via the EM algorithm," J. Roy. Statist. Soc., vol. 39, no. 1, pp. 1-38, 1977, Series B.
42. J. Rissanen, "A universal prior for integers and estimation by Minimum Description Length," J. Ann. Statist., vol. 11, no. 2, pp. 417-431, 1983.
43. H.-C. Lee, "Review of image-blur models in a photographic system using the principles of optics," SPIE Opt. Eng., vol. 20, no. 5, pp. 405-421, May 1990.
44. Y. Vatis, B. Edler, I. Wassermann, D. T. Nguyen, and J. Ostermann, "Coding of coefficients of two-dimensional non-separable adaptive Wiener interpolation filter," in Proc. SPIE Visual Commun. Image Process., San Jose, CA, Jul. 2005, pp. 623-631.
45. Y. Vatis, Software Implementation of Adaptive Interpolation Filter Nov. 2005 [Online]. Available: http:iphome.hhi.de/suehring/tml/download/KTA/
46. P. Lai, A. Ortega, P. Pandit, P. Yin, and C. Gomila, "Adaptive reference filtering for MVC," Joint Video Team (JVT) of ISO/IEC MPEG and ITU-T VCEG JVT-W065, Apr. 2007.