Efficient prediction structures for multiview video coding

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 17, Issue 11, 2007, Pages 1461-1473

  Merkle, Philipp ^b   Müller, Karsten ^a,b  

^a IEEE   (Germany)

^b FRAUNHOFER HEINRICH HERTZ INSTITUTE   (Germany)

Author keywords

3 D television (3DTV); Free viewpoint video; H.264 AVC; Hierarchical B pictures; Multiview video coding (MVC)

Indexed keywords

3-D TELEVISION (3DTV); FREE VIEWPOINT VIDEO; HIERARCHICAL B PICTURES; MULTIVIEW VIDEO CODING (MVC);

COST FUNCTIONS; HIERARCHICAL SYSTEMS; IMAGE COMPRESSION; SIGNAL TO NOISE RATIO; STATISTICAL METHODS;

IMAGE CODING;

EID: 35648982431     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2007.903665     Document Type: Article

References (51)

1. L. Onural, A. Smolic, and T. Sikora, "An overview of a new European consottium: Integrated three-dimensional television-Capture, transmission and display (3DTV)," presented at the European Workshop on the Integration of Knowledge, Semantic and Digital Media Technologies (EWIMT04), London, U.K., Nov. 2004.
2. A. Smolic, K. Müller, P. Merkle, C. Fehn, P. Kauff, P. Eisert, and T. Wiegand, "3D video and free viewpoint video - Technologies, applications and MPEG standards," presented at the IEEE Int. Conf. Multimedia and Expo (ICME 2006), Toronto, ON, Canada, Jul. 2006.
3. "Advanced Video Coding for Generic Audiovisual Services, Version 3," ITU-T Rec. & ISO/IEC 14496-10 AVC, 2005.
4. T. Wiegand, G. J. Sullivan, G. Bjøntegaard, and A. Luthra, "Overview of the H.264/AVC video coding standard," IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 7, pp. 560-560, Jul. 2003.
5. G. Sullivan and T. Wiegand, "Video compression - From concepts to the H.264/AVC standard," Proc. IEEE, Special Issue on Advances in Video Coding and Delivery, vol. 93, no. 1, p. 18, Jan. 2005.
6. A. Smolic and P. Kauff, "Interactive 3D video representation and coding technologies," Proc. IEEE, Special Issue on Advances in Video Coding and Deliverty, vol. 93, no. 1, pp. 98-110, Jan. 2005.
7. P. Merkle, K. Müller, A. Smolic, and T. Wiegand, "Efficient compression of multi-view video exploiting inter-view dependencies based on H.264/MPEG4-AVC," presented at the IEEE Int. Conf. Multimedia and Exposition (ICME 2006), Toronto, ON, Canada, Jul. 2006.
8. K.-J. Oh and Y.-S. Ho, "Multi-view video coding based on the lattice-like pyramid GOP structure," presented at the Picture Coding Symp. (PCS 2006), Beijing, China, Apr. 2006.
9. X. Cheng, L. Sun, and S. Yang, "A Multi-View Video Coding scheme using shared key frames for high interactive application," presented at the Picture Coding Symp. (PCS 2006), Beijing, China, Apr. 2006.
10. Y. Yang, G. Jiang, M. Yu, F. Li, and Y. Kim, "Hyper-space based multiview video coding scheme for free viewpoint television," presented at the Picture Coding Symp. (PCS 2006), Beijing, China, Apr. 2006.
11. F. Shao, G. Jiang, M. Yu, and X. Chen, "A new image correction method for multiview video system," presented at the IEEE Int. Conf. Multimedia and Expo (ICME 2006), Toronto, ON, Canada, Jul. 2006.
12. A. Kaup and U. Fecker, "Analysis of multi-reference block matching for Multi-View Video Coding," in Proc. 7th Workshop Digital Broadcasting, Erlangen, Germany, Sep. 2006, pp. 33-39.
13. E. Martinian, A. Behrens, J. Xin, and A. Vetro, "View synthesis for multiview video compression," presented at the Picture Coding Symp. (PCS 2006), Beijing, China, Apr. 2006.
14. M. Kitahara, H. Kimata, S. Shimizu, K. Kamikura, Y. Yashimata, K. Yamamoto, T. Yendo, T. Fujii, and M. Tanimoto, "Multi-view video coding using view interpolation and reference picture selection," presented at the IEEE Int. Conf. Multimedia and Exposition (ICME 2006), Toronto, ON, Canada, Jul. 2006.
15. A. Smolic, H. Kimata, and A. Vetro, "Development of MPEG standards for 3D and free viewpoint video," presented at the SPIE Optics East, Three-Dimensional TV, Video, and Display IV, Boston, MA, Oct. 2005.
16. A. Smolic and D. M. Cutchen, "3DAV exploration of video-based rendering technology in MPEG," IEEE Trans. Circuits Syst. Video Technol., Special Issue on Immersive Commun., vol. 14, no. 9, pp. 348-356, Mar. 2004.
17. "Survey of algorithms used for Multi-View Video Coding (MVC)," ISO/IEC JTC1/SC29/WG11, Doc. N6909, Hong Kong, China, 2005.
18. "Report of the subjective quality evaluation for MVC call for evidence," ISO/IEC JTC1/SC29/WG11, Doc. N6999, Hong Kong, China, 2005.
19. "Requirements on Multi-View Video Coding v.4," ISO/IEC JTC1/SC29/WG11, Doc. N7282, Poznan, Poland, 2005.
20. "Call for proposals on Multi-View Video Coding," ISO/IEC JTC1/SC29/WG11, Doc. N7327, Poznan, Poland, 2005.
21. "Updated call for proposal on Multi-View Video Coding," ISO/IEC JTC1/SC29/WG11, Doc. N7567, Nice, France, 2005.
22. "Subjective test results for the CfP on multi - view video coding," ISO/IEC JTC1/SC29/WG11, Doc. N7779, Bankok, Thailand, 2006.
23. A. Vetro, Y. Su, H. Kimata, and A. Smolic, "Joint Draft 1.0 on Multiview Video Coding," Doc. JVT-U209 Joint Video Team, Hangzhou, China, Oct. 2006.
24. T. Wiegand, H. Schwarz, A. Joch, F. Kossentini, and G. J. Sullivan, "Rate-constrained coder control and comparison of video coding standards," IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 7, pp. 688-703, Jul. 2003.
25. "Methodology for the subjective assessment of the quality of television pictures," ITU-R BT.500-11, 2002.
26. T. Wiegand, X. Zhang, and B. Girod, "Long-term memory motion-compensated prediction," IEEE Trans. Circuits Syst. Video Technol., vol. 9, no. 2, pp. 70-84, Feb. 1999.
27. H. Schwarz, D. Marpe, and T. Wiegand, "Analysis of hierarchical B pictures and MCTF," in IEEE Int. Conf. Multimedia and Expo (ICME 2006), Toronto, ON, Canada, Jul. 2006.
28. H. Schwarz, M. Wien, and J. Vieron, "JSVM software manual," Doc. JVT-S070 Joint Video Team, Geneva, Swizerland, Apr. 2006.
29. J.-H. Kim, P.-L. Lai, A. Ortega, Y. Su, P. Yin, and C. Gomila, "Results of CE2 on Multi-View Video Coding," Doc. JVT-T117 Joint Video Team, Klagenfurt, Austria, Jul. 2006.
30. Y.-L. Lee, J.-H. Hur, Y.-K. Lee, S.-H. Cho, H. J. Kwon, N. H. Hur, and J. W. Kim, "Results of CE2 on Multi-View Video Coding," Doc. JVT-T110 Joint Video Team, Klagenfurt, Austria, Jul. 2006.
31. O. Schreer, P. Kauff, and T. Sikora, 3D Videocommunication, 1st ed. Chichester, U.K.: Wiley, 2005.
32. E. Lamboray, S. Wümlin, M. Waschbüch, M. Gross, and H. Pfister, "Unconstrained free-viewpoint video coding," presented at the IEEE Int. Conf. Image Process. (ICIP 2004), Singapore, Oct. 2004.
33. A. Smolic, K. Mueller, P. Merkle, T. Rein, P. Eisert, and T. Wiegand, "Representation, coding, and rendering of 3D video objects with MP.EG-4," presented at the IEEE Int. Workshop on Multimedia Signal Processing (MMSP 2004), Siena, Italy, Sep.-Oct. 2004.
34. "Call for evidence on Multi-View Video Coding," ISO/IEC JTC1/SC29/WG11, Palma de Mallorca, Spain, Doc. N6720, 2004.
35. M. Tanimoto, "Free viewpoint television - FTV," presented at the Picture Coding Symp. (PCS 2004), San Francisco, CA, Dec. 2004.
36. T. Fujii and M. Tanimoto, "Free-viewpoint TV system based on ray-space representation," SPIE ITCom, vol. 4864-22, pp. 175-189, 2002.
37. "Applications and requirements for 3DAV," ISO/IEC JTC1/SC29/WG11, Trondheim, Norway, Doc. N5877, 2003.
38. "Report on 3DAV exploration," ISO/IEC JTC1/SC29/WG11, Trondheim, Norway, Doc. N5878, 2003.
39. ISO/IEC 14496-16/PDAM1 ISO/IEC JTC1/SC29/WG11, Redmont, WA, Doc. N6544, 2004.
40. W. Matusik and H. Pfister, "3D TV: A scalable system for real-time acquisition, transmission and autostereoscopic display of dynamic scenes," ACM Trans. Graphics (TOG) SIGGRAPH, vol. 23, no. 3, pp. 814-824, Aug. 2004.
41. M. Magnor and B. Girod, "Data compression for light-field rendering," IEEE Trans. Circuits Syst. Video Technol., vol. 10, no. 3, pp. 338-343, Apr. 2000.
42. J. Li, H. Y. Shum, and Y. Q. Zhang, "On the compression of image based rendering scene," presented at the IEEE Int. Conf. Image Process. (ICIP2000), Vancouver, BC, Canada, Sep. 2000.
43. P. Eisert, E. Steinbach, and B. Girod, "Automatic reconstruction of stationary 3-D objects from multiple uncalibrated camera views," IEEE Trans. Circuits Syst. Video Technol., vol. 10, no. 3, pp. 261-277, Mar. 2000.
44. T. Matsuyama and T. Takai, "Generation, visualization, and editing of 3D video," in Proc. Symp. 3D Data Processing Visualization and Transmission, Padova, Italy, Jun. 2002, pp. 234-245.
45. W. H. Leung and T. Chen, "Compression with, mosaic prediction for image-based rendering applications," presented at the IEEE Int. Conf. Multimedia and Expo (ICME2000), New York, NY, Jul. 2000.
46. J. Li, H. Y. Shum, and Y. Q. Zhang, "On the compression of image based rendering scene," presented at the IEEE Int. Conf. Image Process. (ICIP2000), Vancouver, BC, Canada, Sep. 2000.
47. T. Pintaric, U. Neumann, and A. Rizzo, "Immersive panoramic video," in Proc. 8th ACM Int. Conf. Multimedia, Oct. 2000, pp. 493.494-493. 494.
48. C. Zhang and J. Li, "Compression of lumigraph with, multiple reference frame (MRF) prediction and just-in-time rendering," presented at the IEEE Data Compression Conf. (DCC2000), Snowbird, UT, Mar. 2000.
49. S. Würmlin, E. Lamboray, O. Staadt, and M. Gross, "3D video recorder: A system for recording, processing and playing three-dimensional video," Computer Graphics Forum, vol. 22, no. 2, pp. 181-193, 2003.
50. S. Würmlin, E. Lamboray, and M. Gross, "3D video fragments: Dynamic point samples for real-time free-viewpoint video," Computers and Graphics, Special Issue on Coding, Compression and Streaming Techniquesfor 3D and Multimedia Data, vol.28, no. 1, pp. 3-14, 2004.
51. C. Fehn, P. Kauff, M. O de Beeck, F. Ernst, W. Ijsselsteijn, M. Pollefeys, L. Vangool, E. Ofek, and I. Sexton, "An evolutionary and optimised approach on 3D-TV," presented at the Int. Broadcast Convention (IBC 2002), Amsterdam, The Netherlands, Sep. 2002.