Joint video/depth rate allocation for 3D video coding based on view synthesis distortion model

Signal Processing: Image Communication

Volumn 24, Issue 8, 2009, Pages 666-681

  Liu, Yanwei ^a,b   Huang, Qingming ^a,b   Ma, Siwei ^c   Zhao, Debin ^d   Gao, Wen ^c  

^a INSTITUTE OF COMPUTING TECHNOLOGY   (China)

^b UNIVERSITY OF CHINESE ACADEMY OF SCIENCES   (China)

^c PEKING UNIVERSITY   (China)

^d HARBIN INSTITUTE OF TECHNOLOGY   (China)

Author keywords

3D video coding; Distortion model; Rate allocation; View synthesis

Indexed keywords

3D VIDEO CODING; ADDITIVE MODELS; BIT RATES; COMPUTATIONAL COSTS; DISTORTION MODEL; ERROR CORRELATION; GEOMETRY DISTORTION; JOINT RATE ALLOCATION; OPTIMIZATION PROBLEMS; PIECEWISE LINEAR MODELS; POWER SPECTRAL; RATE ALLOCATION; RATE ALLOCATION METHOD; SEARCH METHOD; TWO SOURCES; VIEW SYNTHESIS;

IMAGE CODING; OPTIMIZATION; PIECEWISE LINEAR TECHNIQUES; SYNTHESIS (CHEMICAL); VISUAL COMMUNICATION; WEAVING;

THREE DIMENSIONAL;

EID: 68749088272     PISSN: 09235965     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.image.2009.06.002     Document Type: Article

References (32)

1. Würmlin S., Lamboray E., and Gross M. 3D video fragments: dynamic point samples for real-time free-viewpoint video, computers and graphics. Compression and Streaming Techniques for 3D and Multimedia Data (Special Issue on Coding) 28 1 (2004) 3-14
2. Introduction to 3D Video, ISO/IEC JTC1/SC29/WG11, Doc. N9784, Archamps, France, May 2008.
3. Smolic A., and Kauff P. Interactive 3-D video representation and coding technologies. Proceedings of the IEEE 93 1 (2005) 98-110
4. C. Theobalt, G. Ziegler, M. Magnor, H.-P. Seidel, Model-based free-viewpoint video acquisition, rendering and encoding, In: Proceedings of Picture Coding Symposium, San Francisco, USA, December 2004, pp. 1-6.
5. Matusik W., Buehler C., and McMillan L. Polyhedral visual hulls for real-time rendering. Proceedings of 12th Eurographics Workshop on Rendering (2001), Eurographics Association 115-125
6. C.L. Zitnick, S.B. Kang, M. Uyttendaele, S. Winder, R. Szeliski, High-quality video view interpolation using a layered representation, In: ACM SIGGRAPH and ACM Transactions on Graphics, Los Angeles, CA, USA, August 2004.
7. A. Smolic, K. Müller, K. Dix, P. Merkle, P. Kauff, T. Wiegand, Intermediate view interpolation based on multiview video plus depth for advanced 3D video systems, In: Proceedings of ICIP 2008, pp. 2448-2451.
8. A. Vetro, S. Yea, A. Smolic, Towards a 3D video format for auto-stereoscopic displays, In: Proceedings of the SPIE: Applications of Digital Image Processing XXXI, San Diego, CA, USA, 2008.
9. A. Bourge, C. Fehn, Committee Draft of ISO/IEC 23002-3 Auxiliary Video Data Representations. ISO/IEC JTC 1/SC 29/WG 11, Doc. N8038. Montreux, Switzerland, April 2006.
10. Description of Exploration Experiments in 3D Video Coding. ISO/IEC JTC1/SC29/WG11, Doc. N9783, Archamps, France, May 2008.
11. Kauff P., Atzpadin N., Fehn C., Müller M., Schreer O., Smolic A., and Tanger R. Depth map creation and image-based rendering for advanced 3DTV services providing interoperability and scalability. Signal Processing: Image Communication 22 2 (2007) 217-234
12. Merkle P., Smolic A., Müller K., and Wiegand T. Efficient prediction structures for multiview video coding. IEEE Transactions on Circuits and Systems for Video Technology, Special Issue on Multi-view Video Coding and 3DTV 17 11 (2007) 1461-1473
13. Yoon S.-U., and Ho Y.-S. Multiple color and depth video coding using a hierarchical representation. IEEE Transactions on Circuits and Systems for Video Technology, Special Issue on Multi-view Video Coding and 3DTV 17 11 (2007) 1450-1460
14. Kim J.H., Lai P., Lopez J., Ortega A., Su Y., Yin P., and Gomila C. New coding tools for illumination and focus mismatch compensation in multiview video coding. IEEE Transactions on Circuits and Systems for Video Technology, Special Issue on Multi-view Video Coding and 3DTV 17 11 (2007) 1519-1535
15. Zwicker M., Vetro A., Yea S., Matusik W., Pfister H., and Durand F. Resampling, antialiasing, and compression in multiview 3-D displays. IEEE Signal Processing Magazine 24 6 (2007) 88-96
16. Guo X., Lu Y., Wu F., and Gao W. Inter-view direct mode for multiview video coding. IEEE Transactions on Circuits and Systems for Video Technology 16 12 (2006) 527-1532
17. Y. Liu, Q. Huang, X. Ji, D. Zhao, W. Gao. Multi-view video coding with flexible view-temporal prediction structure for fast random access, In: Proceedings of Seventh Pacific-Rim Conference on Multimedia (PCM 2006), Hangzhou, China, pp. 564-571.
18. N. Ozbek, M. Tekalp, Scalable multi-view video coding for interactive 3DTV, In: Proceedings of ICME 2006, pp. 213-216.
19. P. Merkle, A. Smolic, K. Müller, T. Wiegand, Multi-view video plus depth representation and coding, In: Proceedings of ICIP 2007, pp. 201-204.
20. Yea S., and Vetro A. View synthesis prediction for multiview video coding. Signal Processing: Image Communication 24 1 (2009) 89-100
21. Y. Morvan, D. Farin, P.H.N. de With, Depth-image compression based on an R-D optimized quadtree decomposition for the transmission of multiview images, In: Proceedings of ICIP 2007, pp. 105-108.
22. M. Maitre, Y. Shinagawa, M.N. Do, Rate-distortion optimal depth maps in the wavelet domain for free-viewpoint rendering, In: Proceedings of ICIP 2007, pp. 125-128.
23. Merkle P., Morvan Y., Smolic A., Farin D., Mueller K., de With P.H.N., and Wiegand T. The effect of depth compression on multiview rendering quality. Signal Processing: Image Communication 24 1 (2009) 73-88
24. Daribo I., Tillier C., and Pesquet-Popescu B. Motion vector sharing and bit-rate allocation for 3D video-plus-depth coding. EURASIP Journal on Advances in Signal Processing 2009 Special Issue on 3DTV (2009) Article ID 258920
25. Y. Morvan, D. Farin, P.H.N. de With, Joint depth/texture bit-allocation for multi-view video compression, In: Proceedings of Picture Coding Symposium, Lisbon, Portugal, November 2007.
26. ITU-R BT.1683, Objective perceptual video quality measurement techniques for standard definition digital broadcast television in the presence of a full reference. Geneva, June 2004.
27. M. Tanimoto, T. Fujii, K. Suzuki, Experiment of view synthesis using multi-view depth. ISO/IEC JTC1/SC29/WG11, Doc. M14889, October 2007.
28. Hartley R., and Zisserman A. Multiple View Geometry in Computer Vision (2003), Cambridge University Press, UK
29. Secker A., and Taubman D. Highly scalable video compression with scalable motion coding. IEEE Transactions on Image Processing 13 8 (2004) 1029-1041
30. I. Feldmann, M. Mueller, F. Zilly, R. Tanger, K. Muller, A. Smolic, P. Kauff, T. Wiegand, HHI Test Material for 3D Video. ISO/IEC JTC 1/SC 29/WG 11, Doc. N15413. Archamps, France, April 2008.
31. Ma S., Gao W., and Lu Y. Rate-distortion analysis for H.264/AVC video coding and its application to rate control. IEEE Transactions on Circuits and Systems for Video Technology 15 12 (2005) 1533-1544
32. Proakis J., and Manolakis D. Digital Signal Processing: Principles, Algorithms and Applications (1995), Prentice-Hall, Englewood Cliffs, NJ