A novel rate control technique for multiview video plus depth based 3D video coding

IEEE Transactions on Broadcasting

Volumn 57, Issue 2 PART 2, 2011, Pages 562-571

  Liu, Yanwei ^a   Huang, Qingming ^b,c   Ma, Siwei ^d   Zhao, Debin ^e   Gao, Wen ^d   Ci, Song ^a,f   Tang, Hui ^a  

^a INSTITUTE OF ACOUSTICS   (China)

^b INSTITUTE OF COMPUTING TECHNOLOGY   (China)

^c UNIVERSITY OF CHINESE ACADEMY OF SCIENCES   (China)

^d PEKING UNIVERSITY   (China)

^e HARBIN INSTITUTE OF TECHNOLOGY   (China)

^f UNIVERSITY OF NEBRASKA LINCOLN   (United States)

Author keywords

3D video coding; Multiview video coding; rate control; video plus depth representation

Indexed keywords

3D VIDEO; 3D VIDEO CODING; BIT RATES; HIGH QUALITY; HYPOTHETICAL REFERENCE DECODERS; JOINT RATE CONTROL; MULTI-VIEWS; MULTIPLE VIEWS; MULTIVIEW VIDEO; MULTIVIEW VIDEO CODING; RATE ALLOCATION; RATE CONTROLS; UNDERFLOWS; VIDEO PLUS DEPTH REPRESENTATION;

ALGORITHMS; DECODING; THREE DIMENSIONAL;

IMAGE CODING;

EID: 79957585246     PISSN: 00189316     EISSN: None     Source Type: Journal    
DOI: 10.1109/TBC.2011.2105652     Document Type: Article

References (28)

1. "3D@Home consortium," [Online]. Available: http://www.3dathome. org
2. A. Vetro, S. Yea, and A. Smolic, "Towards a 3D video format for autostereoscopic displays," in Proc. SPIE: Appl. Digital Image Process. XXXI, San Diego, CA, 2008.
3. A. Gotchev, A. Smolic, S. Jumisko-Pyykk, D. Strohmeier, G.-B. Akar, P. Merkle, and N. Daskalov, "Mobile 3D television: Development of core technological elements and user-centered evaluation methods toward an optimized system," in Electro. Imaging Symp., San Jose, California, Jan. 2009.
4. C. Theobalt, G. Ziegler, M. Magnor, and H.-P. Seidel, "Model-based free-viewpoint video acquisition, rendering and encoding," in Proc. Picture Coding Symp., San Francisco, Dec. 2004, pp. 1-6.
5. S. Wrmlin, E. Lamboray, and M. Gross, "3D video fragments: Dynamic point samples for real-time free-viewpoint video," Comput. Graphics, vol. 28, no. 1, pp. 3-14, 2004.
6. Y. K. Park, K. Jung, Y. Oh, S. Lee, J. K. Kim, H. Lee, K. Yun, N. Hur, and J. Kim, "Depth-image-based rendering for 3DTV service over T-DMB," Signal Process.: Image Commun., vol. 24, pp. 122-136, 2009.
7. P. Kauff, N. Atzpadin, C. Fehn, K. Müller, O. Schreer, A. Smolic, and R. Tanger, "Depth map creation and image-based rendering for advanced 3DTV services providing interoperability and scalability," Signal Process.: Image Commun., vol. 22, no. 2, pp. 217-234, 2007. (Pubitemid 46412731)
8. L. Zhang and W. James Tam, "Stereoscopic image generation based on depth images for 3DTV," IEEE Trans. Broadcast., vol. 51, no. 2, pp. 191-199, 2005. (Pubitemid 40819422)
9. L. Zhang, "Fast stereo matching algorithm for intermediate view reconstruction of stereoscopic television images," IEEE Trans. Circuits Syst. Video Technol., vol. 16, no. 10, pp. 1259-1270, Oct. 2006. (Pubitemid 44832855)
10. D. Kim, D. Min, and K. Sohn, "A stereoscopic video generation method using stereoscopic display characterization and motion analysis," IEEE Trans. Broadcast., vol. 54, no. 2, pp. 188-197, Jun. 2008. (Pubitemid 351780176)
11. "Introduction to 3D video," Archamps, France, ISO/IEC JTC1/SC29/ WG11, Doc.N9784, May 2008.
12. P. Merkle, A. Smolic, K. Müller, and T. Wiegand, "Efficient prediction structures for multiview video coding," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 11, pp. 1461-1473, Nov. 2007. (Pubitemid 350025508)
13. L. Q. Shen, Z. Liu, S. X. Liu, Z. Y. Zhang, and P. An, "Selective disparity estimation and variable size motion estimation based on motion homogeneity for multi-view coding," IEEE Trans. Broadcast., vol. 55, no. 4, pp. 761-766, Dec. 2009.
14. P. Merkle, A. Smolic, K. Müller, and T. Wiegand, "Multi-view video plus depth representation and coding," in Proc. IEEE Int. Conf. Image Process., San Antonio, Texas, Sep. 2007, pp. 201-204.
15. "MPEG 2 Test Model 5," Rev. 2 ISO/IEC JTC1/SC29WG11, Apr. 1993.
16. J. Ribas-Corbera and S. Lei, "Rate control for low-delay video communications," ITU Study Group 16, VCEG, Portland, Doc. Q15-A-20, 1997.
17. Z. G. Li, F. Pan, K. P. Lim, G. Feng, X. Lin, and S. Rahardja, "Adaptive basic unit layer rate control for JVT," Pattaya II, Thailand, Doc. JVTG012r1, 2003.
18. S. Ma, F. Wu, and Z. Li, "Proposed draft of adaptive rate control," Geneva, Switzerland, Doc. JVT-H017r3, 2003.
19. J. E. Lim, J. Kim, K.-N. Ngan, and K. Sohn, "Advanced rate control technologies for 3D-HDTV," IEEE Trans. Consum. Electron., vol. 49, no. 4, pp. 1498-1507, Nov. 2003.
20. S. L. P. Yasakethu, W. A. C. Fernando, and A. M. Kondoz, "Rate controlling in offline 3D video coding using evolution strategy," IEEE Trans. Consum. Electron., vol. 55, no. 1, pp. 150-157, Feb. 2009.
21. B. Kamolrat, W. A. C. Fernando, and M. Mrak, "Rate controlling for color and depth 3D video coding," in Proc. SPIE: Appl. Digital Image Process. XXXI, San Diego, CA, 2008.
22. S. Ma, W. Gao, and Y. Lu, "Rate-distortion analysis for H.264/AVC video coding and its application to rate control," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 12, pp. 1533-1544, Dec. 2005.
23. H.-J. Lee, T. Chiang, and Y.-Q. Zhang, "Scalable rate control for MPEG-4 video," IEEE Trans. Circuits Syst. Video Technol., vol. 10, no. 6, pp. 878-894, Sep. 2000.
24. A. Leontaris and A. M. Tourapis, "Rate control reorganization in the joint model (JM) reference software," San Jose, CA, Doc.JVT-W042, 2007.
25. A. Vetro, P. Pandit, H. Kimata, A. Smolic, and Y.-K.Wang, "Joint draft 8.0 on multiview video coding Hannover, DE, Doc.JVT-AB204, 2008.
26. C. L. Zitnick, S. B. Kang, M. Uyttendaele, S. Winder, and R. Szeliski, "High-quality video view interpolation using a layered representation, " in ACM SIGGRAPH, Los Angeles, CA, Aug. 2004.
27. M. Tanimoto, T. Fujii, K. Suzuki, N. Fukushima, and Y. Mori, "Reference softwares for depth estimation and view synthesis," Archamps, France, ISO/IEC JTC1/SC29/WG11 MPEG2008/M15377, Apr. 2008.
28. Y. Su, A.Vetro, and A. Smolic, "Common test conditions for multiview video coding," Hangzhou, China, Doc. JVT-U211, 2006.