Rate-distortion optimized rate control for depth map-based 3-D video coding

IEEE Transactions on Image Processing

Volumn 22, Issue 2, 2013, Pages 585-594

  Hu, Sudeng ^a   Kwong, Sam ^b   Zhang, Yun ^b   Kuo, C C Jay ^a  

^a University of Southern California ^*  (United States)

^b CITY UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

3 D video coding; depth map; rate control; view synthesis

Indexed keywords

BIT RATES; BITS ALLOCATION; CODING PROCESS; DEPTH MAP; MODEL PARAMETER ESTIMATION; OPTIMAL BIT ALLOCATION; RATE CONTROL SCHEME; RATE CONTROLS; RATE DISTORTIONS; VIDEO SEQUENCES; VIEW SYNTHESIS; VIRTUAL VIEW;

ALGORITHMS; IMAGE CODING; OPTIMIZATION; PARAMETER ESTIMATION; TEXTURES;

VIDEO SIGNAL PROCESSING;

EID: 84872238951     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2012.2219549     Document Type: Article

References (32)

1. A. Smolic, "3D video and free viewpoint video-from capture to display," Pattern Recognit., vol. 44, no. 9, pp. 1958-1968, Sep. 2011.
2. J. Konrad and M. Halle, "3-D displays and signal processing," IEEE Signal Process. Mag., vol. 24, no. 6, pp. 97-111, Nov. 2007. (Pubitemid 350201603)
3. N. Dodgson, "Autostereoscopic 3-D displays," IEEE Comput., vol. 38, no. 8, pp. 31-36, Aug. 2005.
4. P. Benzie, J. Watson, P. Surman, I. Rakkolainen, K. Hopf, H. Urey, V. Sainov, and C. von Kopylow, "A survey of 3DTV displays: Techniques and technologies," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 11, pp. 1647-1658, Nov. 2007.
5. A. Vetro, T. Wiegand, and G. J. Sullivan, "Overview of the stereo and multiview video coding extensions of the H.264/MPEG-4 AVC standard," Proc. IEEE, vol. 99, no. 4, pp. 626-642, Apr. 2011.
6. P. Merkle, A. Smolic, K. Mueller, and T. Wiegand, "Efficient prediction structures for multiview video coding," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 11, pp. 1461-1473, Nov. 2007. (Pubitemid 350025508)
7. K. Muller, P. Merkle, and T. Wiegand, "3-D video representation using depthmaps," Proc. IEEE, vol. 99, no. 4, pp. 643-656, Apr. 2011.
8. P. Merkle, A. Smolic, K. Muller, and T. Wiegand, "Multi-view video plus depth representation and coding," in Proc. IEEE Int. Conf. Image Process., vol. 1. Oct. 2007, pp. 201-204.
9. P. Kauff, N. Atzpadin, C. Fehn, M. Muller, O. Schreer, A. Smolic, and R. Tanger, "Depth map creation and image based rendering for advanced 3DTV services providing interoperability and scalability," Signal Process., Image Commun., vol. 22, no. 2, pp. 217-234, Feb. 2007. (Pubitemid 46412731)
10. C. Fehn, "Depth-image-based rendering (DIBR), compression and transmission for a new approach on 3D-TV," Proc. SPIE Stereosc. Displays Virtual Real. Syst. XI, vol. 5291, pp. 93-104, Jan. 2004.
11. I. Daribo, C. Tillier, and B. Pesquet-Popescu, "Motion vector sharing and bitrate allocation for 3D video-plus-depth coding," EURASIP J. Adv. Signal Process., vol. 2009, pp. 1-13, Jun. 2009.
12. Y. Morvan, D. Farin, and P. H. N. de With, "Joint depth/texture bit allocation for multi-view video compression," in Proc. 26th Picture Coding Symp., Nov. 2007, pp. 265-268.
13. Y. Liu, Q. Huang, S. Ma, D. Zhao, and W. Gao, "Joint video/depth rate allocation for 3-D video coding based on view synthesis distortion model," Signal Process., Image Commun., vol. 24, no. 8, pp. 666-681, Sep. 2009.
14. H. Yuan, Y. Chang, J. Huo, F. Yang, and Z. Lu, "Model-based joint bit allocation between texture videos and depth maps for 3-D video coding," IEEE Trans. Circuits Syst. Video Technol., vol. 21, no. 4, pp. 485-497, Apr. 2011.
15. Y. Liu, Q. Huang, S. Ma, D. Zhao, W. Gao, S. Ci, and H. Tang, "A novel rate control technique for multiview video plus depth based 3D video coding," IEEE Trans. Broadcast., vol. 57, no. 2, pp. 562-571, Jun. 2011.
16. T. Chiang and Y.-Q. Zhang, "A new rate control scheme using quadratic rate distortion model," IEEE Trans. Circuits Syst. Video Technol., vol. 7, no. 1, pp. 246-250, Feb. 1997. (Pubitemid 127765204)
17. Z. Li, F. Pan, K. P. Lim, G. Feng, X. Lin, and S. Rahardja, "Adaptive basic unit layer rate control for JVT," in Proc. 7th JVT Meeting, Pattaya, Thailand, Mar. 2003, pp. 1-28.
18. S. Ma, W. Gao, and Y. Lu, "Rate-distortion analysis for H.264/AVC video coding and its application to rate control," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 12, pp. 1533-1544, Dec. 2005.
19. J. Dong and N. Ling, "A context-adaptive prediction scheme for parameter estimation in H.264/AVC macroblack layer rate control," IEEE Trans. Circuits Syst. Video Technol., vol. 19, no. 8, pp. 1108-1117, Aug. 2009.
20. S. Hu, H. Wang, S. Kwong, and C.-C. J. Kuo, "Rate control optimization for temporal-layer scalable video coding," IEEE Trans. Circuits Syst. Video Technol., vol. 21, no. 8, pp. 1152-1162, Aug. 2011.
21. N. Kamaci, Y. Altinbasak, and R. M. Mersereau, "Frame bit allocation for the H.264/AVC video coder via Cauchy density-based rate and distortion models," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 8, pp. 994-1006, Aug. 2005. (Pubitemid 41343370)
22. S. Hu, H. Wang, S. Kwong, and C.-C. J. Kuo, "Novel rate-quantization model-based rate control with adaptive initialization for spatial scalable video coding," IEEE Trans. Ind. Electron., vol. 59, no. 3, pp. 1673-1684, Mar. 2012.
23. I. E. G. Richardson, H.264 and MPEG-4 Video Compression: Video Coding for Next-Generation Multimedia. New York: Wiley, 2003.
24. P. Merkle, Y. Morvan, A. Smolic, D. Farin, K. Muller, P. H. N. de With, and T. Wiegand, "The effects of multiview depth video compression on multiview rendering," Signal Process., Image Commun., vol. 24, pp. 73-88, Jan. 2009.
25. H. T. Nguyen and M. N. Do, "Error analysis for image-based rendering with depth information," IEEE Trans. Image Process., vol. 18, no. 4, pp. 703-716, Apr. 2009.
26. K. Müller, A. Smolic, K. Dix, P. Merkle, P. Kauff, and T. Wiegand, "View synthesis for advanced 3D video systems," EURASIP J. Image Video Process., vol. 2008, pp. 1-11, 2008, Article ID 438148.
27. C. L. Zitnick, S. B. Kang, M. Uyttendaele, S. Winder, and R. Szeliski, "High-quality video view interpolation using a layered representation, " ACM Trans. Graph., vol. 23, no. 3, pp. 600-608, Aug. 2004.
28. A. Leontaris and A. M. Tourapis, "Rate control for the joint scalable 638 video model (JSVM)," Joint Video Team, San Jose, CA, Tech. Rep. JVT-W043, Apr. 2007.
29. MPEG-FTV Project. (2011) [Online]. Available: http://www.tanimoto. nuee.nagoya-u.ac.jp/mpeg/mpeg-ftv.html
30. GIST (2011, Jan.) [Online]. Available: ftp://203.253.128.142
31. Joint Multiview Video Coding JMVC 8.5 Software Package, ISO/IEC Standard JTC1/SC29/WG11, Mar. 2011.
32. Report on Experimental Framework for 3-D Video Coding, ISO/IEC Standard JTC1/SC29/WG11, Oct. 2010.