A fast and efficient multi-view depth image coding method based on temporal and inter-view correlations of texture images

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 21, Issue 12, 2011, Pages 1859-1868

  Lee, Jin Young ^a   Wey, Ho Cheon ^a   Park, Du Sik ^a  

^a SAMSUNG Electronics   (South Korea)

Author keywords

Inter view correlation; multi view depth image coding; multi view video plus depth (MVD) format; temporal correlation

Indexed keywords

ARBITRARY POSITIONS; CODING METHODS; CODING PERFORMANCE; DEPTH IMAGE; ENCODING PROCESS; MULTI-VIEW VIDEO PLUS DEPTH (MVD) FORMAT; MULTI-VIEWS; MULTIVIEW VIDEO; RATE-DISTORTION OPTIMIZATION; TEMPORAL CORRELATIONS; TEXTURE IMAGE; VIDEO APPLICATIONS; VIDEO REPRESENTATIONS; VIEW GENERATION;

CODES (SYMBOLS); DEPTH PERCEPTION; MOTION ESTIMATION; TEXTURES; THREE DIMENSIONAL; THREE DIMENSIONAL COMPUTER GRAPHICS; VIDEO SIGNAL PROCESSING;

IMAGE CODING;

EID: 83255176170     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2011.2154730     Document Type: Article

References (37)

1. A. Smolic, K. Mueller, P. Merkle, C. Fehn, P. kauff, P. Eisert, and T. Wiegand, "3D video and free viewpoint video: Technologies, applications and MPEG standards," in Proc. IEEE Int. Conf. Multimedia Expo., Jul. 2006, pp. 2161-2164. (Pubitemid 46680177)
2. ITU-T Rec. H.264-ISO/IEC 14496-10 AVC, Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification, document JVT-G050, Joint Video Team (JVT) of ISO/IEC MPEG and ITU-T VCEG, May 2003.
3. P. Merkle, K. Muller, A. Smolic, and T. Wiegand, "Efficient compression of multi-view video exploiting inter-view dependencies based on H.264/MPEG4-AVC," in Proc. IEEE Int. Conf. Multimedia Expo., Jul. 2006, pp. 1717-1720. (Pubitemid 46680066)
4. P. Merkle, A. Smolic, K. Muller, and T. Wiegand, "Efficient prediction structures for multiview video coding," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 11, pp. 1461-1473, Nov. 2007. (Pubitemid 350025508)
5. Text of ISO/IEC 14496-10:200X/FDAM 1 Multiview Video Coding, document N9978, ISO/IEC JTC1/SC29/WG11, Jul. 2008.
6. Joint Multiview Video Model (JMVM) 8, document N9762, ISO/IEC JTC1/SC29/WG11, May 2008.
7. Multi-View Video Plus Depth (MVD) Format for Advanced 3D Video System, document JVT-W100, ISO/IEC MPEG and ITU-T VCEG, Apr. 2007.
8. Overview of 3D Video Coding, document N9784, ISO/IEC JTC1/SC29/WG11, May 2008.
9. C. Fehn, "Depth-image-based rendering (DIBR), compression and transmission for a new approach on 3D-TV," Proc. SPIE Stereoscopic Displays Virtual Reality Syst. XI, vol. 5291, pp. 93-104, Jan. 2004.
10. A. Smolic, K. Mueller, P. Merkle, P. Kauff, and T. Wiegand, "An overview of available and emerging 3D video formats and depth enhanced stereo as efficient generic solution," in Proc. Picture Coding Symp., May 2009, pp. 1-4.
11. J. Shade, S. Gortler, L. He, and R. Szeliski, "Layered depth images," in Proc. ACM SIGGRAPH, Jul. 1998, pp. 231-242.
12. H. Oh and Y.-S. Ho, "H.264/AVC-based depth map sequence coding using motion information of corresponding texture video," in Proc. PSIVT, LNCS vol. 4319. Dec. 2006, pp. 898-907.
13. Y. Morvan, D. Farin, and P. H. de With, "Depth-image compression based on an R-D optimized quadtree decomposition for the transmission of multiview images," in Proc. IEEE Int. Conf. Image Process., Sep. 2007, pp. 105-108.
14. P. Merkel, Y. Morvan, A. Smolic, D. Farin, K. Mueller, P. H. N. de With, and T. Wiegand, "The effect of depth compression on multiview rendering quality," in Proc. IEEE Conf. 3DTV, May 2008, pp. 245-248.
15. I. Daribo, C. Tillier, and B. Pesquet-Popescu, "Adaptive wavelet coding of the depth map for stereoscopic view synthesis," in Proc. IEEE Workshop Multimedia Signal Process., Oct. 2008, pp. 413-417.
16. K.-J. Oh, S. Yea, A. Vetro, and Y.-S. Ho, "Depth reconstruction filter and down/up sampling for depth coding in 3-D video," IEEE Signal Process. Lett., vol. 16, no. 9, pp. 747-750, Jul. 2009.
17. W. S. Kim, A. Ortega, P. Lai, D. Tian, and C. Gomila, "Depth map distortion analysis for view rendering and depth coding," in Proc. IEEE Int. Conf. Image Process., Nov. 2009, pp. 721-724.
18. D. V. S. X. De Silva and W. A. C. Fernando, "Intra mode selection for depth map coding to minimize rendering distortions in 3D video," IEEE Trans. Consumer Electron., vol. 55, no. 4, pp. 2385-2393, Nov. 2009.
19. I. Daribo, C. Tillier, and B. Pesquet-Popescu, "Motion vector sharing and bit-rate allocation for 3D video-plus-depth coding," EURASIP J. Adv. Signal Process., vol. 2009, pp. 1-13, Jan. 2009.
20. I. Daribo, W. Miled, and B. Pesquet-Popescu, "Joint depth-motion dense estimation for multiview video coding," J. Vis. Commun. Image Representat., vol. 21, nos. 5-6, pp. 487-497, Jul. 2010.
21. S. Yea and A. Vetro, "Multi-layered coding of depth for virtual view synthesis," in Proc. Picture Coding Symp., May 2009, pp. 1-4.
22. C. T. E. R. Hewage, "Prediction of stereoscopic video quality using objective quality models of 2-D video," IET Electron. Lett., vol. 44, no. 16, pp. 963-965, Jul. 2008.
23. J. Y. Lee, H. Wey, and D.-S. Park, "A novel approach for efficient multiview depth map coding," in Proc. Picture Coding Symp., Dec. 2010, pp. 302-305.
24. A. Ortega and K. Ranchandra, "Rate-distortion methods for image and video compression," IEEE Signal Process. Mag., vol. 15, no. 6, pp. 23-50, Nov. 1998. (Pubitemid 128556821)
25. J. Ostermann, J. Bormans, P. List, D. Marpe, M. Narroschke, F. Pereira, T. Stockhammer, and T. Wedi, "Video coding with H.264/AVC: Tools, performance, and complexity," IEEE Circuits Syst. Mag., vol. 4, no. 1, pp. 7-28, Apr. 2004.
26. M. Bertalmio, L. Vese, and G. Sapiro, "Simultaneous structure and texture image inpainting," IEEE Trans. Image Process., vol. 12, no. 8, pp. 882-889, Aug. 2003.
27. Moving Multiview Camera Test Sequences for MPEG-FTV, document M16922, ISO/IEC JTC1/SC29/WG11, Oct. 2009.
28. HHI Test Material for 3D Video, document M15413, ISO/IEC JTC1/SC29/WG11, Apr. 2008.
29. Multiview Video Test Sequence and Camera Parameters, document M15419, ISO/IEC JTC1/SC29/WG11, Apr. 2008.
30. 1D Parallel Test Sequences for MPEG-FTV, document M15378, ISO/IEC JTC1/SC29/WG11, Apr. 2008.
31. Description of Exploration Experiments in 3D Video Coding, document N11477, ISO/IEC JTC1/SC29/WG11, Jul. 2010.
32. View Synthesis Algorithm in View Synthesis Reference Software 2.0 (VSRS2.0), document M16090, ISO/IEC JTC1/SC29/WG11, Feb. 2009.
33. Simple View Synthesis, document M15696, ISO/IEC JTC1/SC29/WG11, Jul. 2008.
34. G. Bj̈ontegaard, "Calculation of average PSNR differences between RDcurves," document ITU-T VCEG-M33, Apr. 2001.
35. C.-H. Chou and Y.-C. Li, "A perceptually tuned subband image coder based on the measure of just-noticeable-distortion profile," IEEE Trans. Circuits Syst. Video Technol., vol. 5, no. 6, pp. 467-476, Dec. 1995.
36. PSPNR Tool 2.0, document M16890, ISO/IEC JTC1/SC29/WG11, Oct. 2009.
37. Methodology for the Subjective Assessment of the Quality of Television Pictures, Rec. ITU-R BT.500-11, 2002.