Arbitrarily shaped motion prediction for depth video compression using arithmetic edge coding

IEEE Transactions on Image Processing

Volumn 23, Issue 11, 2014, Pages 4696-4708

  Daribo, Ismael ^a,b   Florencio, Dinei ^c   Cheung, Gene ^a  

^a NATIONAL INSTITUTE OF INFORMATICS   (Japan)

^b EUROPEAN PATENT OFFICE   (Germany)

^c MICROSOFT RESEARCH   (United States)

Author keywords

adaptive coding; Depth map; video coding

Indexed keywords

CODES (SYMBOLS); DECODING; ELECTRIC DISTORTION; FORECASTING; IMAGE CODING; IMAGE COMPRESSION; IMAGE RECONSTRUCTION; IMAGE SEGMENTATION; IMAGE TEXTURE; IMAGE UNDERSTANDING; MOTION ESTIMATION; PIXELS; SIGNAL DISTORTION; VIDEO SIGNAL PROCESSING;

ADAPTIVE CODING; COMPACT REPRESENTATION; DEPTH IMAGE BASED RENDERING; DEPTH MAP; IMAGE PROCESSING APPLICATIONS; OBJECT IDENTIFICATION; OPTIMIZATION PROCEDURES; SYNTHESIZED VIEW DISTORTIONS;

IMAGE PROCESSING;

ALGORITHM; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; IMAGE ENHANCEMENT; IMAGE SUBTRACTION; INFORMATION PROCESSING; MOTION; PHOTOGRAPHY; PROCEDURES; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING; THREE DIMENSIONAL IMAGING; VIDEORECORDING;

ALGORITHMS; DATA COMPRESSION; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGING, THREE-DIMENSIONAL; MOTION; PATTERN RECOGNITION, AUTOMATED; PHOTOGRAPHY; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING, COMPUTER-ASSISTED; SUBTRACTION TECHNIQUE; VIDEO RECORDING;

EID: 84907483901     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2014.2353817     Document Type: Article

References (41)

1. A. Kubota, A. Smolic, M. Magnor, M. Tanimoto, T. Chen, and C. Zhang, "Multiview imaging and 3DTV," IEEE Signal Process. Mag., vol. 24, no. 6, pp. 10-21, Nov. 2007.
2. S. B. Gokturk, H. Yalcin, and C. Bamji, "A time-of-flight depth sensor- System description, issues and solutions," in Proc. Conf. Comput. Vis. Pattern Recognit. Workshop (CVPRW), Washington, DC, USA, Jun. 2004, p. 35.
3. M. Tanimoto, M. P. Tehrani, T. Fujii, and T. Yendo, "Free-viewpoint TV," IEEE Signal Process. Mag., vol. 28, no. 1, pp. 67-76, Jan. 2011.
4. C. Zhang, Z. Yin, and D. Florencio, "Improving depth perception with motion parallax and its application in teleconferencing," in Proc. IEEE Int. Workshop Multimedia Signal Process., Rio de Jeneiro, Brazil, Oct. 2009, pp. 1-6.
5. T. Wiegand, G. J. Sullivan, G. Bjontegaard, and A. Luthra, "Overview of the H.264/AVC video coding standard," IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 7, pp. 560-576, Jul. 2003.
6. P. Merkle, C. Bartnik, K. Muller, D. Marpe, and T. Weigand, "3D video: Depth coding based on inter-component prediction of block partitions," in Proc. Picture Coding Symp., Krakow, Poland, May 2012, pp. 149-152.
7. I. Daribo, D. Florencio, and G. Cheung, "Arbitrarily shaped sub-block motion prediction in texture map compression using depth information," in Proc. Picture Coding Symp., Krakow, Poland, May 2012, pp. 121-124.
8. G. Cheung, A. Ortega, and T. Sakamoto, "Fast H. 264 mode selection using depth information for distributed game viewing," Proc. SPIE Vis. Commun. Image Process., vol. 6822, pp. 682215-1-682215-12, Jan. 2008.
9. G. Bjontegaard, Calculation of Average PSNR Differences Between RD Curves, ITU SC16/Q6, 13th VCEG Meeting, Austin, TX, USA, document VCEG-M33.doc, Apr. 2001.
10. P. Merkle, A. Smolic, K. Mueller, and T. Wiegand, "Multi-view video plus depth representation and coding," in Proc. IEEE Int. Conf. Image Process., San Antonio, TX, USA, Sep./Oct. 2007, pp. I-201-I-204.
11. G. Shen, W.-S. Kim, S. K. Narang, A. Ortega, J. Lee, and H. Wey, "Edge-adaptive transforms for efficient depth map coding," in Proc. IEEE Picture Coding Symp., Nagoya, Japan, Dec. 2010, pp. 566-569.
12. W. Hu, G. Cheung, X. Li, and O. Au, "Depth map compression using multi-resolution graph-based transform for depth-image-based rendering," in Proc. 19th IEEE Int. Conf. Image Process., Orlando, FL, USA, Sep./Oct. 2012, pp. 1297-1300.
13. J. Gautier, O. Le Meur, and C. Guillemot, "Efficient depth map compression based on lossless edge coding and diffusion," in Proc. 29th Picture Coding Symp., Krakow, Poland, May 2012, pp. 81-84.
14. Y. Morvan, P. H. N. de With, and D. Farin, "Platelet-based coding of depth maps for the transmission of multiview images," Proc. SPIE Stereosc. Displays Appl., vol. 6055, p. 60550K, Jan. 2006.
15. V.-A. Nguyen, D. Min, and M. N. Do, "Efficient techniques for depth video compression using weighted mode filtering," IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 2, pp. 189-202, Feb. 2013.
16. W.-S. Kim, A. Ortega, P. Lai, D. Tian, and C. Gomila, "Depth map distortion analysis for view rendering and depth coding," in Proc. 16th IEEE Int. Conf. Image Process., Cairo, Egypt, Nov. 2009, pp. 721-724.
17. W.-S. Kim, A. Ortega, P. Lai, D. Tian, and C. Gomila, "Depth map coding with distortion estimation of rendered view," Proc. SPIE Vis. Inf. Process. Commun., vol. 7543, p. 75430B, Jan. 2010.
18. G. Cheung, A. Kubota, and A. Ortega, "Sparse representation of depth maps for efficient transform coding," in Proc. IEEE Picture Coding Symp., Nagoya, Japan, Dec. 2010, pp. 298-301.
19. G. Cheung, J. Ishida, A. Kubota, and A. Ortega, "Transform domain sparsification of depth maps using iterative quadratic programming," in Proc. 18th IEEE Int. Conf. Image Process., Brussels, Belgium, Sep. 2011, pp. 129-132.
20. G. Cheung, W.-S. Kim, A. Ortega, J. Ishida, and A. Kubota, "Depth map coding using graph based transform and transform domain sparsification," in Proc. IEEE 13th Int. Workshop Multimedia Signal Process., Hangzhou, China, Oct. 2011, pp. 1-6.
21. H. Oh and Y.-S. Ho, "H.264-based depth map sequence coding using motion information of corresponding texture video," in Proc. Pacific-Rim Symp. Image Video Technol., Hsinchu, Taiwan, Dec. 2006, pp. 898-907.
22. I. Daribo, C. Tillier, and B. Pesquet-Popescu, "Motion vector sharing and bitrate allocation for 3D video-plus-depth coding," EURASIP J. Appl. Signal Process., vol. 2009, Jan. 2009, Art. ID 3.
23. M. Maitre, Y. Shinagawa, and M. N. Do, "Wavelet-based joint estimation and encoding of depth-image-based representations for free-viewpoint rendering," IEEE Trans. Image Process., vol. 17, no. 6, pp. 946-957, Jun. 2008.
24. H. Q. Nguyen, P. A. Chou, and Y. Chen, "Compression of human body sequences using graph wavelet filter banks," in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., Florence, Italy, May 2014, pp. 6152-6156.
25. Y. Gao, G. Cheung, T. Maugey, P. Frossard, and J. Liang, "3D geometry representation using multiview coding of image tiles," in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., Florence, Italy, May 2014, pp. 6157-6161.
26. H. Helgason, H. Li, and M. Flierl, "Multiscale framework for adaptive and robust enhancement of depth in multi-view imagery," in Proc. 19th IEEE Int. Conf. Image Process., Orlando, FL, USA, Sep./Oct. 2012, pp. 13-16.
27. R. Li, D. Rusanovskyy, M. M. Hannuksela, and H. Li, "Joint view filtering for multiview depth map sequences," in Proc. 19th IEEE Int. Conf. Image Process., Orlando, FL, USA, Sep./Oct. 2012, pp. 1329-1332.
28. W. Sun, G. Cheung, P. A. Chou, D. Florencio, C. Zhang, and O. C. Au, "Rate-distortion optimized 3D reconstruction from noise-corrupted multiview depth videos," in Proc. IEEE Int. Conf. Multimedia Expo, San Jose, CA, USA, Jul. 2013, pp. 1-6.
29. E. M. Hung, R. L. de Queiroz, and D. Mukherjee, "On macroblock partition for motion compensation," in Proc. IEEE Int. Conf. Image Process., Atlanta, GA, USA, Oct. 2006, pp. 1697-1700.
30. R. U. Ferreira, E. M. Hung, R. L. De Queiroz, and D. Mukherjee, "Efficiency improvements for a geometric-partition-based video coder," in Proc. 16th IEEE Int. Conf. Image Process., Cairo, Egypt, Nov. 2009, pp. 1005-1008.
31. H. Freeman, "On the encoding of arbitrary geometric configurations," IRE Trans. Electron. Comput., vol. EC-10, no. 2, pp. 260-268, Jun. 1961.
32. A. K. Katsaggelos, L. P. Kondi, F. W. Meier, J. Ostermann, and G. M. Schuster, "MPEG-4 and rate-distortion-based shape-coding techniques," Proc. IEEE, vol. 86, no. 6, pp. 1126-1154, Jun. 1998.
33. I. Daribo, G. Cheung, and D. Florencio, "Arithmetic edge coding for arbitrarily shaped sub-block motion prediction in depth video compression," in Proc. 19th IEEE Int. Conf. Image Process., Orlando, FL, USA, Sep./Oct. 2012, pp. 1541-1544.
34. W. J. Teahan, "Probability estimation for PPM," in Proc. New Zealand Comput. Sci. Res. Students' Conf., 1995.
35. D. Marpe, H. Schwarz, and T. Wiegand, "Context-based adaptive binary arithmetic coding in the H.264/AVC video compression standard," IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 7, pp. 620-636, Jul. 2003.
36. (2004). Microsoft Sequence Ballet and Breakdancers. [Online]. Available: http://research.microsoft.com/en-us/um/people/sbkang/3dvideodownload/
37. C. L. Zitnick, S. B. Kang, M. Uyttendaele, S. Winder, and R. Szeliski, "High-quality video view interpolation using a layered representation," in Proc. 31st Int. Conf. Comput. Graph. Interact. Tech. (SIGGRAPH), Aug. 2004, vol. 23, no. 3, pp. 600-608.
38. G. Cheung, V. Velisavljevic, and A. Ortega, "On dependent bit allocation for multiview image coding with depth-image-based rendering," IEEE Trans. Image Process., vol. 20, no. 11, pp. 3179-3194, Nov. 2011.
39. I. Daribo and H. Saito, "Influence of wavelet-based depth coding in multiview video systems," in Proc. 28th Picture Coding Symp., 2010, pp. 334-337.
40. A. K. Katsaggelos, L. P. Kondi, F. W. Meier, J. Ostermann, and G. M. Schuster, "MPEG-4 and rate-distortion-based shape-coding techniques," Proc. IEEE, vol. 86, no. 6, pp. 1126-1154, Jun. 1998.
41. M. Eden, M. Kocher, and M. Eurasip, "On the performance of a contour coding algorithm in the context of image coding. Part I: Contour segment coding," Signal Process., vol. 8, no. 4, pp. 381-386, 1985. [Online]. Available: http://www.sciencedirect.com/science/article/pii/0165168485900015