View and rate scalable multiview image coding with depth-image-based rendering

17th DSP 2011 International Conference on Digital Signal Processing, Proceedings

Volumn , Issue , 2011, Pages

  Velisavljević, Vladan ^a   Stankovič, Vladimir ^b   Chakareski, Jacob ^c   Cheung, Gene ^d  

^a DEUTSCHE TELEKOM LABORATORIES   (Germany)

^b UNIVERSITY OF STRATHCLYDE   (United Kingdom)

^c EPFL   (Switzerland)

^d NATIONAL INSTITUTE OF INFORMATICS   (Japan)

Author keywords

bit allocation; depth image based rendering; Multiview imaging; view and rate scalable encoding

Indexed keywords

APPLICATION SCENARIO; BIT ALLOCATION; BIT STREAM; BIT-ALLOCATION STRATEGY; BITRATES; DEPTH IMAGE BASED RENDERING; DEPTH MAP; EMBEDDED ENCODING; ENCODING TIME; FINE GRANULARITY; H.264/SVC; MULTI-VIEW IMAGE; MULTIVIEW IMAGING; NOVEL INTERMEDIATES; RATE ALLOCATION ALGORITHM; RATE CONSTRAINTS; RATE DISTORTIONS; SCALABLE ENCODING; SOURCE-CODING; UNCODED;

ALGORITHMS; COMMUNICATION CHANNELS (INFORMATION THEORY); DIGITAL SIGNAL PROCESSING; ENCODING (SYMBOLS); IMAGE RECONSTRUCTION; IMAGE UNDERSTANDING; TEXTURES;

IMAGE CODING;

EID: 80053163910     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDSP.2011.6005019     Document Type: Conference Paper

References (29)

1. S. Gokturk, H. Yalcin, and C. Bamji, "A time-of-flight depth sensor-system description, issues and solutions," in Conference on Computer Vision and Pattern Recognition Workshop (CVPRW),Washington, DC, June 2004.
2. M. Tanimoto, T. Fujii, and K. Suzuki, "Multi-view depth map of Rena and Akko & Kayo," ISO/IEC JTC1/SC29/WG11 MPEG Document M14888, Oct. 2007.
3. P. Merkle, A. Smolic, K. Mueller, and T. Wiegand, "Multi-view video plus depth representation and coding," in IEEE International Conference on Image Processing, San Antonio, TX, October 2007.
4. H.-Y. Shum, S.-C. Chan, and S. B. Kang, Image-Based Rendering, Springer, 2007.
5. Y. Morvan, D. Farin, and P. H. N. de With, "Multiview depth-image compression using an extended H.264 encoder," in Advanced Concepts for Intelligent Vision Systems, Lecture Notes in Computer Sciences, 2007, vol. 4678, pp. 675-686.
6. T. Fujii and M. Tanimoto, "Free viewpoint TV system based on rayspace representation," in Proceedings of SPIE, 2002, vol. 4864, p. 175.
7. H. Schwarz, D. Marpe, and T. Wiegand, "Overview of the scalable video coding extension of the H.264/AVC standard," in IEEE Transactions on Circuits and Systems for Video Technology, September 2007, vol. 17, no.9, pp. 1103-1120. (Pubitemid 47483052)
8. J. Shade, S. Gortler, L. He, and R. Szeliski, "Layered depth images," in ACM SIGGRAPH, New York, NY, September 1998.
9. M. Levoy and P. hanrahan, "light field rendering," in ACMSIGGRAPH, New Orleans, LA, August 1996.
10. S. Gortler, R. Grzeszczuk, R. Szeliski, and M. Cohen, "The lumigraph," in ACM SIGGRAPH, New Orleans, LA, August 1996.
11. P. Debevec, C. Taylor, and J. Malik, "Modeling and rendering architecture from photographs," in ACM SIGGRAPH, New Orleans, LA, August 1996.
12. H.-Y. Shum, S. B. Kang, and S.-C. Chan, "Survey of image-based representations and compression techniques," in IEEE Transactions on Circuits and Systems for Video Technology, November 2003, vol. 13, no.11, pp. 1020-1037.
13. G. Cheung and V. Velisavljevíc, "Efficient bit allocation for multiview image coding & view synthesis," in IEEE International Conference on Image Processing, Hong Kong, September 2010.
14. P. Eder, D. Engel, and A. Uhl, "Jpeg2000-based scalable video coding with mctf," Universiẗat Salzburg Technical Report 2007-04, October 2007.
15. T. Andŕe, M. Cagnazzo, M. Antonini, and M. Barlaud, "JPEG2000-compatible scalable scheme for wavelet-based video coding," EURASIP J. Image and Video Proc., vol. 2007, no. 1, pp. 1-11, 2007.
16. N. Ozbek and A. Murat Tekalp, "Scalable multi-view video coding for interactive 3dtv," in IEEE International Conference on Multimedia and Expo, Toronto, Ontario, Canada, July 2006.
17. A. Droese, C. Clemens, and T. Sikora, "Single-view scalable video coding to multi-view based on h.264/avc," in IEEE International Conference on Image Processing, Atlanta, GA, October 2006.
18. W. Yang, Y. Lu, F. Wu, J. Cai, K.N. Ngan, and S. Li, "4-D waveletbased multiview video coding," IEEE Trans. Circuits Sys. Video Techn., vol. 16, no. 11, pp. 1385-1396, 2006.
19. J.-G. Garbas, U. Fecker, and A. Kaup, "Wavelet-based multi-view video coding with full scalability and illumination compensation," in The 15th ACM Int. Conf. MULTIMEDIA '07, Augsburg, Bavaria, Germany, September 2007.
20. J.-G. Garbas, B. Pesquet-Popescu, M. Trocan, and A. Kaup, "Waveletbased multi-view video coding with joint best basis wavelet packets," in IEEE International Conference on Image Processing, San Diego, CA, October 2008.
21. J. Zhang, M.M. Hannuksela, and L. Houqiang, "Joint multiview video plus depth," in IEEE International Conference on Image Processing, Hong Kong, China, September 2010.
22. S. Li and W. Li, "Shape-adaptive discrete wavelet transforms for arbitrarily shaped visual object coding," IEEE Trans. on Circuits and Systems for Video Tech., vol. 10, pp. 725-743, 2000.
23. M. Maitre, Y. Shinagawa, and M.N. Do, "Wavelet-based joint estimation and encoding of depth-image-based representations for freeviewpoint rendering," in IEEE Transactions on Image Processing, June 2008, vol. 17, no.6, pp. 946-957. (Pubitemid 351772611)
24. A. Said and W. A. Pearlman, "A new, fast, and efficient image codec based on set partitioning in hierarchical trees," IEEE Trans. on Circuits and Systems for Video Tech., vol. 6, pp. 243-250, 1996. (Pubitemid 126777405)
25. P. Merkle, Y. Morvan, A. Smolic, D. Farin, K. M uller, P.H.N. deWith, and T. Wiegand, "The effects of multiview depth video compression on multiview rendering," Signal Proc.: Image Comm., vol. 24, no. 1-2, pp. 73-88, 2009.
26. G. Cheung, V. Velisavljevíc, and A. Ortega, "On dependent bit allocation for multiview image coding & view synthesis," in IEEE Transactions on Image Processing, submitted in November 2010.
27. D. P. Bertsekas, Constrained Optimization and Lagrange Multiplier Methods, Athena Scientific, Nashua, NH, Jan. 1996.
28. "2006 stereo datasets," http://vision.middlebury.edu/stereo/ data/scenes2006/.
29. J. Reichel, H. Schwarz, and M. Wien, "Joint scalable video model 9 (jsvm 9)," Joint Video Team, Doc. JVT-V202, January 2007.