Graph-based representation for multiview image geometry

IEEE Transactions on Image Processing

Volumn 24, Issue 5, 2015, Pages 1573-1586

  Maugey, Thomas ^a   Ortega, Antonio ^c   Frossard, Pascal ^b  

^a CAMPUS DE BEAULIEU   (France)

^b EPFL   (Switzerland)

^c University of Southern California   (United States)

Author keywords

3D representation; graph based representation; Multiview image coding; view prediction

Indexed keywords

CODES (SYMBOLS); CODING ERRORS; GEOMETRY; GRAPHIC METHODS; PIXELS;

3D REPRESENTATIONS; AMOUNT OF INFORMATION; GEOMETRY INFORMATION; GEOMETRY REPRESENTATION; GRAPH-BASED REPRESENTATIONS; MULTI-VIEW GEOMETRY; MULTI-VIEW IMAGE CODING; VIEW PREDICTIONS;

IMAGE CODING;

EID: 84925067645     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2015.2400817     Document Type: Article

References (38)

1. S. Foix, G. Alenya, and C. Torras, "Lock-in time-of-flight (ToF) cameras: A survey," IEEE Sensors J., vol. 11, no. 9, pp. 1917-1926, Sep. 2011.
2. H.-Y. Shum, S. B. Kang, and S.-C. Chan, "Survey of image-based representations and compression techniques," IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 11, pp. 1020-1037, Nov. 2003.
3. K. Müller, P. Merkle, and T. Wiegand, "3D video representation using depth maps," Proc. IEEE, vol. 99, no. 4, pp. 643-656, Apr. 2011.
4. J. Salvador and J. R. Casas, "Multi-view video representation based on fast Monte Carlo surface reconstruction," IEEE Trans. Image Process., vol. 22, no. 9, pp. 3342-3352, Sep. 2013.
5. Joint Multiview Video Model (JMVM), document ISO/IEC MPEG & ITU-T VCEG, Marrakesh, Morocco, Jan. 2007.
6. J.-X. Chai, X. Tong, S.-C. Chan, and H.-Y. Shum, "Plenoptic sampling," in Proc. 27th Annu. Conf. Comput. Graph. Interact. Techn., 2000, pp. 307-318.
7. S.-Y. Kim and Y.-S. Ho, "Mesh-based depth coding for 3D video using hierarchical decomposition of depth maps," in Proc. IEEE Int. Conf. Image Process., San Antonio, TX, USA, Sep./Oct. 2007, pp. V-117-V-120.
8. P. Merkle, A. Smolic, K. Müller, and T. Wiegand, "Multi-view video plus depth representation and coding," in Proc. IEEE Int. Conf. Image Process., San Antonio, TX, USA, Sep./Oct. 2007, pp. I-201-I-204.
9. S. Yea and A. Vetro, "View synthesis prediction for multiview video coding," EURASIP J. Signal Process., Image Commun., vol. 24, nos. 1-2, pp. 89-100, 2009.
10. D. Tian, P.-L. Lai, P. Lopez, and C. Gomila, "View synthesis techniques for 3D video," Proc. SPIE, vol. 7443, p. 74430T, Sep. 2009.
11. K. Müller et al., "3D high-efficiency video coding for multi-view video and depth data," IEEE Trans. Image Process., vol. 22, no. 9, pp. 3366-3378, Sep. 2013.
12. W.-S. Kim, A. Ortega, P. Lai, D. Tian, and C. Gomila, "Depth map distortion analysis for view rendering and depth coding," in Proc. 16th IEEE Int. Conf. Image Process., Cairo, Egypt, Nov. 2009, pp. 721-724.
13. H. Yuan, S. Kwong, J. Liu, and J. Sun, "A novel distortion model and Lagrangian multiplier for depth maps coding," IEEE Trans. Circuits Syst. Video Technol., vol. 24, no. 3, pp. 443-451, Mar. 2014.
14. A. Secker and D. Taubman, "Highly scalable video compression with scalable motion coding," IEEE Trans. Image Process., vol. 13, no. 8, pp. 1029-1041, Aug. 2004.
15. M. A. Agostini-Vautard, M. Cagnazzo, M. Antonini, G. Laroche, and J. Jung, "A new coding mode for hybrid video coders based on quantized motion vectors," IEEE Trans. Circuits Syst. Video Technol., vol. 21, no. 7, pp. 946-956, Jul. 2011.
16. Y. Morvan, D. Farin, and P. H. N. de With, "Joint depth/texture bitallocation for multi-view video compression," in Proc. Picture Coding Symp. (PCS), 2007, pp. 265-268.
17. Q. Wang, X. Ji, Q. Dai, and N. Zhang, "Free viewpoint video coding with rate-distortion analysis," IEEE Trans. Circuits Syst. Video Technol., vol. 22, no. 6, pp. 875-889, Jun. 2012.
18. G. Cheung, V. Velisavlevic, and A. Ortega, "On dependent bit allocation for multiview image coding with depth-image-based rendering," IEEE Trans. Image Process., vol. 20, no. 11, pp. 3179-3194, Nov. 2011.
19. B. Rajei, T. Maugey, H.-R. Pourreza, and P. Frossard, "Rate-distortion analysis of multiview coding in a DIBR framework," Ann. Telecommun., vol. 68, nos. 11-12, pp. 627-640, 2013.
20. K. Müller, P. Merkle, G. Tech, and T. Wiegand, "3D video coding with depth modeling modes and view synthesis optimization," in Proc. Asia-Pacific Signal Inf. Process. Assoc. Annu. Summit Conf. (APSIPA ASC), Hollywood, CA, USA, Dec. 2012, pp. 1-4.
21. T. Maugey, Y.-H. Chao, A. Gadde, A. Ortega, and P. Frossard, "Luminance coding in graph-based representation of multiview images," in Proc. IEEE Int. Conf. Image Process., Paris, France, Oct. 2014, pp. 130-134.
22. P. Merkle, A. Smolic, K. Müller, and T. Wiegand, "Efficient prediction structures for multiview video coding," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 11, pp. 1461-1473, Nov. 2007.
23. Y. Morvan, D. Farin, and P. H. N. de With, "Depth-image compression based on an R-D optimized quadtree decomposition for the transmission of multiview images," in Proc. IEEE Int. Conf. Image Process., San Antonio, TX, USA, Sep./Oct. 2007, pp. V-105-V-108.
24. M. Maitre and M. N. Do, "Depth and depth-color coding using shapeadaptive wavelets," J. Vis. Commun. Image Represent., vol. 21, nos. 5-6, pp. 513-522, Jul./Aug. 2008.
25. S. Liu, P. Lai, D. Tian, and C. W. Chen, "New depth coding techniques with utilization of corresponding video," IEEE Trans. Broadcast., vol. 57, no. 2, pp. 551-561, Jun. 2011.
26. G. Cheung, W.-S. Kim, A. Ortega, J. Ishida, and A. Kubota, "Depth map coding using graph based transform and transform domain sparsification," in Proc. IEEE Int. Workshop Multimedia Signal Process., Hangzhou, China, Oct. 2011, pp. 1-6.
27. I. Daribo, G. Cheung, and D. Florencio, "Arithmetic edge coding for arbitrarily shaped sub-block motion prediction in depth video compression," in Proc. 19th IEEE Int. Conf. Image Process., Orlando, FL, USA, Sep. 2012, pp. 1541-1544.
28. A. Gelman, P. L. Dragotti, and V. Velisavljevic, "Multiview image coding using depth layers and an optimized bit allocation," IEEE Trans. Image Process., vol. 21, no. 9, pp. 4092-4105, Sep. 2012.
29. U. Takyar, T. Maugey, and P. Frossard, "Extended layered depth image representation in multiview navigation," IEEE Signal Process. Lett., vol. 21, no. 1, pp. 22-25, Jan. 2014.
30. F. Maninchedda, M. Pollefeys, and A. Fogel, "Efficient stereo video encoding for mobile applications using the 3D+F codec," in Proc. IEEE 3DTV-Conf., Zürich, Switzerland, Oct. 2012, pp. 1-4.
31. T. Maugey, A. Ortega, and P. Frossard, "Graph-based representation and coding of multiview geometry," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Vancouver, BC, Canada, May 2013, pp. 1325-1329.
32. T. Maugey, A. Ortega, and P. Frossard, "Multiview image coding using graph-based approach," in Proc. IEEE 11th Workshop 3D Image/Video Technol. Appl. (IVMSP), Seoul, Korea, Jun. 2013, pp. 1-4.
33. F. Ono, W. Rucklidge, R. Arps, and C. Constantinescu, "JBIG2-the ultimate bi-level image coding standard," in Proc. Int. Conf. Image Process., Vancouver, BC, Canada, Sep. 2000, pp. 140-143.
34. J.-R. Ohm, D. Rusanovsky, A. Vetro, and K. Müller, "Joint collaborative team on 3D video coding extension develoment," Tech. Rep. JCT3VB1006, Oct. 2012.
35. K. Müller, A. Smolic, K. Dix, P. Merkle, and T. Wiegand, "Coding and intermediate view synthesis of multiview video plus depth," in Proc. 16th IEEE Int. Conf. Image Process., Cairo, Egypt, Nov. 2009, pp. 741-744.
36. M. Tanimoto, "FTV: Free-viewpoint television," Signal Process., Image Commun., vol. 27, no. 6, pp. 555-570, Jul. 2012.
37. JPEG 2000 Final Committe Draft Version 1.0, document ISO/IEC FCD 15444-1, 2000.
38. C. Fehn, "Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV," Proc. SPIE, vol. 5291, pp. 93-104, May 2004.