Multiview image coding using depth layers and an optimized bit allocation

IEEE Transactions on Image Processing

Volumn 21, Issue 9, 2012, Pages 4092-4105

  Gelman, Andriy ^a   Dragotti, Pier Luigi ^a   Velisavljević, Vladan ^b  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

^b DEUTSCHE TELEKOM LABORATORIES   (Germany)

Author keywords

Bit rate allocation; compression; multiview image coding; wavelet transforms

Indexed keywords

BIT ALLOCATION; BIT-ALLOCATION STRATEGY; BIT-RATE ALLOCATION; CODING METHODS; DATA SETS; DEPTH LAYERS; MULTI-VIEW IMAGE; MULTIPLE VIEWPOINTS; RATE DISTORTION PERFORMANCE; SHAPE-ADAPTIVE; SPATIAL DIMENSION; WAVELET COEFFICIENTS; WAVELET-BASED COMPRESSIONS;

COMPACTION; DISCRETE WAVELET TRANSFORMS; IMAGE CODING; WAVELET TRANSFORMS;

THREE DIMENSIONAL;

EID: 84865406214     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2012.2201490     Document Type: Article

References (36)

1. A. Kubota, A. Smolic, M. Magnor, M. Tanimoto, T. Chen, and C. Zhang, "Multiview imaging and 3DTV," IEEE Signal Process. Mag., vol. 24, no. 6, pp. 10-21, Nov. 2007. (Pubitemid 350201595)
2. C. Zhang and T. Chen, "A survey on image-based rendering- representation, sampling and compression," Signal Process., Image Commun., vol. 19, no. 1, pp. 1-28, 2004.
3. M. Levoy and P. Hanrahan, "Light field rendering," in Proc. Comput. Graph., Aug. 1996, pp. 31-42.
4. M. H. Kiu, X. S. Du, R. J. Moorhead, D. C. Banks, and R. Machiraju, "Two dimensional sequence compression using MPEG," in Proc. SPIE, Visual Commun. Image Process., vol. 3309, pp. 914-921, Jan. 1998. (Pubitemid 34981106)
5. C. Zhang and J. Li, "Compression of lumigraph with multiple reference frame (MRF) prediction and just-in-time rendering," in Proc. IEEE Data Compress. Conf., Mar. 2000, pp. 253-262. (Pubitemid 30588731)
6. M. Magnor and B. Girod, "Data compression for light-field rendering," IEEE Trans. Circuits Syst. Video Technol., vol. 10, no. 3, pp. 338-343, Apr. 2000. (Pubitemid 30594839)
7. B. Girod, C.-L. Chang, P. Ramanathan, and X. Zhu, "Light field compression using disparity-compensated lifting," IEEE Trans. Image Process., vol. 15, no. 4, pp. 793-806, Apr. 2006.
8. A. Secker and D. Taubman, "Lifting-based invertible motion adaptive transform (LIMAT) framework for highly scalable video compression," IEEE Trans. Image Process., vol. 12, no. 12, pp. 1530-1542, Dec. 2003. (Pubitemid 40005922)
9. I. Daubechies and W. Sweldens, "Factoring wavelet transforms into lifting steps," J. Fourier Anal. Appl., vol. 4, no. 3, pp. 247-269, 1998.
10. M. Magnor and B. Girod, "Hierarchical coding of light fields with disparity maps," in Proc. IEEE Int. Conf. Image Process., vol. 3. Oct. 1999, pp. 334-338. (Pubitemid 30550060)
11. M. Magnor and P. Eisert, "Model-aided coding of multi-viewpoint image data," in Proc. IEEE Int. Conf. Image Process., vol. 2. Sep. 2000, pp. 919-922. (Pubitemid 32465776)
12. M. Magnor and B. Girod, "Model-based coding of multi-viewpoint imagery," Proc. SPIE, Visual Commun. Image Process., vol. 1, pp. 14- 22, Jun. 2000.
13. X. San, H. Cai, J.-G. Lou, and J. Li, "Multiview image coding based on geometric prediction," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 11, pp. 1536-1548, Nov. 2007. (Pubitemid 350025513)
14. M. Maitre, Y. Shinagawa, and M. N. Do, "Wavelet-based joint estimation and encoding of depth-image-based representations for free-viewpoint rendering," IEEE Trans. Image Process., vol. 17, no. 6, pp. 946-957, Jun. 2008. (Pubitemid 351772611)
15. I. Daribo, C. Tillier, and B. Pesquet-Popescu, "Motion vector sharing and bitrate allocation for 3D video-plus-depth coding," EURASIP J. Adv. Signal Process., vol. 2009, pp. 1-13, Jun. 2009.
16. H.264/AVC Video Coding Algorithm. (2010) [Online]. Available: http://x264.nl/
17. H.264/MVC Multiview Video Coding Algorithm. (2010) [Online]. Available: http://CVS-garcon.ient.rwth-aachen.de
18. E. H. Adelson and J. R. Bergen, "The plenoptic function and the elements of early vision," in Computational Models of Visual Processing. Cambridge, MA: MIT Press, 1991, pp. 3-20.
19. H. Y. Shum, S. C. Chan, and S. B. Kang, Image-Based Rendering. New York: Springer-Verlag, 2007.
20. J. Berent and P. L. Dragotti, "Plenoptic manifolds: Exploiting structure and coherence in multiview images," IEEE Signal Process. Mag., vol. 24, no. 6, pp. 34-44, Nov. 2007.
21. J. Berent and P. L. Dragotti, "Segmentation of epipolar-plane image volumes with occlusion and disocclusion competition," in Proc. IEEE 8th Workshop Multimedia Signal Process., Oct. 2006, pp. 182-185.
22. S. Jehan-Besson, M. Barlaud, and G. Aubert, "DREAM2S: Deformable regions driven by an eulerian accurate minimization method for image and video segmentation," Int. J. Comput. Vis., vol. 53, no. 1, pp. 45-70, Jun. 2003.
23. J. Berent, "Coherent multi-dimensional segmentation of multi-view images using a variational framework and applications to image based rendering," Ph.D. thesis, Dept. Electr. Electron. Eng., Imperial College, London, U.K., 2008.
24. M. Kass, A. Witkin, and D. Terzopoulos, "Snakes: Active contour models," Int. J. Comput. Vis., vol. 1, no. 4, pp. 321-331, Jan. 1988.
25. V. Kolmogorov and R. Zabih, "Multi-camera scene reconstruction via graph cuts," in Proc. 7th Eur. Conf. Comput. Vis.-Part III, 2002, pp. 82-96.
26. D. Scharstein and R. Szeliski. Middlebury Data Sets [Online]. Available: http://vision.middlebury.edu/stereo/
27. R. Shukla, P. L. Dragotti, M. N. Do, and M. Vetterli, "Rate-distortion optimized tree-structured compression algorithms for piecewise polynomial images," IEEE Trans. Image Process., vol. 14, no. 3, pp. 343-359, Mar. 2005. (Pubitemid 40356098)
28. H. Freeman, "On the encoding of arbitrary geometric configurations," IEEE Trans. Electron. Comput., vol. 10, no. 2, pp. 260-268, Jun. 1961.
29. Y. Liu and B. Zalik, "An efficient chain code with huffman coding," Pattern Recognit., vol. 38, no. 4, pp. 553-557, Apr. 2005.
30. Y. Shoham and A. Gersho, "Efficient bit allocation for an arbitrary set of quantizers," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., vol. 36. Sep. 1988, pp. 1445-1453.
31. S. Li and W. Li, "Shape-adaptive discrete wavelet transforms for arbitrarily shaped visual object coding," IEEE Trans. Circuits Syst. Video Technol., vol. 10, no. 5, pp. 725-743, Aug. 2000.
32. D. Taubman, "High performance scalable image compression with EBCOT," IEEE Trans. Image Process., vol. 9, no. 7, pp. 1158-1170, Jul. 2000.
33. T. M. Cover and J. A. Thomas, Elements of Information Theory (Telecommunications and Signal Processing). New York: Wiley, 2006.
34. G. J. Sullivan and T. Wiegand, "Rate-distortion optimization for video compression," IEEE Signal Process. Mag., vol. 15, no. 6, pp. 74-90, Nov. 1998.
35. M. Hötter, "Object-oriented analysis-synthesis coding based on moving two-dimensional objects," Signal Process., Image Commun., vol. 2, no. 4, pp. 409-428, 1990.
36. A. Gelman, P. L. Dragotti, and V. Velisavljevi'c, "Multiview image compression using a layer-based representation," in Proc. IEEE Int. Conf. Image Process., Sep. 2010, pp. 493-496.