Rate-distortion analysis for light field coding and streaming

Signal Processing: Image Communication

Volumn 21, Issue 6, 2006, Pages 462-475

  Ramanathan, Prashant ^a   Girod, Bernd ^a  

^a Stanford University   (United States)

Author keywords

Light field coding; Light field streaming; Light fields; Rate distortion theory; Statistical signal processing

Indexed keywords

COMPUTER SIMULATION; CORRELATION METHODS; GEOMETRY; IMAGE COMPRESSION; SIGNAL DISTORTION; SIGNAL PROCESSING; STATISTICAL METHODS;

DISPARITY COMPENSATION; LIGHT FIELD CODING; LIGHT FIELD STREAMING; LIGHT FIELDS; RATE DISTORTION ANALYSIS; RATE DISTORTION THEORY; STATISTICAL SIGNAL PROCESSING;

IMAGE CODING;

EID: 33646918974     PISSN: 09235965     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.image.2006.03.002     Document Type: Article

References (42)

1. Bennett W.R. Spectra of quantized signals. Bell System Technical J. 27 (July 1948)
2. Berger T. Rate Distortion Theory: A Mathematical Basis for Data Compression (1971), Prentice-Hall, Englewood Cliffs, NJ
3. C. Buehler, M. Bosse, L. McMillan, S. Gortler, M. Cohen, Unstructured lumigraph rendering, in: Computer Graphics (Proceedings of SIGGRAPH01), 2001, pp. 425-432.
4. J.-X. Chai, X. Tong, S.-C. Chan, H.-Y. Shum, Plenoptic sampling, in: Computer Graphics (Proceedings of SIGGRAPH00), August 2000, pp. 307-318.
5. C.-L. Chang, X. Zhu, P. Ramanathan, B. Girod, Inter-view wavelet compression of light fields with disparity-compensated lifting, in: Proceedings of the SPIE Visual Communications and Image Processing VCIP-2003, Lugano, Switzerland, July 2003.
6. C.-L. Chang, X. Zhu, P. Ramanathan, B. Girod, Shape adaptation for light field compression, in: Proceedings of the IEEE International Conference on Image Processing ICIP-2003, Barcelona, Spain, September 2003.
7. Farvardin N., and Modestino J.W. Rate-distortion performance of DPCM schemes for autoregressive sources. IEEE Trans. Image Process. 31 3 (May 1985) 402-418
8. M. Flierl, B. Girod, Multihypothesis motion estimation for video coding, in: Proceedings of the Data Compression Conference 2001, Snowbird, UT, USA, March 2001.
9. M. Flierl, B. Girod, Multihypothesis motion-compensated prediction with forward adaptive hypothesis switching, in: Proceedings of the Picture Coding Symposium 2001, Seoul, Korea, April 2001.
10. M. Flierl, B. Girod, Video coding with motion compensation for groups of pictures, in: Proceedings of the IEEE International Conference on Image Processing ICIP-2002, vol. I, Rochester, NY, USA, September 2002, pp. 69-72.
11. M. Flierl, B. Girod, Investigation of motion-compensated lifted wavelet transforms, in: Proceedings of the Picture Coding Symposium 2003, Saint-Malo, France, April 2003.
12. Flierl M., and Girod B. Video coding with motion-compensated lifted wavelet transforms. EURASIP J. Image Comm. Special Issue on Subband/Wavelet Interframe Video Coding 19 7 (August 2004) 561-575
13. Gallager R. Information Theory and Reliable Communication (1968), Wiley, New York
14. Gersho A., and Gray R.M. Vector Quantization and Signal Compression (1992), Kluwer Academic Publishers, Dordrecht
15. Girod B. The efficiency of motion-compensating prediction for hybrid coding of video sequences. IEEE J. Selected Areas Comm. SAC-5 (August 1987) 1140-1154
16. Girod B. Motion-compensating prediction with fractional pel accuracy. IEEE Trans. Comm. 41 (April 1993) 604-612
17. Girod B. Efficiency analysis of multihypothesis motion-compensated prediction for video coding. IEEE Trans. Image Process. 9 2 (February 2000) 173-183
18. B. Girod, C.-L. Chang, P. Ramanathan, X. Zhu, Light field compression using disparity-compensated lifting, in: Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing 2003, vol. IV, Hong Kong, China, April 2003, pp. 761-764.
19. S.J. Gortler, R. Grzeszczuk, R. Szeliski, M.F. Cohen, The lumigraph, in: Computer Graphics (Proceedings of SIGGRAPH96), August 1996, pp. 43-54.
20. Gray R.M., and Neuhoff D.L. Quantization. IEEE Trans. Inform. Theory 44 6 (October 1998) 2325-2383
21. A. Isaksen, L. McMillan, S.J. Gortler, Dynamically reparameterized light fields, in: Computer Graphics (Proceedings of SIGGRAPH00), August 2000.
22. Jayant N.S., and Noll P. Digital Coding of Waveforms (1984), Prentice-Hall, Englewood Cliffs, NJ
23. Kolmogorov A.N. On the Shannon theory of information transmission in the case of continuous signals. IEEE Trans. Image Process. 2 4 (December 1956) 102-108
24. M. Levoy, P. Hanrahan, Light field rendering, in: Computer Graphics (Proceedings of SIGGRAPH96), August 1996, pp. 31-42.
25. M. Levoy, K. Pulli, et al., The digital Michelangelo project: 3D scanning of large statues, in: Computer Graphics (Proceedings of SIGGRAPH00), August 2000, pp. 131-144.
26. M. Magnor, P. Eisert, B. Girod, Model-aided coding of multi-viewpoint image data, in: Proceedings of the IEEE International Conference on Image Processing ICIP-2000, vol. 2, Vancouver, Canada, September 2000, pp. 919-922.
27. M. Magnor, A. Endmann, B. Girod, Progressive compression and rendering of light fields, in: Proceedings of the Vision, Modelling and Visualization 2000, November 2000, pp. 199-203.
28. Magnor M., and Girod B. Data compression for light field rendering. IEEE Trans. Circuits Systems Video Technol. 10 3 (April 2000) 338-343
29. Magnor M., Ramanathan P., and Girod B. Multi-view coding for image-based rendering using 3-D scene geometry. IEEE Trans. Circuits Systems Video Technol. 13 11 (November 2003) 1092-1106
30. O'Neal Jr. J.B., and Raj Natarajan T. Coding isotropic images. IEEE Trans. Inform. Theory 23 6 (November 1977) 697-707
31. I. Peter, W. Strasser, The wavelet stream: progressive transmission of compressed light field data, in: IEEE Visualization 1999 Late Breaking Hot Topics, October 1999, pp. 69-72.
32. M.S. Pinsker, in: Trudy, Third All-Union Mathematical Conference, vol. 1, 1956, p. 125.
33. P. Ramanathan, Compression and interactive streaming of light fields, Ph.D. Thesis, Stanford University, Stanford, CA, 2005.
34. P. Ramanathan, M. Flierl, B. Girod, Multi-hypothesis disparity-compensated light field compression, in: Proceedings of the IEEE International Conference on Image Processing ICIP-2001, October 2001.
35. P. Ramanathan, B. Girod, Rate-distortion optimized streaming of compressed light fields with multiple representations, in: Packet Video Workshop 2004, Irvine, CA, USA, December 2004.
36. P. Ramanathan, B. Girod, Receiver-driven rate-distortion optimized streaming of light fields, in: Proceedings of the IEEE International Conference on Image Processing ICIP-2005, Genoa, Italy, September 2005.
37. P. Ramanathan, M. Kalman, B. Girod, Rate-distortion optimized streaming of compressed light fields, in: Proceedings of the IEEE International Conference on Image Processing ICIP-2003, vol. 3, Barcelona, Spain, September 2003, pp. 277-280.
38. P. Ramanathan, E. Steinbach, P. Eisert, B. Girod, Geometry refinement for light field compression, in: Proceedings of the IEEE International Conference on Image Processing ICIP-2002, vol. 2, Rochester, NY, USA, September 2002, pp. 225-228.
39. Tong X., and Gray R.M. Interactive rendering from compressed light fields. IEEE Trans. Circuits Systems Video Technol. 13 11 (November 2003) 1080-1091
40. D.N. Wood, D.I. Azuma, K. Aldinger, B. Curless, T. Duchamp, D.H. Salesin, W. Stuetzle, Surface light fields for 3D photography, in: Computer Graphics (Proceedings of SIGGRAPH00), August 2000, pp. 287-296.
41. Zhang C., and Chen T. Spectral analysis for sampling image-based rendering data. IEEE Trans. Circuits Systems Video Technol. 13 11 (November 2003) 1038-1050
42. C. Zhang, J. Li, Compression of lumigraph with multiple reference frame (MRF) prediction and just-in-time rendering, in: Proceedings of the Data Compression Conference 2000, Snowbird, UT, USA, March 2000, pp. 253-262.