RDTC optimized compression of image-based scene representations (Part I): Modeling and theoretical analysis

IEEE Transactions on Image Processing

Volumn 17, Issue 5, 2008, Pages 709-723

  Bauermann, Ingo ^a   Steinbach, Eckehard ^a  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

Image based rendering (IBR); Interactive streaming; RDTC optimization

Indexed keywords

CHANNEL CAPACITY; DECODING; IMAGE CODING; MATHEMATICAL MODELS; OPTIMIZATION; SIGNAL DISTORTION; VIDEO STREAMING;

IMAGE-BASED RENDERING; INTERACTIVE STREAMING; USER-PERCEIVED DELAY;

IMAGE COMPRESSION;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; COMPUTER SIMULATION; IMAGE ENHANCEMENT; INFORMATION PROCESSING; MATHEMATICAL COMPUTING; METHODOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING; THEORETICAL MODEL; THREE DIMENSIONAL IMAGING; VIDEORECORDING;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; DATA COMPRESSION; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGING, THREE-DIMENSIONAL; MODELS, THEORETICAL; NUMERICAL ANALYSIS, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING, COMPUTER-ASSISTED; VIDEO RECORDING;

EID: 42649103321     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2008.918962     Document Type: Article

References (33)

1. M. Levoy and P. Hanrahan, "Light field rendering," in Proc. SIGGRAPH, 1996, pp. 31-42.
2. S. J. Gortler, R. Grzeszczuk, R. Szeliski, and M. F. Cohen, "The Lumigraph," in Proc. SIGGRAPH, 1996, pp. 43-54.
3. H.-Y. Shum and L.-W. He, "Rendering with concentric mosaics," presented at the ACM SIGGRAPH, Los Angeles, CA, Aug. 1999.
4. H.-Y. Shum, S. B. Kang, and S.-C. Chan, "Survey of image-based representations and compression techniques," IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 11, pp. 1020-1037, Nov. 2003.
5. H.-Y. Shum, S.-C. Chan, and S. B. Kang, Image-Based Rendering. New York: Springer, 2007.
6. E. H. Adelson and J. Bergen, "The plenoptic function and the elements of early vision," in Computational Models of Visual Processing. Cambridge, MA: MIT Press, 1991, pp. 3-20.
7. D. Aliaga, T. Funkhouser, D. Yanovsky, and I. Carlbom, "Sea of images," IEEE Comput. Graph. Appl., vol. 23, no. 6, pp. 22-30, Nov. 2003.
8. J.-F. Evers-Senne and R. Koch, "Image-based rendering of complex scenes from a multi-camera rig," presented at the IEEE Vision, Image, Signal Processing, Aug. 2005.
9. H.-Y. Shum, K.-T. Ng, and S.-C. Chan, "A virtual reality system using the concentric mosaic: Construction, rendering, and data compression," IEEE Trans. Multimedia, vol. 7, no. 1, pp. 85-95, Feb. 2005.
10. M. Magnor and B. Girod, "Data compression for light-field rendering," IEEE Trans. Circuits Syst. Video Technol., vol. 10, no. 3, pp. 338-343, Apr. 2000.
11. L. Luo, Y. Wu, J. Li, and Y.-Q. Zhang, "3-D wavelet compression and progressive inverse wavelet synthesis rendering of concentric mosaic," IEEE Trans. Image Process., vol. 11, no. 7, pp. 802-816, Jul. 2002.
12. C.-L. Chan g, X. Zhu, P. Ramanathan, and B. Girod, "Light field compression using disparity-compensated lifting and shape adaptation," IEEE Trans. Image Process., vol. 15, no. 4, pp. 793-806, Apr. 2006.
13. X. Tong and R. Gray, "Interactive rendering from compressed light fields" IEEE Trans. Circuits. Syst. Video Technol., vol. 13, no. 11 pp. 1080-1091, Nov. 2003.
14. C. E. Shannon, "A mathematical theory of communication," Bell Syst. Tech. J., vol. 27, 1948.
15. C. E. Shannon, "Coding theorems for a discrete source with a fidelity criterion," presented at the IRE National Convention Record, Part 4, 1959.
16. T. Berger, Rate Distortion Theory: A Mathematical Basis for Data Compression. Englewood Cliffs, NJ: Prentice-Hall, 1971.
17. Generic Coding of Moving Pictures and Associated Audio Information - Part 2: Video, ITU-T Rec. H.262 and !SO/IEC 13818-2 (MPEG-2), Nov. 1994, ITU-T and ISO/IEC JTC 1.
18. Video Coding for Low Bit Rate Communication, ITU-T Rec. H.263, ITU-T. v1: Nov. 1995, v2: Jan. 1998, v3: Nov. 2000.
19. Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification (ITU-T Rec. H.264 ISO/IEC 14496-10 AVC), Joint Video Team (JVT) of ISO/IEC MPEG and ITU-T VCEG, JVT-G050, Mar. 2003, Joint Video Team of ITU-T and ISO/IEC JTC 1.
20. E. K. Vutukuri, I. Bauermann, and E. Steinbach, "Decoding complexity-constrained rate-distortion optimization for the compression of concentric mosaics," presented at the Picture Coding Symp., San Francisco, CA, Dec. 2004.
21. I. Bauermann, Y. Peng, and E. Steinbach, "Receiver- and channel-adaptive compression for remote browsing of image-based scene representations," presented at the Picture Coding Symp., Apr. 2006.
22. I. Bauermann, Y. Peng, and E. Steinbach, "RDTC optimized streaming for remote browsing in image-based scene representations," presented at the Symp. 3D Data Processing, Visualization and Transmission, Jun. 2006.
23. C. Zhang and J. Li, "On the compression and streaming of concentric mosaic data for free wandering in a realistic environment over the internet," IEEE Trans. Multimedia, vol. 7, no. 6, pp. 1170-1182, Dec. 2005.
24. M. van der Schaar and Y. Andreopoulos, "Rate-distortion-complexity modeling for network and receiver aware adaptation," IEEE Trans. Multimedia, vol. 7, no. 3, pp. 471-480, Jun. 2005.
25. P. Ramanathan, M. Kalman, and B. Girod, "Rate-distortion optimized interactive light field streaming," IEEE Trans. Multimedia, vol. 9, no. 4, pp. 813-825, Jun. 2007.
26. C. Zhang and T. Chen, "Spectral analysis for sampling image-based rendering data," IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 11, pp. 1038-1050, Nov. 2003.
27. B. Wilburn, N. Joshi, V. Vaish, E.-V. Talvala, E. Antunez, A. Barth, A. Adams, M. Horowitz, and M. Levoy, "High performance imaging using large camera arrays," in Proc. ACM SIGGRAPH, Jul. 2005, vol. 24, no. 3, pp. 765-776.
28. C. L. Zitnick, S. B. Kang, M. Uyttendaele, S. Winder, and R. Szcliski, "High-quality video view interpolation using a layered representation," ACM Trans. Graph., vol. 23, no. 3, pp. 600-608, Aug. 2004.
29. H. C. Longuet-Higgins, "A computer algorithm for reconstructing a scene from two projections," Nature, vol. 293, pp. 133-135, 1981.
30. B. Girod, "The efficiency of motion-compensating prediction for hybrid coding of video sequences," IEEE J. Sel. Areas Commun., vol. 5, no. 8, pp. 1140-1154, Aug. 1987.
31. B. Girod, "Efficiency analysis of multihypothesis motion-compensated prediction for video coding," IEEE Trans. Image Process., vol. 9, no. 2, pp. 173-183, Feb. 2000.
32. I. Bauermann and E. Steinbach, "Encoding parameter estimation for RDTC optimized compression and streaming of image-based scene representations," presented at the IEEE Int. Conf. Image Processing, Sep. 2007.
33. I. Bauermann and E. Steinbach, "RDTC optimized compression of image-based scene representations (Part II): Practical coding," IEEE Trans. Image Processing, vol. 17, no. 5, pp. 724-736, May 2008.