A virtual reality system using the concentric mosaic: Construction, rendering, and data compression

IEEE Transactions on Multimedia

Volumn 7, Issue 1, 2005, Pages 85-95

  Shum, Heung Yeung ^a   Ng, King To ^b   Chan, Shing Chow ^b  

^a MICROSOFT RESEARCH ASIA   (China)

^b UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Concentric mosaic; Data compression; Image based rendering (IBR); MPEG 2; Video coding; Virtual reality (VR)

Indexed keywords

ALGORITHMS; COMPUTATIONAL METHODS; DATA ACQUISITION; DATA COMPRESSION; IMAGE CODING; IMAGE RECONSTRUCTION; INTERPOLATION; MATHEMATICAL MODELS; NONLINEAR FILTERING;

CONCENTRIC MOSAIC; IMAGE BASED RENDERING (IBR); MPEG-2;

VIRTUAL REALITY;

EID: 13144269645     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2004.840591     Document Type: Article

References (32)

1. E. H. Adelson and J. Bergen, "The plenoptic function and the elements of early vision," in Computational Models of Visual Processing. Cambridge, MA: MIT Press, 1991, pp. 3-20.
2. S. E. Chen, "QuickTime VR - An image-based approach to virtual environment navigation," in Proc. Annu. Conf. Computer Graphics (SIGGRAPH'95), Aug. 1995, pp. 29-38.
3. P. E. Debevec, C. J. Taylor, and J. Malik, "Modeling and rendering architecture from photographs: A hybrid geometry-and image-based approach," in Proc. Annu. Conf. Computer Graphics (SIGGRAPH'96), Aug. 1996, pp. 11-20.
4. S. J. Gortler, R. Grzeszczuk, R. Szeliski, and M. F. Cohen, "The lumigraph," in Proc. Annu. Conf. Computer Graphics (SIGGRAPH'96), Aug. 1996, pp. 43-54.
5. M. Levoy and P. Hanrahan, "Light field rendering," in Proc. Annu. Conf. Computer Graphics (SIGGRAPH'96), Aug. 1996, pp. 31-42.
6. L. McMillan and G. Bishop, "Plenoptic modeling: An image-based rendering system," in Proc. Proc. Annu. Conf. Computer Graphics (SIGGRAPH'95), Aug. 1995, pp. 39-46.
7. S. Peleg and J. Herman, "Panoramic mosaics by manifold projection," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition (CVPR'97), Jun. 1997, pp. 338-343.
8. R. Szeliski and H. Y. Shum, "Creating full view panoramic image mosaics and environment maps," in Proc. Annu. Conf. Computer Graphics (SIGGRAPH'97), Aug. 1997, pp. 251-258.
9. D. N. Wood, A. Finkelstein, J. F. Hughes, C. E. Thayer, and D. H. Salesin, "Multiperspective panoramas for cel animation," in Proc. Annu. Conf. Computer Graphics (SIGGRAPH'97), Aug. 1997, pp. 243-250.
10. H. Y Shum and L. W. He, "Rendering with concentric mosaics," in Proc. Annu. Conf. Computer Graphics (SIGGRAPH'99), Aug. 1999, pp. 299-306.
11. N. S. Jayant and P. Noll, Digital Coding of Waveforms: Principles and Application to Speech and Video. Englewood Cliffs, NJ: Prentice-Hall, 1984.
12. A. Gersho and R. M. Gray, Vector Quantization and Signal Compression. Boston, MA: Kluwer, 1991.
13. J. M. Shapiro, "Embedded image coding using zerotrees of wavelet coefficients," IEEE Trans. Signal Processing, vol. 41, no. 12, pp. 3445-3462, Dec. 1993.
14. Generic Coding of Moving Pictures and Associated Audio Information: Video, ITU-T Recommendation H.262 ISO/IEC 13818-2, Nov. 1994.
15. M. Antonini, M. Barlaud, P. Mathieu, and I. Daubechies, "Image coding using wavelet transform," IEEE Trans. Image Process., vol. 1, no. 2, pp. 205-220, Apr. 1992.
16. C. Machover and S. E. Tice, "Virtual reality," IEEE Comput. Graph. Appl., vol. 14, no. 1, pp. 15-16, Jan. 1994.
17. S. E. Chen and L. Williams, "View interpolation for image synthesis," in Proc. Annu. Conf. Computer Graphics (SIGGRAPH'93), Aug. 1993, pp. 279-288.
18. R. Gupta and R. Hartley, "Linear pushbroom cameras," IEEE Trans. Pattern Anal. Machine Intell., vol. 19, no. 9, pp. 963-975. Sep. 1997.
19. P. Rademacher and G. Bishop. "Multiple-center-of-projection images," in Proc. Annu. Conf. Computer Graphics (SIGGRAPH'98), Jul. 1998, pp. 199-206.
20. R. L. de Queiroz and D. A. F. Florencio, "A nonlinear filter bank for image coding," in Proc. IEEE 38th Midwest Symp. Circuits and Systems, vol.2, 1996, pp. 1115-1118.
21. M. Goebel, M. Hirose, and L. Rosenblum, "Today's VR," IEEE Comput. Graph. Appl., vol. 21, no. 6, pp. 22-24, Nov.-Dec. 2001.
22. I. Peter and W. Strasser, "The wavelet stream - Progressive transmission of compressed light field data," in Proc. IEEE Visualization '99, Oct. 1999, pp. 69-72.
23. M. Magnor and B. Girod, "Data compression for light-field rendering," IEEE Trans. Circuits Syst. Video Technol., vol. 10, no. 3. pp. 338-343, Apr. 2000.
24. X. Tong and R. M. Gray, "Coding of multi-view images for immersive viewing," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, vol. 4, Jun. 2000, pp. 1879-1882.
25. C. Zhang and J. Li, "Compression of Lumigraph with multiple reference frame (MRF) prediction and just-in-time rendering," in Proc. IEEE Data Compression Conf., Mar. 2000, pp. 253-262.
26. H. Y. Shum, K. T. Ng, and S. C. Chan, "Virtual reality using the concentric mosaic: Construction, rendering, and data compression," in Proc. IEEE Int. Conf. Image Processing (ICIP2000), vol. 3, Sep. 2000. pp. 644-647.
27. C. Zhang and J. Li, "Compression and rendering of concentric mosaics with reference block codec (RBC)," in Proc. SPIE Visual Communication and Image Processing, vol. 4067, Jun. 2000.
28. J. Li, H. Y. Shum, and Y. Q. Zhang, "On the compression of image based rendering scene: A comparison among block, reference, and wavelet coders," Int. J. Image and Graphics, vol. 1, no. 1, pp. 45-61, 2001.
29. K. T. Ng, S. C. Chan, and H. Y. Shum, "Scalable coding and progressive transmission of concentric mosaic using nonlinear filter banks," in Proc. IEEE Int. Conf. Image Processing (ICIP2001), vol. 2, Oct. 2001, pp. 113-116.
30. J. Li, H. Y. Shum, and Y. Q. Zhang, "On the compression of image based rendering scene," in Proc. IEEE Int. Conf. Image Processing (ICIP2000). vol. 2, Sep. 2000, pp. 21-24.
31. S. C. Chan and H. Y. Shum, "A spectral analysis for light field rendering," in Proc. IEEE Int. Conf. Image Processing (ICIP2000), vol. 2, Sep. 2000, pp. 25-28.
32. J. X. Chai, X. Tong, S. C. Chan, and H. Y. Shum, "Plenoptic sampling," in Proc. Anna. Conf. Computer Graphics (SIGGRAPH'00), Jul. 2000, pp. 307-318.