The plenoptic illumination function

IEEE Transactions on Multimedia

Volumn 4, Issue 3, 2002, Pages 361-371

  Wong, Tien Tsin ^a   Fu, Chi Wing ^b   Heng, Pheng Ann ^a   Leung, Chi Sing ^c  

^a CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

^b INDIANA UNIVERSITY   (United States)

^c CITY UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Data compression; Image based modeling and rendering; Light field; Lumigraph; Multimedia application; Panorama; Plenoptic function; Spherical harmonic transform; Virtual reality

Indexed keywords

COMPUTER GRAPHICS; COMPUTER SIMULATION; DATA COMPRESSION; IMAGING TECHNIQUES; INTERPOLATION; MATHEMATICAL MODELS; VIRTUAL REALITY;

IMAGE BASED MODELING; IMAGE BASED RENDERING; LUMIGRAPH; PLENOPTIC FUNCTION; SPHERICAL HARMONIC TRANSFORM;

MULTIMEDIA SYSTEMS;

EID: 0036754927     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2002.802835     Document Type: Article

References (62)

1. E. H. Adelson and J. R. Bergen, "The plenoptic function and the elements of early vision," in Computational Models of Visual Processing, M. S. Landy and J. A. Movshon, Eds. Cambridge, MA: MIT Press, 1991, ch. 1, pp. 3-20.
2. L. McMillan, "An image-based approach to three-dimensional computer graphics," Ph.D. dissertation, Univ. of North Carolina at Chapel Hill, 1997.
3. S. E. Chen, "QuickTime VR - An image-based approach to virtual environment navigation," in Proc. Computer Graphics, Ann. Conf. Series, SIGGRAPH, Aug. 1995, pp. 29-38.
4. M. Levoy and P. Hanrahan, "Light field rendering," in Proc. Computer Graphics, Ann. Conf. Series, SIGGRAPH, Aug. 1996, pp. 31-42.
5. S. J. Gortler, R. Grzeszczuk, R. Szeliski, and M. F. Cohen, "The lumigraph," in Proc. Computer Graphics, Ann. Conf. Series, SIGGRAPH, Aug. 1996, pp. 43-54.
6. H.-Y. Shum and L.-W. He, "Rendering with concentric mosaics," in Proc. Computer Graphics, Ann. Conf. Series, SIGGRAPH, Aug. 1999, pp. 299-306.
7. S. M. Seitz and C. R. Dyer, "View morphing," in Proc. Computer Graphics, Ann. Conf. Series, SIGGRAPH, 1996, pp. 21-30.
8. E. E. Catmull, "A subdivision algorithm for computer display of curved surfaces," Ph.D dissertation, Dept. of Computer Science, Univ. of Utah, Salt Lake City, Dec. 1974.
9. J.F. Blinn and M. E. Newell, "Texture and reflection in computer generated images," Commun. ACM, vol. 19, pp. 542-546, Oct. 1976.
10. N. Greene, "Environment mapping and other applications of world projections," IEEE Comput. Graph. Appl., vol. 6, Nov. 1986.
11. P. S. Heckbert, "Survey of texture mapping," IEEE Comput. Graph. Appl., vol. 6, pp. 56-67, Nov. 1986.
12. S. E. Chen and L. Williams, "View interpolation for image synthesis," in Proc. Computer Graphics, Ann. Conf. Series, SIGGRAPH, vol. 27, J. T. Kajiya, Ed., Aug. 1993, pp. 279-288.
13. N. Max and K. Ohsaki, "Rendering trees from precomputed Z-buffer views," presented at the Eurographics Rendering Workshop, June 1995.
14. J. Shade, S. Gortler, L.-W. He, and R. Szeliski, "Layered depth images," presented at the Proc. SIGGRAPH, Ann. Conf. Series, July 1998.
15. O. Faugeras, Three-Dimensional Computer Vision: A Geometric Viewpoint. Cambridge, MA: MIT Press, 1993.
16. O. Faugeras and L. Robert, "What can two images tell us about a third one?," INRIA, Tech. Rep., July 1993.
17. S. Laveau and O. Faugeras, "3-D scene representation as a collection of images and fundamental matrices," INRIA, Tech. Rep. 2205, Feb. 1994.
18. M. Lhuillier and L. Quan, "Image interpolation by joint view triangulation," Proc. IEEE CVPR, June 1999.
19. T. Beier and S. Neely, "Feature-based image metamorphosis," in Proc. Computer Graphics, Ann. Conf. Series, SIGGRAPH, vol. 26, E. E. Catmull, Ed., July 1992, pp. 35-42.
20. L. McMillan and G. Bishop, "Plenoptic modeling: An image-based rendering system," in Proc. Computer Graphics, Ann. Conf. Series, SIGGRAPH, Aug. 1995 pp. 39-46.
21. X. Gu, M. F. Cohen, and S. J. Gortler, "Polyhedral geometry and the two-plane parameterization." in Proc. 8th Eurographics Rendering Workshop, June 1997, pp. 1-12.
22. T. A. Foley, D. A. Lane, and G. M. Nielson, "Toward animating raytraced volume visualization," J. Vis. Comput. Animation, vol. 1, no. 1, pp. 2-8, 1990.
23. I. Ihm, S. Park, and R. K. Lee, "Rendering of spherical light fields," in Proc. Pacific Graphics, Oct. 1997, pp. 59-68.
24. S. E. Chen and G. S. P. Miller, "Cylindrical to planar image mapping using scanline coherence,", Mar. 7, 1995.
25. G. Wolberg, Digital Image Warping. Los Alamos, CA: IEEE Comput. Soc. Press, 1990.
26. R. Szeliski and H.-Y. Shum, "Creating full view panoramic image mosaics and environment maps," in Proc. Computer Graphics, Ann. Conf. Series, SIGGRAPH, Aug. 1997, pp. 251-258.
27. Y. Xiong and K. Turkowski, "Creating image-based VR using a self-calibrating fisheye lens," Proc. IEEE CVPR, pp. 237-243, June 1997.
28. C.-W. Fu, T.T. Wong, and P.-A. Heng, "Triangle-based view interpolation without depth buffering," J. Graph. Tools, vol. 3, no. 4, pp. 13-31, 1998.
29. ____, "Computing visibility for triangulated panoramas," in Proc. 10th Eurographics Workshop Rendering (Rendering Technique), Granada Spain, June 1999, pp. 169-182.
30. K. Pulli, M. Cohen, T. Duchamp, H. Hoppe, L. Shapiro, and W. Stuetzle, "View-based rendering: Visualizing real objects from scanned range and color data," in Proc. 8th Eurographics Rendering Workshop, June 1997, pp. 23-34.
31. Y. Sato, M. D. Wheeler, and K. Ikeuchi, "Object shape and reflectance modeling from observation," in Proc. Computer Graphics, Ann. Conf. Series, SIGGRAPH, Aug. 1997, pp. 379-387.
32. P. Haeberli. (1992, Jan.) Synthetic Lighting for Photography. [Online]. Available: http://www.sgi.com/grafica/synth/index.html
33. J. S. Nimeroff, E. Simoncelli, and J. Dorsey, "Efficient Re-rendering of naturally illuminated environment," in Proc. 5th Eurographics Workshop Rendering, Darmstadt, Germany, June 1994, pp. 359-373.
34. G. Golub and C. van Loan, Matrix Computations. Baltimore, MD: The John Hopkins Univ. Press, 1989.
35. P. N. Belhumeur, and D. J. Kriegman, "What is the set of images of an object under all possible lighting conditions?," presented at the Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1996.
36. Z. Zhang, "Modeling geometric structure and illumination variation of a scene from real images," presented at the Proc. ICCV, Bombay, Maharashtra, India, Jan. 1998.
37. S. K. Nayar and H. Murase, "Dimensionality of illumination in appearance matching," in Proc. IEEE Int. Conf. Robotics and Automation, Apr. 1996, pp. 1326-1332.
38. R. Epstein, P. W. Hallinan, and A. L. Yuille, "5 ± 2 eigenimages suffice: An empirical investigation of low-dimensional lighting models," in Proc. IEEE Workshop Physics-Based Modeling in Computer Vision, June 1995, pp. 108-116.
39. G. Hager and P. Belhumeur, "Real-time tracking of image regions with changes in geometry and illumination," presented at the Proc. IEEE Conf. Computer Vision and Pattern Recognition, June 1996.
40. T.-T. Wong, P.-A. Heng, S.-H. Or, and W.-Y. Ng, "Image-based rendering with controllable illumination," in Proc. 8th Eurographics Workshop Rendering, Saint Etienne, France, June 1997, pp. 13-22.
41. ____, "Illuminating image-based objects," in Proc. Pacific Graphics. Piscataway, NJ, Oct. 1997. pp. 69-78.
42. T.-T. Wong, "Time-critical modeling and rendering: geometric-based and image-based approaches," Ph.D. dissertation, Dept. Computer Science and Engineering, The Chinese University of Hong Kong, Shatin, 1998.
43. T.-T. Wong, C.-W. Fu, and P.-A. Heng, "Interactive relighting of panoramas," IEEE Comput. Graph. Applicat., vol. 21, no. 2, pp. 32-41, 2001.
44. Y. Yu and J. Malik, "Recovering photometric properties of architectural scenes from photographs," presented at the Proc. SIGGRAPH Conf., Ann. Conf. Series, July 1998.
45. K. J. Dana, B. van Ginneken, S. K. Nayar, and J. J. Koenderink, "Reflectance and texture of real-world surfaces," ACM Trans. Graph., vol. 18, no. 1, pp. 1-34, 1999.
46. J. Stauder, "Augmented reality with automatic illumination control incorporating ellipsoidal models," IEEE Trans. Multimedia, vol. 1, pp. 136-143, June 1999.
47. C. Loscos, G. Drettakis, and L. Robert, "Interactive virtual relighting of real scenes," IEEE Trans. Vis. Comput. Graph., vol. 6, no. 4, pp. 289-305, 2000.
48. P. Debevec, "Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography," presented at the Proc. SIGGRAPH Conf., Ann. Conf. Series, July 1998
49. A. Gershun, "The Light Field," J. Math. Phys., vol. XVIII, pp. 51-151, 1939, Translated by P. Moon and G. Timoshenko.
50. Z. Lin, T-T. Wong, and H.-Y. Shum, "Relighting with the reflected irradiance field: Representation sampling and reconstruction," Proc. IEEE CVPR, Dec. 2001.
51. I. W. Busbridge, The Mathematics of Radiative Transfer. Cambridge, U.K.: Cambridge Univ. Press, 1960.
52. J.-X. Chai, X. Tong, S.-C. Chan, and H.-Y. Shum, "Plenoptic sampling," in Proc. SIGGRAPH, July 2000, pp. 307-318.
53. S. J. Teller, "Computing the antipenumbra of an area light source," Comput. Sci. Div., Univ. California, Berkeley, UCB/CSD 91 6, 1991.
54. D. Lischinski, F. Tampieri, and D. P. Greenberg, "Discontinuity meshing for accurate radiosity," IEEE Comput. Graph. Applicat., vol. 12, pp. 25-39, Nov. 1992.
55. R. Courant and D. Hilbert, Methods of Mathematical Physics. New York: Interscience, 1953.
56. J. T. Kajiya, "Anisotropic Reflection Models," in Proc. Computer Graphics, Ann. Conf. Series, SIGGRAPH, vol. 19, July 1985, pp. 15-21.
57. B. Cabral, N. Max, and R. Springmeyer, "Bidirectional reflection functions from surface bump maps," in Proc. Computer Graphics, Ann. Conf. Series, SIGGRAPH, vol. 21, July 1987, pp. 273-281.
58. F. X. Sillion, J. R. Arvo, S. H. Westin, and D. P. Greenberg, "A global illumination solution for general reflectance distributions," in Proc. Computer Graphics, Ann. Conf. Series, SIGGRAPH, vol. 25, July 1991, pp. 187-196.
59. A. Gersho, "On the structure of vector quantizers," IEEE Trans. Inform. Theory, vol. IT-28, pp. 157-165, Mar. 1982.
60. K. R. Rao, Discrete Cosine Transform, Algorithms, Advantages and Applications. New York: Academic, 1990.
61. P. Schröder and W. Sweldens, "Spherical wavelets: Efficiently representing functions on the sphere," in Proceedings of the SIGGRAPH Conference. Reading, MA: ACM SIGGRAPH, Addison-Wesley, Aug. 6-11, 1995, pp. 161-172.
62. E. P. F. Lafortune, S.-C. Foo, K. E. Torrance, and D. P. Greenberg, "Nonlinear approximation of reflectance functions," in Proc. Computer Graphics, Ann. Conf. Series, ACM SIGGRAPH, Aug. 1997, pp. 117-126.