Space-time light field rendering

IEEE Transactions on Visualization and Computer Graphics

Volumn 13, Issue 4, 2007, Pages 697-710

  Wang, Huamin ^a,b   Sun, Mingxuan ^a,b   Yang, Ruigang ^a,c  

^a IEEE

^b GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

^c UNIVERSITY OF KENTUCKY   (United States)

Author keywords

Epipolar constraint; Image morphing; Image based rendering; Space time light field

Indexed keywords

ADAPTIVE ALGORITHMS; MOTION PICTURES; SYNCHRONIZATION; VIDEO SIGNAL PROCESSING; VISUALIZATION;

EPIPOLAR CONSTRAINT; IMAGE BASED RENDERING; IMAGE MORPHING; SPACE TIME LIGHT FIELD;

IMAGING SYSTEMS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; COMPUTER ASSISTED DIAGNOSIS; COMPUTER GRAPHICS; COMPUTER INTERFACE; COMPUTER SIMULATION; ILLUMINATION; IMAGE ENHANCEMENT; INFORMATION RETRIEVAL; MATHEMATICAL COMPUTING; METHODOLOGY; THEORETICAL MODEL; THREE DIMENSIONAL IMAGING;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER GRAPHICS; COMPUTER SIMULATION; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGING, THREE-DIMENSIONAL; INFORMATION STORAGE AND RETRIEVAL; LIGHTING; MODELS, THEORETICAL; NUMERICAL ANALYSIS, COMPUTER-ASSISTED; USER-COMPUTER INTERFACE;

EID: 34447517763     PISSN: 10772626     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVCG.2007.1019     Document Type: Article

References (41)

1. M. Levoy and P. Hanrahan, "Light Field Rendering," Proc. Int'l Conf. Computer Graphics and Interactive Techniques (SIGGRAPH '96), pp. 31-42, Aug. 1996.
2. S.J. Gortler, R. Grzeszczuk, R. Szeliski, and M.F. Cohen, "The Lumigraph," Proc. Int'l Conf. Computer Graphics and Interactive Techniques (SIGGRAPH '96), pp. 43-54, Aug. 1996.
3. T. Naemura, J. Tago, and H. Harashima, "Realtime Video-Based Modeling and Rendering of 3D Scenes," IEEE Computer Graphics and Applications, vol. 22, no. 2, pp. 66-73, 2002.
4. J.C. Yang, M. Everett, C. Buehler, and L. McMillan, "A Real-Time Distributed Light Field Camera," Proc. 13th Eurographics Workshop Rendering, pp. 77-86, 2002.
5. B. Wilburn, M. Smulski, H. Lee, and M. Horowitz, "The Light Field Video Camera," Media Processors 2002, Proc. SPIE, vol. 4674, pp. 29-36, 2002.
6. W. Matusik and H. Pfister, "3D TV: A Scalable System for Real-Time Acquisition, Transmission, and Autostereoscopic Display of Dynamic Scenes," Proc. Int'l Conf. Computer Graphics and Interactive Techniques (SIGGRAPH '04), pp. 814-824, 2004.
7. B. Wilburn, N. Joshi, V. Vaish, E.-V. Talvala, E. Antunez, A. Barth, A. Adams, M. Horowitz, and M. Levoy, "High Performance Imaging Using Large Camera Arrays," ACM Trans. Graphics, vol. 24, no. 3, pp. 765-776, 2005.
8. E. Shechtman, Y. Caspi, and M. Irani, "Increasing Space-Time Resolution in Video," Proc. Seventh European Conf. Computer Vision (ECCV '02), pp. 753-768, 2002.
9. S. Vedula, S. Baker, and T. Kanade "Image-Based Spatio-Temporal Modeling and View Interpolation of Dynamic Events," ACM Trans. Graphics, vol. 24, no. 2, pp. 240-261, 2005.
10. T. Beier and S. Neely, "Feature Based Image Metamorphosis," Proc. Int'l Conf. Computer Graphics and Interactive Techniques (SIGGRAPH '92), pp. 35-42, 1992.
11. E.H. Adelson and J. Bergen, "The Plenoptic Function and the Elements of Early Vision," Computational Models of Visual Proces-sing, pp. 3-20, Aug. 1991.
12. H.Y. Shum and L.W. He, "Rendering with Concentric Mosaics," Proc. Int'l Conf. Computer Graphics and Interactive Techniques (SIGGRAPH '97), pp. 299-306, 1997.
13. I. Ihm, S. Park, and R.K. Lee, "Rendering of Spherical Light Fields," Pacific Graphics, 1998.
14. C. Zhang and T. Chen, "A Self-Reconfigurable Camera Array," Proc. Eurographics Symp. Rendering, pp. 243-254, 2004.
15. T. Kanade, P.W. Rander, and P.J. Narayanan, "Virtualized Reality: Constructing Virtual Worlds from Real Scenes," IEEE MultiMedia Magazine, vol. 1, no. 1, pp. 34-47, 1997.
16. W. Matusik, C Buehler, R. Raskar, S. Gortler, and L. McMillan, "Image-Based Visual Hulls," Proc. Int'l Conf. Computer Graphics and Interactive Techniques (SIGGRAPH '00), pp. 369-374, Aug. 2000.
17. R. Yang, G. Welch, and G. Bisop, "Real-Time Consensus-Based Scene Reconstruction Using Commodity Graphics Hardware," Proc. Pacific Graphics Conf., pp. 225-234, Oct. 2002.
18. C. Zitnick, S.B. Kang, M. Uyttendaele, S. Winder, and R. Szeliski, "High-Quality Video View Interpolation Using a Layered Representation, " ACM Trans. Graphics, vol. 23, no. 3, pp. 600-608, 2004.
19. Y. Caspi and M. Irani, "A Step Towards Sequence to Sequence Alignment," Proc. Conf. Computer Vision and Pattern Recognition (CVPR '00), pp. 682-689, 2000.
20. Y. Caspi and M. Irani, "Alignment of Non-Overlapping Sequences," Proc. Int'l Conf. Computer Vision (ICCV '01), pp. 76-83, 2001.
21. C. Rao, A. Gritai, M. Shah, and T. Syeda-Mahmood, "View-Invariant Alignment and Matching of Video Sequences," Proc. Int'l Conf. Computer Vision (ICCV '03), pp. 939-945, 2003.
22. P. Sand and S. Teller, "Video Matching," ACM Trans. Graphics, vol. 23, no. 3, pp. 592-599, 2004.
23. C. Zhou and H. Tao, "Depth Computation of Dynamic Scenes Using Unsynchronized Video Streams," Proc. Conf. Computer Vision and Pattern Recognition (CVPR '03), pp. 351-358, 2003.
24. S. Borman and R. Stevenson, "Spatial Resolution Enhancement of Low-Resolution Image Sequences - A Comprehensive Review with Directions for Future Research," technical report, Laboratory for Image and Signal Analysis (LISA), Univ. of Notre Dame, 1998.
25. J.R. Bergen, P. Anandan, K.J. Hanna, and R. Hingorani, "Hierarchical Model-Based Motion Estimation," Proc. Second European Conf Computer Vision (ECCV '92), pp. 237-252, 1992.
26. J. Barron, D.J. Fleet, and S.S. Beauchemin, "Performance of Optical Flow Techniques," Int'l J. Computer Vision, vol. 12, no. 1, pp. 43-77, 1994.
27. S. Vedula, S. Baker, P. Rander, R. Collins, and T. Kanade, "Three-Dimensional Scene Flow," Proc. Int'l Conf. Computer Vision (ICCV '99), vol. 2, pp. 722-729, 1999.
28. K. Kutulakos and S.M. Seitz, "A Theory of Shape by Space Carving," Int'l J. Computer Vision (IJCV), vol. 38, no. 3, pp. 199-218, 2000.
29. H. Wang and R. Yang, "Towards Space-Time Light Field Rendering," Proc. 2005 Symp. Interactive 3D Graphics and Games (I3D '05), pp. 125-132, 2005.
30. C.J. Harris and M. Stephens, "A Combined Corner and Edge Detector," Proc. Fourth Alvey Vision Conf., pp. 147-151, 1988.
31. J.-Y. Bouguet, "Pyramidal Implementation of the Lucas Kanade Feature Tracker Description of the Algorithm," technical report, 1999.
32. B.D. Lucas and T. Kanade, "An Iterative Image Registration Technique with an Application to Stereo Vision," Proc. Int'l joint Conf. Artificial Intelligence, pp. 674-679, 1981.
33. C. Tomasi and T. Kanade, "Detection and Tracking of Point Features," Technical Report CMU-CS-91-132, Carnegie Mellon Univ., 1991.
34. L. Zhang, B. Curless, and S. Seitz, "Spacetime Stereo: Shape Recovery for Dynamic Scenes," Proc. Conf. Computer Vision and Pattern Recognition (CVPR '03), pp. 367-374, 2003.
35. J. Canny, "A Computational Approach to Edge Detection," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 8, no. 6, pp. 679-698, 1986.
36. J.R. Shewchuk, "Triangle: Engineering a 2D Quality Mesh Generator and Delaunay Triangulato," Applied Computational Geometry: Towards Geometric Eng., LNCS 1148, pp. 203-222, 1996.
37. C. Buehler, M. Bosse, L. McMillan, S. Gortler, and M. Cohen, "Unstructured Lumigraph Rendering," Proc. Int'l Conf. Computer Graphics and Interactive Techniques (SIGGRAPH '01), pp. 405-432, Aug. 2001.
38. Point Grey Research, http://www.ptgrey.com, 2007.
39. M.A. Fischler and R.C. Bolles, "Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography," Comm. ACM, vol. 24, pp. 381-395, 1981.
40. J.-X. Chai, X. Tong, S.-C. Chan, and H.-Y. Shum, "Plenoptic Sampling," Proc. Int'l Conf. Computer Graphics and Interactive Techniques (SIGGRAPH '00), pp. 307-318, 2000.
41. S. Baker, T. Sim, and T. Kanadì, "When Is the Shape of a Scene Unique Given Its Light-Field: A Fundamental Theorem of 3D Vision," IEEE Trans. Pattern Analysis and Machine Intelligence (PAMI), vol. 25, no. 1, pp. 100-109, 2003.