Arbitrary Viewpoint Video Synthesis from Multiple Uncalibrated Cameras

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 34, Issue 1, 2004, Pages 430-439

  Yaguchi, Satoshi ^a   Saito, Hideo ^a  

^a KEIO UNIVERSITY   (Japan)

Author keywords

Fundamental matrix; Projective geometry; Projective grid space; Shape from multiple cameras; View interpolation; Virtual view synthesis

Indexed keywords

COMPUTATIONAL GEOMETRY; COMPUTER VISION; IMAGE PROCESSING; INTERPOLATION; MATRIX ALGEBRA; VIDEO CAMERAS;

FUNDAMENTAL MATRIX; PROJECTIVE GEOMETRY; PROJECTIVE GRID SHAPE FROM MULTIPLE CAMERAS; VIEW INTERPOLATION; VIRTUAL VIEW SYNTHESIS;

VIDEO SIGNAL PROCESSING;

ALGORITHM; ARTICLE; AUTOMATED PATTERN RECOGNITION; CALIBRATION; COMPUTER ASSISTED DIAGNOSIS; COMPUTER GRAPHICS; COMPUTER INTERFACE; COMPUTER SIMULATION; EVALUATION; IMAGE SUBTRACTION; INSTRUMENTATION; METHODOLOGY; PHOTOGRAPHY; THREE DIMENSIONAL IMAGING; VALIDATION STUDY; VIDEORECORDING;

ALGORITHMS; CALIBRATION; COMPUTER GRAPHICS; COMPUTER SIMULATION; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGING, THREE-DIMENSIONAL; PATTERN RECOGNITION, AUTOMATED; PHOTOGRAMMETRY; SUBTRACTION TECHNIQUE; USER-COMPUTER INTERFACE; VIDEO RECORDING;

EID: 0742272556     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2003.817108     Document Type: Article

References (25)

1. T. Beier and S. Neely, "Feature-based image metamorphosis," in Proc. of SIGGRAPH '92, 1992, pp. 35-42.
2. C. H. Chein and J. K. Aggarwal, "Identification of 3D objects from multiple silhouettes using quadtrees/octrees," Comput. Vis., Graph., Image Process., vol. 36, pp. 100-133, 1986.
3. S. Chen and L. Williams, "View interpolation for image synthesis," in Proc. SIGGRAPH '93, 1993, pp. 279-288.
4. B. Curless and M. Levoy, "A volumetric method for building complex models from range images," in Proc. SIGGRAPH '96, 1996, pp. 303-312.
5. S. J. Gortler, R. Grzeszczuk, R. Szeliski, and M. F. Cohen, "The Lumigraph," in Proc. SIGGRAPH '96, 1996, pp. 43-54.
6. A. Hilton, J. Stoddart, J. Illingworth, and T. Windeatt, "Reliable surface reconstruction from multiple range images," in Proc. ECCV'96, 1996, pp. 117-126.
7. A. Katayama, K. Tanaka, T. Oshino, and H. Tamura, "A viewpoint dependent stereoscopic display using interpolation of multi-viewpoint images," Proc. SPIE, vol. 2409, pp. 11-20, 1995.
8. T. Kanade, P. W. Rander, S. Vedula, and H. Saito, "Virtulized reality: digitizing a 3D time-varying event as is and in real time," in Proc. Int. Symp. Mixed Reality (ISMR99), Mar. 1999, pp. 41-57.
9. A. Laurentini, "The visual hull concept for silhouette based image understanding," IEEE Trans. Pattern Anal. Machine Intell/, vol. 16, no. 2, pp. 150-162, 1994.
10. S. Laveau and O. Faugers, "3-D scene representation as a collection of images," in Proc. Int. Conf. Pattern Recognition, 1994.
11. M. Levoy and P. Hanrahan, "Light field rendering," in Proc. SIGGRAPH '96, 1996.
12. W. Matusik, C. Buehler, R. Raskar, S. Gorlter, and L. McMillan, "Image-based visual hulls," in Proc. of SIGGRAPH 2000, 2000, pp. 369-374.
13. N. Ohta, "A statistical approach to background subtraction for surveillance systems," in Proc. 8th IEEE Int. Conf. Computer Vision (ICCV 2001), vol. 2, 2001, pp. 481-486.
14. M. Potmesil, "Generating octree models of 3D objects from their silhouettes in a sequense of images," Comput. Vis., Graph., Image Process., vol. 40, pp. 277-283, 1987.
15. H. Saito and T. Kanade, "Shape reconstruction in projective grid space from large number of images," in Proc. IEEE Int. Conf. Computer Vision Pattern Recognition, vol. 2, 1999, pp. 49-54.
16. H. Saito, S. Baba, M. Kimura, S. Vedula, and T. Kanade, "Appearance-based virtual view generation of temporally-varying events from multi-camera images in 3D room," in Proc. 2nd Int. Conf. 3D Digital Imaging and Modeling (3DIM '99), 1999, pp. 516-526.
17. D. Scharstein, "View synthesis using stereo vision," Lecture Notes Comput. Sci., vol. 1583, Spring 1999.
18. S. M. Seitz and C. R. Dyer, "View morphing," in Proc. SIGGRAPH '96, 1996. pp. 21-30.
19. _, "Photorealistic scene reconstruction by voxel coloring," in Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition (CVPR97), 1997, pp. 1067-1073.
20. M. Seki, H. Fujiwara, and K. Sumi, "A robust background subtraction method for changing background," in Proc. 5th IEEE Workshop on Applications of Computer Vision, 2000, pp. 207-213.
21. C. Stauffer and E. Grimson, "Similarity templates for detection and recognition," in Proc. IEEE Int. Conf. Comput. Vision Pattern Recognition (CVPR01), vol. 1, 2001, pp. 221-228.
22. R. Tsai, "A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses," IEEE J. Robot. Automat., pp. 323-344, 1987.
23. S. Vedula, P. W. Rander, H. Saito, and T. Kanade, "Modeling, combining, and rendering dynamic real-world events from image sequences," in Proc. 4th Conf. Virtual Systems and Multimedia, vol. 1, 1998, pp. 326-322.
24. M. D. Wheeler, Y. Sato, and K. Ikeuchi, "Consensus surfaces for modeling 3D objects from multiple range images," in Proc. DARPA Image Understanding Workshop, 1997, pp. 1229-1236.
25. Z. Zhang, "Determining the Epipolar Geometry and its Uncertainly: A Review," INRIA res. rep. 2927, 1996.