Appearance-based virtual view generation from multicamera videos captured in the 3-D room

IEEE Transactions on Multimedia

Volumn 5, Issue 3, 2003, Pages 303-316

  Saito, Hideo ^a   Baba, Shigeyuki ^b   Kanade, Takeo ^c  

^a KEIO UNIVERSITY   (Japan)

^b SONY CORPORATION   (Japan)

^c CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

3 D model; Image based rendering; Model based rendering; Multibaseline stereo; Multiple view images; Shape from silhouette

Indexed keywords

ALGORITHMS; CAMERAS; IMAGE QUALITY; INTERPOLATION; MATHEMATICAL MODELS; PERFORMANCE; THREE DIMENSIONAL;

MULTIPLE BASELINE STEREO METHOD; SHAPE FROM SILHOUETTE METHOD; VIRTUAL VIEW GENERATION METHOD;

VIDEO SIGNAL PROCESSING;

EID: 0042913178     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2003.813283     Document Type: Article

References (35)

1. S. Avidan and A. Shashua, "Novel view synthesis by cascading trilinear tensors," IEEE Trans. Vis. Comput. Graph., vol. 4, no. 4, pp. 293-306, 1998.
2. T. Beier and S. Neely, "Feature-based image metamorphosis," in Proc. SIGGRAPH'92, 1992, pp. 35-42.
3. S. Chen and L. Williams, "View interpolation for image synthesis," in Proc. SIGGRAPH'93, 1993, pp. 279-288.
4. C. H. Chein and J. K. Aggarawal, "Identification of 3D objects from multiple silhouettes using quadtrees/octrees," Comput. Vis., Graph. Image Process., ser. 36. pp. 100-113, 1986.
5. B. Curless and M. Levoy, "A volumetric method for building complex models from range images," in Proc. SIGGRAPH'96, 1996, pp. 303-312.
6. P. Debevec, C. Taylor, and J. Malik, "Modeling and rendering architecture from photographs: A hybrid geometry- and image-based approach," in SIGGRAPH'96, 1996, pp. 11-20.
7. P. Debevec, G. Borshukov, and Y. Yu, "Efficient view-dependent image-based rendering with projective texture-mapping," in 9th Eurographics Rendering Workshop, Vienna, Austria, June 1998, pp. 105-116.
8. O. Faugeras, S. Laveau, L. Robert, G. Csurka, and C. Zeller, "3-D Reconstruction of Urban Scenes From Sequences of Images," INRIA, Tech. Rep. 2572, 1995.
9. D. M. Gavrila and L. S. Davis, "3-D model based tracking of humans in action: Multi-view approach," in Proc. CVPR'96, 1996, pp. 73-80.
10. S. J. Gortler, R. Grzeszczuk, R. Szeliski, and M. F. Cohen, "The lumigraph," in Proc. SIGGRAPH'96, 1996, pp. 43-54.
11. A. Hilton, J. Stoddart, J. Illingworth, and T. Windeatt, "Reliable surface reconstruction from multiple range images," in Proc. ECCV'96, 1996, pp. 117-126.
12. P. Heckbert and M. Garland, "Optimal triangulation and quadric-based surface simplification," J. Comput. Geom.: Theory Applicat., vol. 14, pp. 49-65, 1999.
13. R. Jain and K. Wakimoto, "Multiple perspective interactive video," Proc. IEEE Conf. on Multimedia Systems, pp. 202-211, 1995.
14. T. Kanade, P. W. Rander, and P. J. Narayanan, "Virtualized reality: Constructing virtual worlds from real scenes," IEEE Multimedia, vol. 4, no. 1, pp. 34-47, 1997.
15. T. Kanade, H. Saito, and S. Vedula, "The 3D Room: Digitizing Time-Varying 3D Events by Synchronized Multiple Video Streams," Robotics Inst., Carnegie Mellon Univ., Pittsburgh, PA, Tech. Rep. CMU-RI-TR-98-34, 1998.
16. A. Katayama, K. Tanaka, T. Oshino, and H. Tamura, "A view point dependent stereoscopic display using interpolation of multi-viewpoint images," in Proc. SPIE, Stereoscopic Displays and Virtual Reality Systems II, vol. 2409, 1995, pp. 11-20.
17. W. E. Lorensen and H. E. Cline, "Marching cubes: A high resolution 3D surface reconstruction algorithm," Comput. Graph., vol. 21, no. 4, pp. 163-169, 1987.
18. M. Levoy and P. Hanrahan, "Light field rendering," in SIGGRAPH'96, 1996, pp. 31-42.
19. W. Matusik, C. Beuhler, R. Raskar, S. Gorlter, and L. McMillan, "Image-based visual hulls," in Proc. SIGGRAPH 2000, 2000, pp. 369-374.
20. S. Moezzi, L. C. Tai, and P. Gerard, "Virtual view generation for 3D digital video," IEEE MultiMedia, vol. 4, no. 1, pp. 18-26, 1997.
21. J. Neumann and Y. Aloimonos, "Spatio-temporal stereo using multi-resolution subdivision surfaces," Int. J. Comput. Vis., vol. 47, no. 1-3, pp. 181-193, Apr.-June 2002.
22. M. Okutomi and T. Kanade, "A multiple-baseline stereo," IEEE Trans. Pattern Anal. Machine Intell., vol. 15, pp. 353-363, Apr. 1993.
23. P. J. Narayanan, P. W. Rander, and T. Kanade, "Constructing virtual worlds using dense stereo," in ICCV'98, 1998, pp. 3-10.
24. M. Pollefeys, R. Koch, and L. V. Gool, "Self-calibration and metric reconstruction in spite of varying and unknown internal camera parameters," in ICCV'98, 1998, pp. 90-95.
25. M. Potmesil, "Generating octree models of 3D objects from their silhouettes in a sequence of images," Comput. Vis., Graph. Image Process., ser. 40, pp. 277-283, 1987.
26. R. Raskar, G. Welch, M. Cutts, A. Lake, L. Stesin, and H. Fuchs, "The office of the future: A unified approach to image-based modeling and spatially immersive displays," in SIGGRAPH'98, 1998, pp. 179-188.
27. S. M. Seitz and C. R. Dyer, "Photorealistic scene reconstruction by voxel coloring," in Proc. CVPR'97, 1997, pp. 1067-1073.
28. ____, "View morphing," in Proc. SIGGRAPH'96, 1996, pp. 21-30.
29. H. Tamura, H. Yamamoto, and A. Katayama, "Mixed reality: Future dreams seen at the border between real and virtual worlds," IEEE Comput. Graph. Applicat., vol. 21, no. 6, pp. 64-70, 2001.
30. C. Tomasi and T. Kanade, "Shape and motion from image streams under orthography: A factorization method," Int. J. Comput. Vis., vol. 9, no. 2, pp. 137-154, 1992.
31. R. Tsai, "A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf tv cameras and lenses," IEEE J. Robot. Automat., vol. RA-3, no. 4, pp. 323-344, 1987.
32. S. Vedula, P. W. Rander, H. Saito, and T. Kanade, "Modeling, combining, and rendering dynamic real-world events from image sequences," in Proc. 4th Conf. Virtual Systems and MultiMedia, vol. 1, 1998, pp. 326-332.
33. S. Vedula, S. Baker, P. Rander, R. Collins, and T. Kanade, "Three-dimensional scene flow," in Proc. ICCV'99, vol. 2, Sept. 1999, pp. 722-729.
34. T. Werner, R. D. Hersch, and V. Hlavac, "Rendering real-world objects using view interpolation," in Proc. ICCV'95, 1995, pp. 957-962.
35. M. D. Wheeler, Y. Sato, and K. Ikeuchi, "Consensus surfaces for modeling 3D objects from multiple range images," in DARPA Image Understanding Workshop, 1997, pp. 1229-1236.