Real-Time Dynamic 3-D Object Shape Reconstruction and High-Fidelity Texture Mapping for 3-D Video

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 14, Issue 3, 2004, Pages 357-369

  Matsuyama, Takashi ^a   Wu, Xiaojun ^a   Takai, Takeshi ^a   Wada, Toshikazu ^b  

^a KYOTO UNIVERSITY   (Japan)

^b WAKAYAMA UNIVERSITY   (Japan)

Author keywords

Parallel volume intersection; PC cluster; Real time three dimensional (3 D) volume reconstruction; Three dimensional (3 D) video; Video texture mapping

Indexed keywords

ALGORITHMS; IMAGE ANALYSIS; IMAGE RECONSTRUCTION; PARALLEL PROCESSING SYSTEMS; PROBLEM SOLVING; REAL TIME SYSTEMS; SYNCHRONIZATION; TEXTURES;

PARALLEL VOLUME INTERSECTIONS; PC CLUSTERS; REAL-TIME THREE-DIMENSIONAL (3-D) VOLUME RECONSTRUCTION; THREE-DIMENSIONAL (3-D) VIDEO; VIDEO TEXTURE MAPPING;

VIDEO RECORDING;

EID: 7444257218     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2004.823396     Document Type: Article

References (30)

1. X. Wu and T. Matsuyama, "Real-time active 3-D shape reconstruction for 3-D video," in Proc. 3rd Int. Symp. Image and Signal Processing and Analysis, 2003, pp. 186-191.
2. T. Matsuyama and T. Takai, "Generation, visualization, and editing of 3-D video," in Proc. Symp. 3-D Data Processing Visualization and Transmission, 2002, pp. 234-245.
3. S. Moezzi, L. Tai, and P. Gerard, "Virtual view generation for 3-D digital video," IEEE Multimedia, pp. 18-26, 1997.
4. G. Cheung and T. Kanade, "A real time system for robust 3-D voxel reconstruction of human motions," in Proc. Computer Vision and Pattern Recognition, 2000, pp. 714-720:
5. T. Kanade, P. Rander, S. Vedula, and H. Saito, "Virtualized reality: Digitizing a 3-D time-varying event as is and in real time," in Mixed Reality, Y. Ohta and H. Tamura, Eds. Tokyo, Japan: Ohmsha, 1999, pp. 41-57.
6. T. Wada, X. Wu, S. Tokai, and T. Matsuyama, "Homography based parallel volume intersection: Toward real-time reconstruction using active camera," in Proc. Computer Architectures for Machine Perception, 2000, pp. 331-339.
7. E. Borovikov and L. Davis, "A distributed system for real-time volume reconstruction," in Proc. Computer Architectures for Machine Perception, 2000, pp. 183-189.
8. T. Kanade, A. Yoshida, K. Oda, H. Kano, and M. Tanaka, "A stereo machine for video-rate dense depth MApping and its new applications," in Proc. Computer Vision and Pattern Recognition, 1996, pp. 196-202.
9. J. Mulligan. V. Isler, and K. Daniilidis, "Trinocular stereo: A real-time algorithm and its evaluation," Int. J. Comput. Vis., vol. 47, no. 1/2/3, pp. 51-61, 2002.
10. H. Hirschmuller, P. R. Innocent, and J. Garibaldi, "Real-time correlation-based stereo vision with reduced border errors," Int. J. Comput. Vis., vol. 47, no. 1/2/3, pp. 229-246, 2002.
11. T. Naemura, J. Tago, and H. Harashima, "Real-time video-based modeling and rendering of 3-D scenes," IEEE Comput. Graph. Applicat., vol. 22, pp. 66-73, Mar./Apr. 2002.
12. P. Kauff and O. Schreer, "An immersive 3-D video-conferencing system using shared virtual team user environments," in Proc. ACM Conf. Collaborative Virtual Environments, 2002, pp. 105-112.
13. W. Matusik, C. Buehler, R. Raskar, S. Gortler, and L. MacMillan, "Image-based visual hulls," in Proc. SIGGRAPH, 2000, pp. 369-374.
14. H. Baker, D. Tanguay, I. Sobel, D. Gelb, M. Gross, W. Culbertson, and T. Malzbender, "The coliseum immersive teleconferencing system," in Proc. Int. Workshop Immersive Telepresence, 2002.
15. M. Turk and G. Robertson, "Perceptual user interfaces," Commun. ACM, vol. 43, no. 3, pp. 33-34, 2000.
16. T. Matsuyama and N. Ukita, "Real-time multi-target tracking by a cooperative distributed vision system," Proc. IEEE, vol. 90, pp. 1136-1150, July 2002.
17. T. Matsuyama and R. Yamashita, "Requirements for Standardization of 3-D Video," ISO/IEC JTC1/SC29/WG11, MPEG2002/M8107, 2002.
18. Y. Kenmochi, K. Kotani, and A. Imiya, "Marching cubes method with connectivity consideration" (in Japanese), PRMU-98-218, pp. 197-204, 1999.
19. S. Nobuhara and T. Matsuyama, "Dynamic 3-D shape from multi-view-point images using deformable mesh model," in Proc. 3rd Int. Symp. Image and Signal Processing and Analysis, 2003, pp. 192-197.
20. H. Tezuka, A. Hori, Y. Ishikawa, and M. Sato, "PM: An operating system coordinated high performance communication library," in High-Performance Computing and Networking, P. Sloot and B. Hertzberger, Eds. Berlin, Germany: Springer-Verlag, 1997, vol. 1225, Lecture Notes in Computer Science, pp. 708-717.
21. T. Wada and T. Matsuyama, "Appearance sphere:Background model for pan-tilt- zoom camera," in Proc. 13th ICPR, 1996, pp. A-718-A-722.
22. T. Matsuyama, "Cooperative distributed vision - Dynamic integration of visual perception, action, and communication," in Proc. Image Understanding Workshop. 1998, pp. 365-384.
23. M. Potmesil, "Generating octree models of 3-D objects from their silhouettes in a sequence of images," Comput. Vis., Graph, Image Processing, vol. 40, pp. 1-29, 1987.
24. W. N. Martin and J. K. Aggarwal, "Volumetric description of objects from multiple views," IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-5, pp. 150-158, Feb. 1987.
25. A. Laurentini, "The visual hull concept for silhouette based image understanding," IEEE Trans. Pattern Anal. Machine Intell., vol. 16, pp. 150-162, Feb. 1994.
26. _, "How far 3D shapes can be understood from 2D silhouettes," IEEE Trans. Pattern Anal. Machine Intell., vol. 17, pp. 188-195, Feb. 1995.
27. P. Srivasan, P. Liang, and S. Hackwood, "Computational geometric methods in volumetric intersections for 3-D reconstruction," Pattern Recognit., vol. 23, no. 8, pp. 843-857, 1990.
28. R. Szeliski, "Rapid octree construction from image sequences," Proc. CVGIP: Image Understanding, vol. 58, no. 1, pp. 23-32, 1993.
29. K. N. Kutulakos and S. M. Seitz, "A theory of shape by space carving," in Proc. IEEE Int. Conf. Computer Vision, 1999, pp. 307-314.
30. J. Semple and G. Kneebone, Algebraic Projective Geometry. Oxford, U.K.: Oxford Sci., 1952.