High-quality visualization for geographically distributed 3-D teleimmersive applications

IEEE Transactions on Multimedia

Volumn 13, Issue 3, 2011, Pages 573-584

  Vasudevan, Ramanarayan ^a   Kurillo, Gregorij ^a   Lobaton, Edgar ^b   Bernardin, Tony ^c   Kreylos, Oliver ^c   Bajcsy, Ruzena ^a   Nahrstedt, Klara ^d  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b University of North Carolina   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

^d University of Illinois at Urbana Champaign   (United States)

Author keywords

3 D teleimmersion; 3 D video; Human computer interaction; real time; stereo reconstruction; virtual reality; visualization

Indexed keywords

3-D DISPLAYS; 3-D VIDEO; 3D RECONSTRUCTION; HIGH QUALITY; IMAGING DEVICE; MULTICAMERA SYSTEMS; RAPID DEVELOPMENT; REAL-TIME; REMOTE INTERACTIONS; STEREO RECONSTRUCTION; TELEIMMERSION;

ALGORITHMS; COMPUTER HARDWARE; KNOWLEDGE MANAGEMENT; VIRTUAL REALITY; VISUALIZATION;

THREE DIMENSIONAL;

EID: 79957488992     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2011.2123871     Document Type: Conference Paper

References (34)

1. D. Nguyen and J. Canny, "Multiview: Spatially faithful group video conferencing," in Proc. ACM SIGCHI Conf. Human Factors in Computing Systems, New York, 2005, pp. 799-808. (Pubitemid 41809116)
2. T. DeFanti, D. Sandin, M. Brown, D. Pape, J. Anstey, M. Bogucki, G. Dawe, A. Johnson, and T. S. Huang, "Technologies for virtual reality/ tele-immersion applications: Issues of research in image display and global networking," in Proc. EC/NSF Workshop Research Frontiers in Virtual Environments and Human-Centered Computing, Jun. 1-4, 1999.
3. T. Kanade, P. Rander, S. Vedula, and H. Saito, "Virtualized reality: Digitizing a 3D time varying event as is and in real time," in Mixed Reality, Merging Real and Virtual Worlds. New York: Springer-Verlag, 1999, pp. 41-57.
4. J. Mulligan and K. Daniilidis, "Real time trinocular stereo for teleimmersion," in Proc. 2001 Int. Conf. Image Processing, Thessaloniki, Greece, 2001, pp. 959-962. (Pubitemid 33058147)
5. S. Jung and R. Bajcsy, "A framework for constructing real-time immersive environments for training physical activities," J. Multimedia, vol. 1, no. 7, pp. 9-17, 2006.
6. J. Hasenfratz, M. Lapierre, and F. Sillion, "A real-time system for fullbody interaction with virtual worlds," in Proc. Eurographics Symp. Virtual Environments, The Eurographics Association, 2004, pp. 147-156.
7. O. Schreer, I. Feldmann, N. Atzpadin, P. Eisert, P. Kauff, and H. Belt, "3dpresence-A system concept for multi-user and multi-party immersive 3d videoconferencing," in Proc. 5th Eur. Conf. Visual Media Production (CVMP 2008), Nov. 2008, pp. 1-8.
8. H. Baker, D. Tanguay, I. Sobel, D. Gelb, M. Gross, W. Culbertson, and T. Malzenbender, "The coliseum immersive teleconferencing system," in Proc. Int. Workshop Immersive Telepresence, Juan-les-Pins, France, 2002.
9. M. Gross, S. Würmlin, M. Naef, E. Lamboray, C. Spagno, A. Kunz, E. Koller-Meier, T. Svoboda, L. V. Gool, S. Lang, K. Strehlke, A. V. Moere, and O. Staadt, "blue-c: A spatially immersive display and 3d video portal for telepresence," ACM Trans. Graph., vol. 22, no. 3, pp. 819-827, 2003.
10. D. Scharstein and R. Szeliski, "A taxonomy and evaluation of dense two-frame stereo correspondence algorithms," Int. J. Comput. Vis., vol. 47, no. 1, pp. 7-42, 2002. (Pubitemid 34428419)
11. D. Zhang, Y. Nomura, and S. Fujii, "Error analysis and optimization of camera calibration," in Proc. IEEE/RSJ Int. Workshop Intelligent Robots and Systems (IROS 91), Osaka, Japan, 1991, pp. 292-296.
12. Y. Ma, S. Soatto, J. Kosecka, Y. Ma, S. Soatta, J. Kosecka, and S. Sastry, An Invitation to 3-D Vision. New York: Springer, 2004.
13. X. Cheng, J. Davis, and P. Slusallek, "Wide area camera calibration using virtual calibration objects," in Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR 2000), 2000.
14. I. Ihrke, L. Ahrenberg, and M. M. Magnor, "External camera calibration for synchronized multi-video systems," in Proc. 12th Int. Conf. Computer Graphics, Visualization and Computer Vision 2004, Plzen, Czech Republic, Feb. 2004, vol. 12, pp. 537-544.
15. T. Svoboda, D. Martinec, and T. Pajdla, "A convenient multicamera self-calibration for virtual environments," Presence, vol. 14, no. 4, pp. 407-422, 2005. (Pubitemid 41365734)
16. G. Kurillo, Z. Li, and R. Bajcsy, "Wide-area external multi-camera calibration using vision graphs and virtual calibration object," in Proc. 2nd ACM/IEEE Int. Conf. Distributed Smart Cameras (ICDSC 08), Stanford, CA, Sep. 7-11, 2008, IEEE.
17. M. Lourakis, Levmar: Levenberg-Marquardt Nonlinear Least Squares Algorithms in C/C++, Jul. 2004. [Online]. Available: http://www.ics. forth.gr/~lourakis/levmar.
18. R. I. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, 2nd ed. New York: Cambridge Univ. Press, 2004.
19. M. Lourakis and A. Argyros, The Design and Implementation of a Generic Sparse Bundle Adjustment Software Package Based on the Levenberg-Marquardt Algorithm, Institute of Computer Science- FORTH, Heraklion, Crete, Greece, Tech. Rep. 340, Aug. 2004. [Online]. Available: http://www.ics.forth.gr/~lourakis/ sba.
20. D. Forsyth and J. Ponce, Computer Vision: A Modern Approach. Englewood Cliffs, NJ: Prentice-Hall Professional Technical Reference, 2002.
21. S. Seitz, B. Curless, J. Diebel, D. Scharstein, and R. Szeliski, "A comparison and evaluation of multi-viewstereo reconstruction algorithms," in Proc. Int. Conf. Computer Vision and Pattern Recognition, 2006, pp. 519-528.
22. P. Perona and J. Malik, "Scale-space and edge detection using anisotropic diffusion," IEEE Trans. Pattern Anal. Mach. Intell., vol. 12, no. 7, pp. 629-639, Jul. 1990. (Pubitemid 20726016)
23. J. Maubach, "Local bisection refinement for N-simplicial grids generated by reflection," SIAM J. Sci. Comput., vol. 16, p. 210, 1995.
24. T. Chan and J. Shen, Image Processing and Analysis: Variational, PDE, Wavelet, and Stochastic Methods. Philadelphia, PA: SIAM, 2005.
25. D. Scharstein, R. Szeliski, and M. Coll, "High-accuracy stereo depth maps using structured light," in Proc. 2003 IEEE Computer Society Conf. Computer Vision and Pattern Recognition, 2003, vol. 1.
26. Z. Wang and Z. Zheng, "A region based stereo matching algorithm using cooperative optimization," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition 2008, Anchorage, AK.
27. M. Bleyer and M. Gelautz, "A layered stereo matching algorithm using image segmentation and global visibility constraints," ISPRS J. Photogram. Remote Sens., vol. 59, no. 3, pp. 128-150, 2005. (Pubitemid 40717591)
28. A. Klaus, M. Sormann, and K. Karner, "Segment-based stereo matching using belief propagation and a self-adapting dissimilarity measure," in Proc. Int. Conf. Pattern Recognition, 2006, vol. 2.
29. G. Kurillo, R. Bajcsy, K. Nahrstedt, and O. Kreylos, "Immersive 3d environment for remote collaboration and training of physical activities," in Proc. IEEE Virtual Reality Conf. (VR 2008), Reno, NV, Mar. 8-12, 2008, pp. 269-270.
30. Z. Yang, W. Wu, K. Nahrstedt, G. Kurillo, and R. Bajcsy, "Enabling multi-party 3d tele-immersive environments with viewcast," ACM Trans. Multimedia Comput., Commun., Appl. (TOMCCAP), accepted for publication.
31. J. N. Bailenson, K. Patel, A. Nielsen, R. Bajcsy, S. Jung, and G. Kurillo, "The effect of interactivity on learning physical actions in virtual reality," Media Psychol., to be published.
32. M. Forte and G. Kurillo, "Cyberarchaeology-Experimenting with teleimmersive archaeology," in Proc. 16th Int. Conf. Virtual Systems and Multimedia (VSMM 2010), Seoul, Korea, Oct. 20-23, 2010.
33. S. Hauberg, S. Sommer, and K. S. Pedersen, "Gaussian-like spatial priors for articulated tracking," in Proc. ECCV 2010, K. Daniilidis, P. Maragos, and N. Paragios, Eds., 2010, pp. 425-437, Springer-Verlag, Berlin, Germany.
34. G. Kurillo, T. Koritnik, T. Bajd, and R. Bajcsy, "Real-time 3d avatars for tele-rehabilitation in virtual reality," in Proc. 18th Medicine Meets Virtual Reality (MMVR) Conf., Newport Beach, CA, Feb. 2011, pp. 290-296.