Multi-camera tele-immersion system with real-time model driven data compression: A new model-based compression method for massive dynamic point data

Visual Computer

Volumn 26, Issue 1, 2010, Pages 3-15

  Lien, Jyh Ming ^a   Kurillo, Gregorij ^b   Bajcsy, Ruzena ^b  

^a GEORGE MASON UNIVERSITY   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

3D tele immersion; Model based compression; Multi camera tele immersion system; Point data compression

Indexed keywords

3D RECONSTRUCTION; 3D TELE-IMMERSION; COMPRESSION METHODS; COMPRESSION RATIOS; COMPRESSION TECHNIQUES; DATA CAPTURING; DATA POINTS; FULL BODY; HUMAN BODIES; IMMERSIVE; IMMERSIVE APPLICATION; KINEMATIC PARAMETERS; MULTI-CAMERAS; NEW MODEL; PEAK SIGNAL-TO-NOISE RATIO; POINT CLOUD DATA; POINT DATA; REAL TIME; REAL-TIME MODELS; RECONSTRUCTION QUALITY; REMOTE SITES; TELEIMMERSION; VISION BASED;

CAMERAS; IMAGE RECONSTRUCTION; MOTION ESTIMATION; PARAMETER ESTIMATION; SIGNAL TO NOISE RATIO; THREE DIMENSIONAL; VIDEO CAMERAS;

DATA COMPRESSION;

EID: 72549110654     PISSN: 01782789     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00371-009-0367-8     Document Type: Article

References (51)

1. Adobe. Quicktime 7.0 h.264 implementation (2006)
2. J.K. Aggarwal Q. Cai 1999 Human motion analysis: a review Comput. Vis. Image Underst. 73 3 428 440 10.1006/cviu.1998.0744
3. O. Arikan 2006 Compression of motion capture databases ACM Trans. Graph. 25 3 890 897 10.1145/1141911.1141971 2449197 (Pubitemid 44488157)
4. Baker, H., Tanguay, D., Sobel, I., Gelb, D., Gross, M., Culbertson, W., Malzenbender, T.: The coliseum immersive teleconferencing system. In: Proceedings of International Workshop on Immersive Telepresence, Juan-les-Pins, France (2002)
5. J.L. Bentley 1975 Multidimensional binary search trees used for associative searching Commun. ACM 18 9 509 517 0306.68061 10.1145/361002.361007 904133
6. P.J. Besl N.D. McKay 1992 A method for registration of 3-D shapes IEEE Trans. Pattern Anal. Mach. Intell. 14 2 239 256 10.1109/34.121791
7. Cheung, K.M., Baker, S., Kanade, T.: Shape-from-silhouette of articulated objects and its use for human body kinematics estimation and motion capture. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, June 2003
8. CMU. Graphics Lab Motion Capture Database. Carnegie Mellon University. http://mocap.cs.cmu.edu/
9. Demirdjian, D., Darrell, T.: 3-D articulated pose tracking for untethered deictic reference. In: ICMI'02: Proceedings of the 4th IEEE International Conference on Multimodal Interfaces, Washington, DC, p. 267. IEEE Comput. Soc., Los Alamitos (2002)
10. Dewaele, G., Devernay, F., Horaud, R.: Hand motion from 3D point trajectories and a smooth surface model. In: ECCV (1), pp. 495-507 (2004)
11. D.M. Gavrila 1999 The visual analysis of human movement: a survey Comput. Vis. Image Underst. 73 1 82 98 0924.68174 10.1006/cviu.1998.0716
12. M. Gross S. Würmlin M. Naef E. Lamboray C. Spagno A. Kunz E. Koller-Meier T. Svoboda L.V. Gool S. Lang K. Strehlke A.V. Moere O. Staadt 2003 Blue-c: a spatially immersive display and 3D video portal for telepresence ACM Trans. Graph. 22 3 819 827 10.1145/882262.882350
13. Gumhold, S., Karni, Z., Isenburg, M., Seidel, H.-P.: Predictive point-cloud compression. In: Siggraph 2005 Sketches (2005)
14. Hasenfratz, J., Lapierre, M., Sillion, F.: A real-time system for full-body interaction with virtual worlds. In: Proceedings of Eurographics Symposium on Virtual Environments, pp. 147-156. Eurographics Association, Aire-la-Ville (2004)
15. M.K. Holden 2005 Virtual environments for motor rehabilitation: review Cyberpsychol. Behav. 8 3 187 211 10.1089/cpb.2005.8.187 2152336 (Pubitemid 40847797)
16. Ibarria, L., Rossignac, J.: Dynapack: space-time compression of the 3D animations of triangle meshes with fixed connectivity. In: SCA'03: Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, Aire-la-Ville, Switzerland, pp. 126-135. Eurographics Association, Aire-la-Ville (2003)
17. M. Isard A. Blake 1998 Condensation-conditional density propagation for visual tracking Int. J. Comput. Vis. 29 1 5 28 10.1023/A:1008078328650
18. S. Jung R. Bajcsy 2006 A framework for constructing real-time immersive environments for training physical activities J. Multimed. 1 7 9 17
19. P. Kalra N. Magnenat-Thalman L. Moccozet G. Sannier A. Aubel D. Thalman 1998 Real-time animation of realistic virtual humans IEEE Comput. Graph. Appl. 18 25 42 56 10.1109/38.708560
20. Z. Karni C. Gotsman 2004 Compression of soft-body animation sequences Comput. Graph. 28 1 25 34 10.1016/j.cag.2003.10.002
21. Keshner, E.A.: Virtual reality and physical rehabilitation: a new toy or a new research and rehabilitation tool? J. Neuroengineering Rehabil. 1(8) (2004)
22. E. Keshner R. Kenyon 2004 Using immersive technology for postural research and rehabilitation Assist. Technol. 16 54 62 (Pubitemid 38955460)
23. Knoop, R.D.S., Vacek, S.: Sensor fusion for 3D human body tracking with an articulated 3D body model. In: Proceedings of the IEEE International Conference on Robotics and Automation, Walt Disney Resort, Orlando, Florida, 15 May 2006
24. S.-U. Kum K. Mayer-Patel 2005 Real-time multidepth stream compression ACM Trans. Multimedia Comput. Commun. Appl. 1 2 128 150 10.1145/1062253.1062255
25. Lamboray, E., Würmlin, S., Gross, M.: Real-time streaming of point-based 3D video. In: VR'04: Proceedings of the IEEE Virtual Reality 2004, Washington, DC, p. 91. IEEE Comput. Soc., Los Alamitos (2004)
26. J. Lanier 2001 Virtually there Sci. Am. 4 52 61
27. Lengyel, J.E.: Compression of time-dependent geometry. In: SI3D'99: Proceedings of the 1999 Symposium on Interactive 3D Graphics, New York, NY, pp. 89-95. ACM, New York (1999)
28. L. Li M. Zhang F. Xu S. Liu 2005 Ert-vr: an immersive virtual reality system for emergency rescue training Virtual Real. 8 3 194 197 10.1007/s10055-004-0149-6 (Pubitemid 40858233)
29. Lien, J.-M., Bajcsy, G.K.R.: Skeleton-based data compression for multi-camera tele-immersion system. In: Proceedings of the International Symposium on Visual Computing (ISVC), pp. 347-354 (2007)
30. Lopez, E.J.L.: Finite element surface-based stereo 3D reconstruction, April 2006. Poster presentation given at the Trust NSF Site Visit
31. W.M. Marc Alexa 2000 Representing animations by principal components Comput. Graph. Forum 19 3 411 418 10.1111/1467-8659.00433
32. Mason, H., Moutahir, M.: Multidisciplinary experiential education in second life: a global approach. In: Second Life Education Workshop, San Francisco, California, pp. 30-34 (2006)
33. McComas, J., Pivik, J., Laflamme, M.: Current uses of virtual reality for children with disabilities. Virtual Environments in Clinical Psychology and Neuroscience (1998)
34. Morency, L.-P., Darrell, T.: Stereo tracking using ICP and normal flow constraint. In: Proceedings of International Conference on Pattern Recognition (2002)
35. Mulligan, J., Daniilidis, K.: Real-time trinocular stereo for tele-immersion. In: Proceedings of 2001 International Conference on Image Processing, Thessaloniki, Greece, pp. 959-962 (2001)
36. Ochotta, T., Saupe, D.: Compression of point-based 3D models by shape-adaptive wavelet coding of multi-height fields. In: Symposium on Point-Based Graphics, pp. 103-112 (2004)
37. Patel, K., Bailenson, J.N., Hack-Jung, S., Diankov, R., Bajcsy, R.: The effects of fully immersive virtual reality on the learning of physical tasks. In: Proceedings of the 9th Annual International Workshop on Presence, Ohio, USA, pp. 87-94 (2006)
38. Piccardi, M.: Background subtraction techniques: a review. In: Proceedings of IEEE International Conference on Systems, Man and Cybernetics, Hague, Netherlands, pp. 3099-3104 (2004)
39. Point Grey Research Inc, Vancouver, Canada
40. R. Robb 2002 Virtual reality in medicine: A personal perspective J. Vis. 5 4 317 326
41. Rusinkiewicz, S., Levoy, M.: Efficient variants of the ICP algorithm. In: Proceedings of the Third International Conference on 3-D Digital Imaging and Modeling (3DIM), pp. 145-152 (2001)
42. Sattler, M., Sarlette, R., Klein, R.: Simple and efficient compression of animation sequences. In: SCA'05: Proceedings of the 2005 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, New York, NY, pp. 209-217. ACM, New York (2005)
43. Simon, D., Hebert, M., Kanade, T.: Real-time 3-D pose estimation using a high-speed range sensor. In: Proceedings of IEEE International Conference on Robotics and Automation (ICRA'94), vol. 3, pp. 2235-2241 (1994)
44. R. Tsai 1987 A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses IEEE J. Robot. Autom. RA3 4 323 344 10.1109/JRA.1987.1087109
45. William Pennebaker, J.M.: JPEG: Still Image Data Compression Standard. Springer, Berlin (1992)
46. S. Würmlin E. Lamboray M. Gross 2004 3D video fragments: dynamic point samples for real-time free-viewpoint video Comput. Graph. 28 3 14 10.1016/j.cag.2003.10.015
47. Y. Yang X. Wang J.X. Chen 2002 Rendering avatars in virtual reality: integrating a 3D model with 2D images Comput. Sci. Eng. 4 1 86 91 10.1109/5992.976440 812540 (Pubitemid 34109125)
48. Yang, Z., Cui, Y., Anwar, Z., Bocchino, R., Kiyanclar, N., Nahrstedt, K., Campbell, R.H., Yurcik, W.: Real-time 3D video compression for tele-immersive environments. In: Proc. of SPIE/ACM Multimedia Computing and Networking (MMCN'06), San Jose, CA (2006)
49. Zhang, J., Owen, C.B.: Octree-based animated geometry compression. In: DCC'04: Proceedings of the Conference on Data Compression, Washington, DC, p. 508. IEEE Comput. Soc., Los Alamitos (2004)
50. Zhang, D., Nomura, Y., Fujii, S.: Error analysis and optimization of camera calibration. In: Proceedings of IEEE/RSJ International Workshop on Intelligent Robots and Systems (IROS'91), Osaka, Japan, pp. 292-296 (1991)
51. W. Zhao N. Nandhakumar 1996 Effects of camera alignment errors on stereoscopic depth estimates Pattern Recogn. 29 12 2115 2126 10.1016/S0031-3203(96)00051-9