Integration of wireless gesture tracking, object tracking, and 3D reconstruction in the perceptive workbench

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 2095, Issue , 2001, Pages 73-92

  Leibe, Bastian ^a   Minnen, David ^b   Weeks, Justin ^b   Starner, Thad ^b  

^a ETH ZURICH   (Switzerland)

^b Georgia Institute of Technology   (Georgia)

Author keywords

3D object reconstruction; Computer vision; Gesture; Infrared; Object recognition; Tracking; Virtual reality

Indexed keywords

AUGMENTED REALITY; COMPUTER VISION; GESTURE RECOGNITION; INFRARED RADIATION; LIGHT SOURCES; OBJECT RECOGNITION; SURFACE DISCHARGES; TRACKING (POSITION); VIRTUAL REALITY;

3-D OBJECT RECONSTRUCTION; AUGMENTED REALITY GAMING; GESTURE; INFRARED LIGHT SOURCES; PERFORMANCE ASPECTS; TERRAIN NAVIGATIONS; VISION BASED INTERFACE; VISION-BASED METHODS;

IMAGE RECONSTRUCTION;

EID: 84937429907     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/3-540-48222-9_6     Document Type: Conference Paper

References (40)

1. O. Bimber. Gesture controlled object interaction: A virtual table case study. In 7th Int'l Conf. in Central Europe on Computer Graphics, Visualization, and Interactive Digital Media (WSCG'99), volume 1, Plzen, Czech Republic, 1999.
2. A. Bobick, S. Intille, J. Davis, F. Baird, C. Pinhanez, L. Campbell, Y. Ivanov, and A. Wilson. The kidsroom: A perceptually-based interactive and immersive story environment. PRESENCE: Teleoperators and Virtual Environments, 8(4):367-391, August 1999.
3. R. Bolt and E. Herranz. Two-handed gesture in multi-modal natural dialogue. In ACM Symposium on User Interface Software and Technology (UIST'92), pages 7-14, 1992.
4. P. Cignoni, C. Rocchini, and R. Scopigno. Metro: Measuring error on simplified surfaces. Computer Graphics Forum, 17(2):167-174, June 1998.
5. D. Daum and G. Dudek. On 3-d surface reconstruction using shape from shadows. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR'98), pages 461-468, 1998.
6. J.W. Davis and A.F. Bobick. Sideshow: A silhouette-based interactive dual-screen environment. Technical Report TR-457, MIT Media Lab Tech Report, 1998.
7. Computer Aided Design and Graphics Laboratory (CADLAB). TWIN Solid Modeling Package Reference Manual. School of Mechanical Engineering, Purdue University, http://cadlab.www.ecn.purdue.edu/cadlab/twin, 1995.
8. K. Dorfmueller-Ulhaas and D. Schmalstieg. Finger tracking for interaction in augmented environments. Technical Report TR-186-2-01-03, Vienna University of Technology, 2001. submitted to Computer Graphics Forum.
9. G.W. Fitzmaurice, H. Ishii, and W. Buxton. Bricks: Laying the foundations for graspable user interfaces. In Proceedings of CHI'95, pages 442-449, 1995.
10. M. Fukumoto, K. Mase, and Y. Suenaga. Real-time detection of pointing actions for a glove-free interface. In Proceedings of IAPR Workshop on Machine Vision Applications, Tokyo, Japan, 1992.
11. H. Ishii and B. Ullmer. Tangible bits: Towards seamless interfaces between people, bits, and atoms. In Proceedings of CHI'97, pages 234-241, 1997.
12. C. Jennings. Robust finger tracking with multiple cameras. In Proc. of the International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems, pages 152-160, 1999.
13. M. Krueger. Artificial Reality II. Addison-Wesley, 1991.
14. W. Krueger, C.-A. Bohn, B. Froehlich, H. Schueth, W. Strauss, and G. Wesche. The responsive workbench: A virtual work environment. IEEE Computer, 28(7):42-48, July 1995.
15. A. Laurentini. How many 2d silhouettes does it take to reconstruct a 3d object? Computer Vision and Image Understanding (CVIU), 67(1):81-87, July 1997.
16. B. Leibe, T. Starner, W. Ribarsky, Z. Wartell, D. Krum, B. Singletary, and L. Hodges. Toward spontaneous interaction with the perceptive workbench. IEEE Computer Graphics & Applications, 20(6):54-65, Nov. 2000.
17. W. Matusik, C. Buehler, S. Gortler, R. Raskar, and L. McMillan. Image based visual hulls. In Proceedings of SIGGRAPH 2000, 2000.
18. F.K.H. Quek. Eyes in the interface. Image and Vision Computing, 13(6):511-525, Aug. 1995.
19. J.M. Rehg and T. Kanade. Visual tracking of high dof articulated structures: an application to human hand tracking. In Third European Conference on Computer Vision (ECCV'94), pages 35-46, 1994.
20. J. Rekimoto and N. Matsushita. Perceptual surfaces: Towards a human and object sensitive interactive display. In Workshop on Perceptual User Interfaces (PUI'97), 1997.
21. P.L. Rosin and G.A.W. West. Non-parametric segmentation of curves into various representations. IEEE Transactions on Pattern Analysis and Machine Intelligence, 17(12):1140-1153, 1995.
22. Y. Sato, Y. Kobayashi, and H. Koike. Fast tracking of hands and ingertips in infrared images for augmented desk interface. In Proc. of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition, pages 462-467, 2000.
23. A.F. Seay, D. Krum, W. Ribarsky, and L. Hodges. Multimodal interaction techniques for the virtual workbench. In Proceedings CHI'99 Extended Abstracts, pages 282-283, 1999.
24. J. Segen and S. Kumar. Shadow gestures: 3d hand pose estimation using a single camera. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR'99), volume 1, pages 479-485, 1999.
25. R. Sharma and J. Molineros. Computer vision based augmented reality for guiding manual assembly. PRESENCE: Teleoperators and Virtual Environments, 6(3):292-317, 1997.
26. S.K. Srivastava and N. Ahuja. An algorithm for generating octrees from object silhouettes in perspective views. Computer Vision, Graphics, and Image Processing: Image Understanding (CVGIP:IU), 49(1):68-84, 1990.
27. T. Starner, B. Leibe, B. Singletary, and J. Pair. Mind-warping: Towards creating a compelling collaborative augmented reality gaming interface through wearable computers and multi-modal input and output. In IEEE International Conference on Intelligent User Interfaces (IUI'2000), 2000.
28. T. Starner, J. Weaver, and A. Pentland. Real-time american sign language recognition using desk and wearable computer based video. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(12):1371-1375, 1998.
29. D. Sturman. Whole-hand Input. PhD thesis, MIT Media Lab, 1992.
30. S. Sullivan and J. Ponce. Automatic model construction, pose estimation, and object recognition from photographs using triangular splines. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(10):1091-1097, 1998.
31. B. Ullmer and H. Ishii. The metadesk: Models and prototypes for tangible user interfaces. In ACM Symposium on User Interface Software and Technology (UIST'97), pages 223-232, 1997.
32. J. Underkoffler and H. Ishii. Illuminating light: An optical design tool with a luminous-tangible interface. In Proceedings of CHI'98, pages 542-549, 1998.
33. A. Utsumi and J. Ohya. Multiple-hand-gesture tracking using multiple cameras. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR 99), volume 1, pages 473-478, 1999.
34. R. van de Pol, W. Ribarsky, L. Hodges, and F. Post. Interaction in semi-immersive large display environments. In Proceedings ofVirtual Environments 99, pages 157-168, 1999.
35. C. Vogler and D. Metaxas. Asl recognition based on coupling between hmms and 3d motion analysis. In Sixth International Conference on Computer Vision (ICCV 98), pages 363-369, 1998.
36. C. Ware and R. Balakrishnan. Reaching for objects in vr displays: Lag and frame rate. ACM Transactions on Computer-Human Interaction, 1(4):331-356, 1994.
37. Z. Wartell, W. Ribarsky, and L.F. Hodges. Third-person navigation of whole-planet terrain in a head-tracked stereoscopic environment. In IEEE Virtual Reality 99 Conference, pages 141-149, 1999.
38. B. Watson, N. Walker, W. Ribarsky, and V. Spaulding. The effects of variation of system responsiveness on user performance in virtual environments. Human Factors, 40(3):403-414, 1998.
39. P. Wellner. Interacting with paper on the digital desk. Communications of the ACM, 36(7):86-89, 1993.
40. C. Wren, A. Azarbayejani, T. Darrell, and A. Pentland. Pfinder: Real-time tracking of the human body. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(7):780-785, 1997.