A real-time framework for natural multimodal interaction with large screen displays

Proceedings - 4th IEEE International Conference on Multimodal Interfaces, ICMI 2002

Volumn , Issue , 2002, Pages 349-354

  Krahnstoever, N ^a   Kettebekov, S ^a   Yeasin, M ^b   Sharma, R ^b  

^a PENNSYLVANIA STATE UNIVERSITY   (United States)

^b Advanced Interface Technologies Inc   (United States)

Author keywords

Continuous Gesture Recognition; Multimodal HCI; Real Time System; Speech Gesture Co Analysis; Visual Tracking

Indexed keywords

GESTURE RECOGNITION; INTERACTIVE COMPUTER SYSTEMS; REAL TIME SYSTEMS; SOFTWARE PROTOTYPING; SPEECH RECOGNITION;

CO-ANALYSIS; COMMERCIAL APPLICATIONS; ENTERTAINMENT INDUSTRY; LARGE SCREEN DISPLAYS; MULTI-MODAL; MULTI-MODAL INTERACTIONS; MULTIMODAL HUMAN COMPUTER INTERACTION; VISUAL TRACKING;

HUMAN COMPUTER INTERACTION;

EID: 84963813554     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICMI.2002.1167020     Document Type: Conference Paper

References (19)

1. R. Bolt, "Put-that-there: Voice and gesture at the graphic interface," In SIGGRAPH-Computer Graphics, 1980.
2. K. Nguyen, "Methods and apparatus for real-time gesture recognition," US Patent.
3. S. L. Oviatt, "Multimodal interfaces for dynamic interactive maps," in Proc. of the Conf. on Human Factors in Comp. Systems, ACM Press, 1996, pp. 95-102.
4. J. Cassell, "What you need to know about natural gesture," in Intl. Conf. on Automatic Face and Gesture Recognition: Keynote Address, 1996.
5. T. E. Starner and A. Pentland, "Visual Recognition of American Sign Language Using Hidden Markov Models," in Intl. Workshop on Automatic Face- and Gesture-Recognition, 1995.
6. M. Lucente, "Visualization Space: A Testbed for Deviceless Multimodal User Interface," Computer Graphics, vol. 31, 1997.
7. R. Sharma, I. Poddar, E. Ozyildiz, S. Kettebekov, H. Kim, and T. Huang, "Toward Intrepretation of Natural Speech/Gesture: Spatial Planning on a Virtual Map," in Proc. of the ARL FedLab Symposium, 1999.
8. I. Poddar, Y. Sethi, E. Ozyildiz, and R. Sharma, "Toward Natural Gesture/Speech HCI: A Case Study of Weather Narration," in Proc. 2nd Workshop on Perceptual User Interface, 1998, pp. 1-6.
9. th ARL FedLab Symposium, 2000.
10. MIT Media Laboratory, http://whitechapel.media.mit.edu/vismod/demos/demos.html.
11. B. Brumitt, B. Meyers, J. Krumm, A. Kern, and S. Shafer, "EasyLiving: Technologies for intelligent environments," 2nd Intl. Symp. on Handheld and Ubiquitous Computing (HUC), Bristol, UK, 2000.
12. S. Kettebekov and R. Sharma, "Toward Natural Gesture/Speech Control of a Large Display", in Engineering for Human-Computer Interaction, Lecture Notes in Computer Science, Springer Verlag, 2001.
13. M. Yeasin and Y. Kuniyoshi, "Detecting and tracking human face using a space-varying sensor and an active head,", CVPR, 2000.
14. N. Krahnstoever, S. Kettebekov, M. Yeasin, and R. Sharma, "iMap: A Real-Time Framework for Natural Multimodal Interaction with Large Screen Displays," Dept. of Comp. Science and Eng. Technical Report CSE-02-010, Pennsylvania State University, May 2002.
15. I. Rauschert, P. Agrawal, S. Fuhrmann, I. Brewer, R. Sharma, G. Cai, and A. MacEachren, "Designing a Human-Centered, Multimodal GIS Interface to Support Emergency Management," in 10th ACM International Symposium on Advances in Geographic Information Systems, McLean, VA, 2002.
16. L. R. Rabiner, "A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition," Proceedings of the IEEE, vol. 77, pp. 257-286, 1989.
17. S. J. Young, N. H. Rusell, and J. H. S. Thornton, "Token Passing: a Conceptual model for Connected Speech Recognition," Cambridge University Engineering Dept, CUED/F-INFENG/TR38, 1989.
18. I. Poddar, "Continuous Recognition of Natural Hand Gestures for Human Computer Interaction," MS Thesis, Pennsylvania State University, 1999.
19. E. Schapira and R. Sharma, "Experimental evaluation of vision and speech-based multimodal interfaces," in Workshop on Perceptive User Interfaces, ACM Digital Library, 2001.