Toward multimodal interpretation in a natural speech/gesture interface

Proceedings - 1999 International Conference on Information Intelligence and Systems, ICIIS 1999

Volumn , Issue , 1999, Pages 328-335

  Kettebekov, Sanshzar ^a   Sharma, Rajeev ^a  

^a PENNSYLVANIA STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

SIGNAL PROCESSING; SPEECH; VIRTUAL REALITY;

CRITICAL COMPONENT; HUMAN COMPUTER INTERACTION (HCI); HUMAN-TO-HUMAN INTERACTIONS; INTEGRATION PROBLEMS; MULTI-MODAL INTERFACES; NATURAL INTERACTIONS; NATURAL INTERFACES; ONE-TO-ONE MAPPINGS;

HUMAN COMPUTER INTERACTION;

EID: 84983167591     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICIIS.1999.810285     Document Type: Conference Paper

References (18)

1. Y. Azoz, L. Devi, and R. Sharma. Reliable tracking of human arm dynamics by multiple cue integration and constraint fusion. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, 1998.
2. D. Caplan and G. Waters. Verbal working memory and sentence comprehension. Cambridge University Press. 1998.
3. Edwards, G. & Moulin, B. (1998) Towards the simulation of spatial images using the Voronoi model. In P. Oliver & K. Gapp (Eds.) Representation and Processing of Spatial Expressions (163-184). Mahwah, New Jersey: Erlbaum.
4. A. Kendon. Current issues in the study of gesture. In J. L. Nespoulous, P. Peron, and A. R. Lecours, editors, The Biological Foundations of Gestures: Motor and Semiotic Aspects, 23-47. Lawrence Erlbaum Assoc., 1986.
5. P. Killeen. Mathematical Principles of reinforcement Based on the correlation of behavior with incentives in short-term memory. Cambridge University Press. 1994.
6. S. Kita, LV. Gijn, and H.V. Hulst. Movement phases in signs and co-speech gestures, and their transcription by human coders. In Proceedings of Intl. Gesture Workshop, pp 23-35, Sept. 1997
7. D. McNeill, Hand and Mind. The University of Chicago Press, Chicago, 1992
8. S. Oviatt. Multimodal interfaces for dynamic interactive maps. In Proceedings of the Conference on Human Factors in Computing Systems (CHI96), 95-102, 1996.
9. S. Oviatt, A. De Angeli, and K. Kuhn. Integration and synchronization of input modes during multimodal human-computer interaction. In Proceedings of the Conference on Human Factors in Computing Systems (CHIV7), 95-102, ACM Press, New York, 1997, pp. 415-422.
10. V. I. Pavlovic, R. Sharma, and T. S. Huang. Visual interpretation of hand gestures for human-computer interaction: A review. IEEE Trans on Pattern Analysis and Machine Intelligence, 19(7):677~695, July 1997.
11. D. Petrelli, A. De Angeli, W. Gerbino, G. Cassano. Referring in Multimodal Systems: The Importance of User Expertise and System Features. In Proceedings of 35th Annual Meeting of the Association for Computational (ACL-EACL'97). July, 1997
12. T. Starner, J. Weaver, and A. Pentland. Real-Time American Sign Language Recognition Using Desk and Wearable Computer Based Video. In IEEE Transactions on Pattern Analysis and Machine Intelligence, . Vol.: 20.12, Dec.1998, pp. 1371 -1375
13. I. Poddar. Continuous Recognition of Deictic Gestures for Multimodal Interfaces. Master Thesis. The Pennsylvania State University, University Park, 1999.
14. I. Poddar and Y. Sethi and E. Ozyildiz and R. Sharma. Toward Natural Gesture/Speech HCI: A Case Study of Weather Narration. In Proc. 2' Workshop on Perceptual User Interaces (PUI), 1998.
15. F. Quek. Toward a vision-based hand gesture interface. In Virtual Reality Software and Technology Conference, Aug. 1994.
16. R. Sharma, V. I. Pavlovic, and T. S. Huang. Toward multimodal human-computer interface. In Proceedings of the IEEE, 86(5):853-869, May 1998.
17. D. J. Sturman and D. Zeltzer. A survey of glove-based input. IEEE Computer Graphics and Applications, 14(1):30-39, Jan. 1994
18. D. Salber and J. Contaz. Applying the wizard-of-oz techniques to the study of multimodal systems. In EWHC1'93, Moscow, Russia, 1993