An integrative recognition method for speech and gestures

ICMI'08: Proceedings of the 10th International Conference on Multimodal Interfaces

Volumn , Issue , 2008, Pages 93-96

  Miki, Madoka ^a   Miyajima, Chiyomi ^a   Nishino, Takanori ^a   Kitaoka, Norihide ^a   Takeda, Kazuya ^a  

^a NAGOYA UNIVERSITY   (Japan)

Author keywords

Gesture recognition; Integrative recognition; Multimodal interface; Speech recognition

Indexed keywords

GESTURE RECOGNITION; INTERACTIVE COMPUTER SYSTEMS; MOTION ESTIMATION; PROBABILITY DISTRIBUTIONS; SPEECH;

3D POSITION SENSOR; GEOMETRY PROBLEMS; INTEGRATIVE RECOGNITION; MOVEMENT RECOGNITION; MULTI-MODAL; MULTI-MODAL INTERFACES; MULTIPLE MODALITIES; RECOGNITION METHODS;

SPEECH RECOGNITION;

EID: 63449109269     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1452392.1452411     Document Type: Conference Paper

References (13)

1. S. Oviatt, R. Coulston, and R. Lundsford, "When Do We Interact Multimodally? Cognitive Load and Multimodal Communication Patterns," Proc. IEEE International Conference on Multimodal Interfaces (ICMI'04), 2004.
2. S. Oviatt, R. Lunsford, and R. Coulston, "Individual Differences in Multimodal Integration Patterns: What Are They and Why Do They Exist?" CHI 2005, 2005.
3. S. Kettebekov, M. Yeasin, and R. Sharma, "Prosody based co-analysis for continuous recognition of co-verbal gestures," Proc. ICME, 2002.
4. M. Fukumoto, Y. Suenaga, and K. Mase, "Finger-pointer: pointing interface by image processing," Comput. Graph., Vol. 18, No. 5, pp. 633-642, 1994.
5. R. A. Bolt, "Put-that-there: Voice and gesture at the graphics interface," ACM Computer Graphics, Vol. 14, No. 3, pp. 262-270, 1980.
6. P. Hui and H. M. Meng, "Joint interpretation of input speech and pen gestures for multimodal human computer interaction," Proc. INTERSPEECH-2006, pp. 1197-1200, Sept. 2006.
7. S. Qu and J. Y. Chai, "Salience Modeling based on Non-Verbal Modalities for Spoken Language Understanding," Proc. ICMI'06, pp. 193-200, 2006.
8. N. Krahnstoever, S. Kettebekov, M. Yeasin, and R. Sharma, "A real-time framework for natural multimodal interaction with large screen displays," Proc. ICMI 2002, Oct. 2002.
9. J. Chai, P. Hong, M. Zhou, and Z. Prasov, "Optimization in multimodal interpretation," Proc. 42nd Annual Meeting of Association for Computational Linguistics (ACL), 2004.
10. M. Johnston and S. Bangalore, "Finite-state multimodal parsing and understanding," Proc. COLING 2000, 2000.
11. M. Johnston, "Unification-based multimodal parsing," Proc. COLING-ACL'98, 1998.
12. L. Wu, S. L. Oviatt, and P. R. Cohen, "Multimodal integration-A statistical view," IEEE Trans. Multimedia, Vol. 1, No. 4, pp. 334-341, 1999.
13. K. Maekawa, 2003, Corpus of Spontaneous Japanese: Its design and evaluation, Proceedings of the ISCA & IEEE Workshop on Spontaneous Speech Processing and Recognition (SSPR2003), pp. 7-12.