Joint interpretation of input speech and pen gestures for multimodal human-computer interaction

INTERSPEECH 2006 and 9th International Conference on Spoken Language Processing, INTERSPEECH 2006 - ICSLP

Volumn 3, Issue , 2006, Pages 1197-1200

  Hui, Pui Yu ^a   Meng, Helen M ^a  

^a CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Human computer interaction; Joint interpretation; Multi modal input; Pen gesture; Spoken input

Indexed keywords

COST FUNCTIONS; SEMANTICS;

JOINT INTERPRETATION; MULTI-MODAL; MULTIMODAL HUMAN COMPUTER INTERACTION; PEN GESTURE; SEMANTIC COMPATIBILITY; SEMANTIC INTERPRETATION; SPOKEN INPUT; TEMPORAL ORDER;

HUMAN COMPUTER INTERACTION;

EID: 34547501327     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (10)

1. Oviatt, S., R. Coulston and R. Lunsford, "When Do We Interact Multimodally? Cognitive Load and Multimodal Communication Patterns." In the Proceedings of ICM, 2004.
2. Oviatt, S., A. DeAngeli & K. Kuhn, "Integration and Synchronization of Input Modes during Multimodal Human-Computer Interaction," Proc. of CHI, 1997.
3. Nigay, L. and J. Coutaz, "A Generic Platform for Addressing the Multimodal Challenge," Proc. of CHI, 1995.
4. Wang, S. "A Multimodal Galaxy-based Geographic System," S.M. Thesis, MIT, 2003.
5. Johnston, M. et al, "Unification-based Multimodal Integration," Proc. ACL, 1997.
6. Wu, L. et al., "Multimodal Integration - A Statistical View," IEEE Transactions on Multimedia, 1(4), pp.334-341, 1999.
7. Wahlster, W. et al., SmartKom (www.smartkom.org)
8. Johnston, M. & S. Bangalore, "Finite-state Multimodal Parsing and Understanding," Proc. of COLING, 2000.
9. Chai, J., "A Probabilistic Approach to Reference Resolution in Multimodal User Interfaces," Proc. of IUI, 2004.
10. Brown, P. et al., "The Mathematics of Machine Translation: Parameter Estimation. Computational Linguistics,19(2):263-311, 1993.