A general framework for incremental processing of multimodal inputs

ICMI'11 - Proceedings of the 2011 ACM International Conference on Multimodal Interaction

Volumn , Issue , 2011, Pages 225-228

  Ameri Ekhtiarabadi, Afshin ^a   Akan, Batu ^a   Çürüklü, Baran ^a   Asplund, Lars ^a  

^a MÄLARDALEN UNIVERSITY   (Sweden)

Author keywords

multimodal framework; multimodal interface

Indexed keywords

ERROR PRONES; INCREMENTAL PROCESSING; INFORMATION CHANNELS; MULTI-MODAL; MULTI-MODAL INTERFACES; MULTI-MODALITY; MULTIMODAL FRAMEWORKS; MULTIMODAL INTERFACE; NATURAL LANGUAGE UNDERSTANDING; SEMANTIC ANALYSIS;

SEMANTICS; SPEECH COMMUNICATION;

INTERACTIVE COMPUTER SYSTEMS;

EID: 83455176699     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2070481.2070521     Document Type: Conference Paper

References (10)

1. T. Brick and M. Scheutz. Incremental natural language processing for HRI. ACM Press, New York, New York, USA, 2007.
2. F. Flippo, A. Krebs, and I. Marsic. A framework for rapid development of multimodal interfaces. Proceedings of the 5th international conference on Multimodal interfaces - ICMI '03, page 109, 2003.
3. S. Irawati, D. Calderón, and H. Ko. Spatial ontology for semantic integration in 3D multimodal interaction framework. In Proc. ACM VRCAI2006, volume 1, pages 129-135, New York, New York, USA, 2006.
4. M. Johnston. Unification-based multimodal parsing. Proceedings of the 36th annual meeting on Association for Computational Linguistics -, page 624, 1998.
5. M. Johnston and S. Bangalore. Finite-state multimodal integration and understanding. Natural Language Engineering, 11(02):159-187, 2005. (Pubitemid 40794932)
6. M. Johnston, P. R. Cohen, D. McGee, S. L. Oviatt, J. a. Pittman, and I. Smith. Unification-based multimodal integration. Proc. ACL 35th meeting, pages 281-288, 1997.
7. Y. Kamide, G. T. M. Altmann, and S. L. Haywood. The time-course of prediction in incremental sentence processing: Evidence from anticipatory eye movements. Journal of Memory and Language, 49(1):133-156, 2003. (Pubitemid 36802720)
8. S. L. Oviatt. Ten myths of multimodal interaction. In CACM, 42(11):74-81, 1999.
9. D. Schlangen and G. Skantze. A general, abstract model of incremental dialogue processing. Proc. EACL '09, (April):710-718, 2009.
10. R. Stiefelhagen, C. Fogen, P. Gieselmann, H. Holzapfel, K. Nickel, and a. Waibel. Natural human-robot interaction using speech, head pose and gestures. IROS 2004, pages 2422-2427, 2004.