Context-based multimodal input understanding in conversational systems

Proceedings - 4th IEEE International Conference on Multimodal Interfaces, ICMI 2002

Volumn , Issue , 2002, Pages 87-92

  Chai, J ^a   Pan, Shimei ^a   Zhou, M X ^a   Houck, K ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

SEMANTICS;

CONTEXT-BASED; CONVERSATIONAL SYSTEMS; HUMAN-MACHINE; INTERPRETATION FRAMEWORKS; MULTI-MODAL; MULTI-MODAL FUSION; MULTIMODAL INPUTS; UNIQUE FEATURES;

INTERACTIVE COMPUTER SYSTEMS;

EID: 84963820661     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICMI.2002.1166974     Document Type: Conference Paper

References (15)

1. J. Allen, D. Byron, M. Dzikovska, G. Ferguson, G. L., and A. Stent. Toward conversational human computer interaction. AI Magazine, 22(4):27-37, 2001.
2. R. A. Bolt. Voice and gesture at the graphics interface. Computer Graphics, pages 262-270, 1980.
3. J. Burger and R. Marshall. The application of natural language models to intelligent multimedia. In M. Maybury, editor, Intelligent Multimedia Interfaces, pages 429-440. MIT Press, 1993.
4. P. Cohen, M. Johnston, D. McGee, S. Oviatt, J. Pittman, I. Smith, L. Chen, and J. Clow. Quickset: Multimodal interaction for distributed applications. Proc. ACM MM'96, pages 31-40, 1996.
5. B.J. Grosz, A. K. Joshi, and S.Weinstein. Towards a computational theory of discourse interpretation. Computational Linguistics, 21(2):203-225, 1995.
6. B. J. Grosz and C. Sidner. Attention, intentions, and the structure of discourse. Computational Linguistics, 12(3):175-204, 1986.
7. F. Jelinek, J. Lafferty, D. M. Magerman, R. Mercer, and S. Roukos. Decision tree parsing using a hidden derivation model. Proc. Darpa Speech and Natural Language Workshop, March 1994.
8. M. Johnsonton. Unification-based multimodal parsing. Proc. COLING-ACL'98, 1998.
9. A. Kehler. Cognitive status and form of reference in multimodal human-computer interaction. Proc. AAAI'01, pages 685-689, 2000.
10. K. Lochbaum. A collaborative planning model of intentional structure. Computational Linguistics, 24(4):525-572, 1998.
11. S. Oviatt. Multimodal interfaces for dynamic interactive maps. Proc. CHI'96, 1996.
12. C. Rich and C. Sidner. Collagen: A collaboration manager for software interface agents. User Modeling and User-Adapted Interaction, 1998.
13. W. Wahlster. User and discourse models for multimodal communication. In M. Maybury and W. Wahlster, editors, Intelligent User Interfaces, pages 359-370. 1998.
14. W. Wahlster. Mobile speech-to-speech translation of spontaneous dialogs: An overview of the final verbmobil system. Verbmobile, pages 3-21, 2000.
15. M. X. Zhou and S. Pan. Automated authoring of coherent multimedia discourse for conversation systems. Proc. ACM MM'01, pages 555-559, 2001