Linguistic theories in efficient multimodal reference resolution: An empirical investigation

International Conference on Intelligent User Interfaces, Proceedings IUI

Volumn , Issue , 2005, Pages 43-50

  Chai, Joyce Y ^a   Prasov, Zahar ^a   Blaim, Joseph ^a   Jin, Rong ^a  

^a Michigan State University   (United States)

Author keywords

Multimodal input interpretation; Reference resolution

Indexed keywords

MULTIMODAL INPUT INTERPRETATION; REFERENCE RESOLUTION;

BEHAVIORAL RESEARCH; COGNITIVE SYSTEMS; COMMUNICATION SYSTEMS; GESTURE RECOGNITION; GRAPH THEORY;

LINGUISTICS;

EID: 33644594894     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (20)

1. Chai, J., Hong, P., Zhou, M. X., and Prasov, Z. 2004c. Optimization in Multimodal Interpretation. In Proceedings of ACL, 2004, pp. 1-8. Barcelona, Spain.
2. Chai, J., Prasov, Z, and Hong, P. 2004b. Performance Evaluation and Error Analysis for Multimodal Reference Resolution in a Conversational System. Proceedings of HLT-NAACL 2004 (Companion Volumn).
3. th International Conference on Intelligent User Interfaces (IUI): 70-77.
4. th ICMI, 2002.
5. Cohen, P., The Pragmatics of Referring and Modality of Communication, Computational Linguistics, 10, pp 97-146. 1984.
6. Cohen, P., Johnston, M., McGee, D., Oviatt, S., Pittman, J., Smith, I., Chen, L., and Clow, J. Quickset: Multimodal Interaction for Distributed Applications. Proceedings of ACM Multimedia, 1996. pp. 31-40.
7. Grice, H. P. Logic and Conversation. In Cole, P., and Morgan, J., eds. Speech Acts. New York, New York: Academic Press. 41-58. 1975.
8. Grosz, B. J. and Sidner, C. Attention, intention, and the structure of discourse. Computational Linguistics, 12(3): 175-204. 1986.
9. Gundel, J. K., Hedberg, N., and Zacharski, R. Cognitive Status and the Form of Referring Expressions in Discourse. Language 69(2):274-307. 1993.
10. Huls, C., Bos, E., and Classen, W. 1995. Automatic Referent Resolution of Deictic and Anaphoric Expressions. Computational Linguistics, 21(1):59-79.
11. Johnston, M, Cohen, P., McGee, D., Oviatt, S., Pittman, J. and Smith, I. Unification-based Multimodal Integration, Proceedings of ACL'97, 1997.
12. Johnston, M. Unification-based Multimodal parsing, Proceedings of COLING-ACL'98, 1998.
13. Johnston, M. and Bangalore, S. Finite-state multimodal parsing and understanding. Proc. COLING'00. 2000.
14. Kehler, A. Cognitive Status and Form of Reference in Multimodal Human-Computer Interaction, Proceedings of AAAI'01, 2000, pp. 685-689.
15. Oviatt, S. L. Multimodal interfaces for dynamic interactive maps. In Proceedings of Conference on Human Factors in Computing Systems: CHI '96, 1996, pp. 95-102.
16. Oviatt, S., DeAngeli, A., and Kuhn, K., Integration and Synchronization of Input Modes during Multimodal Human-Computer Interaction, In Proceedings of Conference on Human Factors in Computing Systems: CHI '97, 1997,
17. Oviatt, S. L. Mutual Disambiguation of Recognition Errors in a Multimodal Architecture. In Proceedings of Conference on Human Factors in Computing Systems: CHI '99.
18. Oviatt, S.L., Multimodal System Processing in Mobile Environments. In Proceedings of the Thirteenth Annual ACM Symposium on User Interface Software Technology (UIST'2000), 21-30. New York: ACM Press.
19. Wahlster, W., User and Discourse Models for Multimodal Communication. Intelligent User Interfaces, M. Maybury and W. Wahlster (eds.), 1998, pp 359-370.
20. Zancanaro, M., Stock, O., and Strapparava, C. 1997. Multimodal Interaction for Information Access: Exploiting Cohesion. Computational Intelligence 13(7):439-464.