The role of interactivity in human-machine conversation for automatic word acquisition

Proceedings of the SIGDIAL 2009 Conference: 10th Annual Meeting of the Special Interest Group on Discourse and Dialogue

Volumn , Issue , 2009, Pages 188-195

  Qu, Shaolin ^a   Chai, Joyce Y ^a  

^a Michigan State University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATION; COUPLINGS; LINGUISTICS; MERGERS AND ACQUISITIONS;

AUTOMATIC IDENTIFICATION; CLOSE COUPLING; HUMAN-MACHINE; INTERACTIVITY; NATURALLY OCCURRING; SPEECH PRODUCTION; VOCABULARY ACQUISITION; WORD ACQUISITION;

SPEECH RECOGNITION;

EID: 77952728436     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/1708376.1708404     Document Type: Conference Paper

References (21)

1. G. Aist, J. Dowding, B. A. Hockey, M. Rayner, J. Hieronymus, D. Bohus, B. Boven, N. Blaylock, E. Campana, S. Early, G. Gorrell, and S. Phan. 2003. Talking through procedures: An intelligent space station procedure assistant. In Proceedings of the 10th Conference of the European Chapter of the Association for Computational Linguistics (EACL).
2. S. Bangalore and M. Johnston. 2004. Robust multimodal understanding. In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP).
3. K. Barnard, P. Duygulu, N. de Freitas, D. Forsyth, D. Blei, and M. Jordan. 2003. Matching words and pictures. Journal of Machine Learning Research, 3:1107-1135.
4. D. Byron, T. Mampilly, V. Sharma, and T. Xu. 2005. Utilizing visual attention for cross-modal coreference interpretation. In Proceedings of the Fifth International and Interdisciplinary Conference on Modeling and Using Context (CONTEXT-05), pages 83-96.
5. K. Eberhard, M. Spivey-Knowiton, J. Sedivy, and M. Tanenhaus. 1995. Eye movements as a window into real-time spoken language comprehension in natural contexts. Journal of Psycholinguistic Research, 24:409-436.
6. Z. Griffin and K. Bock. 2000. What the eyes say about speaking. Psychological Science, 11:274-279.
7. M. Just and P. Carpenter. 1976. Eye fixations and cognitive processes. Cognitive Psychology, 8:441-480.
8. D. Kahneman. 1973. Attention and Effort. Prentice-Hall, Inc., Englewood Cliffs.
9. S. le Cessie and J. van Houwelingen. 1992. Ridge estimators in logistic regression. Applied Statistics, 41(1):191-201.
10. O. Lemon, A. Gruenstein, and S. Peters. 2002. Collaborative activities and multitasking in dialogue systems. Traitement Automatique des Langues, 43(2):131-154.
11. Y. Liu, J. Chai, and R. Jin. 2007. Automated vocabulary acquisition and interpretation in multimodal conversational systems. In Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics (ACL).
12. A. Meyer, A. Sleiderink, and W. Levelt. 1998. Viewing and naming objects: eye movements during noun phrase production. Cognition, 66(22):25-33.
13. Y. Nakano, G. Reinstein, T. Stocky, and J. Cassell. 2003. Towards a model of face-to-face grounding. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL).
14. Z. Prasov and J. Chai. 2008. What's in a gaze? the role of eye-gaze in reference resolution in multimodal conversational interfaces. In Proceedings of ACM 12th International Conference on Intelligent User interfaces (IUI).
15. S. Qu and J. Chai. 2006. Salience modeling based on non-verbal modalities for spoken language understanding. In Proceedings of the International Conference on Multimodal Interfaces (ICMI), pages 193-200. (Pubitemid 47113449)
16. S. Qu and J. Chai. 2008. Incorporating temporal and semantic information with eye gaze for automatic word acquisition in multimodal conversational systems. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 244-253.
17. K. Rayner. 1998. Eye movements in reading and information processing - 20 years of research. Psychological Bulletin, 124(3):372-422. (Pubitemid 128461792)
18. L. Razzaq and N. Heffernan. 2004. Tutorial dialog in an equation solving intelligent tutoring system. In Proceedings of the Workshop on Dialog-based Intelligent Tutoring Systems: State of the art and new research directions.
19. D. Roy and A. Pentland. 2002. Learning words from sights and sounds, a computational model. Cognitive Science, 26(1):113-146.
20. M. Tanenhaus, M. Spivey-Knowiton, K. Eberhard, and J. Sedivy. 1995. Integration of visual and linguistic information in spoken language comprehension. Science, 268:1632-1634.
21. C. Yu and D. Ballard. 2004. A multimodal learning interface for grounding spoken language in sensory perceptions. ACM Transactions on Applied Perceptions, 1(1):57-80.