Automated vocabulary acquisition and interpretation in multimodal conversational systems

ACL 2007 - Proceedings of the 45th Annual Meeting of the Association for Computational Linguistics

Volumn , Issue , 2007, Pages 368-375

  Liu, Yi ^a   Chai, Joyce Y ^a   Jin, Rong ^a  

^a Michigan State University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CONVERSATIONAL SYSTEMS; EYE-GAZE; GRAPHIC DISPLAYS; HUMAN LANGUAGE; HUMAN-MACHINE; MULTI-MODAL; TRANSLATION MODELS; UNSUPERVISED APPROACHES; VOCABULARY ACQUISITION;

COMPUTATIONAL LINGUISTICS;

EID: 84860503757     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (13)

1. P. F. Brown, S. A. Della Pietra, V. J. Della Pietra, and R. L. Mercer. 1993. The mathematics of statistical machine translation: Parameter estimation. Computational Linguistics, 19(2):263-311.
2. E. Campana, J. Baldridge, J. Dowding, B. A. Hockey, R. Remington, and L. S. Stone. 2001. Using eye movements to determine referents in a spoken dialog system. In Proceedings of PUI'01.
3. A. T. Duchowski. 2002. A breath-first survey of eye tracking applications. Behavior Research methods, Instruments, and Computers, 33(4).
4. Z. M. Griffin and K. Bock. 2000. What the eyes say about speaking. Psychological Science, 11:274-279.
5. M. A. Just and P. A. Carpenter. 1976. Eye fixations and cognitive processes. Cognitive Psychology, 8:441-480.
6. M. Kaur,M. Tremaine, N. Huang, J.Wilder, Z. Gacovski, F. Flippo, and C. S. Mantravadi. 2003. Where is "it"? Event synchronization in gaze-speech input systems. In Proceedings of ICMI'03, pages 151-157.
7. Z. Prasov, J. Y. Chai, and H. Jeong. 2007. Eye gaze for attention prediction in multimodal human-machine conversation. In 2007 Spring Symposium on Interaction Challenges for Artificial Assistants, Palo Alto, California, March.
8. S. Qu and J. Y. Chai. 2007. An exploration of eye gaze in spoken language processing for multimodal conversational interfaces. In NAACL'07, pages 284-291, Rochester, New York, April.
9. D. Roy and A. Pentland. 2002. Learning words from sights and sounds, a computational model. Cognitive Science, 26(1):113-1146.
10. J. M. Siskind. 1995. Grounding language in perception. Artificial Intelligence Review, 8:371-391.
11. K. Tanaka. 1999. A robust selection system using realtime multi-modal user-agent interactions. In Proceedings of IUI'99, pages 105-108.
12. M. K. Tenenhaus, M. Sivey-Knowlton, E. Eberhard, and J. Sedivy. 1995. Integration of visual and linguistic information during spoken language comprehension. Science, 268:1632-1634.
13. C. Yu and D. H. Ballard. 2004. On the integration of grounding language and learning objects. Proceedings of AAAI'04.