Utilizing visual attention for cross-modal coreference interpretation

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 3554 LNAI, Issue , 2005, Pages 83-96

  Byron, Donna ^a   Mampilly, Thomas ^a   Sharma, Vinay ^a   Xu, Tianfang ^a  

^a The Ohio State University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER GRAPHICS; DATA REDUCTION; INFORMATION RETRIEVAL; LINGUISTICS; ROBOTICS; VIRTUAL REALITY;

DIALOG; EXOPHORS; GRAPHICAL AVATARS; ROBOTIC COLLABORATORS;

VISUAL COMMUNICATION;

EID: 26944498636     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/11508373_7     Document Type: Conference Paper

References (28)

1. thAnnual Meeting of the Association for Computational Linguistics (ACL '96), pages 263-269, 1996.
2. Susan E. Brennan, Marilyn W. Friedman, and Carl J. Pollard. A centering approach to pronouns. In Proceedings of ACL '87, pages 155-162, 1987.
3. Donna K. Byron. Improving discourse management in TRIPS-98. In Proceedings of the 6th European Conference on Speech Communication and Technology (Eurospeech-99), 1999.
4. th Annual Meeting of the Association for Computational Linguistics (ACL '02), pages 80-87, 2002.
5. E. Campana, J. Baldridge, J. Dowding, B. A. Hockey, R. W. Remington, and L. S. Stone. Using eye movements to determine referents in a spoken dialogue system. In Workshop on Perceptive User Interfaces.
6. S. E. Christ, C. S. McCrae, and R. A. Abrama. Inhibition of return in static and dynamic displays. Psychonomic Bulletin and Review, 9(1):80-85, 2002.
7. Miriam Eckert and Michael Strube. Dialogue acts, synchronising units and anaphora resolution. Journal of Semantics, 17(l):51-89, 2000.
8. H. E. Egeth, R. A. Virzi, and H. Garbart. Searching for conjunctively defined targets. J, Exp, Psychol:Human Perception and Performance, 10:32-39, 1984,
9. Malte Gabsdil, Alexander Koller, and Kristina Striegnitz, Natural Language and Inference in a Computer Game, In Proceedings of the 19th International Conference on Computational Linguistics (COLING02), Taipei, 2002,
10. G. Gillund and R. M. Shiffrin. A retrieval model for both recogintion and recall, Psychological Review, 91:1-67, 1984.
11. Barbara J. Grosz, Aravind K. Joshi, and Scott Weinstein. Centering: A framework for modeling the local coherence of discourse. Computational Linguistics, 21(2):203-226, 1995.
12. rd Annual Meeting of the Association for Computational Linguistics (ACL '85), pages 218-227, 1985.
13. P. Heeman and J. Allen. The Trains spoken dialog corpus. CD-ROM, Linguistics Data Consortium, 1995.
14. J. E. Hoffrnan. A two-stage model for visual search. Perception and Psychophysics, 25:319-327, 1979.
15. th Annual Meeting of the Association for Computational Linguistics (ACL '02), pages 376-383, 2002.
16. Ed Kaiser, Alex Olwal, David McGee, Hrvoje Benko, Andrea Corradini, Xiaoguang Li, Phil Cohen, and Steven Feiner. Mutual disambiguation of 3d multimodal interaction in augmented and virtual reality. In Proceedings of the 5th international conference on Multimodal interfaces (ICMI 2003), Vancouver, B.C., Canada, November 2003.
17. Andrew Kehler. Cognitive status and form of reference in multimodal humancomputer interaction. In Proceedings of the 17th National Conference on Artificial Intelligence (AAAI-2000), Austin, Texas, July 2000.
18. J. Kelleher and J. van Genabith. Exploiting visual salience for the generation of referring expressions. In Proceedings of the 17th International FLAIRS conference, 2004.
19. John Kelleher and Josef van Genabith. Dynamically updating and interrelating representations of visual and linguistic discourse, submitted to Artificial Intelligence.
20. John Kelleher and Josef van Genabith. Visual salience and reference resolution in simulated 3-d environments. Artificial Intelligence Review, 21(3):253-267, 2004.
21. Pia Knoeferle, Matthew W. Crocker, Christoph Scheepers, and Martin J. Pickering. The influence of the immediate visual context on incremental thematic roleassignment: Evidence from eye-movements in depicted events. Cognition, 2004.
22. Scheutz Matthias, Eberhard Kathleen, and Andronache Virgil. A real-time robotic model of human reference resolution using visual constraints. Connection Science, 2004.
23. U. Neisser. Cognitive Psychology. Appleton, Century, Crofts, New York, 1967.
24. Candace L. Sidner. Focusing in the comprehension of definite anaphora. In M. Brady and R. Berwick, editors, Computational Models of Discourse, pages 363-394. 1983.
25. M.K. Tanenhaus, M.J. Spivey-Knowlton, K.M. Eberhard, and J.E. Sedivy. Integration of visual and linguistic information in spoken language comprehension. Science, 268:1632-1634, 1995.
26. Joel R. Tetreault. Empirical Evaluations of Pronoun Resolution. PhD thesis, University of Rochester, 2004.
27. Marilyn A. Walker. Limited attention and discourse structure. Computational Linguistics, 22(2):255-264, 1996.
28. Terry Winograd. Understanding natural language. New York: Academic Press, 1972.