Enhancing referential success by tracking hearer gaze

SIGDIAL 2012 - 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue, Proceedings of the Conference

Volumn , Issue , 2012, Pages 30-39

  Koller, Alexander ^a   Garoufi, Konstantina ^a   Staudte, Maria ^b   Crocker, Matthew ^b  

^a UNIVERSITY OF POTSDAM   (Germany)

^b SAARLAND UNIVERSITY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

BASELINE SYSTEMS; DIALOG SYSTEMS; EYE-TRACKING; INTERACTIVE SYSTEM; REFERENCE RESOLUTION;

EID: 84988039570     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (24)

1. Paul Allopenna, James Magnuson, and Michael Tanenhaus. 1998. Tracking the Time Course of Spoken Word Recognition Using Eye Movements: Evidence for Continuous Mapping Models. Journal of Memory and Language, 38:419-439.
2. R.H. Baayen, D.J. Davidson, and D.M. Bates. 2008. Mixed-effects modeling with crossed random effects for subjects and items. Journal of Memory and Language, 59:390-412.
3. Okko Buss and David Schlangen. 2010. Modelling sub-utterance phenomena in spoken dialogue systems. In Aspects of Semantics and Pragmatics of Dialogue.
4. SemDial 2010, 14th Workshop on the Semantics and Pragmatics of Dialogue, pages 33-41.
5. Alexandre Denis. 2010. Generating referring expressions with reference domain theory. In Proceedings of the 6th International Natural Language Generation Conference.
6. Nina Dethlefs, Heriberto Cuayahuitl, Kai-Florian Richter, Elena Andonova, and John Bateman. 2010. Evaluating task success in a dialogue system for indoor navigation. In Aspects of Semantics and Pragmatics of Dialogue. SemDial 2010, 14th Workshop on the Semantics and Pragmatics of Dialogue, pages 143-146.
7. Daniel Dionne, Salvador de la Puente, Carlos León, Pablo Gervás, and Raquel Hervás. 2009. A model for human readable instruction generation using levelbased discourse planning and dynamic inference of attributes. In Proceedings of the 12th European Workshop on Natural Language Generation.
8. Mary Ellen Foster. 2007. Enhancing human-computer interaction with embodied conversational agents. In Proceedings of HCI International 2007.
9. Andrew Gargett, Konstantina Garoufi, Alexander Koller, and Kristina Striegnitz. 2010. The GIVE-2 Corpus of Giving Instructions in Virtual Environments. In Proceedings of the 7th Conference on International Language Resources and Evaluation.
10. Konstantina Garoufi and Alexander Koller. 2011. The Potsdam NLG systems at the GIVE-2.5 Challenge. In Proceedings of the Generation Challenges Session at the 13th European Workshop on Natural Language Generation.
11. Graeme Hirst, Susan McRoy, Peter Heeman, Philip Edmonds, and Diane Horton. 1994. Repairing conversational misunderstandings and non-understandings. Speech Communications, 15:213-229.
12. Ryu Iida, Masaaki Yasuhara, and Takenobu Tokunaga. 2011. Multi-modal reference resolution in situated dialogue by integrating linguistic and extra-linguistic clues. In Proceedings of 5th International Joint Conference on Natural Language Processing.
13. K. Jokinen, H. Furukawa, M. Nishida, and S. Yamamoto. in press. Gaze and turn-taking behaviour in casual conversational interactions. ACM Trans. Interactive Intelligent Systems. Special Issue on Eye Gaze in Intelligent Human-Machine Interaction.
14. Alexander Koller, Kristina Striegnitz, Donna Byron, Justine Cassell, Robert Dale, Johanna Moore, and Jon Oberlander. 2010. The First Challenge on Generating Instructions in Virtual Environments. In Emiel Krahmer and Mariet Theune, editors, Empirical Methods in Natural Language Generation, number 5790 in LNCS, pages 337-361. Springer.
15. Tim Paek and Eric Horvitz. 1999. Uncertainty, utility, and misunderstanding: A decision-theoretic perspective on grounding in conversational systems. In AAAI Fall Symposium on Psychological Models of Communication in Collaborative Systems.
16. David Nicolás Racca, Luciana Benotti, and Pablo Duboue. 2011. The GIVE-2.5 C Generation System. In Proceedings of the Generation Challenges Session at the 13th European Workshop on Natural Language Generation.
17. Marc Schröder and J. Trouvain. 2003. The German Text-to-Speech Synthesis System MARY: A Tool for Research, Development and Teaching. International Journal of Speech Technology, 6:365-377.
18. Gabriel Skantze and David Schlangen. 2009. Incremental dialogue processing in a micro-domain. In Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics.
19. Maria Staudte and Matthew W. Crocker. 2011. Investigating joint attention mechanisms through humanrobot interaction. Cognition, 120(2):268-291.
20. Maria Staudte, Alexander Koller, Konstantina Garoufi, and Matthew W. Crocker. 2012. Using listener gaze to augment speech generation in a virtual 3D environment. In Proceedings of the 34th Annual Conference of the Cognitive Science Society. To appear.
21. Kristina Striegnitz, Alexandre Denis, Andrew Gargett, Konstantina Garoufi, Alexander Koller, and Mariet Theune. 2011. Report on the Second Second Challenge on Generating Instructions in Virtual Environments (GIVE-2.5). In Proceedings of the Generation Challenges Session at the 13th European Workshop on Natural Language Generation.
22. Michael K. Tanenhaus, Michael J. Spivey-Knowlton, Kathleen M. Eberhard, and Julie C. Sedivy. 1995. Integration of visual and linguistic information in spoken language comprehension. Science, 268:1632-1634.
23. David Traum. 1994. A computational theory of grounding in natural language conversation. Ph.D. thesis, University of Rochester.
24. Michael Young, Johanna Moore, and Martha Pollack. 1994. Towards a principled representation for discourse plans. In Proceedings of the Sixteenth Annual Meeting of the Cognitive Science Society.