What and where: An empirical investigation of pointing gestures and descriptions in multimodal referring actions

ENLG 2013 - 14th European Workshop on Natural Language Generation, Proceedings

Volumn , Issue , 2013, Pages 82-91

  Gatt, Albert ^a   Paggio, Patrizia ^a  

^a UNIVERSITY OF MALTA   (Malta)

Author keywords

[No Author keywords available]

Indexed keywords

NATURAL LANGUAGE PROCESSING SYSTEMS;

EMPIRICAL INVESTIGATION; MACHINE LEARNING TECHNIQUES; MULTI-MODAL; POINTING GESTURES; REFERRING EXPRESSIONS;

LEARNING SYSTEMS;

EID: 84943549571     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (31)

1. A. Anderson, M. Bader, E. Bard, E. Boyle, G. M. Doherty, S. Garrod, S. Isard, J. Kowtko, J. McAllister, J. Miller, C. Sotillo, H. S. Thompson, and R. Weinert. 1991. The HCRC Map Task corpus. Language and Speech, 34:351–366.
2. E. André and T. Rist. 1996. Coping with temporal constraints in multimedia presentation planning. In Proceedings of the 13th National Conference on Artificial Intelligence (AAAI’96).
3. A. Bangerter. 2004. Using pointing and describing to achieve joint focus of attention in dialogue. Psychological Science, 15(6):415–419.
4. K. Bergmann and S. Kopp. 2009. GNetIc - using bayesian decision networks for iconic gesture generation. In A. Nijholt and H. Vilhjálmsson, editors, Proceedings of the 9th International Conference on Intelligent Virtual Agents (LNAI 5773), pages 76–89. Springer.
5. R.J. Beun and A. Cremers. 1998. Object reference in a shared domain of conversation. Pragmatics and Cognition, 6(1-2):121–152.
6. B. Bohnet. 2008. The fingerprint of human referring expressions and their surface realization with graph transducers. In Proceedings of the 5th International Conference on Natural Language Generation (INLG’08).
7. C. Callaway and J. C. Lester. 2002. Pronominalization in generated discourse and dialogue. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (ACL’02).
8. R. Dale and E. Reiter. 1995. Computational interpretation of the Gricean maxims in the generation of referring expressions. Cognitive Science, 19(8):233–263.
9. R. Dale and J. Viethen. 2010. Attribute-centric referring expression generation. In E. Krahmer and M. Theune, editors, Empirical Methods in Natural Language Generation, volume 5790 of LNAI. Springer, Berlin and Heidelberg.
10. R. Dale. 1989. Cooking up referring expressions. In Proceedings of the 27th annual meeting of the Association for Computational Linguistics (ACL’89), pages 68–75.
11. J.P. de Ruiter, A. Bangerter, and P. Dings. 2012. The interplay between gesture and speech in the production of referring expressions: Investigating the tradeoff hypothesis. Topics in Cognitive Science, 4:232–248.
12. J.P. de Ruiter. 2000. The production of gesture and speech. In D. McNeill, editor, Language and Gesture, pages 284–311. Cambridge University Press.
13. G. Di Fabbrizio, A. J. Stent, and S. Bangalore. 2008. Trainable speaker-based referring expression generation. In Proceedings of the 12th Conference on Computational Natural Language Learning (CONLL’08), pages 151–158.
14. A. Gatt and A. Belz. 2010. Introducing shared task evaluation to nlg: The TUNA shared task evaluation challenges. In E. Krahmer and M. Theune, editors, Empirical Methods in Natural Language Generation. Springer.
15. S. Kita and A. Özyürek. 2003. What does cross-linguistic variation in semantic coordination of speech and gesture reveal?: Evidence for an interface representation of spatial thinking and speaking. Journal of Memory and Language, 48:16–32.
16. S. Kopp, K. Bergmann, and I. Wachsmuth. 2008. Multimodal communication from multimodal thinking: Towards an integrated model of speech and gesture production. International Journal of Semantic Computing, 2(1):115–136.
17. E. Krahmer and M. Theune. 2002. Efficient context-sensitive generation of referring expressions. In K. van Deemter and R. Kibble, editors, Information Sharing: Reference and Presupposition in Language Generation and Interpretation. CSLI Publications, Stanford.
18. E. Krahmer and K. van Deemter. 2012. Computational generation of referring expressions: A survey. Computational Linguistics, 38(1):173–218.
19. E. Krahmer, S. van Erk, and A. Verleg. 2003. Graph-based generation of referring expressions. Computational Linguistics, 29(1):53–72.
20. A. Kranstedt and I. Wachsmuth. 2005. Incremental generation of multimodal deixis referring to objects. In Proceedings of the 10th European Workshop on Natural Language Generation (ENLG’05).
21. B. Landau and R. Jackendoff. 1993. what and where in spatial language and spatial cognition. Behavioral and Brain Sciences, 16:217–238.
22. M. Louwerse and A. Bangerter. 2010. Effects of ambiguous gestures and language on the time-course of reference resolution. Cognitive Science, 34:1517–1529.
23. K.F. McCoy and M. Strube. 1999. Generating anaphoric expressions: Pronoun or definite description? In Proceedings of the Workshop on the Relation of Discourse/Dialogue Structure and Reference.
24. D. McNeill and S.D. Duncan. 2000. Growth points in thinking for speaking. In D. McNeill, editor, Language and Gesture, pages 141–161. Cambridge University Press.
25. D. McNeill. 1985. So you think gestures are nonverbal? Psychological Review, 92(3):350–371.
26. M. Neff, M. Kipp, I. Albrecht, and H.-P. Seidel. 2008. Gesture modeling and animation based on a probabilistic recreation of speaker style. ACM Transactions on Graphics, 27(1):1–24.
27. P. Piwek, R-J. Beun, and A. Cremers. 2007. proximal and distal in language and cognition: Evidence from deictic demonstratives in dutch. Journal of Pragmatics, 40(4):694–718.
28. P. Piwek. 2007. Modality choice for generation of referring acts: Pointing vs describing. In Proceedings of the Workshop on Multimodal Output Generation (MOG’07)., pages 129–139.
29. I. van der Sluis and E. Krahmer. 2007. Generating multimodal referring expressions. Discourse Processes, 44(3):145–174.
30. I. van der Sluis, P. Piwek, A. Gatt, and A. Bangerter. 2008. Towards a balanced corpus of multimodal referring expressions in dialogue. In Proceedings of the Symposium on Multimodal Output Generation (MOG’08).
31. I.H. Witten and E. Frank. 2005. Data Mining: Practical machine learning tools and techniques. Morgan Kaufmann, San Francisco, second edition.