Learning when to point: A data-driven approach

COLING 2014 - 25th International Conference on Computational Linguistics, Proceedings of COLING 2014: Technical Papers

Volumn , Issue , 2014, Pages 2007-2017

  Gatt, Albert ^a   Paggio, Patrizia ^a,b  

^a UNIVERSITY OF MALTA   (Malta)

^b UNIVERSITY OF COPENHAGEN   (Denmark)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; LEARNING SYSTEMS; LINGUISTICS;

DATA-DRIVEN APPROACH; DISCOURSE CONTEXT; MULTI-MODAL; POINTING GESTURES; SPATIAL INFORMATIONS; VISUAL PROPERTIES;

COMPUTATIONAL LINGUISTICS;

EID: 84959872380     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (20)

1. A. Anderson, M. Bader, E. Bard, E. Boyle, G. M. Doherty, S. Garrod, S. Isard, J. Kowtko, J. McAllister, J. Miller, C. Sotillo, H. S. Thompson, and R. Weinert. 1991. The HCRC Map Task corpus. Language and Speech, 34:351-366.
2. E. Andŕe and T. Rist. 1996. Coping with temporal constraints in multimedia presentation planning. In Proceedings of the 13th National Conference on Artificial Intelligence (AAAI'96).
3. A. Bangerter. 2004. Using pointing and describing to achieve joint focus of attention in dialogue. Psychological Science, 15(6):415-419.
4. R.J. Beun and A. Cremers. 1998. Object reference in a shared domain of conversation. Pragmatics and Cognition, 6(1-2):121-152.
5. R. Dale and E. Reiter. 1995. Computational interpretation of the Gricean maxims in the generation of referring expressions. Cognitive Science, 19(8):233-263.
6. R. Dale. 1989. Cooking up referring expressions. In Proceedings of the 27th annual meeting of the Association for Computational Linguistics (ACL'89), pages 68-75.
7. J.P. de Ruiter, A. Bangerter, and P. Dings. 2012. The interplay between gesture and speech in the production of referring expressions: Investigating the tradeoff hypothesis. Topics in Cognitive Science, 4:232-248.
8. N.J. Enfield. 2009. The Anatomy of Meaning: Speech, Gesture and Composite Utterances. Cambridge University Press, Cambridge.
9. A. Gatt and P. Paggio. 2013. What and where: An empirical investigation of pointing gestures and descriptions in multimodal referring actions. In Proceedings of the 14th European Workshop on Natural Language Generation (ENLG'13).
10. S. Kita and A. Ö zyürek. 2003. What does cross-linguistic variation in semantic coordination of speech and gesture reveal?: Evidence for an interface representation of spatial thinking and speaking. Journal of Memory and Language, 48:16-32.
11. S. Kopp, K. Bergmann, and I.Wachsmuth. 2008. Multimodal communication from multimodal thinking: Towards an integrated model of speech and gesture production. International Journal of Semantic Computing, 2(1):115- 136.
12. E. Krahmer and K. van Deemter. 2012. Computational generation of referring expressions: A survey. Computational Linguistics, 38(1):173-218.
13. E. Krahmer, S. van Erk, and A. Verleg. 2003. Graph-based generation of referring expressions. Computational Linguistics, 29(1):53-72.
14. A. Kranstedt and I. Wachsmuth. 2005. Incremental generation of multimodal deixis referring to objects. In Proceedings of the 10th European Workshop on Natural Language Generation (ENLG'05).
15. D. McNeill and S.D. Duncan. 2000. Growth points in thinking for speaking. In D. McNeill, editor, Language and Gesture, pages 141-161. Cambridge University Press.
16. D. McNeill. 1985. So you think gestures are nonverbal? Psychological Review, 92(3):350-371.
17. P. Piwek. 2007. Modality choice for generation of referring acts: Pointing vs describing. In Proceedings of the Workshop on Multimodal Output Generation (MOG'07)., pages 129-139.
18. I. van der Sluis and E. Krahmer. 2007. Generating multimodal referring expressions. Discourse Processes, 44(3):145-174.
19. I. van der Sluis, P. Piwek, A. Gatt, and A. Bangerter. 2008. Towards a balanced corpus of multimodal referring expressions in dialogue. In Proceedings of the Symposium on Multimodal Output Generation (MOG'08).
20. I.H. Witten and E. Frank. 2005. Data Mining: Practical machine learning tools and techniques. Morgan Kaufmann, San Francisco, second edition.