Generating expressions that refer to visible objects

NAACL HLT 2013 - 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Main Conference

Volumn , Issue , 2013, Pages 1174-1184

  Mitchell, Margaret ^a   Van Deemter, Kees ^b   Reiter, Ehud ^b  

^a Johns Hopkins HLTCOE   (United States)

^b UNIVERSITY OF ABERDEEN   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EVALUATION METHODS; GENERATING REFERRING EXPRESSIONS; GRAPH-BASED ALGORITHMS; INCREMENTAL ALGORITHM; NON DETERMINISM; NOVEL ALGORITHM; PROPERTY; REFERRING EXPRESSIONS; TWO DOMAINS;

GRAPHIC METHODS;

EID: 84908171705     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (55)

1. Carlos Areces, Alexander Koller, and Kristina Striegnitz. 2008. Referring expressions as formulas of description logic. Proceedings of the 5th International Natural Language Generation Conference (INLG 2008), pages 42-29.
2. Ellen Gurman Bard, Robin Hill, Manabu Arai, and Mary Ellen Foster. 2009. Accessibility and attention in situated dialogue: Roles and regulations. Proceedings of the Workshop on the Production of Referring Expressions (PRE-CogSci 2009).
3. Anja Belz and Albert Gatt. 2008. Intrinsic vs. extrinsic evaluation measures for referring expression generation. Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics (ACL 2008), pages 197-200.
4. Alexander C. Berg, Tamara L. Berg, Hal Daumé III, Jesse Dodge, Amit Goyal, Xufeng Han, Alyssa Mensch, Margaret Mitchell, Karl Stratos, and Kota Yamaguchi. 2011. An exploration of how to learn from visually descriptive text. JHU-CLSP Summer Workshop Whitepaper.
5. Steven Bird, Edward Loper, and Ewan Klein. 2009. Natural Language Processing with Python. O'Reilly Media Inc., Sebastopol, CA.
6. Sarah Brown-Schmidt and Michael K. Tanenhaus. 2006. Watching the eyes when talking about size: An investigation of message formulation and utterance planning. Journal of Memory and Language, 54:592-609.
7. Herbert H. Clark and Gregory L. Murphy. 1982. Audience Design in Meaning and Reference. In J. F. LeNy and W. Kintsch, editors, Language and Comprehension, volume 9 of Advances in Psychology, pages 287-299. North-Holland, Amsterdam.
8. Herbert H. Clark, Robert Schreuder, and Samuel Buttrick. 1983. Common ground and the understanding of demonstrative reference. Journal of Verbal Learning and Verbal Behavior, 22:245-258.
9. Robert Dale and Ehud Reiter. 1995. Computational interpretations of the gricean maxims in the generation of referring expressions. Cognitive Science, 19:233-263.
10. Robert Dale. 1989. Cooking up referring expressions. Proceedings of the 27th Annual Meeting of the Association for Computational Linguistics (ACL 1989).
11. P. E. Engelhardt, K. Bailey, and F. Ferreira. 2006. Do speakers and listeners observe the gricean maxim of quantity? Journal of Memory and Language, 54:554-573.
12. Fang Fang, Huseyin Boyaci, Daniel Kersten, and Scott O. Murray. 2008. Attention-dependent representation of a size illusion in human V1. Current biology, 18(21):1707-1712.
13. Ali Farhadi, Ian Endres, Derek Hoiem, and David Forsyth. 2009. Describing objects by their attributes. Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2009).
14. V. Ferrari and A. Zisserman. 2007. Learning visual attributes. Advances in Neural Information Processing Systems (NIPS 2007).
15. William Ford and David Olson. 1975. The elaboration of the noun phrase in children's description of objects. The Journal of Experimental Child Psychology, 19:371-382.
16. David A. Forsyth. 2011. Personal communication. Video clip of communication available from: http://vimeo. com/40553150. At 1:06:46.
17. T. M. Gann and D. J. Barr. 2013. Speaking from experience: Audience design as expert performance. Language and Cognitive Processes. In press.
18. Albert Gatt and Anja Belz. 2008. Attribute selection for referring expression generation: New algorithms and evaluation methods. Proceedings of 5th International Natural Language Generation Conference (INLG 2008), pages 50-58.
19. Albert Gatt, Anja Belz, and Eric Kow. 2009. The TUNA REG challenge 2009: Overview and evaluation results. Proceedings of the 12th European Workshop on Natural Language Generation (ENLG 2009), pages 174-182.
20. Mark Hall, Eibe Frank, Geoffrey Holmes, Bernhard Pfahringer, Peter Reutemann, and Ian H. Witten. 2009. The weka data mining software: An update. SIGKDD Explorations, 11(1).
21. William S. Horton and Boaz Keysar. 1996. When do speakers take into account common ground? Cognition, 59(1):91-117.
22. Laurent Itti and Christof Koch. 2001. Computational modelling of visual attention. Nature Reviews Neuroscience, 2:194-203.
23. John Kelleher and Fintan Costello. 2009. Applying computational models of spatial prepositions to visually situated dialog. Computational Linguistics, 35(2):271-306.
24. John Kelleher, Fintan Costello, and Josef van Genabith. 2005. Dynamically structuring, updating and interrelating representations of visual and linguistic discourse context. Artificial Intelligence, 167:62-102.
25. Boaz Keysar and Anne S. Henly. 2002. Speakers' overestimation of their effectiveness. Psychological Science, 13(3):207-212.
26. Ruud Koolen, Martijn Goudbeek, and Emiel Krahmer. 2011. Effects of scene variation on referential overspecification. Proceedings of the 33rd Annual Meeting of the Cognitive Science Society (CogSci 2011).
27. Ruud Koolen, Emiel Krahmer, and Mariët Theune. 2012. Learning preferences for referring expression generation: Effects of domain, language and algorithm. Proceedings of the 7th International Workshop on Natural Language Generation (INLG 2012).
28. Emiel Krahmer and Mariët Theune. 2002. Efficient context-sensitive generation of referring expressions. Information Sharing: Reference and Presupposition in Language Generation and Interpretation, 143:223-263.
29. Emiel Krahmer and Kees van Deemter. 2012. Computational generation of referring expressions: A survey. Computational Linguistics, 38:173-218.
30. Emiel Krahmer, Sebastiaan van Erk, and Andŕe Verleg. 2003. Graph-based generation of referring expressions. Computational Linguistics, 29(1):53-72.
31. H. W. Kuhn. 1955. The hungarian method for the assignment problem. Naval Research Logistics Quarterly, 2:83-97.
32. Margaret Mitchell, Kees van Deemter, and Ehud Reiter. 2011. Two approaches for generating size modifiers. Proceedings of the 13th European Workshop on Natural Language Generation (ENLG 2011).
33. James Munkres. 1957. Algorithms for the assignment and transportation problems. Journal of Industrial and Applied Mathematics, 5(1):32-38.
34. Scott O. Murray, Huseyin Boyaci, and Daniel Kersten. 2006. The representation of perceived angular size in human primary visual cortex. Nature Neuroscience, 9(3):429-434.
35. David R. Olson. 1970. Language and thought: Aspects of a cognitive theory of semantics. Psychological Review, 77:257-273.
36. Thomas Pechmann. 1989. Incremental speech production and referential overspecification. Linguistics, 27:89-110.
37. Ehud Reiter and Anja Belz. 2009. An investigation into the validity of some metrics for automatically evaluating natural language generation systems. Computational Linguistics, 35(4):529-558.
38. Ehud Reiter and Robert Dale. 1992. A fast algorithm for the generation of referring expressions. Proceedings of the 14th International Conference on Computational Linguistics (COLING 1992), 1:232-238.
39. Ehud Reiter and Somayajulu Sripada. 2002. Human variation and lexical choice. Computational Linguistics, 28:545-553.
40. D. Samuel Schwarzkopf, Chen Song, and Geraint Rees. 2010. The surface area of human V1 predicts the subjective experience of object size. Nature Neuroscience, 14(1):28-30.
41. J. R. Searle. 1969. Speech Acts: An Essay in the Philosophy of Language. Cambridge University Press, Cambridge.
42. Susan Sonnenschein. 1985. The development of referential communication skills: Some situations in which speakers give redundant messages. Journal of Psycholinguistic Research, 14:489-508.
43. Mariët Theune, Ruud Koolen, Emiel Krahmer, and Sander Wubben. 2011. Does size matter-how much data is required to train a REG algorithm? Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics (ACL 2011).
44. Anne M. Treisman and Garry Gelade. 1980. A feature integration theory of attention. Cognitive Psychology, 12:97-13.
45. Anne Treisman. 1985. Preattentive processing in vision. Computer Vision, Graphics, and Image Processing, 31:156177.
46. L. G. Ungerleider and M. Mishkin. 1982. Two Cortical Visual Systems. In D. J. Ingle, M. Goodale, and R. J. W. Mansfield, editors, Analysis of Visual Behaviour, chapter 18, pages 549-586. The MIT Press.
47. Kees van Deemter, Ielka van der Sluis, and Albert Gatt. 2006. Building a semantically transparent corpus for the generation of referring expressions. Proceedings of the 4th International Conference on Natural Language Generation (INLG 2006).
48. Kees van Deemter, Albert Gatt, Ielka van der Sluis, and Richard Power. 2012a. Generation of referring expressions: Assessing the incremental algorithm. Cognitive Science, 36(5):799-836.
49. Kees van Deemter, Emiel Krahmer, Roger van Gompel, and Albert Gatt. 2012b. Towards a computational psycholinguistics of reference production. TopiCS: Production of Referring Expressions-Bridging the Gap between Computational and Empirical Approaches to Reference.
50. Roger P. G. van Gompel, Albert Gatt, Emiel Krahmer, and Kees van Deemter. 2012. PRO: A computational model of referential overspecification. Architectures and Mechanisms for Language Processing (AMLaP 2012).
51. Jette Viethen and Robert Dale. 2008. The use of spatial relations in referring expression generation. Proceedings of the 5th International Natural Language Generation Conference (INLG 2008), pages 59-67.
52. Jette Viethen and Robert Dale. 2010. Speaker-dependent variation in content selection for referring expression generation. Proceedings of the 8th Australasian Language Technology Workshop (ALTW 2010), pages 81-89.
53. Jette Viethen, Robert Dale, Emiel Krahmer, Mariët Theune, and Pascal Touset. 2008. Controlling redundancy in referring expressions. Proceedings of the 6th International Conference on Language Resources and Evaluation (LREC 2008).
54. Jette Viethen, Martijn Goudbeek, and Emiel Krahmer. 2012. The impact of colour difference and coloure codability on reference production. Proceedings of the 34th Annual Meeting of the Cognitive Science Society (CogSci 2012).
55. G. J. Whitehurst. 1976. The development of communication: Changes with age and modeling. Child Development, 47:473-482.