From the virtual to the real world: Referring to objects in real-world spatial scenes

Conference Proceedings - EMNLP 2015: Conference on Empirical Methods in Natural Language Processing

Volumn , Issue , 2015, Pages 1936-1942

  Gkatzia, Dimitra ^a   Rieser, Verena ^a   Bartie, Phil ^b   Mackaness, William ^c  

^a HERIOT WATT UNIVERSITY   (United Kingdom)

^b UNIVERSITY OF STIRLING   (United Kingdom)

^c UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

NAVIGATION SYSTEMS; OBJECT RECOGNITION;

CONTROLLED ENVIRONMENT; IMAGE COMPLEXITY; NATURAL LANGUAGE GENERATION SYSTEMS; REAL-WORLD; REAL-WORLD SCENARIO; REFERRING EXPRESSIONS; SPATIAL REFERENCE; VIRTUAL WORLDS;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 84954299658     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.18653/v1/d15-1224     Document Type: Conference Paper

References (25)

1. Donna Byron, Alexander Koller, Kristina Striegnitz, Justine Cassell, Robert Dale, Johanna Moore, and Jon Oberlander. 2009. Report on the First NLG Challenge on Generating Instructions in Virtual Environment (GIVE). In 12th European Workshop in Natural Language Generation (ENLG).
2. Alasdair D. F. Clarke, Micha Eisner, and Hannah Rohde. 2013. Where's wally: The influence of visual salience on referring expression generation. Frontiers in Psychology, 4 (329).
3. Giuseppe Di Fabbrizio, Amanda Stent, and Srinivas Bangalore. 2008. Referring expression generation using speaker-based attribute selection and trainable realization. In 5th International Natural Language Generation Conference (INLG).
4. Yansong Feng and Mirella Lapata. 2013. Automatic caption generation for news images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(4):797-812.
5. Nicholas FitzGerald, Yoan Artzi, and Luke Zettlemoyer. 2013. Learning distributions over logical forms for referring expression generation. In Conference on Empirical Methods in Natural Language Processing (EMNLP).
6. Andrew Gargett, Konstantina Garoufi, Alexander Koller, and Kristina Striegnitz. 2010. The GIVE-2 Corpus of Giving Instructions in Virtual Environments. In 7th International Conference on Language Resources and Evaluation (LREC).
7. Albert Gatt, Anja Belz, and Eric Kow. 2009. The TUNA-REG Challenge 2009: Overview and Evaluation Results. In 12th European Workshop in Natural Language Generation (ENLG).
8. Albert Gatt, Emiel Krahmer, and Kees van Deemter. 2014. Models and empirical data for the production of referring expressions. Language, Cognition and Neuroscience, 29(8):899-911.
9. Srinivasan Janarthanam, Xingkun Liu, and Oliver Lemon. 2012. A web-based evaluation framework for spatial instruction-giving systems. In Proc. of Annual Meeting of the Association for Computational Linguistics (ACL).
10. Srinivasan Janarthenam, Helen Hastie, Oliver Lemon, and Xingkun Liu. 2011. "the day after the day after tomorrow?" a machine learning approach to adaptive temporal expression generation: training and evaluation with real users. In 12th Annual Meeting of the Special Interest Group on Discourse and Dialogue.
11. Rong Jin and Luo Si. 2004. A study of methods for normalizing user ratings in collaborative filtering. In Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR'04, pages 568-569, New York, NY, USA. ACM.
12. Anil Kandangath and Xiaoyuan Tu. 2015. Humanized navigation instructions for mapping applications. US Patent, 04.
13. Sahar Kazemzadeh, Vicente Ordonez, Mark Matten, and Tamara Berg. 2014. ReferltGame: Referring to Objects in Photographs of Natural Scenes. In Conference on Empirical Methods in Natural Language Processing (EMNLP).
14. Emiel Krahmer and Kees van Deemter. 2011. Computational generation of referring expressions: A survey. Computational Linguistics, 38(1):173-218, 2015/02/20.
15. Christopher Manning, Mihai Surdeanu, John Finkel, Jenny Bethard, and David McClosky. 2014. The Stanford CoreNLP Natural Language Processing Toolkit. In 52nd Annual Meeting of the Association for Computational Linguistics (ACL): System Demonstrations.
16. Margaret Mitchell, Kees van Deemter, and Ehud Reiter. 2010. Natural reference to objects in a visual domain. In 6th International Natural Language Generation Conference (INLG).
17. Margaret Mitchell, Xufeng Han, Jesse Dodge, Alyssa Mensch, Amit Goyal, Alex Berg, Kota Yamaguchi, Tamara Berg, Karl Stratos, and Hal Daumé, III. 2012. Midge: Generating image descriptions from computer vision detections. In Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics, EACL'12, pages 747-756.
18. Margaret Mitchell, Ehud Reiter, and Kees van Deemter. 2013a. Typicality and object reference. In Cognitive Science (CogSci).
19. Margaret Mitchell, Kees van Deemter, and Ehud Reiter. 2013b. Generating expressions that refer to visible objects. In North American Chapter of the Association for Computational Linguistics (NAACL).
20. Paul Resnick, Neophytos Iacovou, Mitesh Suchak, Peter Bergstorm, and John Riedl. 1994. GroupLens: an open architecture for collaborative filtering of netnews. In ACM Conference on Computer Supported Cooperative Work (CSCW).
21. Verena Rieser, Oliver Lemon, and Simon Keizer. 2014. Natural language generation as incremental planning under uncertainty: Adaptive information presentation for statistical dialogue systems. Audio, Speech, and Language Processing, IEEE/ACM Transactions on, 22(5):979-994, May.
22. Kees van Deemter, Ielka van der Sluis, and Albert Gatt. 2006. Building a semantically transparent corpus for the generation of referring expressions. In 4th International Natutral Language Generation Conference.
23. Jette Viethen and Robert Dale. 2008. The use of spatial relations in referring expression generation. In 5th International Natural Language Generation Conference (INLG).
24. Yezhou Yang, Ching Lik Teo, Hal Daumé, III, and Yannis Aloimonos. 2011. Corpus-guided sentence generation of natural images. In Conference on Empirical Methods in Natural Language Processing (EMNLP).
25. ∗SEM 2014).