Training an adaptive dialogue policy for interactive learning of visually grounded word meanings

SIGDIAL 2016 - 17th Annual Meeting of the Special Interest Group on Discourse and Dialogue, Proceedings of the Conference

Volumn , Issue , 2016, Pages 339-349

  Yu, Yanchao ^a   Eshghi, Arash ^a   Lemon, Oliver ^a  

^a HERIOT WATT UNIVERSITY   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ECONOMIC AND SOCIAL EFFECTS; EDUCATIONAL TECHNOLOGY; NATURAL LANGUAGE PROCESSING SYSTEMS; SEMANTICS; SPEECH PROCESSING; SYNTACTICS;

DIALOGUE SYSTEMS; DYNAMIC SYNTAXES; DYNAMIC TYPE; INTERACTIVE LEARNING; LEARNING EFFORTS; LEARNING RATES; MULTI-MODAL; SEMANTIC PARSING; TYPE THEORY; WORD MEANING;

LEARNING SYSTEMS;

EID: 84992500924     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (34)

1. Elia Bruni, Nam-Khanh Tran, and Marco Baroni. 2014. Multimodal distributional semantics. J. Artif. Intell. Res.(JAIR), 49(1–47).
2. Ronnie Cann, Ruth Kempson, and Lutz Marten. 2005. The Dynamics of Language. Elsevier, Oxford.
3. Robin Cooper. 2005. Records and record types in semantic theory. Journal of Logic and Computation, 15(2):99–112.
4. Simon Dobnik, Robin Cooper, and Staffan Larsson. 2012. Modelling language, action, and perception in type theory with records. In Proceedings of the 7th International Workshop on Constraint Solving and Language Processing (CSLPÄô12), pages 51–63.
5. Arash Eshghi and Oliver Lemon. 2014. How domain-general can we be? learning incremental dialogue systems without dialogue acts. In Proceedings of SemDial.
6. Arash Eshghi, Julian Hough, Matthew Purver, Ruth Kempson, and Eleni Gregoromichelaki. 2012. Conversational interactions: Capturing dialogue dynamics. In S. Larsson and L. Borin, editors, From Quantification to Conversation: Festschrift for Robin Cooper on the occasion of his 65th birthday, volume 19 of Tributes, pages 325–349. College Publications, London.
7. A. Eshghi, C. Howes, E. Gregoromichelaki, J. Hough, and M. Purver. 2015. Feedback in conversation as incremental semantic update. In Proceedings of the 11th International Conference on Computational Semantics (IWCS 2015), London, UK. Association for Computational Linguisitics.
8. Ali Farhadi, Ian Endres, Derek Hoiem, and David Forsyth. 2009. Describing objects by their attributes. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR.
9. Shen Furao and Osamu Hasegawa. 2006. An incremental network for on-line unsupervised classification and topology learning. Neural Networks, 19(1):90–106.
10. Jonathan Ginzburg. 2012. The Interactive Stance: Meaning for Conversation. Oxford University Press.
11. Julian Hough and Matthew Purver. 2014. Probabilistic type theory for incremental dialogue processing. In Proceedings of the EACL 2014 Workshop on Type Theory and Natural Language Semantics (TTNLS), pages 80–88, Gothenburg, Sweden, April. Association for Computational Linguistics.
12. Andrej Karpathy and Li Fei-Fei. 2014. Deep visual-semantic alignments for generating image descriptions. CoRR, abs/1412.2306.
13. Andrej Karpathy and Fei-Fei Li. 2015. Deep visual-semantic alignments for generating image descriptions. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015, Boston, MA, USA, June 7-12, 2015, pages 3128–3137.
14. Ruth Kempson, Wilfried Meyer-Viol, and Dov Gabbay. 2001. Dynamic Syntax: The Flow of Language Understanding. Blackwell.
15. Casey Kennington and David Schlangen. 2015. Simple learning and compositional application of perceptually grounded word meanings for incremental reference resolution. In Proceedings of the Conference for the Association for Computational Linguistics (ACL-IJCNLP). Association for Computational Linguistics.
16. Thomas Kollar, Jayant Krishnamurthy, and Grant Strimel. 2013. Toward interactive grounded language acqusition. In Robotics: Science and Systems.
17. Xiangnan Kong, Michael K. Ng, and Zhi-Hua Zhou. 2013. Transductive multilabel learning via label set propagation. IEEE Trans. Knowl. Data Eng., 25(3):704–719.
18. Matej Kristan and Ales Leonardis. 2014. Online discriminative kernel density estimator with gaussian kernels. IEEE Trans. Cybernetics, 44(3):355–365.
19. Christoph H. Lampert, Hannes Nickisch, and Stefan Harmeling. 2014. Attribute-based classification for zero-shot visual object categorization. IEEE Trans. Pattern Anal. Mach. Intell., 36(3):453–465.
20. Staffan Larsson. 2013. Formal semantics for perceptual classification. Journal of logic and computation.
21. Cynthia Matuszek, Liefeng Bo, Luke Zettlemoyer, and Dieter Fox. 2014. Learning from unscripted deictic gesture and language for human-robot interactions. In Proceedings of the Twenty-Eighth AAAI Conference on Artificial Intelligence, July 27-31, 2014, Québec City, Québec, Canada., pages 2556–2563.
22. Deb Roy. 2002. A trainable visually-grounded spoken language generation system. In Proceedings of the International Conference of Spoken Language Processing.
23. Carina Silberer and Mirella Lapata. 2014. Learning grounded meaning representations with autoencoders. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), volume 1, pages 721–732, Baltimore, Maryland, June. Association for Computational Linguistics.
24. Danijel Skocaj, Matej Kristan, Alen Vrecko, Marko Mahnic, Miroslav Janícek, Geert-Jan M. Kruijff, Marc Hanheide, Nick Hawes, Thomas Keller, Michael Zillich, and Kai Zhou. 2011. A system for interactive learning in dialogue with a tutor. In 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2011, San Francisco, CA, USA, September 25-30, 2011, pages 3387–3394.
25. Danijel Skočaj, Matej Kristan, and Aleš Leonardis. 2009. Formalization of different learning strategies in a continuous learning framework. In Proceedings of the Ninth International Conference on Epigenetic Robotics; Modeling Cognitive Development in Robotic Systems, pages 153–160. Lund University Cognitive Studies.
26. Richard Socher, Milind Ganjoo, Christopher D. Manning, and Andrew Y. Ng. 2013. Zero-shot learning through cross-modal transfer. In Advances in Neural Information Processing Systems 26: 27th Annual Conference on Neural Information Processing Systems, pages 935–943, Lake Tahoe, Nevada, USA.
27. Richard Socher, Andrej Karpathy, Quoc V Le, Christopher D Manning, and Andrew Y Ng. 2014. Grounded compositional semantics for finding and describing images with sentences. Transactions of the Association for Computational Linguistics, 2:207–218.
28. Yuyin Sun, Liefeng Bo, and Dieter Fox. 2013. Attribute based object identification. In Robotics and Automation (ICRA), 2013 IEEE International Conference on, pages 2096–2103. IEEE.
29. Richard S. Sutton and Andrew G. Barto. 1998. Reinforcement Learning: an Introduction. MIT Press.
30. Stefanie Tellex, Pratiksha Thaker, Joshua Mason Joseph, and Nicholas Roy. 2014. Learning perceptually grounded word meanings from unaligned parallel data. Machine Learning, 94(2):151–167.
31. Yanchao Yu, Arash Eshghi, and Oliver Lemon. 2015a. Comparing attribute classifiers for interactive language grounding. In Proceedings of the Fourth Workshop on Vision and Language, pages 60–69, Lisbon, Portugal, September. Association for Computational Linguistics.
32. Yanchao Yu, Oliver Lemon, and Arash Eshghi. 2015b. Interactive learning through dialogue for multimodal language grounding. In SemDial 2015, Proceedings of the 19th Workshop on the Semantics and Pragmatics of Dialogue, Gothenburg, Sweden, August 24-26 2015, pages 214–215.
33. Tong Zhang. 2004. Solving large scale linear prediction problems using stochastic gradient descent algorithms. In Proceedings of the twenty-first international conference on Machine learning, page 116. ACM.
34. Jun Zheng, Furao Shen, Hongjun Fan, and Jinxi Zhao. 2013. An online incremental learning support vector machine for large-scale data. Neural Computing and Applications, 22(5):1023–1035.