High-risk learning: Acquiring new word vectors from tiny data

EMNLP 2017 - Conference on Empirical Methods in Natural Language Processing, Proceedings

Volumn , Issue , 2017, Pages 304-309

  Herbelot, Aurélie ^a   Baroni, Marco ^b  

^a UNIVERSITAT POMPEU FABRA   (Spain)

^b UNIVERSITY OF TRENTO   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

SEMANTICS;

BACK-GROUND KNOWLEDGE; DISTRIBUTIONAL SEMANTICS; ITS STANDARDS; LANGUAGE MODEL; SEMANTIC SPACE; SMALL DATA; STATE OF THE ART; WORD VECTORS;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 85073146688     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.18653/v1/d17-1030     Document Type: Conference Paper

References (20)

1. Marco Baroni, Silvia Bernardini, Adriano Ferraresi, and Eros Zanchetta. 2009. The WaCky wide web: a collection of very large linguistically processed web-crawled corpora. Language resources and evaluation, 43(3):209–226.
2. Yoshua Bengio, Réjean Ducharme, Pascal Vincent, and Christian Jauvin. 2003. A neural probabilistic language model. Journal of machine learning research, 3:1137–1155.
3. Elia Bruni, Nam Khanh Tran, and Marco Baroni. 2014. Multimodal distributional semantics. Journal of Artificial Intelligence Research, 49(1):1–47.
4. Alexander Clark and Shalom Lappin. 2010. Computational learning theory and language acquisition. In Ruth M Kempson, Tim Fernando, and Nicholas Asher, editors, Philosophy of linguistics, pages 445–475. Elsevier.
5. Stephen Clark. 2012. Vector space models of lexical meaning. In Shalom Lappin and Chris Fox, editors, Handbook of Contemporary Semantics – second edition. Wiley-Blackwell.
6. Ronan Collobert, Jason Weston, Léon Bottou, Michael Karlen, Koray Kavukcuoglu, and Pavel Kuksa. 2011. Natural language processing (almost) from scratch. Journal of Machine Learning Research, 12:2493–2537.
7. Katrin Erk. 2012. Vector space models of word meaning and phrase meaning: a survey. Language and Linguistics Compass, 6:635–653.
8. Eric H Huang, Richard Socher, Christopher D Manning, and Andrew Y Ng. 2012. Improving word representations via global context and multiple word prototypes. In Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics (ACL2012), pages 873–882.
9. Max Kisselew, Sebastian Padó, Alexis Palmer, and Jan Šnajder. 2015. Obtaining a Better Understanding of Distributional Models of German Derivational Morphology. In Proceedings of the 11th International Conference on Computational Semantics (IWCS2015), pages 58–63, London, UK.
10. Brenden M Lake, Ruslan Salakhutdinov, Jason Gross, and Joshua B Tenenbaum. 2011. One-shot learning of simple visual concepts. In Proceedings of the 33rd Annual Meeting of the Cognitive Science Society (CogSci2012), Boston, MA.
11. Brenden M. Lake, Tomer D. Ullman, Joshua B. Tenenbaum, and Samuel J. Gershman. 2016. Building machines that learn and think like people. arxiv, abs/1604.00289.
12. Angeliki Lazaridou, Marco Marelli, and Marco Baroni. 2017. Multimodal word meaning induction from minimal exposure to natural text. Cognitive Science, 41(S4):677–705.
13. Angeliki Lazaridou, Marco Marelli, Roberto Zamparelli, and Marco Baroni. 2013. Compositional-ly Derived Representations of Morphologically Complex Words in Distributional Semantics. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (ACL2013), pages 1517–1526, Sofia, Bulgaria.
14. Thang Luong, Richard Socher, and Christopher D. Manning. 2013. Better Word Representations with Recursive Neural Networks for Morphology. In Proceedings of the 17th Conference on Computational Natural Language Learning (CoNLL2013), pages 104–113, Sofia, Bulgaria.
15. Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In C. J. C. Burges, L. Bottou, M. Welling, Z. Ghahramani, and K. Q. Weinberger, editors, Advances in Neural Information Processing Systems 26, pages 3111–3119. Curran Associates, Inc.
16. Sebastian Padó, Aurélie Herbelot, Max Kisselew, and Jan Šnajder. 2016. Predictability of distributional semantics in derivational word formation. In Proceedings of the 26th International Conference on Computational Linguistics (COLING2016), Osaka, Japan.
17. Behrang QasemiZadeh, Laura Kallmeyer, and Aurélie Herbelot. 2017. Non-Negative Randomized Word Embeddings. In Proceedings of Traitement automatique des langues naturelles (TALN2017), Orléans, France.
18. John C Trueswell, Tamara Nicol Medina, Alon Hafri, and Lila R Gleitman. 2013. Propose but verify: Fast mapping meets cross-situational word learning. Cognitive psychology, 66(1):126–156.
19. Peter D Turney and Patrick Pantel. 2010. From frequency to meaning: Vector space models of semantics. Journal of artificial intelligence research, 37:141–188.
20. Yanchao Yu, Arash Eshghi, and Oliver Lemon. 2016. Training an adaptive dialogue policy for interactive learning of visually grounded word meanings. In Proceedings of the 17th Annual SIGdial Meeting on Discourse and Dialogue (SIGDIAL2016), pages 339–349, Los Angeles,CA.