Morphological smoothing and extrapolation of word embeddings

54th Annual Meeting of the Association for Computational Linguistics, ACL 2016 - Long Papers

Volumn 3, Issue , 2016, Pages 1651-1660

  Cotterell, Ryan ^a   Schütze, Hinrich ^b   Eisner, Jason ^a  

^a JOHNS HOPKINS UNIVERSITY   (United States)

^b UNIVERSITY OF MUNICH   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; EXTRAPOLATION;

DATA SPARSITY; GAUSSIAN GRAPHICAL MODELS; LARGE CORPORA; LATENT VARIABLE; PREDICTIVE ACCURACY; TRAINING CORPUS; TRAINING SIZE; WORD SIMILARITY;

EMBEDDINGS;

EID: 85011933897     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.18653/v1/p16-1156     Document Type: Conference Paper

References (35)

1. R Harald Baayen, Richard Piepenbrock, and Rijn van H. 1993. The CELEX lexical data base on CD-ROM.
2. Francis R Bach and Michael I Jordan. 2005. A probabilistic interpretation of canonical correlation analysis. Technical report, UC Berkeley.
3. Jan A. Botha and Phil Blunsom. 2014. Compositional Morphology for Word Representations and Language Modelling. In ICML.
4. Ronan Collobert, Jason Weston, Léon Bottou, Michael Karlen, Koray Kavukcuoglu, and Pavel Kuksa. 2011. Natural language processing (almost) from scratch. JMLR, 12.
5. Ryan Cotterell and Hinrich Schütze. 2015. Morphological word embeddings. In NAACL.
6. Ryan Cotterell, Thomas Müller, Alexander Fraser, and Hinrich Schütze. 2015a. Labeled morphological segmentation with semi-Markov models. In CoNLL.
7. Ryan Cotterell, Nanyun Peng, and Jason Eisner. 2015b. Modeling word forms using latent underlying morphs and phonology. TACL, 3.
8. Mathias Creutz and Krista Lagus. 2007. Unsupervised models for morpheme segmentation and morphology learning. ACM Transactions on Speech and Language Processing, 4(1):3.
9. Arthur P Dempster, Nan M Laird, and Donald B Rubin. 1977. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society B, pages 1-38.
10. Cicero Nogueira dos Santos and Bianca Zadrozny. 2014. Learning character-level representations for part-of-speech tagging. In ICML.
11. Manaal Faruqui, Jesse Dodge, Sujay K Jauhar, Chris Dyer, Eduard Hovy, and Noah A Smith. 2015. Retrofitting word vectors to semantic lexicons. In NAACL.
12. Lev Finkelstein, Evgeniy Gabrilovich, Yossi Matías, Ehud Rivlin, Zach Solan, Gadi Wolfman, and Eytan Ruppin. 2001. Placing search in context: The concept revisited. In WWW. ACM.
13. Juri Ganitkevitch, Benjamin Van Durme, and Chris Callison-Burch. 2013. PPDB: The paraphrase database. In NAACL.
14. Christoph Go Her and Andreas Kuchler. 1996. Learning task-dependent distributed representations by backpropagation through structure. Neural Networks.
15. Jan Hajič and Jaroslava Hlaváčová. 2013. MorfFlex CZ. LINDAT/CLARIN digital library at Institute of Formal and Applied Linguistics, Charles University in Prague.
16. Jan Hajic. 2000. Morphological tagging: Data vs.dictionaries. In NAACL.
17. Samer Hassan and Rada Mihalcea. 2009. Crosslingual semantic relatedness using encyclopedic knowledge. In EMNLP.
18. Daphne Koller and Nir Friedman. 2009. Probabilistic Graphical Models: Principles and Techniques. MIT press.
19. Maximilian Köper, Christian Scheible, and Sabine Schulteim Walde. 2015. Multilingual reliability and semantic structure of continuous word spaces. In IWCS.
20. Ira Leviant. 2016. Separated by an Un-common Language: Towards Judgment Language Informed Vector Space Modeling. Ph. D. thesis, Technion.
21. Minh-Thang Luong, Richard Socher, and C Manning. 2013. Better word representations with recursive neural networks for morphology. In CoNLL.
22. Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013a. Efficient estimation of word representations in vector space. In ICLR Workshop.
23. Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013b. Distributed representations of words and phrases and their compositionality. In NIPS.
24. Tomas Mikolov, Wen-tau Yih, and Geoffrey Zweig. 2013c. Linguistic regularities in continuous space word representations. In NAACL.
25. George A. Miller, Richard Beckwith, Christiane Fellbaum, Derek Gross, and Katherine J Miller. 1990. Introduction to WordNet: An on-line lexical database. International Journal of Lexicography, 3(4):235-244.
26. Andriy Mnih and Geoffrey Hinton. 2007. Three new graphical models for statistical language modelling. In ICML.
27. Garrett Nicolai, Colin Cherry, and Grzegorz Kondrak. 2015. Morpho-syntactic regularities in continuous word representations: A multilingual study. In Proceedings of Workshop on Vector Space Modeling for NLP, pages 129-134.
28. Siyu Qiu, Qing Cui, Jiang Bian, Bin Gao, and Liu Tie-Yan. 2014. Co-learning of word representations and morpheme representations. In COLING.
29. Radim Řehuřek and Petr Sojka. 2010. Software Framework for Topic Modelling with Large Corpora. In Proceedings of the LREC 2010 Workshop on New Challenges for NLP Frameworks, pages 45-50.
30. Sam Roweis. 1998. EM algorithms for PCA and SPCA. In NIPS.
31. Richard Socher. 2014. Recursive Deep Learning for Natural Language Processing and Computer Vision. Ph. D. thesis, Stanford University.
32. John Sylak-Glassman, Christo Kirov, David Yarowsky, and Roger Que. 2015. A language-independent feature schema for inflectional morphology. In ACL.
33. Matt Taddy. 2015. Document classification by inversion of distributed language representations. In ACL.
34. Michael E Tipping and Christopher M Bishop. 1999. Probabilistic principal component analysis. Journal of the Royal Statistical Society B, 61(3):611-622.
35. John Wieting, Mohit Bansal, Kevin Gimpel, Karen Livescu, and Dan Roth. 2015. From paraphrase database to compositional paraphrase model and back. TACL.