How much do word embeddings encode about syntax?

52nd Annual Meeting of the Association for Computational Linguistics, ACL 2014 - Proceedings of the Conference

Volumn 2, Issue , 2014, Pages 822-827

  Andreas, Jacob ^a   Klein, Dan ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; EMBEDDINGS; ENCODING (SYMBOLS);

OUT OF VOCABULARY WORDS; SMALL GAIN; STATE OF THE ART; STATISTICAL PARSER; SUPERVISED TRAININGS; SYNTACTIC INFORMATION; TRAINING DATA; TREEBANKS;

SYNTACTICS;

EID: 84906928500     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/v1/p14-2133     Document Type: Conference Paper

References (15)

1. Jacob Andreas and Zoubin Ghahramani. 2013. A generative model of vector space semantics. In Proceedings of the ACL Workshop on Continuous Vector Space Models and their Compositionality, Sofia, Bulgaria.
2. Mohit Bansal, Kevin Gimpel, and Karen Livescu. 2014. Tailoring continuous word representations for dependency parsing. In Proceedings of the Annual Meeting of the Association for Computational Linguistics.
3. Ronan Collobert, Jason Weston, Léon Bottou, Michael Karlen, Koray Kavukcuoglu, and Pavel Kuksa. 2011. Natural language processing (almost) from scratch. Journal of Machine Learning Research, 12:2493-2537.
4. Scott C. Deerwester, Susan T Dumais, Thomas K. Landauer, GeorgeW. Furnas, and Richard A. Harshman. 1990. Indexing by latent semantic analysis. Journal of the American Society for Information Science, 41(6):391-407.
5. Dayne Freitag. 2004. Trained named entity recognition using distributional clusters. In Proceedings of the Conference on Empirical Methods in Natural Language Processing.
6. James Henderson. 2004. Discriminative training of a neural network statistical parser. In Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics, page 95. Association for Computational Linguistics.
7. Karl Moritz Hermann and Phil Blunsom. 2013. The role of syntax in vector space models of compositional semantics. In Proceedings of the Annual Meeting of the Association for Computational Linguistics, pages 894-904, Sofia, Bulgaria, August.
8. Zhongqiang Huang and Mary P. Harper. 2011. Feature-rich log-linear lexical model for latent variable pcfg grammars. In Proceedings of the International Joint Conference on Natural Language Processing, pages 219-227.
9. Terry Koo, Xavier Carreras, and Michael Collins. 2008. Simple semi-supervised dependency parsing. In Proceedings of the Annual Meeting of the Association for Computational Linguistics, pages 595- 603.
10. Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean. 2013a. Distributed representations of words and phrases and their compositionality. In Advances in Neural Information Processing Systems, pages 3111-3119.
11. Tomas Mikolov, Wen-tau Yih, and Geoffrey Zweig. 2013b. Linguistic regularities in continuous space word representations. In Proceedings of the Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics, pages 746-751.
12. Slav Petrov and Dan Klein. 2007. Improved inference for unlexicalized parsing. In Proceedings of the Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics. Assocation for Computational Linguistics.
13. Hinrich Schütze. 1995. Distributional part-of-speech tagging. In Proceedings of the European Association for Computational Linguistics, pages 141-148.
14. Richard Socher, John Bauer, Christopher D. Manning, and Andrew Y. Ng. 2013. Parsing with compositional vector grammars. In Proceedings of the Annual Meeting of the Association for Computational Linguistics.
15. Joseph Turian, Lev Ratinov, and Yoshua Bengio. 2010. Word representations: a simple and general method for semi-supervised learning. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, pages 384-394. Proceedings of the Annual Meeting of the Association for Computational Linguistics.