Evaluation methods for unsupervised word embeddings

Conference Proceedings - EMNLP 2015: Conference on Empirical Methods in Natural Language Processing

Volumn , Issue , 2015, Pages 298-307

  Schnabel, Tobias ^a   Labutov, Igor ^a   Mimno, David ^a   Joachims, Thorsten ^a  

^a Cornell University ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EMBEDDINGS;

DATA DRIVEN; EMBEDDING METHOD; EMBEDDING TECHNIQUE; EVALUATION METHODS; RELEVANCE JUDGMENT; VECTOR REPRESENTATIONS;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 84959860040     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.18653/v1/d15-1036     Document Type: Conference Paper

References (29)

1. Jacob Andreas and Dan Klein. 2014. How much do word embeddings encode about syntax? In ACL: Short Papers, pages 822-827.
2. Javed Aslam and Mark Montague. 2001. Models for metasearch. In SIGIR, pages 276-284.
3. Marco Baroni, Georgiana Dinu, and German Kruszewski. 2014. Don't count, predict! a systematic comparison of context-counting vs. context-predicting semantic vectors. In ACL, pages 238-247.
4. Elia Bruni, Nam-Khanh Iran, and Marco Baroni. 2014. Multimodal distributional semantics. JAIR, 49:1-7.
5. James McKeen Cattell. 1886. The time taken up by cerebral operations. Mind, (42): 220-242.
6. Jonathan Chang, Jordan Boyd-Graber, Sean Gerrish, Chong Wang, and David Blei. 2009. Reading tea leaves: How humans interpret topic models. In NIPS, pages 288-296.
7. Yanqing Chen, Bryan Perozzi, Rami Al-Rfou, and Steven Skiena. 2013. The expressive power of word embeddings. arXivpreprint: 1408.3456.
8. Ronan Collobert, Jason Weston, Leon Bottou, Michael Karlen, Koray Kavukcuoglu, and Pavel Kuksa. 2011. Natural language processing (almost) from scratch. JLMR, 12:2493-2537.
9. Paramveer S. Dhillon, Jordan Rodu, Dean P. Foster, and Lyle H. Ungar. 2012. Two step CCA: A new spectral method for estimating vector models of words. In ICML, pages 1551-1558.
10. Rong-En Fan, Kai-Wei Chang, Cho-Jui Hsieh, Xiang-Rui Wang, and Chih-Jen Lin. 2008. LIBLINEAR: A library for large linear classification. JLMR, 9:1871-1874.
11. Manaal Faruqui and Chris Dyer. 2014. Community evaluation and exchange of word vectors at wordvectors.org. In ACL: System Demonstrations.
12. Lev Finkelstein, Ehud Rivlin Zach Solan Gadi Wolfman Evgeniy Gabrilovich, Yossi Matias, and Eytan Ruppin. 2002. Placing search in context: The concept revisited. TOIS, 20(1):116-131, January.
13. Bin Gao, Jiang Bian, and Tie-Yan Liu. 2014. WordRep: A benchmark for research on learning word representations. ICML Workshop on Knowledge-Powered Deep Learning for Text Mining.
14. Remi Lebret and Ronan Collobert. 2014. Word embeddings through Hellinger PCA. In EACL, pages 482-490.
15. Omer Levy and Yoav Goldberg. 2014. Neural word embedding as implicit matrix factorization. In NIPS, pages 2177-2185.
16. Omer Levy, Yoav Goldberg, and Ido Dagan. 2015a. Improving distributional similarity with lessons learned from word embeddings. TACL.
17. Omer Levy, Steffen Remus, Chris Biemann, and Ido Dagan. 2015b. Do supervised distributional methods really learn lexical inference relations? In NAACL.
18. Ping Li, Trevor J Hastie, and Kenneth W Church. 2006. Very sparse random projections. In KDD, pages 287-296.
19. Andrew L. Maas, Raymond E. Daly, Peter T. Pham, Dan Huang, Andrew Y. Ng, and Christopher Potts. 2011. Learning word vectors for sentiment analysis. In HLT-ACL, pages 142-150.
20. Christopher D. Manning, Mihai Surdeanu, John Bauer, Jenny Finkel, Steven J. Bernard, and David McClosky. 2014. The Stanford CoreNLP natural language processing toolkit. In ACL: System Demonstrations, pages 55-60.
21. Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean. 2013a. Distributed representations of words and phrases and their compositionality. In NIPS, pages 3111-3119.
22. Tomas Mikolov, Wen-Tau Yih, and Geoffrey Zweig. 2013b. Linguistic regularities in continuous space word representations. In HLT-NAACL, pages 746-751.
23. George A Miller. 1995. WordNet: a lexical database for english. Communications of the ACM, 38(11):39-41.
24. David Newman, Jey Han Lau, Karl Grieser, and Timothy Baldwin. 2010. Automatic evaluation of topic coherence. In HLT-NAACL, pages 100-108.
25. Jeffrey Pennington, Richard Socher, and Christopher D. Manning. 2014. GloVe: Global vectors for word representation. In EMNLP.
26. Yulia Tsvetkov, Manaal Faruqui, Wang Ling, Guillaume Lample, and Chris Dyer. 2015. Evaluation of word vector representations by subspace alignment. In EMNLP.
27. Joseph Turian, Lev Ratinov, and Yoshua Bengio. 2010. Word representations: a simple and general method for semi-supervised learning. In ACL, pages 384-394.
28. Peter D. Turney. 2008. A uniform approach to analogies, synonyms, antonyms, and associations. In COLING, pages 905-912.
29. Alexander Yeh. 2000. More accurate tests for the statistical significance of result differences. In ACL, pages 947-953.