Word embeddings evaluation and combination

Proceedings of the 10th International Conference on Language Resources and Evaluation, LREC 2016

Volumn , Issue , 2016, Pages 300-305

  Ghannay, Sahar ^a   Favre, Benoit ^b   Estève, Yannick ^a   Camelin, Nathalie ^a  

^a UNIVERSITÉ DU MAINE   (France)

^b AIX MARSEILLE UNIVERSITY   (France)

Author keywords

Benchmarking; Natural language processing; Speech processing; Word embeddings

Indexed keywords

BENCHMARKING; SPEECH PROCESSING;

EMBEDDINGS; EVALUATION RESULTS; SCIENTIFIC LITERATURE; TRAINING DATA;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 85031045023     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (26)

1. Mohit Bansal, Kevin Gimpel, and Karen Livescu. 2014a. Tailoring continuous word representations for dependency parsing. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 809-815. Association for Computational Linguistics.
2. Mohit Bansal, Kevin Gimpel, and Karen Livescu. 2014b. Tailoring continuous word representations for dependency parsing. In ACL (2), pages 809-815.
3. Yoshua Bengio, Réjean Ducharme, Pascal Vincent, and Christian Janvin. 2003. A neural probabilistic language model. volume 3, pages 1137-1155. JMLR.org, March.
4. Elia Bruni, Gemma Boleda, Marco Baroni, and Nam Khanh Tran. 2012. Distributional semantics in technicolor. In Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 136-145, Jeju Island, Korea, July. Association for Computational Linguistics.
5. Ronan Collobert, Jason Weston, Léon Bottou, Michael Karlen, Koray Kavukcuoglu, and Pavel Kuksa. 2011. Natural Language Processing (Almost) from Scratch. volume 12, pages 2493-2537. JMLR.org.
6. Lev Finkelstein, Evgeniy Gabrilovich, Yossi Matias, Ehud Rivlin, Zach Solan, Gadi Wolfman, and Eytan Ruppin. 2001. Placing search in context: The concept revisited. In Proceedings of the 10th international conference on World Wide Web, pages 406-414. ACM.
7. Bin Gao, Jiang Bian, and Tie-Yan Liu. 2014. Wordrep: A benchmark for research on learning word representations. CoRR, abs/1407.1640.
8. Sahar Ghannay, Yannick Estève, Nathalie Camelin, Camille Dutrey, Fabian Santiago, and Martine Adda-Decker. 2015. Combining continous word representation and prosodic features for asr error prediction. In 3rd International Conference on Statistical Language and Speech Processing (SLSP 2015), Budapest (Hungary), November 24-26.
9. Eduard Hovy, Mitchell Marcus, Martha Palmer, Lance Ramshaw, and Ralph Weischedel. 2006. Ontonotes: the 90% solution. In Proceedings of the human language technology conference of the NAACL, Companion Volume: Short Papers, pages 57-60. Association for Computational Linguistics.
10. Shihao Ji, Hyokun Yun, Pinar Yanardag, Shin Matsushima, and S. V. N. Vishwanathan. 2015. Wordrank: Learning word embeddings via robust ranking. CoRR, abs/1506.02761.
11. Rémi Lebret and Ronan Collobert. 2013. Word emdeddings through hellinger pca. arXiv preprint arXiv:1312.5542.
12. Omer Levy and Yoav Goldberg. 2014. Dependencybased word embeddings. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, volume 2, pages 302-308.
13. Omer Levy, Yoav Goldberg, and Ido Dagan. 2015. Improving distributional similarity with lessons learned from word embeddings. Transactions of the Association for Computational Linguistics, 3:211-225.
14. Minh-Thang Luong, Richard Socher, and Christopher D Manning. 2013. Better word representations with recursive neural networks for morphology. CoNLL-2013, 104.
15. Mitchell P Marcus, Mary Ann Marcinkiewicz, and Beatrice Santorini. 1993. Building a large annotated corpus of english: The penn treebank. Computational linguistics, 19(2):313-330.
16. Grégoire Mesnil, Yann Dauphin, Kaisheng Yao, Yoshua Bengio, Li Deng, Dilek Hakkani-Tur, Xiaodong He, Larry Heck, Gokhan Tur, Dong Yu, et al. 2015. Using Recurrent Neural Networks for Slot Filling in Spoken Language Understanding. Audio, Speech, and Language Processing, IEEE/ACM Transactions on, 23(3):530-539.
17. Grégoire Mesnil. 2015. Recurrent Neural Networks with Word Embeddings DeepLearning 0.1 documentation. http://www.deeplearning.net/tutorial/rnnslu.html nnslu.
18. Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013a. Efficient estimation of word representations in vector space. In Proceedings of Workshop at ICLR.
19. Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean. 2013b. Distributed representations of words and phrases and their compositionality. In Advances in neural information processing systems, pages 3111-3119.
20. Jeffrey Pennington, Richard Socher, and Christopher D Manning. 2014. Glove: Global vectors for word representation. In Proceedings of the Empiricial Methods in Natural Language Processing (EMNLP 2014), volume 12.
21. Holger Schwenk. 2007. Continuous space language models. Computer Speech & Language, 21(3):492-518.
22. Holger Schwenk. 2013. CSLM-a modular open-source continuous space language modeling toolkit. In INTER-SPEECH, pages 1198-1202.
23. Erik F Tjong Kim Sang and Sabine Buchholz. 2000. Introduction to the conll-2000 shared task: Chunking. In Proceedings of the 2nd workshop on Learning language in logic and the 4th conference on Computational natural language learning-Volume 7, pages 127-132. Association for Computational Linguistics.
24. Erik F Tjong Kim Sang and Fien De Meulder. 2003. Introduction to the conll-2003 shared task: Languageindependent named entity recognition. In Proceedings of the seventh conference on Natural language learning at HLT-NAACL 2003-Volume 4, pages 142-147. Association for Computational Linguistics.
25. Joseph Turian, Lev Ratinov, and Yoshua Bengio. 2010. Word representations: a simple and general method for semi-supervised learning. In Proceedings of the 48th annual meeting of the association for computational linguistics, pages 384-394. Association for Computational Linguistics.
26. P. Vincent, H. Larochelle, Y. Bengio, and P. A. Manzagol. 2008. Extracting and composing robust features with denoising autoencoders. In Proceedings of the 25th international conference on Machine learning.