Learning word vectors for 157 languages

LREC 2018 - 11th International Conference on Language Resources and Evaluation

Volumn , Issue , 2019, Pages 3483-3487

  Grave, Edouard ^a   Bojanowski, Piotr ^a   Gupta, Prakhar ^a,b   Joulin, Armand ^a   Mikolov, Tomas ^a  

^a FACEBOOK AI RESEARCH   (United States)

^b EPFL   (United States)

Author keywords

Fasttext; Word analogies; Word vectors

Indexed keywords

NATURAL LANGUAGE PROCESSING SYSTEMS;

FASTTEXT; HIGH QUALITY; LARGE CORPORA; ONLINE ENCYCLOPEDIA; STATE-OF-THE-ART PERFORMANCE; WORD ANALOGIES; WORD REPRESENTATIONS; WORD VECTORS;

VECTORS;

EID: 85059915649     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (25)

1. Al-Rfou, R., Perozzi, B., and Skiena, S. (2013). Polyglot: Distributed word representations for multilingual nlp. Proc. CoNLL.
2. Baldwin, T. and Lui, M. (2010). Language identification: The long and the short of the matter. In Proc. NAACL.
3. Berardi, G., Esuli, A., and Marcheggiani, D. (2015). Word embeddings go to Italy: a comparison of models and training datasets. Italian Information Retrieval Workshop.
4. Bojanowski, P., Grave, E., Joulin, A., and Mikolov, T. (2017). Enriching word vectors with subword information. Transactions of the Association for Computational Linguistics, 5.
5. Buck, C., Heafield, K., and Van Ooyen, B. (2014). N-gram counts and language models from the common crawl. In Proc. LREC, volume 2.
6. Cardellino, C. (2016). Spanish Billion Words Corpus and Embeddings, March.
7. Chang, P.-C., Galley, M., and Manning, C. D. (2008). Optimizing chinese word segmentation for machine translation performance. In Proceedings of the third workshop on statistical machine translation.
8. Collobert, R. and Weston, J. (2008). A unified architecture for natural language processing: Deep neural networks with multitask learning. In Proc. ICML.
9. Hartmann, N., Fonseca, E., Shulby, C., Treviso, M., Ro-drigues, J., and Aluisio, S. (2017). Portuguese word embeddings: Evaluating on word analogies and natural language tasks. arXiv preprint arXiv:1708.06025.
10. Jin, P. and Wu, Y. (2012). Semeval-2012 task 4: evaluating chinese word similarity. In Proc. *SEM.
11. Joulin, A., Grave, E., Bojanowski, P., and Mikolov, T. (2017). Bag of tricks for efficient text classification. In Proc. EACL.
12. Koehn, P. (2005). Europarl: A parallel corpus for statistical machine translation. In MT summit, volume 5.
13. Köper, M., Scheible, C., and im Walde, S. S. (2015). Multilingual reliability and”semantic” structure of continuous word spaces. Proc. IWCS 2015.
14. Kudo, T. (2005). Mecab: Yet another part-of-speech and morphological analyzer. http://mecab. sourceforge. net/.
15. Lui, M. and Baldwin, T. (2012). langid.py: An off-the-shelf language identification tool. In Proc. ACL (system demonstrations).
16. Mihalcea, R. (2007). Using wikipedia for automatic word sense disambiguation. In Proc. NAACL.
17. Mikolov, T., Chen, K., Corrado, G. D., and Dean, J. (2013a). Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781.
18. Mikolov, T., Sutskever, I., Chen, K., Corrado, G. S., and Dean, J. (2013b). Distributed representations of words and phrases and their compositionality. In Adv. NIPS.
19. Mikolov, T., Grave, E., Bojanowski, P., Puhrsch, C., and Joulin, A. (2017). Advances in pre-training distributed word representations. arXiv preprint arXiv:1712.09405.
20. Mnih, A. and Kavukcuoglu, K. (2013). Learning word embeddings efficiently with noise-contrastive estimation. In Adv. NIPS.
21. Nguyen, T.-P. and Le, A.-C. (2016). A hybrid approach to vietnamese word segmentation. In Computing & Communication Technologies, Research, Innovation, and Vision for the Future (RIVF), 2016 IEEE RIVF International Conference on. IEEE.
22. Pennington, J., Socher, R., and Manning, C. (2014). Glove: Global vectors for word representation. In Proc. EMNLP.
23. Svoboda, L. and Brychcin, T. (2016). New word analogy corpus for exploring embeddings of Czech words. In Proc. CICLING.
24. Venekoski, V. and Vankka, J. (2017). Finnish resources for evaluating language model semantics. In Proc. NoDaL-iDa.
25. Wu, F. and Weld, D. S. (2010). Open information extraction using wikipedia. In Proc. ACL.