How to train goodword embeddings for biomedical nlp

BioNLP 2016 - Proceedings of the 15th Workshop on Biomedical Natural Language Processing

Volumn , Issue , 2016, Pages 166-174

  Chiu, Billy ^a   Crichton, Gamal ^a   Korhonen, Anna ^a   Pyysalo, Sampo ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

NATURAL LANGUAGE PROCESSING SYSTEMS; PETROLEUM RESERVOIR EVALUATION; QUALITY CONTROL;

BIOMEDICAL DOMAIN; BIOMEDICAL NLP; EMBEDDINGS; EVALUATION TOOL; HYPER-PARAMETER; MODELING ARCHITECTURE; OPEN LICENSE; PARAMETER-SETTING; STATE OF THE ART;

EMBEDDINGS;

EID: 85108075285     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. Yoshua Bengio, Réjean Ducharme, Pascal Vincent, and Christian Jauvin. 2003. A neural probabilistic language model. Journal of Machine Learning Research, pages 1137-1155.
2. Steven Bird. 2006. Nltk: The natural language toolkit. In Proceedings of COLING/ACL demos, pages 69-72.
3. Billy Chiu, Anna Korhonen, and Sampo Pyysalo. 2016. Intrinsic evaluation of word vectors fails to predict extrinsic performance. Proceedings of RepEval 2016.
4. Ronan Collobert and Jason Weston. 2008. A unified architecture for natural language processing: Deep neural networks with multitask learning. In Proceedings of ICML, pages 160-167. ACM.
5. Javi Fernández, Yoan Gutiérrez, José M Gómez, and Patricio Martinez-Barco. 2014. Gplsi: Supervised sentiment analysis in twitter using skipgrams. In Proceedings of SemEval, pages 294-299.
6. Felix Hill, Roi Reichart, and Anna Korhonen. 2015. Simlex-999: Evaluating semantic models with (genuine) similarity estimation. Computational Linguistics.
7. Jin-Dong Kim, Tomoko Ohta, Yoshimasa Tsuruoka, Yuka Tateisi, and Nigel Collier. 2004. Introduction to the bio-entity recognition task at JNLPBA. In Proceedings of JNLPBA, pages 70-75.
8. Aris Kosmopoulos, Ion Androutsopoulos, and Georgios Paliouras. 2015. Biomedical semantic indexing using dense word vectors in bioasq. Journal Of Biomedical Semantics.
9. Gabriella Lapesa and Stefan Evert. 2014. A large scale evaluation of distributional semantic models: Parameters, interactions and model selection. Transactions of the Association for Computational Linguistics, 2:531-545.
10. Omer Levy, Yoav Goldberg, and Ido Dagan. 2015. Improving distributional similarity with lessons learned from word embeddings. TACL, 3:211-225.
11. Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013a. Efficient estimation of word representations in vector space. In Proceedings of ICLR.
12. Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean. 2013b. Distributed representations of words and phrases and their compositionality. In Proceedings of NIPS, pages 3111-3119.
13. TH Muneeb, Sunil Kumar Sahu, and Ashish Anand. 2015. Evaluating distributed word representations for capturing semantics of biomedical concepts. In Proceedings of ACL-IJCNLP, page 158.
14. Serguei Pakhomov, Bridget McInnes, Terrence Adam, Ying Liu, Ted Pedersen, and Genevieve B Melton. 2010. Semantic similarity and relatedness between clinical terms: An experimental study. In Proceedings of AMIA, volume 2010, page 572.
15. Jeffrey Pennington, Richard Socher, and Christopher D Manning. 2014. Glove: Global vectors for word representation. In Proceedings of EMNLP, volume 14, pages 1532-1543.
16. Sampo Pyysalo, Filip Ginter, Hans Moen, Tapio Salakoski, and Sophia Ananiadou. 2013. Distributional semantics resources for biomedical text processing. Proceedings of LBM.
17. Rune Sætre, Kazuhiro Yoshida, Akane Yakushiji, Yusuke Miyao, Yuichiro Matsubayashi, and Tomoko Ohta. 2007. Akane system: Protein-protein interaction pairs in biocreative2 challenge, ppi-ips subtask. In Proceedings of BioCreative II, pages 209-212.
18. Larry Smith, Lorraine K Tanabe, Rie Johnson nee Ando, Cheng-Ju Kuo, I-Fang Chung, Chun-Nan Hsu, Yu-Shi Lin, Roman Klinger, Christoph M Friedrich, Kuzman Ganchev, et al. 2008. Overview of biocreative ii gene mention recognition. Genome biology, 9(Suppl 2):1-19.
19. Pontus Stenetorp, Hubert Soyer, Sampo Pyysalo, Sophia Ananiadou, and Takashi Chikayama. 2012. Size (and domain) matters: Evaluating semantic word space representations for biomedical text. In Proceedings of SMBM.
20. Joseph Turian, Lev Ratinov, and Yoshua Bengio. 2010. Word representations: A simple and general method for semi-supervised learning. In Proceedings of ACL, pages 384-394.
21. Peter D Turney. 2012. Domain and function: A dual-space model of semantic relations and compositions. Journal of Artificial Intelligence Research, pages 533-585.