Size (and domain) matters: Evaluating semantic word space representations for biomedical text

SMBM 2012 - Proceedings of the 5th International Symposium on Semantic Mining in Biomedicine

Volumn , Issue , 2012, Pages 42-49

  Stenetorp, Pontus ^a   Soyer, Hubert ^a   Pyysalo, Sampo ^b   Ananiadou, Sophia ^b   Chikayama, Takashi ^a  

^a UNIVERSITY OF TOKYO   (Japan)

^b UNIVERSITY OF MANCHESTER   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

BIOMEDICAL TEXT; DOMAIN MACHINES; LARGE CORPORA; NAMED ENTITY RECOGNITION; NATURAL LANGUAGE PROCESSING; SCIENTIFIC TEXTS; SEMANTIC CATEGORY; SEMANTIC REPRESENTATION; SUPERVISED MACHINE LEARNING; WORD REPRESENTATIONS; WORD SPACES;

LEARNING ALGORITHMS; LINGUISTICS; SEMANTICS; SUPERVISED LEARNING;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 84874260421     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.5167/uzh-64476     Document Type: Conference Paper

References (31)

1. R.K. Ando and T. Zhang. 2005. A framework for learning predictive structures from multiple tasks and un-labeled data. The Journal of Machine Learning Research, 6: 1817-1853.
2. T. Brants and A. Franz. 2009. The Google Web 1T 5-gram Corpus version 1.1. LDC2006T13.
3. P.F. Brown, P.V. Desouza, R.L. Mercer, V.J. Della Pietra, and J.C. Lai. 1992. Class-based n-gram models of natural language. Computational linguistics, 18(4):467-479.
4. A. Clark. 2003. Combining distributional and morphological information for part of speech induction. In Proceedings of EACL, pages 59-66.
5. R. Collobert and J. Weston. 2008. A unified architecture for natural language processing: deep neural networks with multitask learning. In Proceedings of ICML 2008, pages 160-167.
6. S.T. Dumais, G.W. Furnas, T.K. Landauer, S. Deerwester, and R. Harshman. 1988. Using latent semantic analysis to improve access to textual information. In Proceedings of the SIGCHI conference on Human factors in computing systems, pages 281-285.
7. J.R. Finkel and C.D. Manning. 2009. Nested named entity recognition. In Proceedings of EMNLP 2009, pages 141-150.
8. J. Firth. 1957. A synopsis of linguistic theory 1930-1955. In Studies in Linguistic Analysis.
9. R. Islamaj Dogan and Z. Lu. 2012. An improved corpus of disease mentions in PubMed citations. In Proceedings of BioNLP 2012, pages 91-99.
10. S. Jonnalagadda, R. Leaman, T. Cohen, and G. Gonzalez. 2010. A distributional semantics approach to simultaneous recognition of multiple classes of named entities. Computational Linguistics and Intelligent Text Processing, pages 224-235.
11. J-D. Kim, S. Pyysalo, T. Ohta, R. Bossy, N. Nguyen, and J. Tsujii. 2011. Overview of BioNLP Shared Task 2011. In Proceedings of the BioNLP 2011 Shared Task, pages 1-6.
12. R. Leaman, G. Gonzalez, et al. 2008. BANNER: An executable survey of advances in biomedical named entity recognition. In Pacific Symposium on Biocomputing, volume 13, pages 652-663.
13. R. Leaman, C. Miller, and G. Gonzalez. 2009. Enabling recognition of diseases in biomedical text with machine learning: Corpus and benchmark. In Proceedings of LBM 2009.
14. D. Lin and X. Wu. 2009. Phrase clustering for discriminative learning. In Proceedings of ACL-IJCNLP 2009, pages 1030-1038.
15. D. Lin, K. Church, H. Ji, S. Sekine, D. Yarowsky, S. Bergsma, K. Patil, E. Pitler, R. Lathbury, V. Rao, et al. 2010. New tools for web-scale n-grams. In Proceedings of LREC.
16. D. McClosky, M. Surdeanu, and C. Manning. 2011. Event extraction as dependency parsing for BioNLP 2011. In Proceedings of BioNLP Shared Task 2011, pages 41-45.
17. T. McIntosh and J.R. Curran. 2009. Reducing semantic drift with bagging and distributional similarity. In Proceedings of ACL 2009, pages 396-404.
18. G.A. Miller. 1995. WordNet: a lexical database for english. Communications of the ACM, 38(11): 39-41.
19. M. Miwa, R. Sætre, Y. Miyao, and J. Tsujii. 2009. Protein-protein interaction extraction by leveraging multiple kernels and parsers. International Journal of Medical Informatics, 78(12):e39-e46.
20. A. Mnih and G.E. Hinton. 2009. A scalable hierarchical distributed language model. NIPS, 21: 1081-1088.
21. H. Ney, U. Essen, and R. Kneser. 1994. On structuring probabilistic dependences in stochastic language modelling. Computer Speech and Language, 8(1): 1-38.
22. T. Ohta, Y. Tateisi, and J-D. Kim. 2002. The GENIA corpus: An annotated research abstract corpus in molecular biology domain. In Proceedings of HLT 2002, pages 82-86.
23. T. Ohta, S. Pyysalo, J. Tsujii, and S. Ananiadou. 2012. Open-domain anatomical entity mention detection. In Proceedings of DSSD 2012.
24. C. Quirk, P. Choudhury, M. Gamon, and L. Vanderwende. 2011. MSR-NLP entry in BioNLP Shared Task 2011. In Proceedings of BioNLP Shared Task, pages 155-163.
25. L. Ratinov and D. Roth. 2009. Design challenges and misconceptions in named entity recognition. In Proceedings of CoNLL 2009, pages 147-155.
26. L. Smith, L.K. Tanabe, R.J. Ando, C.J. Kuo, I.F. Chung, C.N. Hsu, Y.S. Lin, R. Klinger, C.M. Friedrich, K. Ganchev, et al. 2008. Overview of BioCreative II gene mention recognition. Genome Biology, 9(Suppl 2):S2.
27. L. Tanabe, N. Xie, L. Thom, W. Matten, and W.J. Wilbur. 2005. GENETAG: a tagged corpus for gene/protein named entity recognition. BMC bioinformatics, 6(Suppl 1):S3.
28. E.F. Tjong Kim Sang and F. De Meulder. 2003. Introduction to the CoNLL-2003 Shared Task: Language-independent named entity recognition. In Proceedings of HLT-NAACL 2003, pages 142-147.
29. Y. Tsuruoka, Y. Tateishi, J-D. Kim, T. Ohta, J. McNaught, S. Ananiadou, and J. Tsujii. 2005. Developing a robust part-of-speech tagger for biomedical text. Advances in informatics, pages 382-392.
30. J. Turian, L. Ratinov, and Y. Bengio. 2010. Word representations: a simple and general method for semi-supervised learning. In Proceedings of ACL 2010, pages 384-394.
31. S. Van Landeghem, T. Abeel, B. De Baets, and Y. Van de Peer. 2011. Detecting entity relations as a supporting task for bio-molecular event extraction. In Proceedings of BioNLP Shared Task, pages 147-148.