Medical semantic similarity with a neural language model

CIKM 2014 - Proceedings of the 2014 ACM International Conference on Information and Knowledge Management

Volumn , Issue , 2014, Pages 1819-1822

  De Vine, Lance ^a   Zuccon, Guido ^a   Koopman, Bevan ^a,b   Sitbon, Laurianne ^a   Bruza, Peter ^a  

^a QUEENSLAND UNIVERSITY OF TECHNOLOGY   (Australia)

^b CSIRO   (Australia)

Author keywords

Distributed representations; Medical information retrieval; Neural language model; Semantic similarity; Skip gram; Word2Vec

Indexed keywords

BIOINFORMATICS; COMPUTATIONAL LINGUISTICS; INFORMATION RETRIEVAL; KNOWLEDGE MANAGEMENT; SEMANTICS;

DISTRIBUTED REPRESENTATION; LANGUAGE MODEL; SEMANTIC SIMILARITY; SKIP-GRAM; WORD2VEC;

MEDICAL INFORMATICS;

EID: 84937604534     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2661829.2661974     Document Type: Conference Paper

References (17)

1. P. Agarwal and D. B. Searls. Can literature analysis identify innovation drivers in drug discovery? Nature reviews. Drug discovery, 8(11):865-78, Nov. 2009.
2. A. R. Aronson and F.-M. Lang. An overview of MetaMap: historical perspective and recent advances. JAMIA, 17(3):229-236, 2010.
3. M. Baroni, G. Dinu, and G. Kruszewski. Don't count, predict! a systematic comparison of context-counting vs. context-predicting semantic vectors. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, 2014.
4. Y. Bengio, R. Ducharme, P. Vincent, and C. Jauvin. A neural probabilistic language model. Journal of Machine Learning Research, 3:1137-1155, 2003.
5. J. E. Caviedes and J. J. Cimino. Towards the development of a conceptual distance metric for the UMLS. Journal of biomedical informatics, 37(2):77-85, Apr. 2004.
6. T. Cohen and D. Widdows. Empirical distributional semantics: Methods and biomedical applications. Journal of Biomedical Informatics, 42(2):390-405, 2009.
7. R. Collobert and J. Weston. A unified architecture for natural language processing: Deep neural networks with multitask learning. In Proceedings of the 25th international conference on Machine learning, pages 160-167. ACM, 2008.
8. Z. S. Harris. Distributional structure. Word, 1954.
9. B. Koopman, G. Zuccon, P. Bruza, L. Sitbon, and M. Lawley. An evaluation of corpus-driven measures of medical concept similarity for information retrieval. In Proceedings of the 21st ACM international conference on Information and knowledge management, pages 2439-2442. ACM, 2012.
10. R. Lebret, J. Legrand, and R. Collobert. Is deep learning really necessary for word embeddings? In NIPS Workshop on Deep Learning, 2013.
11. T. Mikolov, K. Chen, G. Corrado, and J. Dean. Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781, 2013.
12. T. Mikolov, M. Karafiát, L. Burget, J. Cernocky, and S. Khudanpur. Recurrent neural network based language model. In INTERSPEECH, pages 1045-1048, 2010.
13. T. Mikolov, I. Sutskever, K. Chen, G. S. Corrado, and J. Dean. Distributed representations of words and phrases and their compositionality. In Advances in Neural Information Processing Systems, pages 3111-3119, 2013.
14. G. A. Miller and W. G. Charles. Contextual correlates of semantic similarity. Language and cognitive processes, 6(1):1-28, 1991.
15. T. Pedersen, S. Pakhomov, S. Patwardhan, and C. Chute. Measures of semantic similarity and relatedness in the biomedical domain. Journal of Biomedical Informatics, 40(3):288-299, 2007.
16. H. Schwenk and J.-L. Gauvain. Training neural network language models on very large corpora. In Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing, pages 201-208. Association for Computational Linguistics, 2005.
17. E. Voorhees and R. Tong. Overview of the TREC Medical Records Track. In Twentieth Text REtrieval Conference (TREC 2011), MD, USA, 2011.