Relation extraction from clinical texts using domain invariant convolutional neural network

BioNLP 2016 - Proceedings of the 15th Workshop on Biomedical Natural Language Processing

Volumn , Issue , 2016, Pages 206-215

  Sahu, Sunil Kumar ^a   Anand, Ashish ^a   Oruganty, Krishnadev ^b   Gattu, Mahanandeeshwar ^b  

^a INDIAN INSTITUTE OF TECHNOLOGY GUWAHATI   (India)

^b Excelra Knowledge Solutions Pvt Ltd   (India)

Author keywords

[No Author keywords available]

Indexed keywords

CLINICAL RESEARCH; CONVOLUTION; NATURAL LANGUAGE PROCESSING SYSTEMS; NEURAL NETWORKS; SEMANTICS;

BIOMEDICAL DOMAIN; CONVOLUTION NEURAL NETWORK; CONVOLUTIONAL NEURAL NETWORK; CURSE OF DIMENSIONALITY; DISCHARGE SUMMARY; FEATURES VECTOR; KERNEL-METHODS; RELATION EXTRACTION; RESEARCH EFFORTS; SEMANTIC RELATIONS;

EXTRACTION;

EID: 85120057290     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (49)

1. Martin Abadi, Ashish Agarwal, Paul Barham, Eugene Brevdo, Zhifeng Chen, Craig Citro, Greg S Corrado, Andy Davis, Jeffrey Dean, Matthieu Devin, et al. 2015. Tensorflow: Large-scale machine learning on heterogeneous systems, 2015. Software available from tensorflow.org.
2. Yoshua Bengio, Réjean Ducharme, Pascal Vincent, and Christian Janvin. 2003. A neural probabilistic language model. J. Mach. Learn. Res., 3:1137-1155, March.
3. Alex Bravo, Janet Piñero, Núria Queralt-Rosinach, Michael Rautschka, and Laura I Furlong. 2015. Extraction of relations between genes and diseases from text and large-scale data analysis: Implications for translational research. BMC bioinformatics, 16(1):1.
4. Markus Bundschus, Mathaeus Dejori, Martin Stetter, Volker Tresp, and Hans-Peter Kriegel. 2008. Extraction of semantic biomedical relations from text using conditional random fields. BMC bioinformatics, 9(1):1.
5. Razvan Bunescu, Raymond Mooney, Arun Ramani, and Edward Marcotte. 2006. Integrating cooccurrence statistics with information extraction for robust retrieval of protein interactions from medline. In Proceedings of the Workshop on Linking Natural Language Processing and Biology: Towards Deeper Biological Literature Analysis, pages 49-56. Association for Computational Linguistics.
6. Ronan Collobert and Jason Weston. 2008. A unified architecture for natural language processing: Deep neural networks with multitask learning. In Proceedings of the 25th international conference on Machine learning, pages 160-167. ACM.
7. Ronan Collobert, Jason Weston, Léon Bottou, Michael Karlen, Koray Kavukcuoglu, and Pavel Kuksa. 2011. Natural language processing (almost) from scratch. J. Mach. Learn. Res., 12:2493-2537, November.
8. Aron Culotta and Jeffrey Sorensen. 2004. Dependency tree kernels for relation extraction. In Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics, page 423. Association for Computational Linguistics.
9. Cicero Nogueira dos Santos, Bing Xiang, and Bowen Zhou. 2015. Classifying relations by ranking with convolutional neural networks. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, volume 1, pages 626-634.
10. Iris Hendrickx, Su Nam Kim, Zornitsa Kozareva, Preslav Nakov, Diarmuid O Séaghdha, Sebastian Padó, Marco Pennacchiotti, Lorenza Romano, and Stan Szpakowicz. 2009. Semeval-2010 task 8: Multi-way classification of semantic relations between pairs of nominals. In Proceedings of the Workshop on Semantic Evaluations: Recent Achievements and Future Directions, pages 94-99.
11. Association for Computational Linguistics.
12. Gumwon Hong. 2005. Relation extraction using support vector machine. In Natural Language Processing-IJCNLP 2005, pages 366-377. Springer.
13. Baotian Hu, Zhengdong Lu, Hang Li, and Qingcai Chen. 2014. Convolutional neural network architectures for matching natural language sentences. In Advances in Neural Information Processing Systems, pages 2042-2050.
14. Nal Kalchbrenner, Edward Grefenstette, and Phil Blunsom. 2014. A convolutional neural network for modelling sentences. arXiv preprint arXiv:1404.2188.
15. Andrej Karpathy and Li Fei-Fei. 2014. Deep visualsemantic alignments for generating image descriptions. arXiv preprint arXiv:1412.2306.
16. Yoon Kim. 2014. Convolutional neural networks for sentence classification. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 1746-1751, Doha, Qatar, October. Association for Computational Linguistics.
17. Diederik Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980.
18. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks. pages 1097-1105.
19. Gondy Leroy, Hsinchun Chen, and Jesse D Martinez. 2003. A shallow parser based on closed-class words to capture relations in biomedical text. Journal of biomedical Informatics, 36(3):145-158.
20. Jiexun Li, Zhu Zhang, Xin Li, and Hsinchun Chen. 2008. Kernel-based learning for biomedical relation extraction. Journal of the American Society for Information Science and Technology, 59(5):756-769.
21. Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013a. Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781.
22. Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean. 2013b. Distributed representations of words and phrases and their compositionality. In Advances in Neural Information Processing Systems, pages 3111-3119.
23. Anne-Lyse Minard, Anne-Laure Ligozat, Asma Ben Abacha, Delphine Bernhard, Bruno Cartoni, Louise Deléger, Brigitte Grau, Sophie Rosset, Pierre Zweigenbaum, and Cyril Grouin. 2011a. Hybrid methods for improving information access in clinical documents: Concept, assertion, and relation identification. Journal of the American Medical Informatics Association, 18(5):588-593.
24. Anne-Lyse Minard, Anne-Laure Ligozat, and Brigitte Grau. 2011b. Multi-class svm for relation extraction from clinical reports. In RANLP, pages 604-609.
25. Mike Mintz, Steven Bills, Rion Snow, and Dan Jurafsky. 2009. Distant supervision for relation extraction without labeled data. In Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 2 - Volume 2, ACL '09, pages 1003-1011, Stroudsburg, PA, USA. Association for Computational Linguistics.
26. Jong C Park, Hyun Sook Kim, and Jung-Jae Kim. 2001. Bidirectional incremental parsing for automatic pathway identification with combinatory categorial grammar. In Pacific Symposium on Biocomputing, volume 6, pages 396-407.
27. F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay. 2011. Scikit-learn: Machine learning in Python. Journal of Machine Learning Research, 12:2825-2830.
28. Longhua Qian and Guodong Zhou. 2012. Tree kernel-based proteinprotein interaction extraction from biomedical literature. Journal of Biomedical Informatics, 45(3):535 - 543.
29. Sebastian Riedel, Limin Yao, and Andrew McCallum. 2010. Modeling relations and their mentions without labeled text. In Machine Learning and Knowledge Discovery in Databases, pages 148-163. Springer.
30. Bryan Rink, Sanda Harabagiu, and Kirk Roberts. 2011. Automatic extraction of relations between medical concepts in clinical texts. Journal of the American Medical Informatics Association, 18(5):594-600.
31. Roland Roller and Mark Stevenson. 2014. Applying umls for distantly supervised relation detection. In Proceedings of the 5th International Workshop on Health Text Mining and Information Analysis (Louhi), pages 80-84, Gothenburg, Sweden, April. Association for Computational Linguistics.
32. Barbara Rosario and Marti A. Hearst. 2004. Classifying semantic relations in bioscience texts. In Proceedings of the 42Nd Annual Meeting on Association for Computational Linguistics, ACL '04, Stroudsburg, PA, USA. Association for Computational Linguistics.
33. Yue Shang, Yanpeng Li, Hongfei Lin, and Zhihao Yang. 2011. Enhancing biomedical text summarization using semantic relation extraction. PLoS ONE, 6(8):1-10, 08.
34. Ranti D Sharma, Samarth Tripathi, Sunil K Sahu, Sudhanshu Mittal, and Ashish Anand. 2016. Predicting online doctor ratings from user reviews using convolutional neural networks. International Journal of Machine Learning and Computing, 6(2):149.
35. Qiang Song, Yousuke Watanabe, and Haruo Yokota. 2011. Relationship extraction methods based on co-occurrence in web pages and files. In Proceedings of the 13th International Conference on Information Integration and Web-based Applications and Services, iiWAS '11, pages 82-89, New York, NY, USA. ACM.
36. Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. 2014. Dropout: A simple way to prevent neural networks from overfitting. The Journal of Machine Learning Research, 15(1):1929-1958.
37. Benjamin J Stapley and Gerry Benoit. 2000. Biobibliometrics: Information retrieval and visualization from co-occurrences of gene names in medline abstracts. In Pac Symp Biocomput, volume 5, pages 529-540.
38. Weiyi Sun, Anna Rumshisky, and Ozlem Uzuner. 2013. Evaluating temporal relations in clinical text: 2012 i2b2 challenge. Journal of the American Medical Informatics Association, 20(5).
39. MUNEEB TH, Sunil Sahu, and Ashish Anand. 2015. Evaluating distributed word representations for capturing semantics of biomedical concepts. In Proceedings of BioNLP 15, pages 158-163, Beijing, China, July. Association for Computational Linguistics.
40. James Thomas, David Milward, Christos Ouzounis, Stephen Pulman, and Mark Carroll. 2000. Automatic extraction of protein interactions from scientific. In Pacific symposium on biocomputing, volume 5, pages 538-549.
41. Özlem Uzuner, Yuan Luo, and Peter Szolovits. 2007. Evaluating the state-of-the-art in automatic deidentification. Journal of the American Medical Informatics Association, 14(5):550-563.
42. Özlem Uzuner, Ira Goldstein, Yuan Luo, and Isaac Kohane. 2008. Identifying patient smoking status from medical discharge records. Journal of the American Medical Informatics Association, 15(1):14-24.
43. Özlem Uzuner, Imre Solti, and Eithon Cadag. 2010. Extracting medication information from clinical text. Journal of the American Medical Informatics Association, 17(5):514-518.
44. Özlem Uzuner, Brett R South, Shuying Shen, and Scott L DuVall. 2011. 2010 i2b2/va challenge on concepts, assertions, and relations in clinical text. Journal of the American Medical Informatics Association, 18(5):552-556.
45. Erik M. van Mulligen, Annie Fourrier-Reglat, David Gurwitz, Mariam Molokhia, Ainhoa Nieto, Gianluca Trifiro, Jan Kors, and Laura I Furlong. 2012. The EU-ADR corpus: Annotated drugs, diseases, targets, and their relationships. Journal of biomedical informatics, 45(5):879-884.
46. Fei-Yu Xu. 2008. Bootstrapping Relation Extraction from Semantic Seeds. Ph.D. thesis, Saarland University.
47. Wenpeng Yin and Hinrich Schtze. 2015. Multichannel variable-size convolution for sentence classification. In Afra Alishahi and Alessandro Moschitti, editors, CoNLL, pages 204-214. ACL.
48. Dmitry Zelenko, Chinatsu Aone, and Anthony Richardella. 2003. Kernel methods for relation extraction. The Journal of Machine Learning Research, 3:1083-1106.
49. Daojian Zeng, Kang Liu, Siwei Lai, Guangyou Zhou, and Jun Zhao. 2014. Relation classification via convolutional deep neural network. In COLING 2014, 25th International Conference on Computational Linguistics, Proceedings of the Conference: Technical Papers, August 23-29, 2014, Dublin, Ireland, pages 2335-2344.