An attention-based BiLSTM-CRF approach to document-level chemical named entity recognition

Bioinformatics

Volumn 34, Issue 8, 2018, Pages 1381-1388

  Luo, Ling ^a   Yang, Zhihao ^a   Yang, Pei ^a   Zhang, Yin ^b   Wang, Lei ^b   Lin, Hongfei ^a   Wang, Jian ^a  

^a DALIAN UNIVERSITY OF TECHNOLOGY   (China)

^b Beijing Institute of Health Service and Medical Information   (China)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL NEURAL NETWORK; CHEMISTRY; DATA MINING; MEDICAL RESEARCH; NOMENCLATURE; PROCEDURES;

BIOMEDICAL RESEARCH; CHEMISTRY; DATA MINING; NEURAL NETWORKS (COMPUTER); TERMINOLOGY AS TOPIC;

EID: 85046730956     PISSN: 13674803     EISSN: 14602059     Source Type: Journal    
DOI: 10.1093/bioinformatics/btx761     Document Type: Article

References (36)

1. Bahdanau, D. et al. (2015) Neural machine translation by jointly learning to align and translate. In: International Conference on Learning Representations.
2. Bergstra, J. and Bengio, Y. (2012) Random search for hyper-parameter optimization. J. Mach. Learn. Res., 13, 281-305.
3. Bharadwaj, A. et al. (2016) Phonologically aware neural model for named entity recognition in low resource transfer settings. EMNLP, 2016, 1462-1472.
4. Bottou, L. (1991) Stochastic gradient learning in neural networks. In: Proceedings of Neuro-Nimes, p. 91.
5. Chalapathy, R. et al. (2016) An investigation of recurrent neural architectures for drug name recognition. In: Proceedings of the Seventh International Workshop on Health Text Mining and Information Analysis (LOUHI), pp. 1-5.
6. Collobert, R. et al. (2011) Natural language processing (almost) from scratch. J. Mach. Learn. Res., 12, 2493-2537.
7. Davis, A.P. et al. (2009) Comparative Toxicogenomics Database: a knowledgebase and discovery tool for chemical-gene-disease networks. Nucleic Acids Res., 37, D786-D792.
8. Degtyarenko, K. et al. (2008) ChEBI: a database and ontology for chemical entities of biological interest. Nucleic Acids Res., 36, D344-D350.
9. Eltyeb, S. and Salim, N. (2014) Chemical named entities recognition: a review on approaches and applications. J. Cheminf., 6, 17.
10. Finkel, J.R. et al. (2005) Incorporating non-local information into information extraction systems by gibbs sampling. In: Proceedings of the 43rd annual meeting on association for computational linguistics., pp. 363-370.
11. Hettne, K.M. et al. (2009) A dictionary to identify small molecules and drugs in free text. Bioinformatics, 25, 2983-2991.
12. Hochreiter, S. and Schmidhuber, J. (1997) Long short-term memory. Neural Comput., 9, 1735-1780.
13. Huang, Z. et al. (2015) Bidirectional LSTM-CRF models for sequence tagging. arXiv preprint arXiv: 1508.01991.
14. Krallinger, M. et al. (2015) CHEMDNER: The drugs and chemical names extraction challenge. J. Cheminform., 7, S1.
15. Lai, S. et al. (2016) How to generate a good word embedding. IEEE Intell. Syst., 31, 5-14.
16. Lai, S. et al. (2015) Recurrent convolutional neural networks for text classification. AAAI, 2267-2273.
17. Lample, G. et al. (2016) Neural architectures for named entity recognition. In: Proceedings of NAACL-HLT. pp. 260-270.
18. Leaman, R. and Lu, Z. (2016) TaggerOne: joint named entity recognition and normalization with semi-Markov Models. Bioinformatics, 32, 2839-2846.
19. Leaman, R. et al. (2015) tmChem: a high performance approach for chemical named entity recognition and normalization. Journal of Cheminformatics, 7.
20. Li, L. et al. (2015) Biomedical named entity recognition based on extended recurrent neural networks. In: 2015 IEEE International Conference on Bioinformatics and Biomedicine (BIBM). IEEE, pp. 649-652.
21. Li, J. et al. (2016) BioCreative V CDR task corpus: a resource for chemical disease relation extraction. Database, 2016, 1-10.
22. Liu, S. et al. (2015) Drug name recognition: approaches and resources. Information, 6, 790-810.
23. Lu, Y. et al. (2015) CHEMDNER system with mixed conditional random fields and multi-scale word clustering. J. Cheminf., 7, S4.
24. Ma, X. and Hovy, E. (2016) End-to-end sequence labeling via bi-directional lstm-cnns-crf. In: Proceedings of ACL, pp. 1064-1074.
25. Mikolov, T. et al. (2013) Distributed representations of words and phrases and their compositionality. Adv. Neural Inf. Process. Syst., 2, 3111-3119.
26. Mnih, V. et al. (2014) Recurrent models of visual attention. Adv. Neural Inf. Process. Syst., 2, 2204-2212.
27. Pandey, C. et al. (2017) Improving RNN with attention and embedding for adverse drug reactions. In: Proceedings of the 2017 International Conference on Digital Health. ACM, pp. 67-71.
28. Pennington, J. et al. (2014) Glove: Global vectors for word representation. In: Proceedings of the Empiricial Methods in Natural Language Processing (EMNLP 2014), vol. 12, pp. 1532-1543.
29. Prechelt, L. (1998) Automatic early stopping using cross validation: quantifying the criteria. Neural Netw., 11, 761-767.
30. Ratinov, L. and Roth, D. (2009) Design challenges and misconceptions in named entity recognition. In: Proceedings of CoNLL. Association for Computational Linguistics, pp. 147-155.
31. Rei, M. et al. (2016) Attending to characters in neural sequence labeling models. arXiv preprint arXiv: 1611.04361.
32. Rocktäschel, T. et al. (2012) ChemSpot: a hybrid system for chemical named entity recognition. Bioinformatics, 28, 1633-1640.
33. Sahu, S.K. and Anand, A. (2016) Recurrent neural network models for disease name recognition using domain invariant features. In: Proceedings of ACL, pp.2216-2225
34. Segura Bedmar, I. et al. (2013) Semeval-2013 Task 9: Extraction of Drug-Drug Interactions from Biomedical Texts (Ddiextraction 2013). In: Proceedings of the 7th International Workshop on Semantic Evaluation, Atlanta, Association for Computational Linguistics, pp. 341-350.
35. Usié, A. et al. (2014) CheNER: chemical named entity recognizer. Bioinformatics, 30, 1039-1040.
36. Viterbi, A. (1967) Error bounds for convolutional codes and an asymptotically optimum decoding algorithm. IEEE Trans. Inf. Theory, 13, 260-269.