Boosting drug named entity recognition using an aggregate classifier

Artificial Intelligence in Medicine

Volumn 65, Issue 2, 2015, Pages 145-153

  Korkontzelos, Ioannis ^a   Piliouras, Dimitrios ^a   Dowsey, Andrew W ^b,c   Ananiadou, Sophia ^a  

^a UNIVERSITY OF MANCHESTER   (United Kingdom)

^b UNIVERSITY OF MANCHESTER   (United Kingdom)

^c MANCHESTER UNIVERSITY NHS FOUNDATION TRUST   (United Kingdom)

Author keywords

Drug named entity recognition; Genetic programming evolved string similarity patterns; Gold standard vs. silver standard annotations; Named entity annotation sparsity; Named entity recogniser aggregation

Indexed keywords

ARTIFICIAL INTELLIGENCE; CLASSIFICATION (OF INFORMATION); GENETIC ALGORITHMS; GENETIC PROGRAMMING; LEARNING SYSTEMS; NATURAL LANGUAGE PROCESSING SYSTEMS; PHARMACOKINETICS; SILVER; SUPERVISED LEARNING; VOTING MACHINES;

CLASSIFICATION PERFORMANCE; GOLD STANDARDS; MULTINOMIAL LOGISTIC REGRESSION; NAMED ENTITIES; NAMED ENTITY RECOGNITION; PHARMACOKINETIC PARAMETERS; STRING SIMILARITY; SUPERVISED MACHINE LEARNING;

GOLD;

BENZOCAINE; BROMAZEPAM; DOBUTAMINE; ENPROFYLLINE; EPROSARTAN; FLUCONAZOLE; HALOXAZOLAM; HESPERETIN; LEPIRUDIN; NEVIRAPINE; SAQUINAVIR; DRUG;

ACCURACY; ARTICLE; DRUG DATABASE; DRUG NAMED ENTITY RECOGNITION; DRUG NOMENCLATURE; GOLD STANDARD; KNOWLEDGE BASE; NATURAL LANGUAGE PROCESSING; PRIORITY JOURNAL; MACHINE LEARNING; PHARMACOKINETICS;

MACHINE LEARNING; PHARMACEUTICAL PREPARATIONS; PHARMACOKINETICS;

EID: 84943586410     PISSN: 09333657     EISSN: 18732860     Source Type: Journal    
DOI: 10.1016/j.artmed.2015.05.007     Document Type: Article

References (62)

1. Cohen A.M., Hersh W.R. A survey of current work in biomedical text mining. Brief Bioinform 2005, 6(1):57-71.
2. Ananiadou S., McNaught J. Text Mining for Biology and Biomedicine 2005, Artech House, Inc., Norwood, MA, USA.
3. U.S. Food and Drug Administration. How FDA Reviews Proposed Drug Names. [online, accessed 15.04.15]. http://www.fda.gov/downloads/Drugs/DrugSafety/MedicationErrors/ucm080867.pdf.
4. Wishart D.S., Knox C., Guo A.C., Cheng D., Shrivastava S., Tzur D., et al. DrugBank: a knowledgebase for drugs, drug actions and drug targets. Nucl Acids Res 2008, 36(Suppl. 1):D901-D906.
5. Subhadarshini A., Karnik S., Wang Z., Philips S., Duke J., Quinney S., et al. An integrated pharmacokinetics ontology and semantically annotated corpus for text mining. Proceedings of Summit on Translational Bioinformatics 2012, American Medical Informatics Association (AMIA), Bethesda, MD, USA.
6. Linguistic Data Consortium ACE (Automatic Content Extraction) English Annotation Guidelines for Entities 2008, June, [online, accessed 15.04.15]. http://www.ldc.upenn.edu/sites/www.ldc.upenn.edu/files/english-entities-guidelines-v6.6.pdf.
7. Sundheim B.M. Overview of results of the MUC-6 evaluation. MUC6 1995: Proceedings of the 6th Conference on Message Understanding, MUC6 1995 1995, November, 13-31. Association for Computational Linguistics, Stroudsburg, PA, USA.
8. Chinchor N.A. MUC-7 named entity task definition. Proceedings of the Seventh Message Understanding Conference (MUC-7) 1998, April, Fairfax, VA, [version 3.5]. B. Sundheim (Ed.).
9. Tjong Kim Sang E.F. Introduction to the CoNLL-2002 shared task: language-independent named entity recognition. Proceedings of the 6th Conference on Natural Language Learning, vol. 20, COLING-02 2002, 1-4. Association for Computational Linguistics, Stroudsburg, PA, USA.
10. Tjong Kim Sang E.F., De Meulder F. Introduction to the CoNLL-2003 shared task: language-independent named entity recognition. Proceedings of the Seventh Conference on Natural Language Learning at HLT-NAACL 2003, vol. 4, CONLL 2003 2003, 142-147. Association for Computational Linguistics, Stroudsburg, PA, USA.
11. Liu F., Chen Y., Manderick B. Named entity recognition in biomedical literature: a comparison of support vector machines and conditional random fields. ICEIS (Selected Papers), vol. 12 of Lecture Notes in Business Information Processing 2007, 137-147. Springer, Berlin & Heidelberg, Germany. J. Filipe, J. Cordeiro, J. Cardoso (Eds.).
12. Goulart R.R.V., de Lima V.L.S., Xavier C.C. A systematic review of named entity recognition in biomedical texts. J Braz Comput Soc 2011, 17(2):103-116.
13. Doan S., Xu H. Recognizing medication related entities in hospital discharge summaries using support vector machine. Proceedings of the 23rd International Conference on Computational Linguistics: Posters COLING'10 2010, 259-266. Association for Computational Linguistics, Stroudsburg, PA, USA. C.-R. Huang, D. Jurafsky (Eds.).
14. Sanchez-Cisneros D., Aparicio Gali F. UEM-UC3M: an ontology-based named entity recognition system for biomedical texts. Second Joint Conference on Lexical and Computational Semantics (*SEM), vol. 2: Proceedings of the Seventh International Workshop on Semantic Evaluation (SemEval 2013) 2013, June, 622-627. Association for Computational Linguistics, Atlanta, Georgia, USA. S. Manandhar, D. Yuret (Eds.).
15. Björne J., Kaewphan S., Salakoski T. UTurku: drug named entity recognition and drug-drug interaction extraction using SVM classification and domain knowledge. Second Joint Conference on Lexical and Computational Semantics (*SEM), vol. 2: Proceedings of the Seventh International Workshop on Semantic Evaluation (SemEval 2013) 2013, June, 651-659. Association for Computational Linguistics, Atlanta, Georgia, USA. S. Manandhar, D. Yuret (Eds.).
16. Segura-Bedmar I., Martínez P., Herrero Zazo M. Semeval-2013 task 9: extraction of drug-drug interactions from biomedical texts (DDIExtraction 2013). Second Joint Conference on Lexical and Computational Semantics (*SEM), vol. 2: Proceedings of the Seventh International Workshop on Semantic Evaluation (SemEval 2013) 2013 June, 341-350. Association for Computational Linguistics, Atlanta, Georgia, USA. S. Manandhar, D. Yuret (Eds.).
17. Rebholz-Schuhmann D., Yepes A.J.J., van Mulligen E.M., Kang N., Kors J., Milward D., et al. The CALBC silver standard corpus - harmonizing multiple semantic annotations in a large biomedical corpus. Proceedings of the Third International Symposium on Languages in Biology and Medicine, LBM 2009 2009, November, 64-72.
18. Rebholz-Schuhmann D., Arregui M., Gaudan S., Kirsch H., Jimeno A. Text processing through web services: calling Whatizit. Bioinformatics 2008, 24(2):296-298.
19. Schuemie M.J., Jelier R., Kors J.A. Peregrine: Lightweight gene name normalization by dictionary lookup. Proceedings of the Second BioCreative Challenge Evaluation Workshop, BioCreative II 2007, 131-133. CNIO Centro Nacional de Investigaciones Oncológicas, Carlos III, Madrid, Spain.
20. Wermter J., Tomanek K., Hahn U. High-performance gene name normalization with GeNo. Bioinformatics 2009, 25(6):815-821.
21. Aronson A.R., Lang F.-M. An overview of MetaMap: historical perspective and recent advances. J Am Med Inform Assoc 2010, 17(3):229-236.
22. Milward D., Milligan P. Text data mining using interactive information extraction. Proceedings of the BioLink Special Interest Group on Text Mining: Linking Literature, Information and Knowledge for Biology, BioLinkSIG 2007 2007.
23. Rebholz-Schuhmann D., Jimeno-Yepes A., Li C., Kafkas S., Lewin I., Kang N., et al. Assessment of NER solutions against the first and second CALBC silver standard corpus. Semantic Mining in Biomedicine vol. 714 of CEUR Workshop Proceedings 2010, CEUR-WS.org. N. Collier, U. Hahn, D. Rebholz-Schuhmann, F. Rinaldi, S. Pyysalo (Eds.).
24. Tsuruoka Y., McNaught J., Tsujii J., Ananiadou S. Learning string similarity measures for gene/protein name dictionary look-up using logistic regression. Bioinformatics 2007, 23(20):2768-2774.
25. Kolărik C., Hofmann-Apitius M., Zimmermann M., Fluck J. Identification of new drug classification terms in textual resources. Bioinformatics 2007, 23(13):i264-i272.
26. Hearst M.A. Automatic acquisition of hyponyms from large text corpora. Proceedings of the 15th International Conference on Computational Linguistics, vol. 2, COLING 1992 1992, 539-545. Association for Computational Linguistics, Stroudsburg, PA, USA.
27. Chen E.S., Hripcsak G., Xu H., Markatou M., Friedman C. Automated acquisition of disease drug knowledge from biomedical and clinical documents: an initial study. J Am Med Inform Assoc 2008, 15(February):87-98.
28. Feng C., Yamashita F., Hashida M. Automated extraction of information from the literature on chemical-CYP3A4 interactions. J Chem Inform Model 2007, 47(6):2449-2455.
29. Hettne K.M., Stierum R.H., Schuemie M.J., Hendriksen P.J.M., Schijvenaars B.J.A., Mulligen E.M.v., et al. A dictionary to identify small molecules and drugs in free text. Bioinformatics 2009, 25(November):2983-2991.
30. Rindflesch T., Tanabe L., Weinstein J.N., Hunter L. EDGAR: extraction of drugs, genes and relations from the biomedical literature. Pacific Symposium of Biocomputing 2000, 514-525. Available from: psb.stanford.edu/psb-online/proceedings/psb00/ [accessed 15.04.15].
31. Usami Y., Cho H.-C., Okazaki N., Tsujii J. Automatic acquisition of huge training data for bio-medical named entity recognition. Proceedings of BioNLP 2011 Workshop BioNLP 2011 2011, Association for Computational Linguistics, Stroudsburg, PA, USA. K.B. Cohen, D. Demner-Fushman, S. Ananiadou, J. Pestian, J. Tsujii, B. Webber (Eds.).
32. Vlachos A., Gasperin C. Bootstrapping and evaluating named entity recognition in the biomedical domain. Proceedings of the HLT-NAACL BioNLP Workshop on Linking Natural Language and Biology LNLBioNLP 2006 2006, 138-145. Association for Computational Linguistics, New York, NY. K. Verspoor, K.B. Cohen, B. Goertzel, I. Mani (Eds.).
33. Korkontzelos I., Vlachos A., Lewin I. From gene names to actual genes. Proceedings of the BioLink Special Interest Group on Text Mining: Linking Literature, Information and Knowledge for Biology, BioLinkSIG 2007 2007.
34. Thomas P., Bobic T., Leser U., Hofmann-Apitius M., Klinger R. Weakly labeled corpora as silver standard for drug-drug and protein-protein interaction. Proceedings of the Workshop on Building and Evaluating Resources for Biomedical Text Mining (BioTxtM) on Language Resources and Evaluation Conference (LREC) 2012, May, 63-70. European Language Resources Association (ELRA), Instanbul, Turkey, Available from: www.lrec-conf.org/proceedings/lrec2012/workshops/14.BioTxtM-Proceedings.pdf#page=70 [accessed 15.04.15]. S. Ananiadou, K. Cohen, D. Demner-Fushman, P. Thompson (Eds.).
35. Kerrien S., Aranda B., Breuza L., Bridge A., Broackes-Carter F., Chen C., et al. The IntAct molecular interaction database in 2012. Nucl Acids Res 2012, 40(D1):D841-D846.
36. Dagan I., Engelson S.P. Committee-based sampling for training probabilistic classifiers. Proceedings of the Twelfth International Conference on Machine Learning the Morgan Kaufmann Series in Machine Learning 1995, 150-157. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA. A. Prieditis, S.J. Russell (Eds.).
37. Thompson C.A., Califf M.E., Mooney R.J. Active learning for natural language parsing and information extraction. Proceedings of the Sixteenth International Conference on Machine Learning the Morgan Kaufmann Series in Machine Learning 1999, 406-414. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA. I. Bratko, S. Džeroski (Eds.).
38. Tomanek K., Wermter J., Hahn U. An approach to text corpus construction which cuts annotation costs and maintains reusability of annotated data. Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL) 2007, June, 486-495. Association for Computational Linguistics, Prague, Czech Republic. J. Eisner (Ed.).
39. Tsuruoka Y., Tsujii J., Ananiadou S. Accelerating the annotation of sparse named entities by dynamic sentence selection. Proceedings of the Workshop on Current Trends in Biomedical Natural Language Processing BioNLP 2008 2008, June, 30-37. Association for Computational Linguistics, Columbus, OH, USA. D. Demner-Fushman, S. Ananiadou, K.B. Cohen, J. Pestian, J. Tsujii, B. Webber (Eds.).
40. Berger A.L., Pietra V.J.D., Pietra S.A.D. A maximum entropy approach to natural language processing. Comput Linguist 1996 Mar, 22:39-71.
41. Rosenblatt F. The perceptron: a perceiving and recognizing automaton, Report 85-460-1, Project PARA 1957, January, Cornell Aeronautical Laboratory, Ithaca, NY.
42. Radev D., Teufel S., Saggion H., Lam W., Blitzer J., Qi H., et al. Evaluation challenges in large-scale document summarization. Proceedings of the 41st Annual Meeting on Association for Computational Linguistics, vol. 1 2003, July, 375-382. Association for Computational Linguistics, Sapporo, Japan.
43. Mihăilă C., Batista-Navarro R.T.B. What's in a name? Entity type variation across two biomedical subdomains. Proceedings of the Student Research Workshop at the 13th Conference of the European Chapter of the Association for Computational Linguistics 2012, April, 38-45. Association for Computational Linguistics, Avignon, France. P. Lison, M. Nilsson, M. Recasens (Eds.).
44. Segura-Bedmar I., Martínez P., De Pablo-Sánchez C. Using a shallow linguistic kernel for drug-drug interaction extraction. J Biomed Inform 2011, October, 44:789-804.
45. Okazaki N., Ananiadou S., Tsujii J. Building a high quality sense inventory for improved abbreviation disambiguation. Bioinformatics 2010, 26(9):1246-1253.
46. Chen S.F., Goodman J. An empirical study of smoothing techniques for language modeling. Proceedings of the 34th Annual Meeting on Association for Computational Linguistics, ACL 1996 1996, 310-318. Association for Computational Linguistics, Stroudsburg, PA, USA.
47. Jelinek F., Merialdo B., Roukos S., Strauss M.J. Self-organized language modeling for speech recognition. Readings in Speech Recognition 1990, 450-506. Morgan Kaufmann, San Francisco, CA, USA. A. Waibel, K.-F. Lee (Eds.).
48. Katz S.M. Estimation of probabilities from sparse data for the language model component of a speech recognizer. IEEE Trans Acoust Speech Signal Process 1987, ASSP-35(March):400-401.
49. Collins M., Brooks J. Prepositional phrase attachment through a backed-off model. Proceedings of the Third Workshop on Very Large Corpora 1995, 27-38. Association for Computational Linguistics, Cambridge, MA, USA. D. Yarowsky, K. Church (Eds.).
50. Roth D., Zelenko D. Part of speech tagging using a network of linear separators. Proceedings of the 36th Annual Meeting of the Association for Computational Linguistics and 17th International Conference on Computational Linguistics, vol. 2, ACL 1998 1998, 1136-1142. Association for Computational Linguistics, Montreal, Quebec, Canada.
51. Bikel D.M., Schwartz R., Weischedel R.M. An algorithm that learns what's in a name. Mach Learn 1999, 34(February):211-231.
52. Zhou G., Su J., Yang L. Resolution of data sparseness in named entity recognition using hierarchical features and feature relaxation principle. Proceedings of the 6th International Conference on Computational Linguistics and Intelligent Text Processing, CICLing 2005 2005, 750-761. Springer-Verlag, Berlin & Heidelberg, Germany. A. Gelbukh (Ed.).
53. Campbell G., Mosimann J.E. Multivariate methods for proportional shape. Proceedings of the Section on Statistical Graphics, Annual Meeting of the American Statistical Association 1987, 10-17. American Statistical Association, Alexandria, VA, USA.
54. Hijazi R.H. Analysis of Compositional Data Using Dirichlet Covariate Models 2003, (Ph.D. thesis), The American University, Washington, DC, USA.
55. Hijazi R.A., Jernigan R.W. Modelling compositional data using dirichlet regression models. J Appl Probab Stat 2009, 4(1):77-91.
56. Koza J.R., Bennett F.H., Andre D., Keane M.A. Genetic Programming III: Darwinian Invention and Problem Solving. 1999, May, Morgan Kaufmann Publishers Inc., San Francisco, CA, USA. 1st ed.
57. Bennett P.N., Dumais S.T., Horvitz E. The combination of text classifiers using reliability indicators. Inform Retr 2005, 8(January):67-100.
58. Al-Kofahi K., Tyrrell A., Vachher A., Travers T., Jackson P. Combining multiple classifiers for text categorization. Proceedings of the Tenth International Conference on Information and Knowledge Management, CIKM 2001 2001, 97-104. ACM, New York, NY, USA.
59. Yang Y., Ault T., Pierce T. Combining multiple learning strategies for effective cross-validation. International Conference on Machine Learning 2000, 1167-1174. The International Machine Learning Society, Madison, WI, USA. J. Furnkranz, T. Joachims (Eds.).
60. Bi Y., Mcclean S., Anderson T. Combining rough decisions for intelligent text mining using Dempster's rule. Artif Intell Rev 2006, 26(November):191-209.
61. Si L. Boosting performance of bio-entity recognition by combining results from multiple systems. Proceedings of the 5th International Workshop on Bioinformatics, BIOKDD 2505 2005, 76-83. ACM Press, New York, NY, USA.
62. Poli R., Langdon W.B., McPhee N.F. A Field Guide to Genetic Programming 2008, Published via lulu.com and freely available at: www.gp-field-guide.org.uk, With contributions by J.R. Koza [accessed 15.04.15].