Identifying adverse drug event information in clinical notes with distributional semantic representations of context

Journal of Biomedical Informatics

Volumn 57, Issue , 2015, Pages 333-349

  Henriksson, Aron ^a   Kvist, Maria ^a,b   Dalianis, Hercules ^a   Duneld, Martin ^a  

^a STOCKHOLM UNIVERSITY   (Sweden)

^b KAROLINSKA INSTITUTE   (Sweden)

Author keywords

Adverse drug events; Corpus annotation; Distributional semantics; Electronic health records; Machine learning; Relation extraction

Indexed keywords

ARTIFICIAL INTELLIGENCE; CLUSTERING ALGORITHMS; DIAGNOSIS; HEALTH; LEARNING SYSTEMS; NATURAL LANGUAGE PROCESSING SYSTEMS; PATIENT TREATMENT; RECORDS MANAGEMENT; SEMANTICS; VECTOR SPACES;

ADVERSE DRUG EVENTS; CORPUS ANNOTATIONS; DISTRIBUTIONAL SEMANTICS; ELECTRONIC HEALTH RECORD; RELATION EXTRACTION;

ELECTRONIC DOCUMENT EXCHANGE;

ADVERSE DRUG REACTION; ARTICLE; CONTROLLED STUDY; DATA ANALYSIS; DISTRIBUTIONAL SEMANTICS; DRUG INDICATION; DRUG INFORMATION; ELECTRONIC MEDICAL RECORD; MATHEMATICAL MODEL; MEDICAL TERMINOLOGY; PRIORITY JOURNAL; SEMANTICS; SWEDEN; DATA MINING; ELECTRONIC HEALTH RECORD; HUMAN; INFORMATION PROCESSING;

DATA CURATION; DATA MINING; DRUG-RELATED SIDE EFFECTS AND ADVERSE REACTIONS; ELECTRONIC HEALTH RECORDS; HUMANS; SEMANTICS;

EID: 84949514782     PISSN: 15320464     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jbi.2015.08.013     Document Type: Article

References (88)

1. Jensen P.B., Jensen L.J., Brunak S. Mining electronic health records: towards better research applications and clinical care. Nat. Rev. Genet. 2012, 13(6):395-405.
2. Meystre S.M., Savova G.K., Kipper-Schuler K.C., Hurdle J.F., et al. Extracting information from textual documents in the electronic health record: a review of recent research. Yearb. Med. Inform. 2008, 35:128-144.
3. Smith K., Megyesi B., Velupillai S., Kvist M. Professional language in Swedish clinical text: linguistic characterization and comparative studies. Nord. J. Linguist. 2014, 37(02):297-323.
4. Sibbald B. Rofecoxib (vioxx) voluntarily withdrawn from market. Can. Med. Assoc. J. 2004, 171(9):1027-1028.
5. Furberg C.D., Pitt B. Withdrawal of cerivastatin from the world market. Curr. Control Trials Cardiovasc Med. 2001, 2(5):205-207.
6. Beijer H., De Blaey C. Hospitalisations caused by adverse drug reactions (adr): a meta-analysis of observational studies. Pharm. World Sci. 2002, 24(2):46-54.
7. Howard R., Avery A., Slavenburg S., Royal S., Pipe G., Lucassen P., Pirmohamed M. Which drugs cause preventable admissions to hospital? a systematic review. Brit. J. Clin. Pharmacol. 2007, 63(2):136-147.
8. Hakkarainen K.M., Hedna K., Petzold M., Hägg S. Percentage of patients with preventable adverse drug reactions and preventability of adverse drug reactions - a meta-analysis. PloS One 2012, 7(3):e33236.
9. Goldman S.A. Limitations and strengths of spontaneous reports data. Clin. Ther. 1998, 20:C40-C44.
10. Hazell L., Shakir S.A. Under-reporting of adverse drug reactions. Drug Safety 2006, 29(5):385-396.
11. Van Mulligen E.M., Fourrier-Reglat A., Gurwitz D., Molokhia M., Nieto A., Trifiro G., Kors J.A., Furlong L.I. The EU-ADR corpus: annotated drugs, diseases, targets, and their relationships. J. Biomed. Inform. 2012, 45(5):879-884.
12. Sarker A., Ginn R., Nikfarjam A., O'Connor K., Smith K., Jayaraman S., Upadhaya T., Gonzalez G. Utilizing social media data for pharmacovigilance: a review. J. Biomed. Inform. 2015, 54:202-212.
13. Harpaz R., Haerian K., Chase H.S., Friedman C. Mining electronic health records for adverse drug effects using regression based methods. Proceedings of the 1st ACM International Health Informatics Symposium 2010, 100-107. ACM.
14. Chazard E., Ficheur G., Bernonville S., Luyckx M., Beuscart R. Data mining to generate adverse drug events detection rules. IEEE Trans. Inform. Technol. Biomed. 2011, 15(6):823-830.
15. Zhao J., Henriksson A., Boström H. Detecting adverse drug events using concept hierarchies of clinical codes. IEEE International Conference on Healthcare Informatics 2014, 285-293. IEEE.
16. Zhao J., Henriksson A., Asker L., Boström H. Detecting adverse drug events with multiple representations of clinical measurements. IEEE International Conference on Bioinformatics and Biomedicine 2014, 536-543. IEEE.
17. J. Zhao, A. Henriksson, M. Kvist, L. Asker, H. Boström, Handling temporality of clinical events for derug safety surveillance, in: AMIA Annual Proceedings, American Medical Informatics Association, 2015.
18. Eriksson R., Jensen P.B., Frankild S., Jensen L.J., Brunak S. Dictionary construction and identification of possible adverse drug events in Danish clinical narrative text. J. Am. Med. Inform. Assoc. 2013, 20(5):947-953.
19. Eriksson R., Werge T., Jensen L.J., Brunak S. Dose-specific adverse drug reaction identification in electronic patient records: temporal data mining in an inpatient psychiatric population. Drug Safety 2014, 37(4):237-247.
20. Wang X., Hripcsak G., Markatou M., Friedman C. Active computerized pharmacovigilance using natural language processing, statistics, and electronic health records: a feasibility study. J. Am. Med. Inform. Assoc. 2009, 16(3):328-337.
21. LePendu P., Iyer S., Fairon C., Shah N.H., et al. Annotation analysis for testing drug safety signals using unstructured clinical notes. J. Biomed. Semant. 2012, 3(S-1):S5.
22. LePendu P., Iyer S.V., Bauer-Mehren A., Harpaz R., Mortensen J.M., Podchiyska T., Ferris T.A., Shah N.H. Pharmacovigilance using clinical notes. Clin. Pharmacol. Ther. 2013, 93(6):547-555.
23. Iyer S.V., Harpaz R., LePendu P., Bauer-Mehren A., Shah N.H. Mining clinical text for signals of adverse drug-drug interactions. J. Am. Med. Inform. Assoc. 2014, 21(2):353-362.
24. Aramaki E., Miura Y., Tonoike M., Ohkuma T., Masuichi H., Waki K., Ohe K. Extraction of adverse drug effects from clinical records. Stud. Health Technol. Inform. 2010, 160(Pt 1):739-743.
25. S. Santiso, A. Pérez, K. Gojenola, I. Taldea, A. Casillas, M. Oronoz, Adverse Drug Event prediction combining shallow analysis and machine learning, in: Proceedings of the 5th International Workshop on Health Text Mining and Information Analysis (Louhi) at EACL, 2014, pp. 85-89.
26. Uzuner Ö., Solti I., Cadag E. Extracting medication information from clinical text. J. Am. Med. Inform. Assoc. 2010, 17(5):514-518.
27. Uzuner Ö., South B.R., Shen S., DuVall S.L. 2010 i2b2/va challenge on concepts, assertions, and relations in clinical text. J. Am. Med. Inform. Assoc. 2011, 18(5):552-556.
28. Pradhan S., Elhadad N., Chapman W., Manandhar S., Savova G. Semeval-2014 task 7: analysis of clinical text. SemEval 2014 2014, 199(99):54.
29. Pradhan S., Elhadad N., South B.R., Martinez D., Christensen L., Vogel A., Suominen H., Chapman W.W., Savova G. Evaluating the state of the art in disorder recognition and normalization of the clinical narrative. J. Am. Med. Inform. Assoc. 2015, 22(1):143-154.
30. C. Friedman, Towards a comprehensive medical language processing system: methods and issues, in: Proceedings of the AMIA Annual Fall Symposium, American Medical Informatics Association, 1997, pp. 595.
31. Aronson A.R., Lang F.-M. An overview of metamap: historical perspective and recent advances. J. Am. Med. Inform. Assoc. 2010, 17(3):229-236.
32. Savova G.K., Masanz J.J., Ogren P.V., Zheng J., Sohn S., Kipper-Schuler K.C., Chute C.G. Mayo clinical text analysis and knowledge extraction system (ctakes): architecture, component evaluation and applications. J. Am. Med. Inform. Assoc. 2010, 17(5):507-513.
33. de Bruijn B., Cherry C., Kiritchenko S., Martin J., Zhu X. Machine-learned solutions for three stages of clinical information extraction: the state of the art at i2b2 2010. J. Am. Med. Inform. Assoc. 2011, 18(5):557-562.
34. Tang B., Cao H., Wu Y., Jiang M., Xu H. Recognizing clinical entities in hospital discharge summaries using structural support vector machines with word representation features. BMC Med. Inform. Decis. Making 2013, 13(Suppl 1):S1.
35. Zhang Y., Wang J., Tang B., Wu Y., Jiang M., Chen Y., Xu H. Uth_ccb: a report for semeval 2014-task 7 analysis of clinical text. SemEval 2014, 802-806.
36. Skeppstedt M., Kvist M., Nilsson G.H., Dalianis H. Automatic recognition of disorders, findings, pharmaceuticals and body structures from clinical text: An annotation and machine learning study. J. Biomed. Inform. 2014, 49:148-158.
37. Chapman W.W., Bridewell W., Hanbury P., Cooper G.F., Buchanan B.G. A simple algorithm for identifying negated findings and diseases in discharge summaries. J. Biomed. Inform. 2001, 34(5):301-310.
38. Chapman W.W., Hilert D., Velupillai S., Kvist M., Skeppstedt M., Chapman B.E., Conway M., Tharp M., Mowery D.L., Deleger L. Extending the NegEx lexicon for multiple languages. Stud. Health Technol. Inform. 2013, 192:677.
39. Skeppstedt M. Negation detection in Swedish clinical text: an adaption of NegEx to Swedish. J. Biomed. Seman. 2011, 2(S-3):S3.
40. I. Goldin, W.W. Chapman, Learning to detect negation with 'not' in medical texts, in: Proc. Workshop on Text Analysis and Search for Bioinformatics, ACM SIGIR, 2003.
41. Huang Y., Lowe H.J. A novel hybrid approach to automated negation detection in clinical radiology reports. J. Am. Med. Inform. Assoc. 2007, 14(3):304-311.
42. Wu S., Miller T., Masanz J., Coarr M., Halgrim S., Carrell D., Clark C. Negation's not solved: generalizability versus optimizability in clinical natural language processing. PloS One 2014, 9(11):e112774.
43. Uzuner Ö., Zhang X., Sibanda T. Machine learning and rule-based approaches to assertion classification. J. Am. Med. Inform. Assoc. 2009, 16(1):109-115.
44. S. Velupillai, Shades of Certainty: Annotation and Classification of Swedish Medical Records, Doctoral Thesis, Stockholm University, 2012.
45. Harkema H., Dowling J.N., Thornblade T., Chapman W.W. Context: an algorithm for determining negation, experiencer, and temporal status from clinical reports. J. Biomed. Inform. 2009, 42(5):839-851.
46. Lin Y.-K., Chen H., Brown R.A. Medtime: a temporal information extraction system for clinical narratives. J. Biomed. Inform. 2013, 46:S20-S28.
47. Sun W., Rumshisky A., Uzuner O. Evaluating temporal relations in clinical text: 2012 i2b2 challenge. J. Am. Med. Inform. Assoc. 2013, amiajnl-2013.
48. Bethard S., Derczynski L., Pustejovsky J., Verhagen M. Semeval-2015 task 6: clinical tempeval. Proceedings of the 9th International Workshop on Semantic Evaluation (SemEval 2015) 2015, Association for Computational Linguistics.
49. S. Velupillai, Temporal expressions in swedish medical text - a pilot study, in: Proceedings of BioNLP, 2014, pp. 88-92.
50. Shatkay H., Feldman R. Mining the biomedical literature in the genomic era: an overview. J. Comput. Biol. 2003, 10(6):821-855.
51. Giuliano C., Lavelli A., Romano L. Exploiting shallow linguistic information for relation extraction from biomedical literature. EACL 2006, vol. 18:401-408. Citeseer.
52. Rink B., Harabagiu S., Roberts K. Automatic extraction of relations between medical concepts in clinical texts. J. Am. Med. Inform. Assoc. 2011, 18(5):594-600.
53. Sun A., Grishman R., Sekine S. Semi-supervised relation extraction with large-scale word clustering. Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies 2011, vol. 1:521-529. Association for Computational Linguistics.
54. Miller S., Guinness J., Zamanian A. Name tagging with word clusters and discriminative training. HLT-NAACL 2004, vol. 4:337-342. Citeseer.
55. Turian J., Ratinov L., Bengio Y. Word representations: a simple and general method for semi-supervised learning. Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics 2010, 384-394. Association for Computational Linguistics.
56. Z.S. Harris, Distributional Structure, Word.
57. Turney P.D., Pantel P., et al. From frequency to meaning: vector space models of semantics. J. Artif. Intell. Res. 2010, 37(1):141-188.
58. Cohen T., Widdows D. Empirical distributional semantics: methods and biomedical applications. J. Biomed. Inform. 2009, 42(2):390-405.
59. A. Henriksson, Semantic Spaces of Clinical Text: Leveraging Distributional Semantics for Natural Language Processing of Electronic Health Records, Licentiate Thesis, Stockholm University, 2013.
60. Henriksson A., Moen H., Skeppstedt M., Daudaravicius V., Duneld M. Synonym extraction and abbreviation expansion with ensembles of semantic spaces. J. Biomed. Seman. 2014, 5:6.
61. Henriksson A., Dalianis H., Kowalski S. Generating features for named entity recognition by learning prototypes in semantic space: the case of de-identifying health records. IEEE International Conference on Bioinformatics and Biomedicine 2014, 450-457. IEEE.
62. M. Sahlgren, The Word-Space Model: Using Distributional Analysis to Represent Syntagmatic and Paradigmatic Relations Between Words in High-Dimensional Vector Spaces, Ph.D. Thesis, Stockholm University, 2006.
63. G. Lapesa, S. Evert, S.S. im Walde, Contrasting syntagmatic and paradigmatic relations: insights from distributional semantic models, in: Proceedings of the Third Joint Conference on Lexical and Computational Semantics (*SEM 2014), 2014, pp. 160-170.
64. Lapesa G., Evert S. A large scale evaluation of distributional semantic models: parameters, interactions and model selection. Trans. Assoc. Comput. Linguist. 2014, 2:531-545.
65. A. Henriksson, Learning multiple distributed prototypes of semantic categories for named entity recognition, Int. J. Data Min. Biomed. (in press).
66. H. Dalianis, M. Hassel, A. Henriksson, M. Skeppstedt, Stockholm EPR Corpus: a clinical database used to improve health care, in: Swedish Language Technology Conference, SLTC-2012, 2012, pp. 17-18.
67. Stausberg J., Hasford J. Drug-related admissions and hospital-acquired adverse drug events in Germany: a longitudinal analysis from 2003 to 2007 of ICD-10-coded routine data. BMC Health Serv. Res. 2011, 11(1):134.
68. Stenetorp P., Pyysalo S., Topić G., Ohta T., Ananiadou S., Tsujii J. Brat: a web-based tool for nlp-assisted text annotation. Proceedings of the Demonstrations at the 13th Conference of the European Chapter of the Association for Computational Linguistics 2012, 102-107. Association for Computational Linguistics.
69. J. Lafferty, A. McCallum, F.C. Pereira, Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data.
70. T. Kudo, CRF++: Yet Another CRF Toolkit. http://crfpp. sourceforge.net
71. Breiman L. Random forests. Mach. Learn. 2001, 45(1):5-32.
72. Sun Y., Wong A.K., Kamel M.S. Classification of imbalanced data: a review. Int. J. Pattern Recogn. Artif. Intell. 2009, 23(04):687-719.
73. C. Chen, A. Liaw, L. Breiman, Using Random Forest to Learn Imbalanced Data, University of California, Berkeley.
74. Pedregosa F., Varoquaux G., Gramfort A., Michel V., Thirion B., Grisel O., Blondel M., Prettenhofer P., Weiss R., Dubourg V. Scikit-learn: machine learning in python. J. Mach. Learn. Res. 2011, 12:2825-2830.
75. T. Mikolov, K. Chen, G. Corrado, J. Dean, Efficient estimation of word representations in vector space, in: ICLR Workshop, 2013.
76. M. Baroni, G. Dinu, G. Kruszewski, Don't count, predict! a systematic comparison of context-counting vs. context-predicting semantic vectors, in: Association for Computational Linguistics, vol. 1, 2014, pp. 238-247.
77. Y. Goldberg, O. Levy, Word2vec Explained: Deriving Mikolov et al.'s Negative-Sampling Word-Embedding Method, Available from: arXiv:. arxiv:1402.3722.
78. Östling R. Stagger: an open-source part of speech tagger for swedish. Northern Euro. J. Lang. Technol. 2013, 3:1-18.
79. Japkowicz N., Shah M. Evaluating Learning Algorithms: A Classification Perspective 2011, Cambridge University Press.
80. Demšar J. Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 2006, 7:1-30.
81. Hommel G. A stagewise rejective multiple test procedure based on a modified Bonferroni test. Biometrika 1988, 75(2):383-386.
82. Lingren T., Deleger L., Molnar K., Zhai H., Meinzen-Derr J., Kaiser M., Stoutenborough L., Li Q., Solti I. Evaluating the impact of pre-annotation on annotation speed and potential bias: natural language processing gold standard development for clinical named entity recognition in clinical trial announcements. J. Am. Med. Inform. Assoc. 2013, amiajnl-2013.
83. Chapman W.W., Dowling J.N., Hripcsak G. Evaluation of training with an annotation schema for manual annotation of clinical conditions from emergency department reports. Int. J. Med. Inform. 2008, 77(2):107-113.
84. Jonnalagadda S., Cohen T., Wu S., Gonzalez G. Enhancing clinical concept extraction with distributional semantics. J. Biomed. Inform. 2012, 45(1):129-140.
85. Zhang S., Elhadad N. Unsupervised biomedical named entity recognition: experiments with clinical and biological texts. J. Biomed. Inform. 2013, 46(6):1088-1098.
86. Henriksson A., Conway M., Duneld M., Chapman W.W. Identifying synonymy between SNOMED clinical terms of varying length using distributional analysis of electronic health records. AMIA Annual Symposium Proceedings 2013, 600-609. American Medical Informatics Association.
87. Henriksson A., Skeppstedt M., Kvist M., Duneld M., Conway M. Corpus-driven terminology development: populating swedish SNOMED CT with synonyms extracted from electronic health records. Proceedings of BioNLP 2013, Association for Computational Linguistics.
88. A. Henriksson, M. Hassel, Optimizing the dimensionality of clinical term spaces for improved diagnosis coding support, in: Proceedings of Louhi Workshop on Health Document Text Mining and Information Analysis, 2013.