Automatically Recognizing Medication and Adverse Event Information from Food and Drug Administration's Adverse Event Reporting System Narratives

JMIR Medical Informatics

Volumn 2, Issue 1, 2014, Pages

  Ramesh, Balaji Polepalli ^a,b   Belknap, Steven M ^c   Li, Zuofeng ^a   Frid, Nadya ^a,b   West, Dennis P ^c   Yu, Hong ^a,d,e  

^a UNIVERSITY OF MASSACHUSETTS MEDICAL SCHOOL   (United States)

^b UNIVERSITY OF WISCONSIN MILWAUKEE   (United States)

^c NORTHWESTERN UNIVERSITY   (United States)

^d VA Central Western Massachusetts Healthcare System   (United States)

^e University of Massachusetts Amherst   (United States)

Author keywords

Adverse drug events; Natural language processing; Pharmacovigilance

Indexed keywords

EID: 85076125394     PISSN: None     EISSN: 22919694     Source Type: Journal    
DOI: 10.2196/medinform.3022     Document Type: Article

References (80)

1. Kohn LT, Corrigan JM, Donaldson MS. To err is human: Building a safer health system. In: To err is human: Building a safer health system. Washington, D.C: National Academy Press; 2000.
2. E 2 A Clinical Safety Data Management: Definitions and Standards for Expedited Reporting-WC500002749. pdfURL: Http://www.ema.europa.eu/docs/en-GB/document-library/Scientific-guideline/2009/09/WC500002749.pdf [accessed 2013-10-01] [WebCite Cache ID 6K2qiistb].
3. Bates DW, Cullen DJ, Laird N, Petersen LA, Small SD, Servi D, et al. Incidence of adverse drug events and potential adverse drug events. Implications for prevention. ADE Prevention Study Group. JAMA 1995 Jul 5;274(1):29-34. [Medline: 7791255].
4. Nebeker JR, Barach P, Samore MH. Clarifying adverse drug events: A clinician's guide to terminology, documentation, and reporting. Ann Intern Med 2004 May 18;140(10):795-801. [Medline: 15148066].
5. Forster AJ, Halil RB, Tierney MG. Pharmacist surveillance of adverse drug events. Am J Health Syst Pharm 2004 Jul 15;61(14):1466-1472. [Medline: 15332694].
6. Thomas EJ, Studdert DM, Burstin HR, Orav EJ, Zeena T, Williams EJ, et al. Incidence and types of adverse events and negligent care in Utah and Colorado. Med Care 2000 Mar;38(3):261-271. [Medline: 10718351].
7. Leape LL, Brennan TA, Laird N, Lawthers AG, Localio AR, Barnes BA, et al. The nature of adverse events in hospitalized patients. Results of the Harvard Medical Practice Study II. N Engl J Med 1991 Feb 7;324(6):377-384. [doi: 10.1056/NEJM199102073240605] [Medline: 1824793].
8. Classen DC, Pestotnik SL, Evans RS, Lloyd JF, Burke JP. Adverse drug events in hospitalized patients. Excess length of stay, extra costs, and attributable mortality. JAMA 1997;277(4):301-306. [Medline: 9002492].
9. Cullen DJ, Sweitzer BJ, Bates DW, Burdick E, Edmondson A, Leape LL. Preventable adverse drug events in hospitalized patients: A comparative study of intensive care and general care units. Crit Care Med 1997 Aug;25(8):1289-1297. [Medline: 9267940].
10. Cullen DJ, Bates DW, Small SD, Cooper JB, Nemeskal AR, Leape LL. The incident reporting system does not detect adverse drug events: A problem for quality improvement. Jt Comm J Qual Improv 1995 Oct;21(10):541-548. [Medline: 8556111].
11. Bates DW, Spell N, Cullen DJ, Burdick E, Laird N, Petersen LA, et al. The costs of adverse drug events in hospitalized patients. Adverse Drug Events Prevention Study Group. JAMA 1997;277(4):307-311. [Medline: 9002493].
12. FDA Adverse Events Reporting System (FAERS) > FDA Adverse Event Reporting System (FAERS) Statistics. Available. OnlineURL: Http://www.fda.gov/Drugs/GuidanceComplianceRegulatoryInformation/Surveillance/AdverseDrugEffects/ucm070093.htm [accessed 2013-10-01] [WebCite Cache ID 6K2rK4ifG].
13. Tatonetti NP, Ye PP, Daneshjou R, Altman RB. Data-driven prediction of drug effects and interactions. Sci Transl Med 2012 Mar 14;4(125):125ra31 [FREE Full text] [doi: 10.1126/scitranslmed.3003377] [Medline: 22422992].
14. Hiatt HH, Barnes BA, Brennan TA, Laird NM, Lawthers AG, Leape LL, et al. A study of medical injury and medical malpractice. N Engl J Med 1989 Aug 17;321(7):480-484. [doi: 10.1056/NEJM198908173210725] [Medline: 2761585].
15. Brennan TA, Leape LL, Laird NM, Hebert L, Localio AR, Lawthers AG, et al. Incidence of adverse events and negligence in hospitalized patients. Results of the Harvard Medical Practice Study I. N Engl J Med 1991 Feb 7;324(6):370-376. [doi: 10.1056/NEJM199102073240604] [Medline: 1987460].
16. Jha AK, Kuperman GJ, Teich JM, Leape L, Shea B, Rittenberg E, et al. Identifying adverse drug events: Development of a computer-based monitor and comparison with chart review and stimulated voluntary report. J Am Med Inform Assoc 1998 Jun;5(3):305-314 [FREE Full text] [Medline: 9609500].
17. Murff HJ, Forster AJ, Peterson JF, Fiskio JM, Heiman HL, Bates DW. Electronically screening discharge summaries for adverse medical events. J Am Med Inform Assoc 2003 Aug;10(4):339-350 [FREE Full text] [doi: 10.1197/jamia.M1201] [Medline: 12668691].
18. Hwang SH, Lee S, Koo HK, Kim Y. Evaluation of a computer-based adverse-drug-event monitor. Am J Health Syst Pharm 2008 Dec 1;65(23):2265-2272. [doi: 10.2146/ajhp080122] [Medline: 19020194].
19. Tinoco A, Evans RS, Staes CJ, Lloyd JF, Rothschild JM, Haug PJ. Comparison of computerized surveillance and manual chart review for adverse events. J Am Med Inform Assoc 2011 Aug;18(4):491-497 [FREE Full text] [doi: 10.1136/amiajnl-2011-000187] [Medline: 21672911].
20. Gardner RM, Pryor TA, Warner HR. The HELP hospital information system: Update 1998. Int J Med Inform 1999 Jun;54(3):169-182. [Medline: 10405877].
21. Hazlehurst B, Frost HR, Sittig DF, Stevens VJ. MediClass: A system for detecting and classifying encounter-based clinical events in any electronic medical record. J Am Med Inform Assoc 2005 Oct;12(5):517-529 [FREE Full text] [doi: 10.1197/jamia.M1771] [Medline: 15905485].
22. Hazlehurst B, Naleway A, Mullooly J. Detecting possible vaccine adverse events in clinical notes of the electronic medical record. Vaccine 2009 Mar 23;27(14):2077-2083. [doi: 10.1016/j.vaccine.2009.01.105] [Medline: 19428833].
23. Wang X, Hripcsak G, Markatou M, Friedman C. Active computerized pharmacovigilance using natural language processing, statistics, and electronic health records: A feasibility study. J Am Med Inform Assoc 2009 Jun;16(3):328-337 [FREE Full text] [doi: 10.1197/jamia.M3028] [Medline: 19261932].
24. Haerian K, Varn D, Vaidya S, Ena L, Chase HS, Friedman C. Detection of pharmacovigilance-related adverse events using electronic health records and automated methods. Clin Pharmacol Ther 2012 Aug;92(2):228-234 [FREE Full text] [doi: 10.1038/clpt.2012.54] [Medline: 22713699].
25. Melton GB, Hripcsak G. Automated detection of adverse events using natural language processing of discharge summaries. J Am Med Inform Assoc 2005 Aug;12(4):448-457 [FREE Full text] [doi: 10.1197/jamia.M1794] [Medline: 15802475].
26. Friedman C, Alderson PO, Austin JH, Cimino JJ, Johnson SB. A general natural-language text processor for clinical radiology. J Am Med Inform Assoc 1994 Apr;1(2):161-174 [FREE Full text] [Medline: 7719797].
27. Aramaki E, Miura Y, Tonoike M, Ohkuma T, Masuichi H, Waki K, et al. Extraction of adverse drug effects from clinical records. Stud Health Technol Inform 2010;160(Pt 1):739-743. [Medline: 20841784].
28. Yang C, Srinivasan P, Polgreen PM. Automatic adverse drug events detection using letters to the editor. AMIA Annu Symp Proc 2012;2012:1030-1039 [FREE Full text] [Medline: 23304379].
29. Gurulingappa H, Mateen-Rajput A, Toldo L. Extraction of potential adverse drug events from medical case reports. J Biomed Semantics 2012;3(1):15 [FREE Full text] [doi: 10.1186/2041-1480-3-15] [Medline: 23256479].
30. Chee BW, Berlin R, Schatz B. Predicting adverse drug events from personal health messages. AMIA Annu Symp Proc 2011;2011:217-226 [FREE Full text] [Medline: 22195073].
31. Nikfarjam A, Gonzalez GH. Pattern mining for extraction of mentions of Adverse Drug Reactions from user comments. AMIA Annu Symp Proc 2011;2011:1019-1026 [FREE Full text] [Medline: 22195162].
32. White RW, Tatonetti NP, Shah NH, Altman RB, Horvitz E. Web-scale pharmacovigilance: Listening to signals from the crowd. J Am Med Inform Assoc 2013 May 1;20(3):404-408 [FREE Full text] [doi: 10.1136/amiajnl-2012-001482] [Medline: 23467469].
33. Shetty KD, Dalal SR. Using information mining of the medical literature to improve drug safety. J Am Med Inform Assoc 2011 Oct;18(5):668-674 [FREE Full text] [doi: 10.1136/amiajnl-2011-000096] [Medline: 21546507].
34. Lindquist M. VigiBase, the WHO Global ICSR Database System: Basic Facts. Therapeutic Innovation & Regulatory Science September 2008 Sep;42(5):409-419. [doi: 10.1177/009286150804200501].
35. Hauben M, Madigan D, Gerrits CM, Walsh L, Van Puijenbroek EP. The role of data mining in pharmacovigilance. Expert Opin Drug Saf 2005 Sep;4(5):929-948. [doi: 10.1517/14740338.4.5.929] [Medline: 16111454].
36. Hauben M, Bate A. Decision support methods for the detection of adverse events in post-marketing data. Drug Discov Today 2009 Apr;14(7-8):343-357. [doi: 10.1016/j.drudis.2008.12.012] [Medline: 19187799].
37. Harpaz R, DuMouchel W, Shah NH, Madigan D, Ryan P, Friedman C. Novel data-mining methodologies for adverse drug event discovery and analysis. Clin Pharmacol Ther 2012 Jun;91(6):1010-1021 [FREE Full text] [doi: 10.1038/clpt.2012.50] [Medline: 22549283].
38. Bate A, Evans SJ. Quantitative signal detection using spontaneous ADR reporting. Pharmacoepidemiol Drug Saf 2009 Jun;18(6):427-436. [doi: 10.1002/pds.1742] [Medline: 19358225].
39. Almenoff JS, Pattishall EN, Gibbs TG, DuMouchel W, Evans SJ, Yuen N. Novel statistical tools for monitoring the safety of marketed drugs. Clin Pharmacol Ther 2007 Aug;82(2):157-166. [doi: 10.1038/sj.clpt.6100258] [Medline: 17538548].
40. Evans SJ, Waller PC, Davis S. Use of proportional reporting ratios (PRRs) for signal generation from spontaneous adverse drug reaction reports. Pharmacoepidemiol Drug Saf 2001 Nov;10(6):483-486. [doi: 10.1002/pds.677] [Medline: 11828828].
41. van Puijenbroek EP, Bate A, Leufkens HG, Lindquist M, Orre R, Egberts AC. A comparison of measures of disproportionality for signal detection in spontaneous reporting systems for adverse drug reactions. Pharmacoepidemiol Drug Saf 2002 Feb;11(1):3-10. [doi: 10.1002/pds.668] [Medline: 11998548].
42. Norén GN, Sundberg R, Bate A, Edwards IR. A statistical methodology for drug-drug interaction surveillance. Stat Med 2008 Jul 20;27(16):3057-3070. [doi: 10.1002/sim.3247] [Medline: 18344185].
43. Harpaz R, Vilar S, Dumouchel W, Salmasian H, Haerian K, Shah NH, et al. Combing signals from spontaneous reports and electronic health records for detection of adverse drug reactions. J Am Med Inform Assoc 2013 May 1;20(3):413-419 [FREE Full text] [doi: 10.1136/amiajnl-2012-000930] [Medline: 23118093].
44. Sakaeda T, Kadoyama K, Okuno Y. Adverse event profiles of platinum agents: Data mining of the public version of the FDA adverse event reporting system, AERS, and reproducibility of clinical observations. Int J Med Sci 2011;8(6):487-491 [FREE Full text] [Medline: 21897761].
45. Vilar S, Harpaz R, Chase HS, Costanzi S, Rabadan R, Friedman C. Facilitating adverse drug event detection in pharmacovigilance databases using molecular structure similarity: Application to rhabdomyolysis. J Am Med Inform Assoc 2011 Dec;18 Suppl 1:i73-i80 [FREE Full text] [doi: 10.1136/amiajnl-2011-000417] [Medline: 21946238].
46. Norén GN, Bate A, Orre R, Edwards IR. Extending the methods used to screen the WHO drug safety database towards analysis of complex associations and improved accuracy for rare events. Stat Med 2006 Nov 15;25(21):3740-3757. [doi: 10.1002/sim.2473] [Medline: 16381072].
47. Hochberg AM, Hauben M, Pearson RK, O'Hara DJ, Reisinger SJ, Goldsmith DI, et al. An evaluation of three signal-detection algorithms using a highly inclusive reference event database. Drug Saf 2009;32(6):509-525. [Medline: 19459718].
48. Bate A, Lindquist M, Edwards IR, Orre R. A data mining approach for signal detection and analysis. Drug Saf 2002;25(6):393-397. [Medline: 12071775].
49. Bate A. Bayesian confidence propagation neural network. Drug Saf 2007;30(7):623-625. [Medline: 17604417].
50. DuMouchel W, Pregibon D. Empirical bayes screening for multi-item associations. In: KDD-2001. New York, NY, USA: Association for Computing Machinery; 2001 Presented at: Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining; August 26-29, 2001; San Francisco, CA, USA.
51. Bate A, Lindquist M, Edwards IR, Olsson S, Orre R, Lansner A, et al. A Bayesian neural network method for adverse drug reaction signal generation. Eur J Clin Pharmacol 1998 Jun;54(4):315-321. [Medline: 9696956].
52. Genkin A, Lewis DD, Madigan D. Large-Scale Bayesian Logistic Regression for Text Categorization. Technometrics 2007 Aug;49(3):291-304. [doi: 10.1198/004017007000000245].
53. Caster O, Norén GN, Madigan D, Bate A. Large-scale regression-based pattern discovery: The example of screening the WHO global drug safety database. Stat Anal Data Min 2010;3(4):197-208. [doi: 10.1002/sam.10078].
54. Solomon R, Dumouchel W. Contrast media and nephropathy: Findings from systematic analysis and Food and Drug Administration reports of adverse effects. Invest Radiol 2006 Aug;41(8):651-660. [doi: 10.1097/01.rli.0000229742.54589.7b] [Medline: 16829749].
55. Rouane-Hacene M, Toussaint Y, Valtchev P. Mining Safety Signals in Spontaneous Reports Database Using Concept Analysis. In: AIME Proceedings/Lecture Notes in Artificial Intelligence. Berlin, Heidelberg: Springer; 2009 Presented at: 12th Conference on Artificial Intelligence in Medicine in Europe (AIME); July 18-22, 2009; Verona, Italy p. 285-294.
56. Harpaz R, Chase HS, Friedman C. Mining multi-item drug adverse effect associations in spontaneous reporting systems. BMC Bioinformatics 2010;11 Suppl 9:S7 [FREE Full text] [doi: 10.1186/1471-2105-11-S9-S7] [Medline: 21044365].
57. Harpaz R, Perez H, Chase HS, Rabadan R, Hripcsak G, Friedman C. Biclustering of adverse drug events in the FDA's spontaneous reporting system. Clin Pharmacol Ther 2011 Feb;89(2):243-250 [FREE Full text] [doi: 10.1038/clpt.2010.285] [Medline: 21191383].
58. Ball R, Botsis T. Can network analysis improve pattern recognition among adverse events following immunization reported to VAERS? Clin Pharmacol Ther 2011 Aug;90(2):271-278. [doi: 10.1038/clpt.2011.119] [Medline: 21677640].
59. Harpaz R, DuMouchel W, LePendu P, Bauer-Mehren A, Ryan P, Shah NH. Performance of pharmacovigilance signal-detection algorithms for the FDA adverse event reporting system. Clin Pharmacol Ther 2013 Jun;93(6):539-546. [doi: 10.1038/clpt.2013.24] [Medline: 23571771].
60. Yom-Tov E, Gabrilovich E. Postmarket drug surveillance without trial costs: Discovery of adverse drug reactions through large-scale analysis of web search queries. J Med Internet Res 2013;15(6):e124 [FREE Full text] [doi: 10.2196/jmir.2614] [Medline: 23778053].
61. RADAR (Research on Adverse Drug events And Reports). Available. OnlineURL: Http://www.feinberg.northwestern.edu/news/2013/07/radar.html [accessed 2013-10-01] [WebCite Cache ID 6K2rG1Z3L].
62. Uzuner O, Solti I, Cadag E. Extracting medication information from clinical text. J Am Med Inform Assoc 2010 Oct;17(5):514-518 [FREE Full text] [doi: 10.1136/jamia.2010.003947] [Medline: 20819854].
63. Li Z, Liu F, Antieau L, Cao Y, Yu H. Lancet: A high precision medication event extraction system for clinical text. J Am Med Inform Assoc 2010 Oct;17(5):563-567 [FREE Full text] [doi: 10.1136/jamia.2010.004077] [Medline: 20819865].
64. Knowtator. URL: Http://knowtator.sourceforge.net/[accessed 2014-05-06] [WebCite Cache ID 6PNDuSsKi].
65. Protégé. URL: Http://protege.stanford.edu/[accessed 2014-05-06] [WebCite Cache ID 6PNEHutVo].
66. Cohen J. A Coefficient of Agreement for Nominal Scales. Educational and Psychological Measurement 1960;20(1). [doi: 10.1177/001316446002000104].
67. John L, Andrew M, Fernando C N P. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. 2001 Presented at: 18th International Conference on Machine Learning (ICML); 2001; Williams College, Williamstown, MA, USA p. 282-289.
68. Weka 3-Data Mining with Open Source Machine Learning Software in Java. Available. OnlineURL: Http://www. cs.waikato.ac.nz/ml/weka/[accessed 2013-10-01] [WebCite Cache ID 6K2rPJb8r].
69. Settles B. ABNER: An open source tool for automatically tagging genes, proteins and other entity names in text. Bioinformatics 2005 Jul 15;21(14):3191-3192 [FREE Full text] [doi: 10.1093/bioinformatics/bti475] [Medline: 15860559].
70. Simon T, Koller D. Support vector machine active learning with applications to text classification. The Journal of Machine Learning Research 2002;2:45-66. [doi: 10.1162/153244302760185243].
71. Thorsten J. Text categorization with support vector machines: Learning with many relevant features. In: Machine learning: ECML-98: Lecture Notes in Computer Science Volume 1398, 1998, pp 137-142. Berlin: Springer; 1998 Presented at: 10th European Conference on Machine Learning (ECML); April 1998; Chemnitz, Germany.
72. Leaman R, Gonzalez G. BANNER: An executable survey of advances in biomedical named entity recognition. Pac Symp Biocomput 2008:652-663 [FREE Full text] [Medline: 18229723].
73. Charniak E, Johnson M. Coarse-to-fine n-best parsing and MaxEnt discriminative reranking. Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics-ACL '05 2005:173-180. [doi: 10.3115/1219840.1219862].
74. McClosky D. Ph. Brown University: . D. thesis,, 2010 Any domain parsing: Automatic domain adaptation for natural language parsingURL: Http://cs.brown.edu/research/pubs/theses/phd/2010/mcclosky.pdf [accessed 2013-10-01] [WebCite Cache ID 6K3Cssx17].
75. Aronson AR. Effective mapping of biomedical text to the UMLS Metathesaurus: The MetaMap program. Proc AMIA Symp 2001:17-21 [FREE Full text] [Medline: 11825149].
76. MetaMap-A Tool For Recognizing UMLS Concepts in Text. URL: Http://metamap.nlm.nih.gov/[accessed 2014-05-06] [WebCite Cache ID 6PNEdc6dD].
77. Agarwal S, Yu H. Biomedical negation scope detection with conditional random fields. J Am Med Inform Assoc 2010;17(6):696-701 [FREE Full text] [doi: 10.1136/jamia.2010.003228] [Medline: 20962133].
78. Agarwal S, Yu H. Detecting hedge cues and their scope in biomedical text with conditional random fields. J Biomed Inform 2010 Dec;43(6):953-961 [FREE Full text] [doi: 10.1016/j.jbi.2010.08.003] [Medline: 20709188].
79. Ramesh BP, Prasad R, Miller T, Harrington B, Yu H. Automatic discourse connective detection in biomedical text. J Am Med Inform Assoc 2012 Oct;19(5):800-808 [FREE Full text] [doi: 10.1136/amiajnl-2011-000775] [Medline: 22744958].
80. Marcus MP, Marcinkiewicz MA, Santorini B. Building a large annotated corpus of English: The Penn Treebank. Computational linguistics 1993;19(2).