Deep learning for pharmacovigilance: Recurrent neural network architectures for labeling adverse drug reactions in Twitter posts

Journal of the American Medical Informatics Association

Volumn 24, Issue 4, 2017, Pages 813-821

  Cocos, Anne ^a   Fiks, Alexander G ^a   Masino, Aaron J ^a  

^a CHILDREN S HOSPITAL OF PHILADELPHIA   (United States)

Author keywords

Adverse drug reaction; Natural language processing; Neural networks (computer); Social media; Twitter messaging

Indexed keywords

ADVERSE DRUG REACTION; ARTICLE; ARTIFICIAL NEURAL NETWORK; DRUG SURVEILLANCE PROGRAM; EMBEDDING; LEARNING; NATURAL LANGUAGE PROCESSING; PARASOMNIA; SOCIAL MEDIA; HUMAN; MACHINE LEARNING;

DRUG-RELATED SIDE EFFECTS AND ADVERSE REACTIONS; HUMANS; MACHINE LEARNING; NATURAL LANGUAGE PROCESSING; NEURAL NETWORKS (COMPUTER); PHARMACOVIGILANCE; SOCIAL MEDIA;

EID: 85026398638     PISSN: 10675027     EISSN: 1527974X     Source Type: Journal    
DOI: 10.1093/jamia/ocw180     Document Type: Article

References (54)

1. Hakkarainen KM, Hedna, K, Petzold M, et al. Percentage of patients with preventable adverse drug reactions and preventability of adverse drug reactions: a meta-analysis. PLoS One. 2012;7(3):e33236.
2. Sultana J, Cutroneo P, Trifiro G. Clinical and economic burden of adverse drug reactions. J Pharmacol Pharmacother. 2013;4:S73-77.
3. Ahmad, SR. Adverse drug event monitoring at the Food and Drug Administration. J Gen Intern Med. 2003;18(1):57-60.
4. Li H, Guo, XJ, Ye XF, et al. Adverse drug reactions of spontaneous reports in Shanghai pediatric population. PLoS One. 2014;9(2):e89829.
5. Lindquist M. VigiBase, the WHO global ICSR database system: basic facts. Drug Inform J. 2008;42(5):409-19.
6. Behrman RE, Benner JS, Brown JS, et al. Developing the Sentinel System: a national resource for evidence development. N Engl J Med. 2011;364(6):498-99.
7. Reisinger SJ, Ryan PB, O'Hara DJ, et al. Development and evaluation of a common data model enabling active drug safety surveillance using disparate healthcare databases. J Am Med Inform Assoc. 2010;17(6): 652-62.
8. Nadkarni PM. Drug safety surveillance using de-identified EMR and claims data: issues and challenges. J Am Med Inform Assoc. 2010;17(6):671-74.
9. Wang X, Hripcsak G, Markatou M, et al. Active computerized pharmacovigilance using natural language processing, statistics, and electronic health records: a feasibility study. J Am Med Inform Assoc. 2009;16(3):328-37.
10. LePendu P, Iyer SV, Bauer-Mehren A, et al. Pharmacovigilance using clinical notes. Clin Pharmacol Ther. 2013;93(6):547-55.
11. Harpaz R, Vilar S, Dumouchel W, et al. Combing signals from spontaneous reports and electronic health records for detection of adverse drug reactions. J Am Med Inform Assoc. 2013;20(3):413-19.
12. Leaman R, Wojtulewicz L, Sullivan R, et al. Towards internet-age pharmacovigilance: extracting adverse drug reactions from user posts to health-related social networks. In: Proceedings of the 2010 Workshop on Biomedical Natural Language Processing; 2010:117-25.
13. Benton A, Ungar L, Hill S, et al. Identifying potential adverse effects using the web: a new approach to medical hypothesis generation. J Biomed Inform. 2011;44(6):989-96.
14. Yang C, Jiang L, Yang H, et al. Detecting signals of adverse drug reactions from health consumer contributed content in social media. In: Proceedings of the 18th Association for Computing Machinery Special Interest Group on Knowledge Discovery and Data Mining Workshop on Health Informatics (HI-SIGKDD); 2012:1-8.
15. Yates A, Goharian N. ADRTrace: detecting expected and unexpected adverse drug reactions from user reviews on social media sites. Adv Inform Retrieval. 2013;7814LNCS:816-19.
16. White RW, Tatonetti NP, Shah NH, et al. Web-scale pharmacovigilance: listening to signals from the crowd. J Am Med Inform Assoc. 2013;20(3):404-08.
17. Freifeld CC, Brownstein JS, Menone CM, et al. Digital drug safety surveillance: monitoring pharmaceutical products in Twitter. Drug Saf. 2014;37(5):343-50.
18. Ginn R, Pimpalkhute P, Nikfarjam A, et al. Mining Twitter for adverse drug reaction mentions: a corpus and classification benchmark. In: Proceedings of the Fourth Workshop on Building and Evaluating Resources for Health and Biomedical Text Processing; 2014:1-8.
19. Liu, X, Liu J, Chen H. Identifying adverse drug events from health social media: a case study on heart disease discussion forums. In: Proceedings of the International Conference on Smart Health (ICSH). 2014;8549:25-36.
20. O'Connor K,Nikfarjam A, Ginn R, et al. Pharmacovigilance on Twitter? Mining tweets for adverse drug reactions. AMIA Annu Symp Proc; 2104:924-33.
21. Nikfarjam A, Sarker A, O'Connor K, et al. Pharmacovigilance from social media: mining adverse drug reaction mentions using sequence labeling with word embedding cluster features. J Am Med Inform Assoc. 2015;22(3):671-81.
22. Lafferty J, McCallum A, Pereira F. Conditional random fields: probabilistic models for segmenting and labeling sequence data. In: Proceedings of the 18th International Conference on Machine Learning. 2001;1:282-89.
23. Wang, W. Mining adverse drug reaction mentions in Twitter with word embeddings. In: Online Proceedings of the Pacific Symposium on Biocomputing Social Media Mining Shared Task Workshop 2016. http://diego.asu.edu/psb2016/acceptedpapers/DLIR.pdf. Accessed August 1, 2016.
24. Sarker, A, Nikfarjam, A, Gonzalez, G. Online Proceedings of the Social Media Mining Shared Task Workshop. Pacific Symposium on Biocomputing. 2016;21:581-92.
25. Yao K, Zweig G, Hwang MY, et al. Recurrent neural networks for language understanding. In: Proceedings of the 14th Annual Conference of the International Speech Communication Association (INTERSPEECH); 2013:2524-2528.
26. Graves A. Supervised sequence labeling with recurrent neural networks (doctoral dissertation). Studies in Computational Intelligence 385, Springer; 2012:1-131.
27. Mesnil G, He X, Deng L, et al. Investigation of recurrent-neural-network architectures and learning methods for language understanding. In: Proceedings of the 14th Annual Conference of the International Speech Communication Association (INTERSPEECH). 2013:3771-75.
28. Godin F, Vandersmissen B, De Neve W, et al. Multimedia Lab @ ACL WNUT NER Shared Task: named entity recognition for Twitter microposts using distributed word representations. In: Proceedings of the Association for Computational Linguistics 2015 Workshop on Noisy User-generated Text; 2015:146-53.
29. Lipton ZC, Kale DC, Elkan C, et al. Learning to diagnose with LSTM recurrent neural networks. In: Proceedings of the International Conference on Learning Representations. 2016. arxiv.org/pdf/1511.03677v6.pdf. Accessed March 2, 2016.
30. Hochreiter S, Schmidhuber J. Long short-term memory. Neural Comput. 1997;9(8):1735-80.
31. Schuster M, Paliwal KK. Bidirectional recurrent neural networks. IEEE Trans Audio Speech Lang Process. 1997;45(11):2673-81.
32. Graves A, Schmidhuber J. Framewise phoneme classification with bidirectional LSTM and other neural network architectures. Neural Netw. 2005;18(5-6):602-10.
33. Ott M. ark-twokenize-py. GitHub Repository. 2016. github.com/myleott/ark-twokenize-py. Accessed August 1, 2016.
34. Owoputi O, O'Connor B, Dyer C, et al. Part-of-speech tagging for Twitter: word clusters and other advances. Carnegie Mellon University. CMU-ML-12-107. 2012. www.cs.cmu.edu/ark/TweetNLP/owoputi+etal.tr12.pdf. Accessed August 2016.
35. Ramshaw LA, Marcus MP. Text chunking using transformation-based learning. In: Proceedings of the Association for Computational Linguistics ThirdWorkshop on Very Large Corpora. 1995:82-94.
36. Mikolov T, Chen K, Corrado G, et al. Efficient Estimation of Word Representations in Vector Space. arXiv preprint arXiv:1301.3781. 2013. arxiv. org/pdf/1301.3781v3.pdf. Accessed August 1, 2016.
37. Chollet F. Keras. GitHub Repository. 2016. github.com/fchollet/keras. Accessed August 1, 2016.
38. Bergstra J, Breuleux O, Bastien F, et al. Theano: a CPU and GPU math expression compiler. In: Proceedings of the 9th Python for Scientific Computing Conference (SciPy). 2010:1-7.
39. Bastien F, Lamblin P, Pascanu R, et al. Theano: new features and speed improvements. In: Adv Neural Inf Process SystWorkshop on Deep Learning and Unsupervised Feature Learning; 2012:1-10.
40. Werbos, PJ. Backpropagation through time: what it does and how to do it. Proc IEEE. 1990;78(10):1550-60.
41. Open Source Collaborative Consumer Health Vocabulary Initiative. consumerhealthvocab. org. Accessed August 1, 2016.
42. Okazaki N. CRFsuite: A Fast Implementation of Conditional Random Fields. Software Package. 2007. www.chokkan.org/software/crfsuite/. Accessed June 1, 2016.
43. Gimpel K, Schneider N, O'Connor B, et al. Smith. Part-of-speech tagging for Twitter: annotation, features, and experiments. In Proceedings of the Annual Meeting of the Association for Computational Linguistics, Companion Volume. Portland, OR; June 2011.
44. Guo Z. DepND. GitHub Repository. 2016. github.com/zachguo/DepND. Accessed August 1, 2016.
45. Sagae, K GDep (GENIA dependency parser). Software package. 2016. sagae.bitbucket.org/gdep/. Accessed August 1, 2016.
46. Sagae K, Tsujii J. Dependency parsing and domain adaptation with LR models and parser ensembles. In: Proceedings of the 11th Conference on Computational Natural Language Learning; 2007:1044-50.
47. Tsai RT, Wu SH, Chou WC, et al. Various criteria in the evaluation of biomedical named entity recognition. BMC Bioinformatics. 2006;7: 92-100.
48. Noreen EW. Approximate randomization tests. In: EW Noreen, ed. Computer-Intensive Methods for Testing Hypotheses: An Introduction. Hoboken, NJ: John Wiley and Sons, Inc; 1989:9-33.
49. Cohen P. Empirical Methods for Artificial Intelligence. Cambridge, MA: MIT Press; 1995:165-75.
50. Padó, S. User's guide to sigf: Significance Testing by Approximate Randomization. 2006. http://www.nlpado.de/sebastian/software/sigf.shtml. Accessed August 2016.
51. Johnson AEW, Pollard TJ, Shen L, et al. MIMIC-III, a freely accessible critical care database. Scientific Data. 2016; 3: 160035.
52. Patki A, Sarker A, Pimpalkhute P, et al. Mining adverse drug reaction signals from social media: going beyond extraction. In: Proceedings of the BioLINK Special Interest Group. 2014:1-8.
53. Sarker A, Gonzalez G. Portable automatic text classification for adverse drug reaction detection via multi-corpus training. J Biomed Inform. 2015; 53: 196-207.
54. Korkontzelos I, Nikfarjam A, Shardlow M, et al. Analysis of the effect of sentiment analysis on extracting adverse drug reactions from tweets and forum posts. J Biomed Inform. 2016; 62: 148-58.