Ensembles of randomized trees using diverse distributed representations of clinical events

BMC Medical Informatics and Decision Making

Volumn 16, Issue , 2016, Pages

  Henriksson, Aron ^a   Zhao, Jing ^a   Dalianis, Hercules ^a   Boström, Henrik ^a  

^a STOCKHOLM UNIVERSITY   (Sweden)

Author keywords

Adverse drug events; Distributional semantics; Electronic health records; Heterogeneous data; Pharmacovigilance; Random forest

Indexed keywords

ADVERSE DRUG REACTION; DECISION TREE; DRUG SURVEILLANCE PROGRAM; ELECTRONIC HEALTH RECORD; HUMAN; MACHINE LEARNING; SEMANTICS; THEORETICAL MODEL;

DECISION TREES; DRUG-RELATED SIDE EFFECTS AND ADVERSE REACTIONS; ELECTRONIC HEALTH RECORDS; HUMANS; MACHINE LEARNING; MODELS, THEORETICAL; PHARMACOVIGILANCE; SEMANTICS;

EID: 84978923841     PISSN: None     EISSN: 14726947     Source Type: Journal    
DOI: 10.1186/s12911-016-0309-0     Document Type: Article

References (49)

1. Jensen PB, Jensen LJ, Brunak S. Mining electronic health records: towards better research applications and clinical care. Nat Rev Genet. 2012; 13(6):395-405.
2. Zhao J, Henriksson A, Boström H. Detecting adverse drug events using concept hierarchies of clinical codes. In: Proceedings of IEEE International Conference on Healthcare Informatics. IEEE: 2014. p. 285-93.
3. Zhao J, Henriksson A, Asker L, Boström H. Detecting adverse drug events with multiple representations of clinical measurements. In: Proceedings of IEEE International Conference on Bioinformatics and Biomedicine. IEEE: 2014. p. 536-43.
4. Eriksson R, Werge T, Jensen LJ, Brunak S. Dose-specific adverse drug reaction identification in electronic patient records: temporal data mining in an inpatient psychiatric population. Drug Saf. 2014; 37(4):237-47.
5. Singh A, Nadkarni G, Gottesman O, Ellis SB, Bottinger EP, Guttag JV. Incorporating temporal ehr data in predictive models for risk stratification of renal function deterioration. J Biomed Inform. 2015; 53:220-8.
6. Zhao J, Henriksson A, Kvist M, Asker L, Boström H. Handling temporality of clinical events for drug safety surveillance. In: American Medical Informatics Association (AMIA) Annual Symposium. American Medical Informatics Association: 2015.
7. Zhao J. Temporal weighting of clinical events in electronic health records for pharmacovigilance. In: IEEE International Conference on Bioinformatics and Biomedicine (BIBM). IEEE: 2015. p. 375-81.
8. Meystre SM, Savova GK, Kipper-Schuler KC, Hurdle JF, et al. Extracting information from textual documents in the electronic health record: a review of recent research. Yearb Med Inform. 2008; 35:128-44.
9. Liu H, Lussier YA, Friedman C. Disambiguating ambiguous biomedical terms in biomedical narrative text: an unsupervised method. J Biomed Inform. 2001; 34(4):249-61.
10. Henriksson A. Representing clinical notes for adverse drug event detection. In: Proceedings of the Sixth International Workshop on Health Text Mining and Information Analysis (Louhi). Association for Computational Linguistics: 2015. p. 152-8.
11. Harris ZS. Distributional structure. Word. 1954; 10(2-3):146-162.
12. Turney PD, Pantel P, et al.From frequency to meaning: Vector space models of semantics. J Artif Intell Res. 2010; 37(1):141-88.
13. Cohen T, Widdows D. Empirical distributional semantics: methods and biomedical applications. J Biomed Inform. 2009; 42(2):390-405.
14. Henriksson A. Semantic Spaces of Clinical Text: Leveraging Distributional Semantics for Natural Language Processing of Electronic Health Records. Sweden: Stockholm University; 2013.
15. Skeppstedt M, Ahltorp M, Henriksson A. Vocabulary expansion by semantic extraction of medical terms. In: Proceedings of the Symposium on Languages in Biology and Medicine (LBM). Database Center for Life Science: 2013.
16. Henriksson A, Conway M, Duneld M, Chapman WW. Identifying synonymy between SNOMED clinical terms of varying length using distributional analysis of electronic health records. In: AMIA Annual Symposium Proceedings. American Medical Informatics Association: 2013. p. 600-9.
17. Henriksson A, Skeppstedt M, Kvist M, Duneld M, Conway M. Corpus-driven terminology development: populating Swedish SNOMED CT with synonyms extracted from electronic health records. In: Proceedings of the 2013 Workshop on Biomedical Natural Language Processing (BioNLP). Association for Computational Linguistics: 2013. p. 36-44.
18. Henriksson A, Moen H, Skeppstedt M, Daudaravicius V, Duneld M. Synonym extraction and abbreviation expansion with ensembles of semantic spaces. J Biomed Semant. 2014; 5(6):1-25.
19. Jonnalagadda S, Cohen T, Wu S, Gonzalez G. Enhancing clinical concept extraction with distributional semantics. J Biomed Inform. 2012; 45(1):129-40.
20. Henriksson A, Dalianis H, Kowalski S. Generating features for named entity recognition by learning prototypes in semantic space: The case of de-identifying health records. In: Proceedings of IEEE International Conference on Bioinformatics and Biomedicine. IEEE: 2014. p. 450-7.
21. Henriksson A, Hassel M, Kvist M. Diagnosis Code Assignment Support Using Random Indexing of Patient Records - A Qualitative Feasibility Study. In: Artificial Intelligence in Medicine. Berlin/Heidelberg: Springer: 2011. p. 348-52.
22. Henriksson A, Hassel M. Election of Diagnosis Codes: Words as Responsible Citizens. In: Proceedings of the 3rd International Louhi Workshop on Health Document Text Mining and Information Analysis. CEUR Workshop Proceedings: 2011. p. 67-74.
23. Henriksson A, Hassel M. Optimizing the dimensionality of clinical term spaces for improved diagnosis coding support. In: Proceedings of Louhi Workshop on Health Document Text Mining and Information Analysis. NICTA: 2013.
24. Moen H, Marsi E, Ginter F, Murtola LM, Salakoski T, Salanterä S. Care episode retrieval. In: Proceedings of the 5th International Workshop on Health Text Mining and Information Analysis (Louhi)@ EACL. Association for Computational Linguistics: 2014. p. 116-24.
25. Henriksson A, Kvist M, Hassel M, Dalianis H. Exploration of adverse drug reactions in semantic vector space models of clinical text. In: Proc. of ICML Workshop on Machine Learning for Clinical Data Analysis. University of Pittsburgh: 2012.
26. Henriksson A, Kvist M, Dalianis H, Duneld M. Identifying adverse drug event information in clinical notes with distributional semantic representations of context. J Biomed Inform. 2015; 57:333-49.
27. Henriksson A, Zhao J, Boström H, Dalianis H. Modeling heterogeneous clinical sequence data in semantic space for adverse drug event detection. In: Proceedings of IEEE International Conference on Data Science and Advanced Analytics. IEEE: 2015.
28. Henriksson A, Zhao J, Bostrom H, Dalianis H. Modeling electronic health records in ensembles of semantic spaces for adverse drug event detection. In: Proceedings of IEEE International Conference on Bioinformatics and Biomedicine (BIBM). IEEE: 2015. p. 343-50.
29. Henriksson A. Ensembles of Semantic Spaces: On Combining Models of Distributional Semantics with Applications in Healthcare. Sweden: Stockholm University; 2015.
30. Henriksson A, Moen H, Skeppstedt M, Eklund AM, Daudaravicius V, Hassel M. Synonym extraction of medical terms from clinical text using combinations of word space models. In: Proceedings of Semantic Mining in Biomedicine (SMBM). Institute of Computational Linguistics, University of Zurich: 2012. p. 10-17.
31. Henriksson A. Learning multiple distributed prototypes of semantic categories for named entity recognition. Int J Data Min Bioinforma. 2015; 13(4):395-411.
32. Sahlgren M. The word-space model: using distributional analysis to represent syntagmatic and paradigmatic relations between words in high-dimensional vector spaces. Sweden: Stockholm University; 2006.
33. Lapesa G, Evert S, im Walde SS. Contrasting syntagmatic and paradigmatic relations: Insights from distributional semantic models. In: Proceedings of the Third Joint Conference on Lexical and Computational Semantics (SEM). Association for Computational Linguistics: 2014. p. 160-70.
34. Lapesa G, Evert S. A large scale evaluation of distributional semantic models: parameters, interactions and model selection. Trans Asso Comput Linguis. 2014; 2:531-45.
35. Breiman L. Random forests. Mach Learn. 2001; 45(1):5-32.
36. Dietterich TG. Ensemble methods in machine learning. In: Multiple Classifier Systems. Berlin/Heidelberg: Springer: 2000. p. 1-15.
37. Austen-Smith D, Banks JS. Information aggregation, rationality, and the condorcet jury theorem. Am Polit Sci Rev. 1996; 90(01):34-45.
38. Kuncheva LI, Whitaker CJ. Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy. Mach Learn. 2003; 51(2):181-207.
39. Krogh A, Vedelsby J. Neural network ensembles, cross validation, and active learning. In: Advances in Neural Information Processing Systems. Cambridge MA: MIT Press: 1995. p. 231-8.
40. Howard R, Avery A, Slavenburg S, Royal S, Pipe G, Lucassen P, Pirmohamed M. Which drugs cause preventable admissions to hospital? a systematic review. Br J Clin Pharmacol. 2007; 63(2):136-47.
41. Hazell L, Shakir SA. Under-reporting of adverse drug reactions. Drug Saf. 2006; 29(5):385-96.
42. Mikolov T, Chen K, Corrado G, Dean J. Efficient estimation of word representations in vector space. In: ICLR Worshop. arXiv: 2013.
43. Baroni M, Dinu G, Kruszewski G. Don't count, predict! a systematic comparison of context-counting vs. context-predicting semantic vectors. In: Association for Computational Linguistics. Association for Computational Linguistics: 2014. p. 238-47.
44. Goldberg Y, Levy O. word2vec Explained: deriving Mikolov et al.'s negative-sampling word-embedding method. arXiv: 2014. arXiv preprint arXiv:1402.3722.
45. Panov P, Džeroski S. Combining bagging and random subspaces to create better ensembles. In: Proceedings of Symposium on Intelligent Data Analysis. Berlin/Heidelberg: Springer: 2007. p. 118-29.
46. Dalianis H, Hassel M, Henriksson A, Skeppstedt M. Stockholm EPR Corpus: a clinical database used to improve health care. In: Swedish Language Technology Conference. Lund Institute of Technology: 2012.
47. Stausberg J, Hasford J. Drug-related admissions and hospital-acquired adverse drug events in germany: a longitudinal analysis from 2003 to 2007 of icd-10-coded routine data. BMC Health Serv Res. 2011; 11(1):134.
48. Östling R. Stagger: an open-source part of speech tagger for swedish. North Eur J Lang Technol (NEJLT). 2013; 3:1-18.
49. Garcia S, Herrera F. An extension on "statistical comparisons of classifiers over multiple data sets" for all pairwise comparisons. J Mach Learn Res. 2008; 9(12):2677-2694.