Validation of a crowdsourcing methodology for developing a knowledge base of related problem-medication Pairs

Applied Clinical Informatics

Volumn 6, Issue 2, 2015, Pages 334-344

  McCoy, A B ^a,b   Wright, A ^c,d,e   Krousel Wood, M ^a,b,f   Thomas, E J ^g,h   McCoy, J A ^a   Sittig, D F ^h  

^a OCHSNER CLINIC FOUNDATION   (United States)

^b TULANE UNIVERSITY   (United States)

^c BRIGHAM AND WOMEN S HOSPITAL   (United States)

^d Partners Health Care ^*  (United States)

^e HARVARD MEDICAL SCHOOL   (United States)

^f TULANE UNIVERSITY SCHOOL OF MEDICINE   (United States)

^g UNIVERSITY OF TEXAS MEDICAL SCHOOL   (United States)

^h UNIVERSITY OF TEXAS   (United States)

Author keywords

Computer assisted drug therapy; Crowdsourcing; Electronic health records; Knowledge bases; Problem oriented medical records; Validation studies

Indexed keywords

COMPUTER ASSISTED DRUG THERAPY; CROWDSOURCING; ELECTRONIC HEALTH RECORD; HUMAN; KNOWLEDGE BASE; PROCEDURES; UNIVERSITY HOSPITAL; VALIDATION STUDY;

ACADEMIC MEDICAL CENTERS; CROWDSOURCING; DRUG THERAPY, COMPUTER-ASSISTED; ELECTRONIC HEALTH RECORDS; HUMANS; KNOWLEDGE BASES;

EID: 84930724135     PISSN: None     EISSN: 18690327     Source Type: Journal    
DOI: 10.4338/ACI-2015-01-RA-0010     Document Type: Article

References (36)

1. Feblowitz JC, Wright A, Singh H, Samal L, Sittig DF. Summarization of clinical information: a conceptual model. J Biomed Inform 2011; 44(4): 688-699.
2. McCoy AB, Wright A, Laxmisan A, Ottosen MJ, McCoy JA, Butten D, Sittig DF. Development and evaluation of a crowdsourcing methodology for knowledge base construction: identifying relationships between clinical problems and medications. J Am Med Inform Assoc JAMIA 2012; 19(5): 713-718.
3. Bates DW, Cullen DJ, Laird N, Petersen LA, Small SD, Servi D, Laffel G, Sweitzer BJ, Shea BF, Hallisey R. Incidence of adverse drug events and potential adverse drug events. Implications for prevention. ADE Prevention Study Group. JAMA J Am Med Assoc 1995; 274(1): 29-34.
4. Blumenthal D, Tavenner M. The "Meaningful Use" Regulation for Electronic Health Records. N Engl J Med 2010; 363(6): 501-504.
5. Laxmisan A, McCoy AB, Wright A, Sittig DF. Clinical Summarization Capabilities of Commercially-available and Internally-developed Electronic Health Records. Appl Clin Inform 2012; 3(1): 80-93.
6. Health IT and Patient Safety: Building Safer Systems for Better Care-Institute of Medicine. Available from: http://iom.edu/Reports/2011/Health-IT-and-Patient-Safety-Building-Safer-Systems-for-Better-Care.aspx
7. Han YY, Carcillo JA, Venkataraman ST, Clark RSB, Watson RS, Nguyen TC, Bayir H, Orr RA. Unexpected increased mortality after implementation of a commercially sold computerized physician order entry system. Pediatrics 2005; 116(6): 1506-1512.
8. Horsky J, Kuperman GJ, Patel VL. Comprehensive analysis of a medication dosing error related to CPOE. J Am Med Inform Assoc JAMIA 2005; 12(4): 377-382.
9. Koppel R, Metlay JP, Cohen A, Abaluck B, Localio AR, Kimmel SE, Strom BL. Role of computerized physician order entry systems in facilitating medication errors. JAMA J Am Med Assoc 2005; 293(10): 1197-1203.
10. McCoy AB, Waitman LR, Lewis JB, Wright JA, Choma DP, Miller RA, Peterson JF. A framework for evaluating the appropriateness of clinical decision support alerts and responses. J Am Med Inform Assoc JAMIA 2012; 19(3): 346-352.
11. Ash JS, Berg M, Coiera E. Some Unintended Consequences of Information Technology in Health Care: The Nature of Patient Care Information System-related Errors. J Am Med Inform Assoc 2004; 11(2): 104-112.
12. Ash JS, Sittig DF, Poon EG, Guappone K, Campbell E, Dykstra RH. The extent and importance of unintended consequences related to computerized provider order entry. J Am Med Inform Assoc JAMIA 2007; 14(4): 415-423.
13. Sittig DF, Singh H. Legal, ethical, and financial dilemmas in electronic health record adoption and use. Pediatrics 2011; 127(4): e1042-e1047.
14. Sittig DF, Teich JM, Osheroff JA, Singh H. Improving clinical quality indicators through electronic health records: it takes more than just a reminder. Pediatrics 2009; 124(1): 375-377.
15. Sittig DF, Singh H. Rights and responsibilities of users of electronic health records. CMAJ Can Med Assoc J J Assoc Medicale Can. 2012; 184(13): 1479-1483.
16. Carter JS, Brown SH, Erlbaum MS, Gregg W, Elkin PL, Speroff T, Tuttle MS. Initializing the VA medication reference terminology using UMLS metathesaurus co-occurrences. Proc AMIA Symp 2002; 116-120.
17. Elkin PL, Carter JS, Nabar M, Tuttle M, Lincoln M, Brown SH. Drug knowledge expressed as computable semantic triples. Stud Health Technol Inform 2011; 166: 38-47.
18. Wright A, Chen ES, Maloney FL. An automated technique for identifying associations between medications, laboratory results and problems. J Biomed Inform 2010; 43(6): 891-901.
19. Brown SH, Miller RA, Camp HN, Guise DA, Walker HK. Empirical derivation of an electronic clinically useful problem statement system. Ann Intern Med 1999; 131(2): 117-126.
20. Zeng Q, Cimino JJ, Zou KH. Providing concept-oriented views for clinical data using a knowledge-based system: an evaluation. J Am Med Inform Assoc JAMIA 2002; 9(3): 294-305.
21. Chen ES, Hripcsak G, Xu H, Markatou M, Friedman C. Automated acquisition of disease drug knowledge from biomedical and clinical documents: an initial study. J Am Med Inform Assoc JAMIA 2008; 15(1): 87-98.
22. Kilicoglu H, Fiszman M, Rodriguez A, Shin D, Ripple A, Rindflesch TC. Semantic MEDLINE: A Web Application for Managing the Results of PubMed Searches 2008; 69-76.
23. Duke JD, Friedlin J. ADESSA: A Real-Time Decision Support Service for Delivery of Semantically Coded Adverse Drug Event Data. AMIA Annu Symp Proc AMIA Symp AMIA Symp 2010; 2010: 177-181.
24. Wu Y, Wright A, Xu H, McCoy AB, Sittig DF. Development of a Unified Computable Problem-Medication Knowledge Base. AMIA Annu Symp Proc AMIA Symp AMIA Symp 2014; 2014.
25. Berk RA. An introduction to ensemble methods for data analysis. Sociol Methods Res 2006; 34(3): 263-295.
26. Tapscott D. Wikinomicsß: how mass collaboration changes everything. New York: Portfolio; 2006.
27. Howe J. The rise of crowdsourcing. Wired Mag 2006; 14(6): 1-4.
28. Giles J. Internet encyclopaedias go head to head. Nature 2005; 438(7070): 900-901.
29. Ekins S, Williams AJ. Reaching out to collaborators: crowdsourcing for pharmaceutical research. Pharm Res 2010; 27(3): 393-395.
30. Hughes S, Cohen D. Can Online Consumers Contribute to Drug Knowledge? A Mixed-Methods Comparison of Consumer-Generated and Professionally Controlled Psychotropic Medication Information on the Internet. J Med Internet Res 2011; 13(3).
31. Brownstein CA, Brownstein JS, Williams DS 3rd, Wicks P, Heywood JA. The power of social networking in medicine. Nat Biotechnol 2009; 27(10): 888-890.
32. Parry DT, Tsung-Chun Tsai. Crowdsourcing techniques to create a fuzzy subset of SNOMED CT for semantic tagging of medical documents. 2010 IEEE International Conference on Fuzzy Systems (FUZZ). IEEE 2010; 1-8.
33. Wagholikar KB, MacLaughlin KL, Kastner TM, Casey PM, Henry M, Greenes RA, Liu H, Chaudhry R. Formative evaluation of the accuracy of a clinical decision support system for cervical cancer screening. J Am Med Inform Assoc 2013; Apr 5; amiajnl-2013-001613.
34. Good BM, Su AI. Crowdsourcing for. Bioinformatics 2013; btt333.
35. Sweidan M, Williamson M, Reeve JF, Harvey K, O'Neill JA, Schattner P, Snowdon T. Evaluation of features to support safety and quality in general practice clinical software. BMC Med Inform Decis Mak 2011; 11(1): 27.
36. Hersh W. Evaluation of biomedical text-mining systems: lessons learned from information retrieval. Brief Bioinform 2005; 6(4): 344-356.