Design of decision support interventions for medication prescribing

International Journal of Medical Informatics

Volumn 82, Issue 6, 2013, Pages 492-503

  Horsky, Jan ^a,b,e   Phansalkar, Shobha ^a,b,e   Desai, Amrita ^a   Bell, Douglas ^c,d   Middleton, Blackford ^a,b,e  

^a PARTNERS HEALTHCARE   (United States)

^b BRIGHAM AND WOMEN S HOSPITAL   (United States)

^c RAND CORPORATION   (United States)

^d UNIVERSITY OF CALIFORNIA   (United States)

^e HARVARD MEDICAL SCHOOL   (United States)

Author keywords

Clinical decision support systems (CDSS); Clinical information systems; Electronic health records systems (EHRs); Health information technology (HIT); Human computer interaction (HCI); Patient safety; Software usability; System design and development

Indexed keywords

CLINICAL DECISION SUPPORT SYSTEMS; CLINICAL INFORMATION SYSTEM; ELECTRONIC HEALTH RECORD; HEALTH INFORMATION TECHNOLOGIES (HIT); HUMAN COMPUTER INTERACTION (HCI); PATIENT SAFETY; SOFTWARE USABILITIES; SYSTEM DESIGN AND DEVELOPMENT;

ARTIFICIAL INTELLIGENCE; DECISION SUPPORT SYSTEMS; HOSPITAL DATA PROCESSING; HUMAN COMPUTER INTERACTION; INFORMATION TECHNOLOGY; MEDICAL INFORMATION SYSTEMS; VISUAL LANGUAGES;

PATIENT TREATMENT;

ALGORITHM; CLINICAL DECISION SUPPORT SYSTEM; COGNITION; COMPUTER PROGRAM; DECISION SUPPORT SYSTEM; ELECTRONIC MEDICAL RECORD; HUMAN; HUMAN COMPUTER INTERACTION; KNOWLEDGE BASE; MEDICATION COMPLIANCE; NOMENCLATURE; PATIENT CODING; PATIENT SAFETY; PHYSICIAN; PRESCRIPTION; PRIORITY JOURNAL; REVIEW; SYSTEMATIC REVIEW; WORKFLOW; CLINICAL PRACTICE; HOSPITAL INFORMATION SYSTEM; MEDICAL INFORMATICS; STANDARDS; STANDARD;

DECISION SUPPORT SYSTEMS, CLINICAL; HUMANS; MEDICAL INFORMATICS; MEDICAL ORDER ENTRY SYSTEMS; PHYSICIAN'S PRACTICE PATTERNS;

EID: 84891639592     PISSN: 13865056     EISSN: 18728243     Source Type: Journal    
DOI: 10.1016/j.ijmedinf.2013.02.003     Document Type: Review

References (102)

1. Chaudhry B., Wang J., Wu S., Maglione M., Mojica W., Roth E., et al. Systematic review: impact of health information technology on quality, efficiency, and costs of medical care. Ann. Intern. Med. 2006, 144:742-752.
2. Kuperman G.J., Bobb A., Payne T.H., Avery A.J., Gandhi T.K., Burns G., et al. Medication-related clinical decision support in computerized provider order entry systems: a review. J. Am. Med. Inform. Assoc. 2007, 14:29-40.
3. Bates D.W., Gawande A.A. Improving safety with information technology. N. Engl. J. Med. 2003, 348:2526-2534.
4. Sittig D.F., Wright A., Osheroff J.A., Middleton B., Teich J.M., Ash J.S., et al. Grand challenges in clinical decision support. J. Biomed. Inform. 2008, 41:387-392.
5. Horsky J., Schiff G.D., Johnston D., Mercincavage L., Bell D., Middleton B. Interface design principles for usable decision support: a targeted review of best practices for clinical prescribing interventions. J. Biomed. Inform. 2012, 45:1202-1216.
6. Holden R.J. Cognitive performance-altering effects of electronic medical records: an application of the human factors paradigm for patient safety. Cogn. Technol. Work 2011, 13:11-29.
7. Bates D.W., Teich J.M., Lee J., Seger D.L., Kuperman G.J., Ma'Luf N., et al. The impact of computerized physician order entry on medication error prevention. J. Am. Med. Inform. Assoc. 1999, 6:313-321.
8. Horsky J., Kuperman G.J., Patel V.L. Comprehensive analysis of a medication dosing error related to CPOE. J. Am. Med. Inform. Assoc. 2005, 12:377-382.
9. Nebeker J.R., Hoffman J.M., Weir C.R., Bennett C.L., Hurdle J.F. High rates of adverse drug events in a highly computerized hospital. Arch. Intern. Med. 2005, 165:1111-1116.
10. Koppel R., Metlay J.P., Cohen A., Abaluck B., Localio A.R., Kimmel S.E., et al. Role of computerized physician order entry systems in facilitating medication errors. JAMA 2005, 293:1197-1203.
11. Eslami S., Abu-Hanna A., de Keizer N.F., de Jonge E. Errors associated with applying decision support by suggesting default doses for aminoglycosides. Drug Saf. 2006, 29:803-809.
12. Wetterneck T.B., Walker J.M., Blosky M.A., Cartmill S.R., Hoonakker P., Johnson M.A., et al. Factors contributing to an increase in duplicate medication order errors after CPOE implementation. J. Am. Med. Inform. Assoc. 2011, 18:774-782.
13. Koppel R., Wetterneck T., Telles J.L., Karsh B.-T. Workarounds to barcode medication administration systems: their occurrences, causes, and threats to patient safety. J. Am. Med. Inform. Assoc. 2008, 15:408-423.
14. McDonald C.J. Computerization can create safety hazards: a bar-coding near miss. Ann. Intern. Med. 2006, 144:510-516.
15. van der Sijs H., van Gelder T., Vulto A., Berg M., Aarts J. Understanding handling of drug safety alerts: a simulation study. Int. J. Med. Inf. 2010, 79:361-369.
16. Kaushal R., Shojania K.G., Bates D.W. Effects of computerized physician order entry and clinical decision support systems on medication safety: a systematic review. Arch. Intern. Med. 2003, 163:1409-1416.
17. Weingart S.N., Toth M., Sands D.Z., Aronson M.D., Davis R.B., Phillips R.S. Physicians' decisions to override computerized drug alerts in primary care. Arch. Intern. Med. 2003, 163:2625-2631.
18. Wipfli R., Lovis C. Alerts in clinical information systems: building frameworks and prototypes. Stud. Health Technol. Inform. 2010, 155:163-169.
19. Feldstein A., Simon S.R., Schneider J., Krall M., Laferriere D., Smith D.H., et al. How to design computerized alerts to safe prescribing practices. Jt. Comm. J. Qual. Saf. 2004, 30:602-613.
20. Magnus D., Rodgers S., Avery A.J. GPs' views on computerized drug interaction alerts: questionnaire survey. J. Clin. Pharm. Ther. 2002, 27:377-382.
21. McFall R.M., Treat T.A. Quantifying the information value of clinical assessments with signal detection theory. Annu. Rev. Psychol. 1999, 50:215-241.
22. Ong M.-S., Coiera E.W. Evaluating the effectiveness of clinical alerts: a signal detection approach. AMIA Annual Fall Symposium 2011, 1036-1044.
23. Greenberg M., Ridgely M.S. Clinical decision support and malpractice risk. JAMA 2011, 306:90-91.
24. Hogan W.R., Wagner M.M. Accuracy of data in computer-based patient records. J. Am. Med. Inform. Assoc. 1997, 4:342-355.
25. Shah N.R., Seger A.C., Seger D.L., Fiskio J.M., Kuperman G.J., Blumenfeld B., et al. Improving acceptance of computerized prescribing alerts in ambulatory care. J. Am. Med. Inform. Assoc. 2006, 13:5-11.
26. U.S.Army Manpower and Personnel Integration (MANPRINT) in the Materiel Acquisition Process 2001, Department of Defense, Washington, DC.
27. O'Hara J.M., Higgins J.C., Persensky J.J., Lewis P.M., Bongarra J.P. Human Factors Engineering Program Review Model 2004, Office of Nuclear Regulatory Research, Washington, DC.
28. Ahlstrom V., Longo K. Human Factors Design Standard: Human Interface Guidelines 2003, Federal Aviation Administration, Washington, DC.
29. Karsh B.-T., Weinger M.B., Abbott P.A., Wears R.L. Health information technology: fallacies and sober realities. J. Am. Med. Inform. Assoc. 2010, 17:617-623.
30. Wears R.L., Leveson N.G. " Safeware" : safety-critical computing and health care information technology. Advances in Patient Safety: New Directions and Alternative Approaches, 2008, vol. 4. Technology and Medication Safety, Rockville, MD.
31. International Standards Organization Ergonomic Requirements for Office Work With Visual Display Terminals: Guidance on Usability. Presentation of Information 1998, International Organization for Standardization, Geneva, Switzerland.
32. ANSI/HFES Human Factors Engineering of Software User Interfaces 2008, Human Factors and Ergonomics Society, Santa Monica, CA.
33. Microsoft Corporation Windows User Experience Interaction Guidelines 2010, Microsoft Corporation.
34. Microsoft Health Common User Interface. Accessed February 28, 2013. http://www.mscui.net/.
35. Schumacher R.M., Lowry S.Z. NIST Guide to the Processes Approach for Improving the Usability of Electronic Health Records 2010, National Institute of Standards and Technology, Washington, DC. National Institute of Standards and Technology (Ed.).
36. Health and Human Services Dept Research-based Web Design & Usability Guidelines 2006, U.S. Dept. of Health and Human Services: U.S. General Services Administration, Washington, DC. 2nd ed.
37. Paterno M., Maviglia S.M., Gorman P.N., Seger D.L., Yoshida E., Seger A.C., et al. Tiering drug-drug interaction alerts by severity increases compliance rates. J. Am. Med. Inform. Assoc. 2009, 16:40-46.
38. Hansten P.D., Horn J.R., Hazlet T.K. ORCA: OpeRational classification of drug interactions. J. Am. Pharm. Assoc. (Wash.) 2001, 41:161-165.
39. Grizzle A.J., Mahmood M.H., Ko Y., Murphy J.E., Armstrong E.P., Skrepnek G.H., et al. Reasons provided by prescribers when overriding drug-drug interaction alerts. Am. J. Manag. Care 2007, 13:573-578.
40. Galanter W.L., Polikaitis A., DiDomenico R.J. A trial of automated safety alerts for inpatient digoxin use with computerized physician order entry. J. Am. Med. Inform. Assoc. 2004, 11:270-277.
41. Kuperman G.J., Diamente R., Khatu V., Chan-Kraushar T., Stetson P., Boyer A., et al. Managing the alert process at NewYork-Presbyterian Hospital. AMIA Annu. Symp. Proc. 2005, 415-419.
42. Chaffee B.W., Zimmerman C.R. Developing and implementing clinical decision support for use in a computerized prescriber-order-entry system. Am. J. Health Syst. Pharm. 2010, 67:391-400.
43. Nielsen J. Usability Engineering 1993, Academic Press, Boston.
44. Lowry S.Z., Quinn M.T., Ramaiah M., Schumacher R.M., Patterson E.S., North R., et al. Technical Evaluation, Testing and Validation of the Usability of Electronic Health Records 2012, National Institute of Standards and Technology.
45. Zhang J., Walji M.F. TURF: Toward a unified framework of EHR usability. J. Biomed. Inform. 2011, 44:1056-1067.
46. Nielsen J., Loranger H. Prioritizing Web usability 2006, New Riders, Berkeley, CA.
47. Weinger M.B., Gardner-Bonneau D., Wiklund M.E., Kelly L.M. Handbook of Human Factors in Medical Device Design 2011, CRC Press, Boca Raton, FL.
48. International Standards Organization Ergonomic Requirements for Office Work With Visual Display Terminals: Presentation of Information 1998, International Organization for Standardization, Geneva, Switzerland.
49. Bates D.W., Kuperman G.J., Wang S., Gandhi T.K., Kittler A., Volk L.A., et al. Ten commandments for effective clinical decision support: making the practice of evidence-based medicine a reality. J. Am. Med. Inform. Assoc. 2003, 10:523-530.
50. van der Sijs H., Aarts J., Vulto A., Berg M. Overriding of drug safety alerts in computerized physician order entry. J. Am. Med. Inform. Assoc. 2006, 13:138-147.
51. Microsoft Corporation Design Guidance Exploration-Decision Support 2008, Microsoft Corporation. 2.0 ed.
52. Johnson K.B., Ho Y.-X., Cala C.M., Davison C. Showing your work: impact of annotating electronic prescriptions with decision support results. J. Biomed. Inform. 2010, 43:321-325.
53. Bernard M., Hamblin C. Cascading Versus Indexed Menu Design. Usability News 2003, Software Usability Research Laboratory at Wichita State University, Wichita, KS.
54. J. Nielsen, Drop-down Menus: Use Sparingly, Alertbox.Useit.com, 2000.
55. J. Nielsen, Does User Annoyance matter? Alertbox.Useit.com, 2007.
56. Nightingale P.G., Adu D., Richards N.T., Peters M. Implementation of rules based computerised bedside prescribing and administration: intervention study. BMJ 2000, 320:750-753.
57. Berner E.S. Clinical Decision Support Systems: State of the Art 2009, Agency for Healthcare Research and Quality, Rockville, MD.
58. Nemeth L.S., Wessell A.M. Improving medication safety in primary care using electronic health records. J. Patient Saf. 2010, 6:238-243.
59. Kawamoto K., Houlihan C.A., Balas E.A., Lobach D.F. Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ 2005, 330:765.
60. Ko Y., Ararca J., Malone D.C., Dare D.C., Geraets D., Houranieh A., et al. Practitioners' views on computerized drug-drug interaction alerts in the VA system. J. Am. Med. Inform. Assoc. 2007, 14:56-64.
61. van der Sijs H., Aarts J., van Gelder T., Berg M., Vulto A. Turning off frequently overridden drug alerts: limited opportunities for doing it safely. J. Am. Med. Inform. Assoc. 2008, 15:439-448.
62. Kuperman G.J., Reichley R.M., Bailey T.C. Using commercial knowledge bases for clinical decision support. J. Am. Med. Inform. Assoc. 2006, 13:369-371.
63. Guzek M., Zorina O.I., Semmler A., Gonzenbach R.R., Huber M., Kullak-Ublick G.A., et al. Evaluation of drug interactions and dosing in 484 neurological inpatients using clinical decision support software and an extended operational interaction classification system (Zurich Interaction System). Pharmacoepidemiol. Drug Saf. 2011, 20:930-938.
64. van Roon E.N., Flikweert S., le Comte M., Langendijk P.N., Kwee-Zuiderwijk W.J., Smits P., et al. Clinical relevance of drug-drug interactions: a structured assessment procedure. Drug Saf. 2005, 28:1131-1139.
65. Classen D.C., Phansalkar S., Bates D.W. Critical drug-drug interactions for use in electronic health records systems with computerized physician order entry: review of leading approaches. J. Patient Saf. 2011, 7:61-65.
66. Wright A., Sittig D.F., Ash J.S., Bates D.W., Feblowitz J., Fraser G., et al. Governance for clinical decision support: case studies and recommended practices from leading institutions. J. Am. Med. Inform. Assoc. 2011, 18:187-194.
67. Sittig D.F., Wright A., Simonaitis L., Carpenter J.D., Allen G.O., Doebbeling B.N., et al. The state of the art in clinical knowledge management: an inventory of tools and techniques. Int. J. Med. Inf. 2010, 79:44-57.
68. van den Bemt P.M., Egberts A.C., Lenderink A.W., Verzijl J.M., Simons K.A., van der Pol W.S., et al. Risk factors for the development of adverse drug events in hospitalized patients. Pharm. World Sci. 2000, 22:62-66.
69. McDonald C.J., Wilson G.A., McCabe G.P. Physician response to computer reminders. JAMA 1980, 244:1579-1581.
70. Dean B., Schachter M., Vincent C., Barber N. Causes of prescribing errors in hospital inpatients: a prospective study. Lancet 2002, 359:1373-1378.
71. Miller R.A., Waitman L.R., Chen S., Rosenbloom S.T. The anatomy of decision support during inpatient care provider order entry (CPOE): empirical observations from a decade of CPOE experience at Vanderbilt. J. Biomed. Inform. 2005, 38:469-485.
72. Mille F., Schwartz C., Brion F., Fontan J.-E., Bourdon O., Degoulet P., et al. Analysis of overridden alerts in a drug-drug interaction detection system. Int. J. Qual. Health Care 2008, 20:400-405.
73. Ahearn M.D., Kerr S.J. General practitioners' perceptions of the pharmaceutical decision-support tools in their prescribing software. Med. J. Aust. 2003, 179:34-37.
74. Isaac T., Weissman J.S., Davis R.B., Massagli M., Cyrulik A., Sands D.Z., et al. Overrides of medication alerts in ambulatory care. Arch. Intern. Med. 2009, 169:305-311.
75. Gardner R.M., Evans R.S. Using computer technology to detect, measure, and prevent adverse drug events. J. Am. Med. Inform. Assoc. 2004, 11:535-536.
76. Rigden C. Now you see it, now you don't. IEEE Computer 2002, 35:104-105.
77. Zuffi S., Brambilla C., Beretta G., Scala P. Human computer interaction: legibility and contrast. 14th International Conference on Image Analysis and Processing 2007, 241-246. IEEE Computer Society, Modena, Italy. R. Cucchiara (Ed.).
78. Baseline Requirements for Color Use in Air Traffic Control Displays 2007, Human Factors Research, Engineering Group, US Department of Transportation, Washington, DC.
79. Larson K. The Science of Word Recognition. Microsoft Typography: Advanced Reading Technology 2004, Microsoft Corporation.
80. Gardner R.M. Computerized clinical decision-support in respiratory care. Respir. Care 2004, 49:378-386.
81. Chazard E., Ficheur G., Merlin B., Serrot E., Consortium P., Beuscart R. Adverse drug events prevention rules: multi-site evaluation of rules from various sources. Stud. Health Technol. Inform. 2009, 148:102-111.
82. Tinker M.A. Bases for Effective Reading 1965, University of Minnesota Press, Minneapolis.
83. Judge J., Field T.S., DeFlorio M., Laprino J., Auger J., Rochon P., et al. Prescribers' responses to alerts during medication ordering in the long term care setting. J. Am. Med. Inform. Assoc. 2006, 13:385-390.
84. Teich J.M., Merchia P.R., Schmiz J.L., Kuperman G.J., Spurr C.D., Bates D.W. Effects of computerized physician order entry on prescribing practices. Arch. Intern. Med. 2000, 160:2741-2747.
85. Murphy J.E., Malone D.C., Olson B.M., Grizzle A.J., Armstrong E.P., Skrepnek G.H. Development of computerized alerts with management strategies for 25 serious drug-drug interactions. Am. J. Health Syst. Pharm. 2009, 66:38-44.
86. Schiff G.D., Klass D., Peterson J.F., Shah G., Bates D.W. Linking laboratory and pharmacy: opportunities for reducing errors and improving care. Arch. Intern. Med. 2003, 163:893-900.
87. Vicente K.J. Ecological interface design: progress and challenges. Hum. Factors 2002, 44:62-78.
88. Filik R., Purdy K., Gale A., Gerrett D. Drug name confusion: evaluating the effectiveness of capital (" Tall Man") letters using eye movement data. Soc. Sci. Med. 2004, 59:2597-2601.
89. US Food and Drug Administration Name Differentiation Project 2001.
90. The Joint Commission List of Look-alike, Sound-alike Drugs 2010.
91. Wiklund M.E. Software user interfaces. Handbook of Human Factors in Medical Device Design 2011, 425-470. CRC Press, Boca Raton, FL. M.B. Weinger, D. Gardner-Bonneau, M.E. Wiklund, L.M. Kelly (Eds.).
92. Shneiderman B., United States Dept.of Health and Human Services Research-Based Web. Design and Usability Guidelines 2006, U.S. Dept. of Health and Human Services: U.S. General Services Administration, Washington, DC. 2 ed.
93. Jackson D. A direct path to dependable software. CACM 2009, 52:78-88.
94. Sittig D.F., Singh H. Defining health information technology-related errors: new developments since to err is human. Arch. Intern. Med. 2011, 171:1281-1284.
95. Fried T.R., Tinetti M.E., Iannone L. Primary care clinicians' experiences with treatment decision making for older persons with multiple conditions. Arch. Intern. Med. 2011, 171:75-80.
96. Metzger J., Welebob E., Bates D.W., Lipsitz S., Classen D.C. Mixed results in the safety performance of computerized physician order entry. Health Aff. (Millwood) 2010, 29:655-663.
97. Nanji K.C., Rothschild J.M., Salzberg C., Keohane C.A., Zigmont K., Devita J., et al. Errors associated with outpatient computerized prescribing systems. J. Am. Med. Inform. Assoc. 2011, 18:767-773.
98. Institute of Medicine Health IT and Patient Safety: Building Safer Systems for Better Care 2011, The National Academies Press, Washington, DC.
99. Ridgely M.S., Greenberg M. Too many alerts. Too much liability: sorting through the malpractice implications of drug-drug interaction clinical decision support. St. Louis Univ. J. Health Law Policy 2012, 5:257-295.
100. Rosenberg S.N., Sullivan M., Juster I.A., Jacques J. Overrides of medication alerts in ambulatory care. Arch. Intern. Med. 2009, 169:1337.
101. B. Middleton, M. Bloomrosen, M.A. Dente, B. Hashmat, R. Koppel, J.M. Overhage, et al., Enhancing patient safety and quality of care by improving the usability of electronic health record systems: recommendations from AMIA, J. Am. Med. Inform. Assoc., (2013), in press,.(Epub ahead of print).
102. HIMSS Usability Task Force Defining and Testing EMR Usability: Principles and Proposed Methods of EMR Usability Evaluation and Rating 2009, Healthcare Information and Management Systems Society, Chicago, IL.