Development and validation of a survey instrument for assessing prescribers' perception of computerized drugedrug interaction alerts

Journal of the American Medical Informatics Association

Volumn 18, Issue SUPPL. 1, 2011, Pages 51-61

  Zheng, Kai ^a   Fear, Kathleen ^a   Chaffee, Bruce W ^a,b   Zimmerman, Christopher R ^a,b   Karls, Edward M ^b   Gatwood, Justin D ^a   Stevenson, James G ^a,b   Pearlman, Mark D ^c  

^a UNIVERSITY OF MICHIGAN   (United States)

^b UNIVERSITY OF MICHIGAN HEALTH SYSTEM   (United States)

^c UNIVERSITY OF MICHIGAN MEDICAL SCHOOL   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; COMPUTER; COMPUTERIZED PROVIDER ORDER ENTRY; CONCEPTUAL FRAMEWORK; FATIGUE; HUMAN; PERCEPTION; PERFORMANCE; PHYSICIAN ATTITUDE; QUESTIONNAIRE; VALIDATION PROCESS; VALIDATION STUDY; ATTITUDE TO COMPUTERS; COMPUTER ASSISTED DRUG THERAPY; DRUG INTERACTION; HEALTH PERSONNEL ATTITUDE; HOSPITAL INFORMATION SYSTEM; INFORMATION PROCESSING; REMINDER SYSTEM;

ATTITUDE OF HEALTH PERSONNEL; ATTITUDE TO COMPUTERS; DATA COLLECTION; DRUG INTERACTIONS; DRUG THERAPY, COMPUTER-ASSISTED; HUMANS; MEDICAL ORDER ENTRY SYSTEMS; QUESTIONNAIRES; REMINDER SYSTEMS;

EID: 84863558204     PISSN: 10675027     EISSN: 1527974X     Source Type: Journal    
DOI: 10.1136/amiajnl-2010-000053     Document Type: Article

References (115)

1. Bates DW, Leape LL, Cullen DJ, et al. Effect of computerized physician order entry and a team intervention on prevention of serious medication errors. JAMA 1998;(15):1311-16.
2. Bates DW, Teich JM, Lee J, et al. The impact of computerized physician order entry on medication error prevention. J Am Med Inform Assoc 1999;6:313-21.
3. Nightingale PG, Adu D, Richards NT, et al. Implementation of rules based computerised bedside prescribing and administration: intervention study. BMJ 2000;320:750-3.
4. Teich JM, Merchia PR, Schmiz JL, et al. Effects of computerized physician order entry on prescribing practices. Arch Intern Med 2000;160:2741-7.
5. Institute of Medicine. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, DC, USA: National Academy Press, 2001.
6. Bates DW, Gawande AA. Improving safety with information technology. N Engl J Med 2003;348:2526-34.
7. Kuperman GJ, Bobb A, Payne TH, et al. Medication-related clinical decision support in computerized provider order entry systems: a review. J Am Med Inform Assoc 2007;14:29-40.
8. Shamliyan TA, Duval S, Du J, et al. Just what the doctor ordered. Review of the evidence of the impact of computerized physician order entry system on medication errors. Health Serv Res 2008;43:32-53.
9. Gardner RM, Evans RS. Using computer technology to detect, measure, and prevent adverse drug events. J Am Med Inform Assoc 2004;11:535-6.
10. Teich JM, Osheroff JA, Pifer EA, et al; CDS Expert Review Panel. Clinical decision support in electronic prescribing: recommendations and an action plan: report of the joint clinical decision support workgroup. J Am Med Inform Assoc 2005;12:365-76.
11. Osheroff JA, Teich JM, Middleton B, et al. A roadmap for national action on clinical decision support. J Am Med Inform Assoc 2007;14:141-5.
12. Congressional Budget Office. Costs and Benefits of Health Information Technology. Washington, DC, USA: Congressional Budget Office, 2008.
13. Blumenthal D. Stimulating the adoption of health information technology. N Engl J Med 2009;360:1477-9.
14. Blumenthal D, Tavenner M. The "meaningful use" regulation for electronic health records. N Engl J Med 2010;363:501-4.
15. The Leapfrog Group. What does Leapfrog Ask Hospitals? 2010. http://www. leapfroggroup.org/for_consumers/hospitals_asked_what (accessed 17 Aug 2010).
16. The Leapfrog Group. Fact Sheet: Computerized Physician Order Entry. 2008. http://www.leapfroggroup.org/media/file/Leapfrog-Computer_Physician_Order_Entry_Fact_Sheet.pdf (accessed 17 Aug 2010).
17. Kaushal R, Shojania KG, Bates DW. Effects of computerized physician order entry and clinical decision support systems on medication safety: a systematic review. Arch Intern Med 2003;163:1409-16.
18. Chaudhry B, Wang J, Wu S, et al. Systematic review: impact of health information technology on quality, efficiency, and costs of medical care. Ann Intern Med 2006;144:742-52.
19. Eslami S, Abu-Hanna A, de Keizer NF. Evaluation of outpatient computerized physician medication order entry systems: a systematic review. J Am Med Inform Assoc 2007;14:400-6.
20. Eslami S, de Keizer NF, Abu-Hanna A. The impact of computerized physician medication order entry in hospitalized patientsda systematic review. Int J Med Inform 2008;77:365-76.
21. Ammenwerth E, Schnell-Inderst P, Machan C, et al. The effect of electronic prescribing on medication errors and adverse drug events: a systematic review. J Am Med Inform Assoc 2008;15:585-600.
22. Wolfstadt JI, Gurwitz JH, Field TS, et al. The effect of computerized physician order entry with clinical decision support on the rates of adverse drug events: a systematic review. J Gen Intern Med 2008;23:451-8.
23. Schedlbauer A, Prasad V, Mulvaney C, et al. What evidence supports the use of computerized alerts and prompts to improve clinicians' prescribing behavior? J Am Med Inform Assoc 2009;16:531-8.
24. Reckmann MH, Westbrook JI, Koh Y, et al. Does computerized provider order entry reduce prescribing errors for hospital inpatients? A systematic review. J Am Med Inform Assoc 2009;16:613-23.
25. van Rosse F, Maat B, Rademaker CM, et al. The effect of computerized physician order entry on medication prescription errors and clinical outcome in pediatric and intensive care: a systematic review. Pediatrics 2009;123:1184-90.
26. Pearson SA, Moxey A, Robertson J, et al. Do computerised clinical decision support systems for prescribing change practice? A systematic review of the literature (1990-2007). BMC Health Serv Res 2009;9:154.
27. Shojania KG, Jennings A, Mayhew A, et al. Effect of point-of-care computer reminders on physician behaviour: a systematic review. CMAJ. 2010;182: E216-25.
28. Payne TH, Nichol WP, Hoey P, et al. Characteristics and override rates of order checks in a practitioner order entry system. Proc AMIA Symp 2002:602-6.
29. Weingart SN, Toth M, Sands DZ, et al. Physicians' decisions to override computerized drug alerts in primary care. Arch Intern Med 2003;163:2625-31.
30. Hsieh TC, Kuperman GJ, Jaggi T, et al. Characteristics and consequences of drug allergy alert overrides in a computerized physician order entry system. J Am Med Inform Assoc 2004;11:482-91.
31. Spina JR, Glassman PA, Belperio P, et al. Primary Care Investigative Group of the VA Los Angeles Healthcare System. Clinical relevance of automated drug alerts from the perspective of medical providers. Am J Med Qual 2005;20:7-14.
32. van der Sijs H, Aarts J, Vulto A, et al. Overriding of drug safety alerts in computerized physician order entry. J Am Med Inform Assoc 2006;13:138-47.
33. Grizzle AJ, Mahmood MH, Ko Y, et al. Reasons provided by prescribers when overriding drug-drug interaction alerts. Am J Manag Care 2007;13:573-8.
34. van der Sijs H, Aarts J, van Gelder T, et al. Turning off frequently overridden drug alerts: limited opportunities for doing it safely. J Am Med Inform Assoc 2008;15:439-48.
35. Lin CP, Payne TH, Nichol WP, et al. Evaluating clinical decision support systems: monitoring CPOE order check override rates in the Department of Veterans Affairs' Computerized Patient Record System. J Am Med Inform Assoc 2008;15:620-6.
36. Isaac T, Weissman JS, Davis RB, et al. Overrides of medication alerts in ambulatory care. Arch Intern Med 2009;169:305-11.
37. van der Sijs H, Mulder A, van Gelder T, et al. Drug safety alert generation and overriding in a large Dutch university medical centre. Pharmacoepidemiol Drug Saf 2009;18:941-7.
38. Berner ES. Clinical Decision Support Systems: State of the Art. Rockville, MD, USA: The Agency for Healthcare Research and Quality (AHRQ), 2010.
39. Miller RA. Medical diagnostic decision support systemsdpast, present, and future: a threaded bibliography and brief commentary. J Am Med Inform Assoc 1994;1:8-27.
40. Engle RL Jr. Attempts to use computers as diagnostic aids in medical decision making: a thirty-year experience. Perspect Biol Med 1992;35:207-19.
41. Berner ES, Detmer DE, Simborg D. Will the wave finally break? A brief view of the adoption of electronic medical records in the United States. J Am Med Inform Assoc 2005;12:3-7.
42. Bates DW, O'Neil AC, Boyle D, et al. Potential identifiability and preventability of adverse events using information systems. J Am Med Inform Assoc 1994;1:404-11.
43. Institute of Medicine. To Err Is Human: Building a Safer Health System. Washington, DC, USA: National Academy Press, 2000.
44. Certification Commission for Health Information Technology. CCHIT Certified 2011 Inpatient EHR, 2010. http://www.cchit.org/certify/2011/cchit-certified-2011-inpatient-ehr (accessed 22 Aug 2010).
45. Wright A, Sittig DF, Ash JS, et al. Clinical decision support capabilities of commercially-available clinical information systems. J Am Med Inform Assoc 2009;16:637-44.
46. van der Sijs H, Lammers L, van den Tweel A, et al. Time-dependent drug-drug interaction alerts in care provider order entry: software may inhibit medication error reductions. J Am Med Inform Assoc 2009;16:864-8.
47. Metzger J, Welebob E, Bates DW, et al. Mixed results in the safety performance of computerized physician order entry. Health Aff (Millwood) 2010;29:655-63.
48. van der Sijs H, Bouamar R, van Gelder T, et al. Functionality test for drug safety alerting in computerized physician order entry systems. Int J Med Inform 2010;79:243-51.
49. Kuperman GJ, Reichley RM, Bailey TC. Using commercial knowledge bases for clinical decision support: Opportunities, hurdles, and recommendations. J Am Med Inform Assoc 2006;13:369-71.
50. Eichner J, Das M. NORC at the University of Chicago. Challenges and Barriers to Clinical Decision Support (CDS) Design and Implementation Experienced in the Agency for Healthcare Research and Quality CDS Demonstrations. Rockville, MD, USA: The Agency for Healthcare Research and Quality (AHRQ), 2010.
51. Ford EW, Menachemi N, Peterson LT, et al. Resistance is futile: but it is slowing the pace of EHR adoption nonetheless. J Am Med Inform Assoc 2009;16:274-81.
52. Koppel R, Metlay JP, Cohen A, et al. Role of computerized physician order entry systems in facilitating medication errors. JAMA 2005;293:1197-203.
53. Campbell EM, Sittig DF, Ash JS, et al. Types of unintended consequences related to computerized provider order entry. J Am Med Inform Assoc 2006;13:547-56.
54. Ash JS, Sittig DF, Poon EG, et al. The extent and importance of unintended consequences related to computerized provider order entry. J Am Med Inform Assoc 2007;14:415-23.
55. Vaziri A, Connor E, Shepherd I, et al. Are we setting about improving the safety of computerised prescribing in the right way? A workshop report. Inform Prim Care 2009;17:175-82.
56. Fishbein M, Ajzen I. Beliefs, Attitude, Intention and Behavior: An Introduction to Theory and Research. Reading, MA, USA: Addison-Wesley, 1975.
57. Ajzen I. From intentions to actions: a theory of planned behavior. In: Kuhl J, Beckmann J, eds. Springer Series in Social Psychology. Heidelberg, Germany: Springer Berlin, 1985:11-39.
58. Sheppard BH, Hartwick J, Warshaw PR. The theory of reasoned action: a meta-analysis of past research with recommendations for modifications and future research. J Cons Res 1988;15:325-43.
59. Armitage CJ, Conner M. Efficacy of the Theory of Planned Behaviour: a meta-analytic review. Br J Soc Psychol 2001;40:471-99.
60. Thompson RL, Higgins CA, Howell JM. Personal computing: toward a conceptual model of utilization. MIS Quart 1991;15:125-43.
61. Goodhue DL, Thompson RL. Task-technology fit and individual performance. MIS Quart 1995;19:213-36.
62. Triandis HC. Values, attitudes, and interpersonal behavior. Nebr Symp Motiv 1980;27:195-259.
63. Davis FD. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quart 1989;13:319-40.
64. Venkatesh V, Davis FD. A theoretical extension of the technology acceptance model: four longitudinal field studies. Manage Sci 2000;46:186-204.
65. Venkatesh V, Morris MG, Davis GB, et al. User acceptance of information technology: toward a unified view. MIS Quart 2003;27:425-78.
66. Lee Y, Kozar K, Larsen K. The technology acceptance model: past, present, and future. Comm Assoc Inform Syst 2003;12:752-80.
67. Zheng K, Padman R, Johnson MP, et al. Evaluation of healthcare IT applications: the user acceptance perspective. In: Kacprzyk J, ed. Studies in Computational Intelligence. Heidelberg, Germany: Springer Berlin, 2007;65:49-78.
68. Godin G, Bélanger-Gravel A, Eccles M, et al. Healthcare professionals' intentions and behaviours: a systematic review of studies based on social cognitive theories. Implement Sci 2008;3:36.
69. Holden RJ, Karsh BT. The technology acceptance model: its past and its future in health care. J Biomed Inform 2010;43:159-72.
70. Reason J. The contribution of latent human failures to the breakdown of complex systems. Philos Trans R Soc Lond B Biol Sci 1990;327:475-84.
71. Homans GC. The Human Group. New York City, NY, USA: Harcourt Brace, 1950.
72. Coleman J, Katz E, Menzel H. Medical Innovation: A Diffusion Study. 2nd edn. New York City, NY, USA: Bobbs-Merrill, 1966.
73. Rice RE, Aydin C. Attitudes toward new organizational technology: network proximity as a mechanism for social information processing. Adm Sci Q 1991;36:219-44.
74. Sullivan HS. Conceptions of Modern Psychiatry. New York City, NY, USA: W.W. Norton & Co., Inc, 1953.
75. Burt RS. Social contagion and innovation: cohesion versus structural equivalence. Am J Sociol 1987;92:1287-35.
76. Zheng K, Padman R, Krackhardt D, et al. Social networks and physician adoption of electronic health records: insights from an empirical study. J Am Med Inform Assoc 2010;17:328-36.
77. van der Sijs H, van Gelder T, Vulto A, et al. Understanding handling of drug safety alerts: a simulation study. Int J Med Inform 2010;79:361-9.
78. Hor CP, O'Donnell JM, Murphy AW, et al. General practitioners' attitudes and preparedness towards Clinical Decision Support in e-Prescribing (CDS-eP) adoption in the West of Ireland: a cross sectional study. BMC Med Inform Decis Mak 2010;10:2.
79. Vashitz G, Meyer J, Parmet Y, et al. Defining and measuring physicians' responses to clinical reminders. J Biomed Inform 2009;42:317-26.
80. Weingart SN, Simchowitz B, Shiman L, et al. Clinicians' assessments of electronic medication safety alerts in ambulatory care. Arch Intern Med 2009;169:1627-32.
81. Weingart SN, Massagli M, Cyrulik A, et al. Assessing the value of electronic prescribing in ambulatory care: a focus group study. Int J Med Inform 2009;78:571-8.
82. Mollon B, Chong J Jr, Holbrook AM, et al. Features predicting the success of computerized decision support for prescribing: a systematic review of randomized controlled trials. BMC Med Inform Decis Mak 2009;9:11.
83. Ko Y, Abarca J, Malone DC, et al. Practitioners' views on computerized drug-drug interaction alerts in the VA system. J Am Med Inform Assoc 2007;14:56-64.
84. Mayo-Smith MF, Agrawal A. Factors associated with improved completion of computerized clinical reminders across a large healthcare system. Int J Med Inform 2007;76:710-16.
85. Graham ID, Logan J, Bennett CL, et al. Physicians' intentions and use of three patient decision aids. BMC Med Inform Decis Mak 2007;7:20.
86. Sittig DF, Krall MA, Dykstra RH, et al. A survey of factors affecting clinician acceptance of clinical decision support. BMC Med Inform Decis Mak 2006;6:6.
87. Glassman PA, Belperio P, Simon B, et al. Exposure to automated drug alerts over time: effects on clinicians' knowledge and perceptions. Med Care 2006;44:250-6.
88. Abarca J, Malone DC, Skrepnek GH, et al. Community pharmacy managers' perception of computerized drug-drug interaction alerts. J Am Pharm Assoc 2006;46:148-53.
89. Nie's J, Colombet I, Degoulet P, et al. Determinants of success for computerized clinical decision support systems integrated in CPOE systems: a systematic review. AMIA Annu Symp Proc 2006:594-8.
90. Saleem JJ, Patterson ES, Militello L, et al. Exploring barriers and facilitators to the use of computerized clinical reminders. J Am Med Inform Assoc 2005;12:438-47.
91. Kawamoto K, Houlihan CA, Balas EA, et al. Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ 2005;330:765.
92. Taylor LK, Tamblyn R. Reasons for physician non-adherence to electronic drug alerts. Stud Health Technol Inform 2004;107:1101-5.
93. Patterson ES, Nguyen AD, Halloran JP, et al. Human factors barriers to the effective use of ten HIV clinical reminders. J Am Med Inform Assoc 2004;11:50-9.
94. Ahearn MD, Kerr SJ. General practitioners' perceptions of the pharmaceutical decision-support tools in their prescribing software. Med J Aust 2003;179:34-7.
95. Magnus D, Rodgers S, Avery AJ. GPs' views on computerized drug interaction alerts: questionnaire survey. J Clin Pharm Ther 2002;27:377-82.
96. Glassman PA, Simon B, Belperio P, et al. Improving recognition of drug interactions: benefits and barriers to using automated drug alerts. Med Care 2002;40:1161-71.
97. Krall MA, Sittig DF. Subjective assessment of usefulness and appropriate presentation mode of alerts and reminders in the outpatient setting. Proc AMIA Symp 2001:334-8.
98. Chaffee BW, Zimmerman CR. Developing and implementing clinical decision support for use in a computerized prescriber-order-entry system. Am J Health Syst Pharm 2010;67:391-400.
99. Straub DW. Validating instruments in MIS research. MIS Quart 1989;13:147-69.
100. Moore GC, Benbasat I. Development of an instrument to measure the perceptions of adopting an information technology innovation. Inform Syst Res 1991;2:192-222.
101. Cork RD, Detmer WM, Friedman CP. Development and initial validation of an instrument to measure physicians' use of, knowledge about, and attitudes toward computers. J Am Med Inform Assoc 1998;5:164-76.
102. Podsakoff PM, MacKenzie SB, Lee JY, et al. Common method biases in behavioral research: a critical review of the literature and recommended remedies. J Appl Psychol 2003;88:879-903.
103. Davis FD, Bagozzi RP, Warshaw PR. User acceptance of computer technology: a comparison of two theoretical models. Manage Sci 1989;35:982-1003.
104. Kaplan D. Structural Equation Modeling: Foundations and Extensions. Thousand Oaks, CA, USA: Sage Publications, 2009.
105. Boudreau MC, Gefen D, Straub DW. Validation in information systems: a state-ofthe-art assessment. MIS Quart 2001;25:1-16.
106. Bagozzi RP. Structural equation models in marketing research: basic principles. In: Bagozzi RP, ed. Principles of Marketing Research. Oxford, England: Blackwell Publishers, 1994:317-85.
107. Hu LT, Bentler PM. Fit indices in covariance structure modeling: sensitivity to underparameterized model misspecification. Psychol Methods 1998;3:424-53.
108. Bentler PM. Comparative fit indexes in structural models. Psychol Bull 1990;107:238-46.
109. Browne MW, Cudeck R. Alternative ways of assessing model fit. In: Bollen KA, Long JS, eds. Testing Structural Equation Models. Thousand Oaks, CA, USA: Sage Publications, 1993:136-62.
110. Sousa KH, Kwok OM. Putting Wilson and Cleary to the test: analysis of a HRQOL conceptual model using structural equation modeling. Qual Life Res 2006;15:725-37.
111. Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res 2005;15:1277-88.
112. Berger RG, Kichak JP. Computerized physician order entry: helpful or harmful? J Am Med Inform Assoc 2004;11:100-3.
113. McDonald CJ, Overhage JM, Mamlin BW, et al. Physicians, information technology, and health care systems: a journey, not a destination. J Am Med Inform Assoc 2004;11:121-4.
114. Lyman JA, Cohn WF, Bloomrosen M, et al. Clinical decision support: progress and opportunities. J Am Med Inform Assoc 2010;17:487-92.
115. Schwarz N, Oyserman D. Asking questions about behavior: cognition, communication, and questionnaire construction. Amer J Eval 2001;22:127-60.