A Conceptual Framework for Evaluating Outpatient Electronic Prescribing Systems Based on Their Functional Capabilities

Journal of the American Medical Informatics Association

Volumn 11, Issue 1, 2004, Pages 60-70

  Bell, Douglas S ^a,b   Cretin, Shan ^a,c   Marken, Richard S ^a   Landman, Adam B ^a,d  

^a RAND CORPORATION   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c American Friends Service Committee   (United States)

^d ROBERT WOOD JOHNSON MEDICAL SCHOOL   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BIOMEDICAL TECHNOLOGY ASSESSMENT; CLINICAL TRIAL; ELECTRONICS; EVALUATION; HAZARD; HUMAN; INTERVIEW; MEDICATION ERROR; META ANALYSIS; OUTPATIENT; PHARMACEUTICAL CARE; PRESCRIPTION; PROCESS MODEL; REVIEW; TELEPHONE; VALIDATION PROCESS;

EID: 0347052856     PISSN: 10675027     EISSN: None     Source Type: Journal    
DOI: 10.1197/jamia.M1374     Document Type: Article

References (79)

1. Agency for Healthcare Research and Quality. MEPS Highlights #11: Distribution of Health Care Expenses, 1999 [web page]. 2001; available at: http://www.meps.ahrq.gov/papers/hl11_00-0024/hl11.htm. Accessed Sept 19, 2002.
2. Melmon KL. Preventable drug reactions-causes and cures. N Engl J Med. 1971;284:1361-8.
3. Steel K, Gertman PM, Crescenzi C, Anderson J. Iatrogenic illness on a general medical service at a university hospital. N Engl J Med. 1981;304:638-42.
4. Bates DW, Cullen DJ, Laird N, et al. Incidence of adverse drug events and potential adverse drug events. Implications for prevention. ADE Prevention Study Group. JAMA. 1995;274:29-34.
5. Leape LL, Bates DW, Cullen DJ, et al. Systems analysis of adverse drug events. ADE Prevention Study Group. JAMA. 1995;274:35-43.
6. Massaro TA. Introducing physician order entry at a major academic medical center: I. Impact on organizational culture and behavior. Acad Med. 1993;68:20-5.
7. Ornstein C. Hospital Heeds Doctors, Suspends Use of Software; Cedars-Sinai physicians entered prescriptions and other orders in it, but called it unsafe. The Los Angeles Times. Jan 22, 2003; Sect B:1.
8. Ash JS, Gorman PN, Hersh WR. Physician order entry in U.S. hospitals. Proc AMIA Symp. 1998:235-9.
9. The Leapfrog Group. Hospital Survey Results Summary [web page]. Jan 17, 2002; available at: http://www.leapfroggroup.org/Briefing/ResultsSummary011702.pdf. Accessed Mar 10, 2003.
10. The Leapfrog Group. Patient Safety: Setting Standards: An Rx for Rx [web page]. Available at: http://wwwleapfroggroup.org/safetyl.htm# CPOE. Accessed Oct 6, 2002.
11. U.S. Senate. 108th Congress. S. 1, Prescription Drug and Medicare Improvement Act of 2003. Available at: http://thomas.loc.gov/cgi-bin/bdquery/z?d108:s.00001 [passed: Jun 27, 2003].
12. U.S. House. 108th Congress. H.R. 1, Medicare Prescription Drug and Modernization Act of 2003. Available at: http://thomas.loc.gov/cgi-bin/bdquery/z?d108:HR00001 [passed: Jun 27, 2003].
13. Kaushal R, Bates DW. Computerized Physician Order Entry (CPOE) with Clinical Decision Support Systems (CDSSs). Shojania KG, Duncan BW, McDonald KM, Wachter RM, eds. Making Health Care Safer: A Critical Analysis of Patient Safety Practices. Washington, DC: Agency for Healthcare Research and Quality, 2001; AHRQ Publication 01-E058. AHRQ Evidence Report/Technology Assessment: Number 43.
14. Simon HA. The science of design: creating the artificial. In: Simon HA. The Sciences of the Artificial. Cambridge, MA: MIT Press; 1996.
15. Campbell M, Fitzpatrick R, Haines A, et al. Framework for design and evaluation of complex interventions to improve health. BMJ. 2000;321:694-6.
16. MRC Health Services and Public Health Research Board. A framework for the development and evaluation of complex interventions to improve health [web page]. April 2000; available at: http://www.mrc.ac.uk/pdf-mrc_cpr.pdf. Accessed Mar 31, 2002.
17. Nadzam DM. Development of medication-use indicators by the Joint Commission on Accreditation of Healthcare Organizations. Am J Hosp Pharm. 1991;48:1925-30.
18. Federal Food, Drug, and Cosmetic Act. 21 U.S.C. 9:353(b).
19. Wax PM. Elixirs, diluents, and the passage of the 1938 Federal Food, Drug and Cosmetic Act. Ann Intern Med. 1995;122:456-461.
20. Burnum JF. Preventability of adverse drug reactions [letter]. Ann Intern Med. 1976;85:80-1.
21. Leape LL, Brennan TA, Laird N, et al. The nature of adverse events in hospitalized patients. Results of the Harvard-Medical Practice Study II. N Engl J Med. 1991;324:377-84.
22. Gandhi TK, Weingart SN, Borus J, et al. Adverse drug events in ambulatory care. N Engl J Med. 2003;348:1556-64.
23. Beers MH, Storrie M, Lee G. Potential adverse drug interactions in the emergency room. An issue in the quality of care. Ann Intern Med. 1990;112:61-4.
24. Goldberg RM, Mabee J, Chan L, Wong S. Drug-drug and drug-disease interactions in the ED: analysis of a high-risk population. Am J Emerg Med. 1996;14:447-50.
25. Langdorf MI, Fox JC, Marwah RS, Montague BJ, Hart MM. Physician versus computer knowledge of potential drug interactions in the emergency department. Acad Emerg Med. 2000;7:1321-9.
26. Schneitman-McIntire O, Farnen TA, Gordon N, Chan J, Toy WA. Medication misadventures resulting in emergency department visits at an HMO medical center. Am J Health Syst Pharm. 1996;53:1416-22.
27. Einarson TR. Drug-related hospital admissions. Ann Pharmacother. 1993;27:832-40.
28. Agency for Healthcare Research and Quality. 1998 Medical Expenditure Panel Survey-Table Compendium [web page]. Jun 14, 2002; available at: http://www.meps.ahrq.gov/compendiumtables/98ch1/compendiumtables.htm. Accessed Sep 7, 2002.
29. Bates DW, Spell N, Cullen DJ, et al. The costs of adverse drug events in hospitalized patients. Adverse Drug Events Prevention Study Group. JAMA. 1997;277:307-11.
30. Bates DW, Miller EB, Cullen DJ, et al. Patient risk factors for adverse drug events in hospitalized patients. ADE Prevention Study Group. Arch Intern Med. 1999;159:2553-60.
31. Lesar TS, Briceland L, Stein DS. Factors related to errors in medication prescribing. JAMA. 1997;277:312-7.
32. Cabral JD. Poor physician penmanship. JAMA. 1997;278:1116-7.
33. Anonymous. A study of physicians' handwriting as a time waster. JAMA. 1979;242:2429-30.
34. Winslow EH, Nestor VA, Davidoff SK, Thompson PG, Borum JC. Legibility and completeness of physicians' handwritten medication orders. Heart Lung. 1997;26:158-64.
35. Charatan F. Compensation awarded for death after illegible prescription. West J Med. 2000;172(2):80.
36. Boring D, Di Domizio G, Cohen MR. The role of pharmaceutical trademarks in medication errors. In: Cohen MR, ed. Medication Errors: Causes, Prevention, and Risk Management. Sudbury, MA: Jones and Bartlett; 2000.
37. Sittig DF, Stead WW. Computer-based physician order entry: the state of the art. J Am Med Inform Assoc. 1994;1:108-23.
38. McDonald CJ, Overhage JM, Tierney WM, et al. The Regenstrief Medical Record System: a quarter century experience. Int J Med Inf. 1999;54:225-53.
39. Tierney WM, Miller ME, Overhage JM, McDonald CJ. Physician inpatient order writing on microcomputer workstations. Effects on resource utilization. JAMA. 1993;269:379-83.
40. Gardner RM, Pryor TA, Warner HR. The HELP hospital information system: update 1998. Int J Med Inf. 1999;54:169-82.
41. Evans RS, Pestotnik SL, Classen DC, et al. A computer-assisted management program for antibiotics and other antiinfective agents. N Engl J Med. 1998;338:232-8.
42. Pestotnik SL, Classen DC, Evans RS, Burke JP. Implementing antibiotic practice guidelines through computer-assisted decision support: clinical and financial outcomes. Ann Intern Med. 1996;124:884-90.
43. Bates DW, Leape LL, Cullen DJ, et al. Effect of computerized physician order entry and a team intervention on prevention of serious medication errors. JAMA. 1998;280:1311-6.
44. Bates DW, Teich JM, Lee J, et al. The impact of computerized physician order entry on medication error prevention. J Am Med Inform Assoc. 1999;6:313-21.
45. Purves IN. PRODIGY: implementing clinical guidance using computers. Br J Gen Pract. 1998;48:1552-3.
46. Gandhi TK, Weingart SN, Borus J, et al. Adverse drug events in ambulatory care. N Engl J Med. 2003;348:1556-64.
47. 2001 resource guide. Healthcare IT products and services. Healthc Inform. 2000;17(12):17-172.
48. Reason J. Human Error. New York: Cambridge University Press, 1990.
49. Johnston ME, Langton KB, Haynes RB, Mathieu A. Effects of computer-based clinical decision support systems on clinician performance and patient outcome. A critical appraisal of research. Ann Intern Med. 1994;120:135-42.
50. Chute CG. Clinical classification and terminology: some history and current observations. J Am Med Inform Assoc. 2000;7:298-303.
51. Teich JM, Merchia PR, Schmiz JL, Kuperman GJ, Spurr CD, Bates DW. Effects of computerized physician order entry on prescribing practices. Arch Intern Med. 2000;160:2741-7.
52. Lambert BL, Lin SJ, Chang KY, Gandhi SK. Similarity as a risk factor in drug-name confusion errors: the look-alike (orthographic) and sound-alike (phonetic) model. Med Care. 1999;37:1214-25.
53. Lambert BL, Chang KY, Lin SJ. Effect of orthographic and phonological similarity on false recognition of drug names. Soc Sci Med. 2001;52:1843-57.
54. Bates DW, Boyle DL, Teich JM. Impact of computerized physician order entry on physician time. Proc Annu Symp Comput Appl Med Care. 1994:996.
55. Tierney WM, Overhage JM, McDonald CJ, Wolinsky FD. Medical students' and housestaff's opinions of computerized order-writing. Acad Med. 1994;69:386-9.
56. Overhage JM, Perkins S, Tierney WM, McDonald CJ. Controlled trial of direct physician order entry: effects on physicians' time utilization in ambulatory primary care internal medicine practices. J Am Med Inform Assoc. 2001;8:361-71.
57. Poirier TI, Giudici R. Evaluation of drug interaction microcomputer software: an updated comparison. Hosp Pharm. 1995;30:888-90, 893-4.
58. Abookire SA, Teich JM, Sandige H, et al. Improving allergy alerting in a computerized physician order entry system. Proc AMIA Symp. 2000:2-6.
59. Lexchin J. Effects of restrictive formularies in the ambulatory care setting. Am J Manag Care. 2002;8(1):69-76.
60. White RH, Hong R, Venook AP, et al. Initiation of warfarin therapy: comparison of physician dosing with computer-assisted dosing. J Gen Intern Med. 1987;2:141-8.
61. Evans RS, Pestotnik SL, Classen DC, Burke JP. Evaluation of a computer-assisted antibiotic-dose monitor. Ann Pharmacother. 1999;33:1026-31.
62. Schiff GD, Rucker TD. Computerized prescribing: building the electronic infrastructure for better medication usage. JAMA. 1998;279:1024-9.
63. Gurwitz JH, Field TS, Harrold LR, et al. Incidence and preventability of adverse drug events among older persons in the ambulatory setting. JAMA. 2003;289:1107-16.
64. Overhage JM, Tierney WM, Zhou XH, McDonald CJ. A randomized trial of "corollary orders" to prevent errors of omission. J Am Med Inform Assoc. 1997;4:364-75.
65. Miller LG, Liu H, Hays RD, et al. How well do clinicians estimate patients' adherence to combination antiretroviral therapy? J Gen Intern Med. 2002;17:1-11.
66. Anderson JG, Jay SJ, Anderson M, Hunt TJ. Evaluating the potential effectiveness of using computerized information systems to prevent adverse drug events. Proc AMIA Annu Fall Symp. 1997:228-32.
67. Anderson JG, Jay SJ, Anderson M, Hunt TJ. Evaluating the capability of information technology to prevent adverse drug events: a computer simulation approach. J Am Med Inform Assoc. 2002;9:479-90.
68. Brook RH, Chassin MR, Fink A, et al. A method for the detailed assessment of the appropriateness of medical technologies. Int J Technol Assess Health Care. 1986;2:53-63.
69. Leveson NG, Turner CS. An investigation of the Therac-25 accidents. IEEE Computer. 1993;26(4):18-41.
70. McDaniel JG. Improving system quality through software evaluation. Comput Biol Med. 2002;32:127-40.
71. Reason J. Human error: models and management. BMJ. 2000;320:768-70.
72. Zhang J, Patel VL, Johnson TR, Shortliffe EH. Toward a cognitive taxonomy of medical errors. Proc AMIA Symp. 2002:934-8.
73. Nielsen J. Usability engineering. Boston: AP Professional, 1994.
74. Leape LL, Berwick DM, Bates DW. What practices will most improve safety? Evidence-based medicine meets patient safety. JAMA. 2002;288:501-7.
75. Shojania KG, Duncan BW, McDonald KM, Wachter RM. Safe but sound: patient safety meets evidence-based medicine. JAMA. 2002;288:508-13.
76. Kaushal R, Bates DW, Landrigan C, et al. Medication errors and adverse drug events in pediatric inpatients. JAMA. 2001;285:2114-20.
77. Honigman B, Lee J, Rothschild J, et al. Using computerized data to identify adverse drug events in outpatients. J Am Med Inform Assoc. 2001;8:254-66.
78. Leape LL, Bates DW, Cullen DJ, et al. Systems analysis of adverse drug events. ADE Prevention Study Group. JAMA. 1995;274:35-43.
79. U.S. Department of Commerce National Institute of Standards and Technology. Integration Definition for Function Modeling (IDEF0). 1993. (Federal Information Processing Standards Publications (FIPS PUBS); vol 183).