Impact of Clinical Reminder Redesign on Learnability, Efficiency, Usability, and Workload for Ambulatory Clinic Nurses

Journal of the American Medical Informatics Association

Volumn 14, Issue 5, 2007, Pages 632-640

  Saleem, Jason J ^a,b,c   Patterson, Emily S ^a,d   Militello, Laura ^e   Anders, Shilo ^d   Falciglia, Mercedes ^a,f   Wissman, Jennifer A ^a   Roth, Emilie M ^g   Asch, Steven M ^h,i  

^a VETERANS AFFAIRS MEDICAL CENTER   (United States)

^b RICHARD L ROUDEBUSH VETERANS AFFAIRS MEDICAL CENTER   (United States)

^c Indiana University Purdue University Indianapolis   (United States)

^d OHIO STATE UNIVERSITY   (United States)

^e UNIVERSITY OF DAYTON RESEARCH INSTITUTE   (United States)

^f UNIVERSITY OF CINCINNATI COLLEGE OF MEDICINE   (United States)

^g Roth Cognitive Engineering   (United States)

^h VA GREATER LOS ANGELES HEALTHCARE SYSTEM   (United States)

ⁱ UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AMBULATORY CARE NURSING; ARTICLE; CONTROLLED STUDY; EVIDENCE BASED MEDICINE; EXPERIMENTAL STUDY; FRUSTRATION; HEALTH SURVEY; HUMAN; HUMAN EXPERIMENT; NURSE; NURSING KNOWLEDGE; OUTPATIENT DEPARTMENT; PRACTICE GUIDELINE; PRODUCTIVITY; REMINDER SYSTEM; SEMI STRUCTURED INTERVIEW; SIMULATION; WORKLOAD;

ATTITUDE TO COMPUTERS; EFFICIENCY; HOSPITAL INFORMATION SYSTEMS; HOSPITALS, VETERANS; HUMANS; LEARNING; NURSING INFORMATICS; NURSING STAFF; OHIO; OUTPATIENT CLINICS, HOSPITAL; REMINDER SYSTEMS; SOFTWARE; USER-COMPUTER INTERFACE; WORKLOAD;

EID: 34548509914     PISSN: 10675027     EISSN: None     Source Type: Journal    
DOI: 10.1197/jamia.M2163     Document Type: Article

References (44)

1. Asch S.M., Fremont A.M., Turner B.J., et al. Symptom-based framework for assessing quality of HIV care. Int J Qual Health Care 16 1 (2004) 41-50
2. McGlynn E.A., Asch S.M., Adams J., et al. The quality of health care delivered to adults in the United States. N Engl J Med 348 26 (2003) 2635-2645
3. Wennberg J.E. Practice variations and health care reform: connecting the dots. Health Aff (Millwood) Suppl Web Exclusives (2004) VAR140-VAR144
4. McDonald C.J. Protocol-based computer reminders, the quality of care and the non-perfectability of man. N Engl J Med 295 24 (1976) 1351-1355
5. Hunt D.L., Haynes R.B., Hanna S.E., and Smith K. Effects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic review. JAMA 280 15 (1998) 1339-1346
6. Agrawal A., and Mayo-Smith M.F. Adherence to computerized clinical reminders in a large healthcare delivery network. Medinfo 11 Pt 1 (2004) 111-114
7. Demakis J.G., Beauchamp C., Cull W.L., et al. Improving residents' compliance with standards of ambulatory care: results from the VA Cooperative Study on Computerized Reminders. JAMA 284 11 (2000) 1411-1416
8. Garg A.X., Adhikari N.K., McDonald H., et al. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA 293 10 (2005) 1223-1228
9. Sequist T.D., Gandhi T.K., Karson A.S., et al. A randomized trial of electronic clinical reminders to improve quality of care for diabetes and coronary artery disease. J Am Med Inform Assoc 12 4 (2005) 431-437
10. Shea S., DuMouchel W., and Bahamonde L. A meta-analysis of 16 randomized controlled trials to evaluate computer-based clinical reminder systems for preventive care in the ambulatory setting. J Am Med Inform Assoc 3 6 (1996) 399-409
11. Patterson E.S., Nguyen A.D., Halloran J.P., and Asch S.M. Human factors barriers to the effective use of ten HIV clinical reminders. J Am Med Inform Assoc 11 1 (2004) 50-59
12. Saleem J.J., Patterson E.S., Militello L., Render M.L., Orshansky G., and Asch S.M. Exploring barriers and facilitators to the use of computerized clinical reminders. J Am Med Inform Assoc 12 4 (2005) 438-447
13. Fung C.H., Woods J.N., Asch S.M., Glassman P., and Doebbeling B.N. Variation in implementation and use of computerized clinical reminders in an integrated healthcare system. Am J Manag Care 10 11 Pt 2 (2004) 878-885
14. Militello L., Patterson E.S., Tripp-Reimer T., et al. Clinical Reminders: Why Don't They Use Them? (2004) Proc Human Factors and Ergonomics Society's 48th Annual Meeting 1651-5.
15. Kushniruk A.W., and Patel V.L. Cognitive and usability engineering methods for the evaluation of clinical information systems. J Biomed Inform 37 1 (2004) 56-76
16. Horsky J., Kaufman D.R., Oppenheim M.I., and Patel V.L. A framework for analyzing the cognitive complexity of computer-assisted clinical ordering. J Biomed Inform 36 1-2 (2003) 4-22
17. Zhang J., Johnson T.R., Patel V.L., Paige D.L., and Kubose T. Using usability heuristics to evaluate patient safety of medical devices. J Biomed Inform 36 1-2 (2003) 23-30
18. Beuscart-Zephir M.C., Watbled L., Carpentier A.M., Degroisse M., and Alao O. A rapid usability assessment methodology to support the choice of clinical information systems: a case study. Proc AMIA Symp (2002) 46-50
19. Coble J.M., Karat J., Orland M.J., and Kahn M.G. Iterative usability testing: ensuring a usable clinical workstation. Proc AMIA Symp (1997) 744-748
20. Rodriguez N.J., Murillo V., Borges J.A., Ortiz J., and Sands D.Z. A usability study of physicians interaction with a paper-based patient record system and a graphical-based electronic patient record system. Proc AMIA Symp (2002) 667-671
21. Wachter S.B., Agutter J., Syroid N., Drews F., Weinger M.B., and Westenskow D. The employment of an iterative design process to develop a pulmonary graphical display. J Am Med Inform Assoc 10 4 (2003) 363-372
22. Patterson E.S., Doebbeling B.N., Fung C.H., Militello L., Anders S., and Asch S.M. Identifying barriers to the effective use of clinical reminders: bootstrapping multiple methods. J Biomed Inform 38 3 (2005) 189-199
23. Nielson J. Enhancing the explanatory power of visibility heuristics (1994) CHI '94 Proceedings;152-8.
24. Hart S., and Staveland L. Development of the NASA-TLX (Task Load Index): Results of empirical and theoretical research. In: Hancock P.A., and Meshkati N. (Eds). Human Mental Workload (1988), Elsevier Science Publishers, North-Holland 139-183
25. NASA Task Load Index (TLX) for Windows. Available at: http://www.nrl.navy.mil/aic/ide/NASATLX.php. Accessed on: December 15, 2004.
26. Lewis J.R. IBM Computer Usability Satisfaction Questionnaires: Psychometric evaluation and instructions for use. [Report] (1993), IBM Corporation, Human Factors Group, Boca Raton, FL 54.786.
27. Lewis J.R. IBM Computer Usability Satisfaction Questionnaires: Psychometric evaluation and instructions for use. Int J Human-Comp Inter 7 1 (1995) 57-78
28. Averty P., Collet C., Dittmar A., Athenes S., and Vernet-Maury E. Mental workload in air traffic control: an index constructed from field tests. Aviat Space Environ Med 75 4 (2004) 333-341
29. Park J., and Jung W. A study on the validity of task complexity measure of emergency operating procedures of nuclear power plants-Comparing with a subjective workload. IEEE Trans Nucl Sci 53 5 (2006) 2962-2970
30. Hakan A., and Nilsson L. The effects of a mobile telephone task on driver behaviour in a car following situation. Acc Anal Prev 27 5 (1995) 707-715
31. Wachter S.B., Johnson K., Albert R., Syroid N., Drews F., and Westenskow D. The evaluation of a pulmonary display to detect adverse respiratory events using high resolution human simulator. J Am Med Inform Assoc 13 6 (2006) 635-642
32. Temple J.G., Warm J.S., Dember W.N., Jones K.S., LaGrange C.M., and Matthews G. The effects of signal salience and caffeine on performance, workload, and stress in an abbreviated vigilance task. Hum Factors 42 2 (2000) 183-194
33. Hendy K.C., Hamilton K.M., and Landry L.N. Measuring subjective workload: When is one scale better than many?. Hum Factors 35 4 (1993) 579-601
34. Nygren T.E. Psychometric properties of subjective workload measurement techniques: Implications for their use in the assessment of perceived mental workload. Hum Factors 33 1 (1991) 17-33
35. Egan D.E. Individual differences in human-computer interaction. In: Helander M. (Ed). Handbook of Human-Computer Interaction (1988), Elsevier Science Publishers, North-Holland 543-568
36. Kaplan B. Evaluating informatics applications-clinical decision support systems literature review. Int J Med Inform 64 1 (2001) 15-37
37. Doebbeling B.N., Chou A.F., and Tierney W.M. Priorities and strategies for the implementation of integrated informatics and communications technology to improve evidence-based practice. J Gen Intern Med 21 Suppl (2006) S50-S57 2
38. Sittig D.F., Krall M.A., Dykstra R.H., Russell A., and Chin H.L. A survey of factors affecting clinician acceptance of clinical decision support. BMC Med Inform Decis Mak 6 (2006) 6
39. Hollnagel E., and Woods D.D. Cognitive systems engineering: New wine in new bottles. Int J Human-Comp Stud 51 (1999) 339-356
40. Patterson E.S., Bozzette S.A., Nguyen A.D., Gomes J.O., and Asch S.M. Comparing findings from cognitive engineering evaluations. Proc Hum Factors Ergonom Soc 47th Annu Meeting (2003) 483-487
41. Roth E.M., Patterson E.S., and Mumaw R.J. Cognitive engineering: Issues in user-centered system design. In: Marciniak J.J. (Ed). Encyclopedia of Software Engineering. 2nd ed. (2002), Wiley-Interscience, John Wiley & Sons, New York 163-179
42. Landauer T.K. Let's get real: A positional paper on the role of cognitive psychology in the design of humanly useful and usable systems. In: Baecker R.M., Grudin J., Buxton W.A.S., and Greenberg S. (Eds). Readings in Human-Computer Interaction: Toward the Year 2000 (1995), Morgan Kaufmann Publishers, Inc, San Francisco 659-665
43. Barnard P. The contributions of applied cognitive psychology to the study of human-computer interaction. In: Baecker R.M., Grudin J., Buxton W.A.S., and Greenberg S. (Eds). Readings in Human-Computer Interaction: Toward the Year 2000 (1995), Morgan Kaufmann Publishers, Inc, San Francisco 640-658
44. Shneiderman B., and Plaisant C. Designing the user interface: Strategies for effective human-computer interaction. 4th ed. (2004), Pearson/Addison-Wesley, Boston, MA