How do clinical information systems affect the cognitive demands of general practitioners? Usability study with a focus on cognitive workload

Journal of Innovation in Health Informatics

Volumn 22, Issue 4, 2015, Pages 379-390

  Ariza, Ferran ^a,b   Kalra, Dipak ^b,c   Potts, Henry W W ^b  

^a Independent General Practitioner   (United Kingdom)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

^c EuroRec Institute   (Belgium)

Author keywords

Cognitive science; Computerized medical record systems; General practice; Human engineering; Medical informatics; Primary health care; User computer interface

Indexed keywords

COGNITION; COMPUTER INTERFACE; ELECTRONIC MEDICAL RECORD SYSTEM; ENGLAND; GENERAL PRACTITIONER; HUMAN; INTERNET; NATIONAL HEALTH SERVICE; PSYCHOLOGY; QUESTIONNAIRE; WORKLOAD;

COGNITION; ENGLAND; GENERAL PRACTITIONERS; HUMANS; INTERNET; MEDICAL RECORDS SYSTEMS, COMPUTERIZED; STATE MEDICINE; SURVEYS AND QUESTIONNAIRES; USER-COMPUTER INTERFACE; WORKLOAD;

EID: 84994078615     PISSN: 20584555     EISSN: 20584563     Source Type: Journal    
DOI: 10.14236/jhi.v22i4.85     Document Type: Article

References (60)

1. Goetz Goldberg D, Kuzel AJ, Feng LB, DeShazo JP and Love LE. EHRs in primary care practices: Benefits, challenges, and successful strategies. American Journal of Managed Care 2012; 18(2): E48-54. PMid: 22435884.
2. Schade CP, Sullivan FM, de Lusignan S and Madeley J. e-Prescribing, efficiency, quality: Lessons from the computerization of UK family practice. Journal of the American Medical Informatics Association 2006; 13(5): 470-5. http://dx.doi.org/10.1197/jamia. M2041. PMid: 16799129; PMCid: PMC1561797.
3. HIMSS EHR Usability Task Force. Defining and testing EMR usability: Principles and proposed methods of EMR usability evaluation and rating. Healthcare Information and Management Systems Society, 2009.
4. Horsky J, Zhang J and Patel VL. To err is not entirely human: Complex technology and user cognition. Journal of Biomedical Informatics 2005; 38(4): 264-6. http://dx.doi.org/10.1016/j.jbi.2005.05.002. PMid: 15967732.
5. Peute LWP, De Keizer NF, Van Der Zwan EPA and Jaspers MWM. Reducing clinicians' cognitive workload by system redesign; a pre-post think aloud usability study. Studies in Health Technology and Informatics 2011; 169: 925-9. PMid: 21893881.
6. Jha AK, Doolan D, Grandt D, Scott T and Bates DW. The use of health information technology in seven nations. International Journal of Medical Informatics 2008; 77(12): 848-54. http://dx.doi.org/10.1016/j.ijmedinf.2008.06.007. PMid: 18657471.
7. Shachak A, Hadas-Dayagi M, Ziv A and Reis S. Primary care physicians' use of an electronic medical record system: A cognitive task analysis. Journal of General Internal Medicine 2009; 24(3): 341-8. http://dx.doi.org/10.1007/s11606-008-0892-6. PMid: 19130148; PMCid: PMC2642564.
8. Microsoft Health Common User Interface [Internet], 2010. Available from: Http://www.mscui.net/Default.aspx.
9. Patel VL and Kushniruk AW. Interface design for health care environments: The role of cognitive science. Proceedings of the AMIA Symposium 1998; 29-37. PMid: 9929179; PMCid: PMC2232103.
10. Alexander G and Staggers N. A Systematic review on the designs of clinical technology: Findings and recommendations for future research. ANS. Advances in Nursing Science 2009; 32(3): 252-79. http://dx.doi.org/10.1097/ANS.0b013e3181b0d737. PMid: 19707093; PMCid: PMC3018768.
11. Sittig DF, Kuperman GJ and Fiskio J. Evaluating physician satisfaction regarding user interactions with an electronic medical record system. Proceedings of the AMIA Symposium 1999; 400-4. PMid: 10566389; PMCid: PMC2232602.
12. Nielsen J. Usability 101: Introduction to Usability [Internet]. Nielsen Norman Group, 2012. Available from: Http://www. nngroup.com/articles/usability-101-introduction-to-usability/.
13. Levinson W, Lesser CS and Epstein RM. Developing physician communication skills for patient-centered care. Health Affairs (Millwood) 2010; 29(7): 1310-18. http://dx.doi.org/10.1377/hlthaff.2009.0450. PMid: 20606179.
14. Pelaccia T, Tardif J, Triby E and Charlin B. An analysis of clinical reasoning through a recent and comprehensive approach: The dual-process theory. Medical Education Online 2011 [cited 2013 Jul 11]; 16. Available from: Http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3060310/.
15. O'Riordan M, Dahinden A, Aktürk Z, Ortiz JMB, Dagdeviren N, Elwyn G et al. Dealing with uncertainty in general practice: An essential skill for the general practitioner. Quality in Primary Care 2011; 19(3): 175-81. PMid: 21781433.
16. Starfield B. Primary care. The Journal of Ambulatory Care Management 1993; 16(4): 27-37. http://dx.doi.org/10.1097/00004479-199310000-00006. PMid: 10128415.
17. Smith PC, Araya-Guerra R, Bublitz C, Parnes B, Dickinson LM, Van Vorst R et al. Missing clinical information during primary care visits. Journal of the American Medical Association 2005; 293(5): 565-71. http://dx.doi.org/10.1001/jama.293.5.565. PMid: 15687311.
18. Beasley JW, Wetterneck TB, Temte J, Lapin JA, Smith P, Rivera- Rodriguez AJ et al. Information chaos in primary care: Implications for physician performance and patient safety. The Journal of the American Board of Family Medicine 2011; 24(6): 745-51. http://dx.doi.org/10.3122/jabfm.2011.06.100255. PMid: 22086819; PMCid: PMC3286113.
19. Byrne AJ, Oliver M, Bodger O, Barnett WA, Williams D, Jones H et al. Novel method of measuring the mental workload of anaesthetists during clinical practice. British Journal of Anaesthesia 2010; 105(6): 767-71. http://dx.doi.org/10.1093/bja/aeq240. PMid: 20846966.
20. Kirsh D. A few thoughts on cognitive overload. Intellectica 2000; 30: 19-51.
21. Clarke MA, Steege LM, Moore JL, Belden JL, Koopman RJ and Kim MS. Addressing Human Computer Interaction Issues of Electronic Health Record in Clinical Encounters. Marcus A (Ed). Design, user experience, and usability health, learning, playing, cultural, and cross-cultural user experience [Internet]. Heidelberg: Springer, 2013 [cited 2013 Jul 10], pp. 381-90. Available from: Http://link.springer.com/chapter/10.1007/978-3-642-39241-2-42. http://dx.doi.org/10.1007/978-3-642-39241-2-42. PMid: 23444324.
22. Ahmed A, Chandra S, Herasevich V, Gajic O and Pickering BW. The effect of two different electronic health record user interfaces on intensive care provider task load, errors of cognition, and performance. Critical Care Medicine 2011; 39(7): 1626-34. http://dx.doi.org/10.1097/CCM.0b013e31821858a0. PMid: 21478739.
23. Longo L and Kane B. A novel methodology for evaluating user interfaces in health care. 24th International Symposium on Computer-Based Medical Systems (CBMS), 2011, pp. 1-6.
24. Bouamrane MM and Mair FS. A study of general practitioners' perspectives on electronic medical records systems in NHSScotland. BMC Medical Informatics and Decision Making 2013; 13(1): 58. http://dx.doi.org/10.1186/1472-6947-13-58. PMid: 23688255; PMCid: PMC3704757.
25. Viitanen J, Hyppönen H, Lääveri T, Vänskä J, Reponen J and Winblad I. National questionnaire study on clinical ICT systems proofs: Physicians suffer from poor usability. International Journal of Medical Informatics 2011; 80(10): 708-25. http://dx.doi.org/10.1016/j.ijmedinf.2011.06.010. PMid: 21784701.
26. Viitanen J, Kuusisto A and Nykänen P. Usability of electronic nursing record systems: Definition and results from an evaluation study in Finland. Studies in Health Technology and Informatics 2011; 164: 333-8. PMid: 21335733.
27. Militello L, Patterson ES, Tripp-Reimer T, Asch SM, Fung CH, Glassman P et al. Clinical reminders: Why don't they use them? Proceedings of the Human Factors and Ergonomics Society Annual Meeting 2004; 48(15): 1651-5. http://dx.doi.org/10.1177/154193120404801505.
28. Garrard CS. Human-computer interactions: Can computers improve the way doctors work? Schweizerische medizinische Wochenschrift 2000; 130(42): 1557-63. PMid: 11092058.
29. Saitwal H, Feng X, Walji M, Patel V and Zhang J. Assessing performance of an Electronic Health Record (EHR) using cognitive task analysis. International Journal of Medical Informatics 2010; 79(7): 501-6. http://dx.doi.org/10.1016/j.ijmedinf.2010.04.001. PMid: 20452274.
30. Zhang J. Human-centered computing in health information systems. Part 1: Analysis and design. Journal of Biomedical Informatics 2005; 38(1): 1-3. http://dx.doi.org/10.1016/j.jbi.2004.12.002. PMid: 15694880.
31. Khajouei R, de Jongh D and Jaspers MWM. Usability evaluation of a computerized physician order entry for medication ordering. Studies in Health Technology and Informatics 2009; 150: 532-6. PMid: 19745368.
32. Koppel R, Metlay JP, Cohen A, Abaluck B, Localio AR, Kimmel SE et al. Role of Computerized Physician Order Entry Systems in Facilitating Medication Errors. Journal of the American Medical Association 2005; 293(10): 1197-203. http://dx.doi.org/10.1001/jama.293.10.1197. PMid: 15755942.
33. Middleton B, Bloomrosen M, Dente MA, Hashmat B, Koppel R, Overhage JM et al. Enhancing patient safety and quality of care by improving the usability of electronic health record systems: Recommendations from AMIA. Journal of the American Medical Association 2013; 20(e1): E2-8. http://dx.doi.org/10.1136/amiajnl- 2012-001458. PMid: 23355463; PMCid: PMC3715367.
34. Cousins DH and Baker M. The work of the National Patient Safety Agency to improve medication safety. British Journal of General Practice 2004; 54(502): 331-3. PMid: 15113513; PMCid: PMC1266164.
35. Protti D. Lessons to be learned from England about the potential of GP computer systems to improve patient safety. Healthcare Quarterly2004; 7(3): 76-80. PMid: 15230172.
36. Johnson C, Johnson D and Crowly P. EHR Usability Toolkit: A background report on usability and electronic health records (prepared by Westat under Contract No. HHSA 290-2009- 00023I). Rockville, Maryland: Agency for Healthcare Research and Quality, 2011. Report No.: 11-0084-EF.
37. Rubio S, Díaz E, Martín J and Puente JM. Evaluation of subjective mental workload: A comparison of SWAT, NASA-TLX, and workload profile methods. Applied Psychology 2004; 53(1): 61-86. http://dx.doi.org/10.1111/j.1464-0597.2004.00161.x.
38. Hart SG. Nasa-Task Load Index (NASA-TLX); 20 years later. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 2006; 50(9): 904-8. http://dx.doi.org/10.1177/154193120605000909.
39. Hoonakker P, Carayon P, Gurses AP, Brown R, Khunlertkit A, McGuire K et al. Measuring workload of ICU nurses with a questionnaire survey: The NASA Task Load Index (TLX). IIE Transactions on Healthcare Systems Engineering 2011; 1(2): 131-43. http://dx.doi.org/10.1080/19488300.2011.609524. PMid: 22773941 PMCid: PMC3388621.
40. Carswell CM, Lio CH, Grant R, Klein MI, Clarke D, Seales WB et al. Hands-free administration of subjective workload scales: Acceptability in a surgical training environment. Applied Ergonomics 2010; 42(1): 138-45. http://dx.doi.org/10.1016/j.apergo.2010.06.003. PMid: 20630495.
41. Zheng B, Jiang X, Tien G, Meneghetti A, Panton ONM and Atkins MS. Workload assessment of surgeons: Correlation between NASA TLX and blinks. Surgical Endoscopy 2012; 26(10): 2746-50. http://dx.doi.org/10.1007/s00464-012- 2268-6. PMid: 22527300.
42. France DJ, Levin S, Hemphill R, Chen K, Rickard D, Makowski R et al. Emergency physicians' behaviors and workload in the presence of an electronic whiteboard. International Journal of Medical Informatics 2005; 74(10): 827-37. http://dx.doi.org/10.1016/j.ijmedinf.2005.03.015. PMid: 16043391.
43. Hart SG and Staveland LE. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research [Internet], 1988 [cited 2013 Jul 25]. Available from: Http://archive.org/details/nasa-techdoc-20000004342.
44. National Aeronautics and Space Administration. NASA TLX: Task Load Index [Internet]. NASA TLX: Task Load Index, no date. Available from: Http://humansystems.arc.nasa.gov/groups/TLX/index.html.
45. Laerum H and Faxvaag A. Task-oriented evaluation of electronic medical records systems: Development and validation of a questionnaire for physicians. BMC Medical Informatics and Decision Making 2004; 4: 1. http://dx.doi.org/10.1186/1472-6947-4-1, http://dx.doi.org/10.1186/1472-6947-4-18.
46. ISD Scotland. Practice Team Information Annual Update (2009/10) [Internet]. ISD Scotland, 2011. Available from: Http://www.isdscotland.scot.nhs.uk/Health-Topics/General-Practice/Publications/2011-02-22/2011-02-22-PTI-report.pdf?.
47. The Health and Social Care Information Centre - Workforce Directorate. General and Personal Medical Services, England, 2001 - 2011, as at 30 September [Internet]. The Health and Social Care Information Centre, 2012 [cited 2012 Dec 15]. Available from: Https://catalogue.ic.nhs.uk/publications/workforce/numbers/nhs-staf-2001-2011-gene-prac/nhs-staf-2001- 2011-gene-prac-rep.pdf.
48. Davis E. English GP Systems Market [Internet]. Woodcode Consulting, 2011 [cited 2012 Dec 7]. Available from: Http://www. woodcote-consulting.com/?p=29.
49. Todd R. CSC to withdraw from primary care. EHI eHealth Insider [Internet]. UK; 2012 Sep 17. Available from: Http://ehi. co.uk/news/ehi/8063/csc-to-withdraw-from-primary-care.
50. SystmOne. TPP to become second biggest GP supplier [Internet]. TTP SystmOne Latests News Stories, 2011 [cited 2012 Dec 7]. Available from: Http://www.tpp-uk.com/latest-newsstories/tpp-to-become-second-biggest-gp-supplier/.
51. Anders S, Albert R, Miller A, Weinger MB, Doig AK, Behrens M et al. Evaluation of an integrated graphical display to promote acute change detection in ICU patients. International Journal of Medical Informatics 2012; 81(12): 842-51. http://dx.doi.org/10.1016/j.ijmedinf.2012.04.004. PMid: 22534099; PMCid: PMC3414670.
52. Avery A, Barber N, Maisoon G, Franklin BD, Armstrong S and Crowe S. Investigating the prevalence and causes of prescribing errors in general practice: The PRACtICe study [Internet]. GMC, 2012 May [cited 2013 Jul 21]. Available from: Http://www. gmc-uk.org/about/research/12996.asp.
53. Haworth LA, Bivens CC and Shively RJ. An investigation of single-piloted advanced cockpit and control configurations for Nap-of-the-Earth Helicopter Combat Mission Tasks. Proceedings of the 1986 Meeting of the American Helicopter Society (Washington, District of Columbia), 1986, pp. 672-5.
54. Colligan L, Potts HWW, Finn CT and Sinkin RA. Cognitive workload changes for nurses transitioning from a legacy system with paper documentation to a commercial electronic health record. International Journal of Medical Informatics 2015; 84(7): 469-76. http://dx.doi.org/10.1016/j.ijmedinf.2015.03.003. PMid: 25868807.
55. Kumarapeli P and de Lusignan S. Using the computer in the clinical consultation; setting the stage, reviewing, recording, and taking actions: Multi-channel video study. Journal of the American Medical Informatics Association [Internet] 2012 [cited 2013 Jan 17]. Available from: Http://jamia.bmj.com/content/early/2012/12/14/amiajnl-2012-001081.
56. De Lusignan S, Pearce C, Kumarapeli P, Stavropoulou C, Kushniruk A, Sheikh A et al. Reporting observational studies of the use of information technology in the clinical consultation. A position statement from the IMIA Primary Health Care Informatics Working Group (IMIA PCI WG). Yearbook of Medical Informatics 2011; 6(1): 39-47. PMid: 21938323.
57. Moroney WF, Biers DW and Eggemeier FT. Some measurement and methodological considerations in the application of subjective workload measurement techniques. The International Journal of Aviation Psychology 1995; 5(1): 87-106. http://dx.doi.org/10.1207/s15327108ijap0501-6.
58. Bethlehem J. Selection bias in web surveys. International Statistical Review 2010; 78(2): 161-88. http://dx.doi.org/10.1111/j.1751-5823.2010.00112.x.
59. VanGeest JB, Johnson TP and Welch VL. Methodologies for improving response rates in surveys of physicians: A systematic review. Evaluation and the Health Professions 2007; 30(4): 303-21. http://dx.doi.org/10.1177/0163278707307899. PMid: 17986667.
60. Nicholls K, Chapman K, Shaw T, Perkins A, Sullivan MM, Crutchfield S et al. Enhancing response rates in physician surveys: The limited utility of electronic options. Health Services Research 2011; 46(5): 1675-82. http://dx.doi.org/10.1111/j.1475- 6773.2011.01261.x. PMid: 21492157; PMCid: PMC3207199.