Assessing the patient safety competencies of healthcare professionals: A systematic review

BMJ Quality and Safety

Volumn 20, Issue 11, 2011, Pages 991-1000

  Okuyama, Ayako ^a,b   Martowirono, Kartinie ^a   Bijnen, Bart ^a,c  

^a Location Alkmaar   (Netherlands)

^b OSAKA UNIVERSITY   (Japan)

^c VU UNIVERSITY MEDICAL CENTER   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

COMPETENCE; CONTENT VALIDITY; FEEDBACK SYSTEM; HEALTH CARE PERSONNEL; HUMAN; INTERPERSONAL COMMUNICATION; MEDICAL LITERATURE; MEDICAL PROFESSION; NURSING; PATIENT SAFETY; PREDICTIVE VALIDITY; REVIEW; RISK MANAGEMENT; SYSTEMATIC REVIEW;

CLINICAL COMPETENCE; HEALTH PERSONNEL; HUMANS; MEDICAL ERRORS; SAFETY MANAGEMENT;

EID: 80054915295     PISSN: 20445415     EISSN: None     Source Type: Journal    
DOI: 10.1136/bmjqs-2011-000148     Document Type: Review

References (79)

1. Flanagan B, Nestel D, Joseph M. Making patient safety the focus: crisis resource management in the undergraduate curriculum. Med Educ 2004;38:56-66. (Pubitemid 38142157)
2. Mayer D, Klamen DL, Gunderson A, et al. Designing a patient safety undergraduate medical curriculum: the Telluride Interdisciplinary Roundtable experience. Teach Learn Med 2009;21:52-8.
3. Wakefield A, Attree M, Braidman I, et al. Patient safety: do nursing and medical curricula address this theme? Nurse Educ Today 2005;25:333-40. (Pubitemid 40668408)
4. Smith EL, Cronenwett L, Sherwood G. Current assessments of quality and safety education in nursing. Nurs Outlook 2007;55:132-7.
5. Kohn LT, Corrigan J, Donaldson MS, eds. To err is human: building a safer health system. 1st edn. Washington, DC: National Academy Press, 2000.
6. Institute of Medicine (US). Health professions education: a bridge to quality. http://books.nap.edu/openbook.php?record-id=10681 (accessed 19 Apr 2011).
7. Canadian Patient Safety Institute (Canada). The safety competencies: enhancing patient safety across the health professions. http://www. patientsafetyinstitute.ca/English/toolsResources/safetyCompetencies/Pages/ default.aspx (accessed 22 Aug 2011).
8. Walton MM, Shaw T, Barnet S, et al. Developing a national patient safety education framework for Australia. Qual Saf Health Care 2006;15:437-42. (Pubitemid 46025157)
9. WHO. The WHO patient safety curriculum guide for medical schools. http://www.who.int/patientsafety/education/curriculum/download/en/index.html (accessed 19 Apr 2011).
10. Carraccio C, Wolfsthal SD, Englander R, et al. Shifting paradigms: from Flexner to competencies. Acad Med 2002;77:361-7. (Pubitemid 34526146)
11. Shumway JM, Harden RM; Association for Medical Education in Europe. AMEE Guide No. 25: the assessment of learning outcomes for the competent and reflective physician. Med Teach 2003;25:569-84. (Pubitemid 38072787)
12. Crossley J, Humphris G, Jolly B. Assessing health professionals. Med Educ 2002;36:800-4. (Pubitemid 35177216)
13. Epstein RM, Hundert EM. Defining and assessing professional competence. JAMA 2002;287:226-35. (Pubitemid 34251949)
14. Kogan JR, Holmboe ES, Hauer KE. Tools for direct observation and assessment of clinical skills of medical trainees. A systematic review. JAMA 2009;302:1316-26.
15. Klass D. Reevaluation of clinical competency. Am J Phys Med Rehabil 2000;79:481-6.
16. Miller GE. The assessment of clinical skills/competence/performance. Acad Med 1990;65(9 Suppl):S63-7. (Pubitemid 20333148)
17. Best Evidence Medical Education Collaboration. Best evidence in medical education. http://www2.warwick.ac.uk/fac/med/beme (accessed 19 Apr 2011).
18. Messick S. Validity of psychological assessment: validation of inferences from persons' responses and performances as scientific inquiry into score meaning. Am Psychol 1995;50:741-9.
19. Cook DA, Beckman TJ. Current concepts in validity and reliability for psychometric instruments: theory and application. Am J Med 2006;119:166.
20. Downing SM. Validity: on the meaningful interpretation of assessment data. Med Educ 2003;37:830-7. (Pubitemid 37083007)
21. Kirkpatrick D. Evaluation of training. In: Craig R, Mittel I, eds. Training and development handbook. New York, NY: McGraw-Hill, 1967: 87-112.
22. Epstein RM. Assessment in medical education. N Engl J Med 2007;356:387-96. (Pubitemid 46148781)
23. Madigosky WS, Headrick LA, Nelson K, et al. Changing and sustaining medical students' knowledge, skills, and attitudes about patient safety and medical fallibility. Acad Med 2006;81:94-101. (Pubitemid 44366100)
24. Hall LW, Scott SD, Cox KR, et al. Effectiveness of patient safety training in equipping medical students to recognise safety hazards and propose robust interventions. Qual Saf Health Care 2010;19:3-8.
25. Kerfoot BP, Conlin PR, Travison T, et al. Web-based education in systems-based practice: a randomized trial. Arch Intern Med 2007;167:361-6. (Pubitemid 46333936)
26. Kerfoot BP, Conlin PR, Travison T, et al. Patient safety knowledge and its determinants in medical trainees. J Gen Intern Med 2007;22:1150-4. (Pubitemid 47038058)
27. Wallace LM, Spurgeon P, Adams S, et al. Survey evaluation of the National Patient Safety Agency's Root Cause Analysis training programme in England and Wales: knowledge, beliefs and reported practices. Qual Saf Health Care 2009;18:288-91.
28. Harik P, Cuddy MM, O'Donovan S, et al. Assessing potentially dangerous medical actions with the computer-based case simulation portion of the USMLE step 3 examination. Acad Med 2009;84(10 Suppl):S79-82.
29. Floreck LM, Guernsey MJ, Clyman SG, et al. Examinee performance on computer-based case simulations as part of the USMLE step 3 examination: are examinees ordering dangerous actions? Acad Med 2002;77(10 Suppl):S77-9. (Pubitemid 35155210)
30. Klamen DL, Reynolds KL, Yale B, et al. Students learning handovers in a simulated in-patient unit. Med Educ 2009;43:1097-8.
31. Varkey P, Natt N, Lesnick T, et al. Validity evidence for an OSCE to assess competency in systems-based practice and practice-based learning and improvement: a preliminary investigation. Acad Med 2008;83:775-80.
32. Gupta P, Varkey P. Developing a tool for assessing competency in root cause analysis. Jt Comm J Qual Patient Saf 2009;35:36-42.
33. Singh R, Singh A, Fish R, et al. A patient safety objective structured clinical examination. J Patient Saf 2009;5:55-60.
34. Wagner DP, Hoppe RB, Lee CP. The patient safety OSCE for PGY-1 residents: a centralized response to the challenge of culture change. Teach Learn Med 2009;21:8-14.
35. Zausig YA, Grube C, Boeker-Blum T, et al. Inefficacy of simulator-based training on anaesthesiologists' non-technical skills. Acta Anaesthesiol Scand 2009;53:611-19.
36. Savoldelli GL, Naik VN, Park J, et al. Value of debriefing during simulated crisis management: oral versus video-assisted oral feedback. Anesthesiology 2006;105:279-85. (Pubitemid 44148172)
37. Yee B, Naik VN, Joo HS, et al. Nontechnical skills in anesthesia crisis management with repeated exposure to simulation-based education. Anesthesiology 2005;103:241-8. (Pubitemid 41076720)
38. Welke TM, LeBlanc VR, Savoldelli GL, et al. Personalized oral debriefing versus standardized multimedia instruction after patient crisis simulation. Anesth Analg 2009;109:183-9.
39. Müller MP, Hänsel M, Fichtner A, et al. Excellence in performance and stress reduction during two different full scale simulator training courses: a pilot study. Resuscitation 2009;80:919-24.
40. Fletcher G, Flin R, McGeorge P, et al. Anaesthetists' Non-Technical Skills (ANTS): evaluation of a behavioural marker system. Br J Anaesth 2003;90:580-8. (Pubitemid 36592330)
41. Bruppacher HR, Alam SK, LeBlanc VR, et al. Simulation-based training improves physicians' performance in patient care in high-stakes clinical setting of cardiac surgery. Anesthesiology 2010;112:985-92.
42. Weller JM, Jolly B, Robinson B. Generalizability of behavioral skills in simulated anesthetic emergencies. Anaesth Intensive Care 2008;36:185-9. (Pubitemid 351449823)
43. Gale TC, Roberts MJ, Sice PJ, et al. Predictive validity of a selection centre testing non-technical skills for recruitment to training in anaesthesia. Br J Anaesth 2010;105:603-9.
44. Yule S, Flin R, Paterson-Brown S, et al. Development of a rating system for surgeons' non-technical skills. Med Educ 2006;40:1098-104. (Pubitemid 44600570)
45. Black SA, Nestel DF, Kneebone RL, et al. Assessment of surgical competence at carotid endarterectomy under local anesthesia in a simulated operating theatre. Br J Surg 2010;97:511-16.
46. Moorthy K, Munz Y, Forrest D, et al. Surgical crisis management skills training and assessment: a stimulation-based approach to enhancing operating room performance. Ann Surg 2006;244:139-47. (Pubitemid 44297458)
47. Moorthy K, Munz Y, Adams S, et al. A human factors analysis of technical and team skills among surgical trainees during procedural simulations in a simulated operating theatre. Ann Surg 2005;242:631-9. (Pubitemid 41567116)
48. Undre S, Koutantji M, Sevdalis N, et al. Multidisciplinary crisis simulations: the way forward for training surgical teams. World J Surg 2007;31:1843-53. (Pubitemid 47283191)
49. Powers KA, Rehrig ST, Irias N, et al. Simulated laparoscopic operating room crisis: an approach to enhance the surgical team performance. Surg Endosc 2008;22:885-900.
50. Papaspyros SC, Javangula KC, O'Regan DJ. Surgical training in the 48-h week: a novel simulation and educational tool. From amateur golfer to professional pilot. Eur J Cardiothorac Surg 2009;36:511-15.
51. Wetzel CM, Black SA, Hanna GB, et al. The effects of stress and coping on surgical performance during simulations. Ann Surg 2010;251:171-6.
52. Wallin CJ, Meurling L, Hedman L, et al. Target-focused medical emergency team training using a human patient simulator: effects on behaviour and attitude. Med Educ 2007;41:173-80. (Pubitemid 46213697)
53. Knudson MM, Khaw L, Bullard MK, et al. Trauma training in simulation: translating skills from SIM time to real time. J Trauma 2008;64:255-63. (Pubitemid 351640421)
54. Williams JB, McDonough MA, Hilliard MW, et al. Intermethod reliability of real-time versus delayed videotaped evaluation of a high-fidelity medical simulation septic shock scenario. Acad Emerg Med 2009;16:887-93.
55. Wright MC, Phillips-Bute BG, Petrusa ER, et al. Assessing teamwork in medical education and practice: relating behavioural teamwork ratings and clinical performance. Med Teach 2009;31:30-8.
56. Westli HK, Johnsen BH, Eid J, et al. Teamwork skills, shared mental models, and performance in simulated trauma teams: an independent group design. Scand J Trauma Resusc Emerg Med 2010;18:47.
57. Kim J, Neilipovitz D, Cardinal P, et al. A comparison of global rating scale and checklist scores in the validation of an evaluation tool to assess performance in the resuscitation of critically ill patients during simulated emergencies (abbreviated as 'CRM simulator study IB'). Simul Healthc 2009;4:6-16.
58. Kim J, Neilipovitz D, Cardinal P, et al. A pilot study using high-fidelity simulation to formally evaluate performance in the resuscitation of critically ill patients: the University of Ottawa Critical Care Medicine, High-Fidelity Simulation, and Crisis Resource Management I Study. Crit Care Med 2006;34:2167-74. (Pubitemid 44305621)
59. Thomas EJ, Taggart B, Crandell S, et al. Teaching teamwork during the Neonatal Resuscitation Program: a randomized trial. J Perinatol 2007;27:409-14. (Pubitemid 47028921)
60. Walker S, Lambden S, Mckay A, et al. Development, reliability, and content validation of the observational skill-based clinical assessment for resuscitation (OSCAR). 23rd Annual Meeting of the European Society of Intensive Care Medicine; 9-13 October 2010, Springer, 2010;36:S328.
61. Haller G, Garnerin P, Morales MA, et al. Effect of crew resource management training in a multidisciplinary obstetrical setting. Int J Qual Health Care 2008;20:254-63. (Pubitemid 352024908)
62. Dycus P, McKeon L. Using QSEN to measure quality and safety knowledge, skills, and attitudes of experienced paediatric oncology nurses: an international study. Qual Manag Health Care 2009;18:202-8.
63. Schnall R, Stone P, Currie L, et al. Development of a self-report instrument to measure patient safety attitudes, skills, and knowledge. J Nurs Scholarsh 2008;40:391-4.
64. Murray ME, Douglas S, Girdley D, et al. Teaching quality improvement. J Nurs Educ 2010;49:466-9.
65. Cooper S, Kinsman L, Buykx P, et al. Managing the deteriorating patient in a simulated environment: nursing students' knowledge, skill and situation awareness. J Clin Nurs 2010;19:2309-18.
66. Radhakrishnan K, Roche JP, Cunningham H. Measuring clinical practice parameters with human patient simulation: a pilot study. Int J Nurs Educ Scholarsh 2007;4:Article8.
67. Ironside PM, Jeffries PR, Martin A. Fostering patient safety competencies using multiple-patient simulation experiences. Nurs Outlook 2009;57:332-7.
68. McKeon LM, Norris T, Cardell B, et al. Developing patient-centered care competencies among prelicensure nursing students using simulation. J Nurs Educ 2009;48:711-15.
69. Walsh T, Jairath N, Paterson MA, et al. Quality and safety education for nurses clinical evaluation tool. J Nurs Educ 2010;49:517-22.
70. Fisher M, Parolin M. The reliability of measuring nursing clinical performance using a competency based assessment tool: a pilot study. Collegian 2000;7:21-7.
71. Patey RE, Fletcher G, Flin R, et al. Usability of the ANTS system. Anesth Analg 2004;98:S33.
72. Galbraith RM, Holtman MC, Clyman SG. Use of assessment to reinforce patient safety as a habit. Qual Saf Health Care 2006;15 Suppl 1:i30-3. (Pubitemid 46009826)
73. Norcini JJ. Current perspectives in assessment for assessing practice performance at work. Med Educ 2005;39:880-9. (Pubitemid 41297587)
74. Yule S, Rowley D, Flin R, et al. Experience matters: comparing novice and expert ratings of non-technical skills using the NOTSS system. ANZ J Surg 2009;79:154-60.
75. Graham J, Hocking G, Giles E. Anaesthesia non-technical skills: can anaesthetists be trained to reliably use this behavioural marker system in 1 day? Br J Anaesth 2010;104:440-5.
76. Wong BM, Etchells EE, Kuper A, et al. Teaching quality improvement and patient safety to trainees: a systematic review. Acad Med 2010;85:1425-39.
77. Vleuten CP. The assessment of professional competence: developments, research and practical implications. Adv Health Sci Educ Theory Pract 1996;1:41-67. (Pubitemid 126716247)
78. Martin JA, Regehr G, Reznick R, et al. Objective Structured Assessment of Technical Skills (OSATS) for surgical residents. Br J Surg 1997;84:273-8. (Pubitemid 27073483)
79. Mishara A, Catchpole K, McCulloch P. The Oxford NOTECHS System: reliability and validity of a tool for measuring teamwork behaviour in the operating theatre. Qual Saf Health Care 2009;18:104-8.