Checklists for assessment and certification of clinical procedural skills omit essential competencies: A systematic review

Medical Education

Volumn 42, Issue 4, 2008, Pages 338-349

  McKinley, Robert K ^a   Strand, Janice ^b   Ward, Linda ^b   Gray, Tracey ^b   Alun Jones, Tom ^b   Miller, Helen ^b  

^a KEELE UNIVERSITY SCHOOL OF MEDICINE   (United Kingdom)

^b UNIVERSITY HOSPITALS OF LEICESTER NHS TRUST   (United Kingdom)

Author keywords

Clinical competence *standards; Health personnel *standards; Review publication type ; Teaching materials; Teaching *methods

Indexed keywords

CERTIFICATION; CLINICAL COMPETENCE; CODING; HUMAN; OUTCOME ASSESSMENT; PATIENT CARE; QUALITATIVE ANALYSIS; REVIEW; SYSTEMATIC REVIEW;

CERTIFICATION; CLINICAL COMPETENCE; EDUCATION, MEDICAL; HEALTH PERSONNEL; RESEARCH DESIGN; TEACHING; TEACHING MATERIALS;

EID: 40849150761     PISSN: 03080110     EISSN: 13652923     Source Type: Journal    
DOI: 10.1111/j.1365-2923.2007.02970.x     Document Type: Review

References (106)

1. Mason WT, Strike PW. See one, do one, teach one - is this still how it works? A comparison of the medical and nursing professions in the teaching of practical procedures. Med Teach 2003 25 (6 664 6.
2. American Nurse Association. Code of Ethics for Nurses with Interpretive Statements. http://www.nursingworld.org/ethics/code/protected_nwcoe303. htm#prov4. 2005. [Accessed 2 February 2006.].
3. Rutherford J, Leigh J, Monk J, Murray C. Creating an organisational infrastructure to develop and support new nursing roles - a framework for debate. J Nurs Manag 2005 13 (2 97 105.
4. Harden RM, Gleeson FA. Assessment of clinical competence using an objective structured clinical examination (OSCE). Med Educ 1979 13 (1 41 54.
5. Harden RM. What is an OSCE? Med Teach 1988 10 (1 19 22.
6. Newble DI, Swanson DB. Psychometric characteristics of the objective structured clinical examination. Med Educ 1988 22 (4 325 34.
7. Wass V, Jones R, van der Vleuten CPM. Standardised or real patients to test clinical competence? The long case revisited. Med Educ 2001 35 (4 321 5.
8. Wass V, van der Vleuten CPM. The long case. Med Educ 2004 38 (11 1176 80.
9. Norman G. The long case versus objective structured clinical examinations. BMJ 2002 324 (7340 748 9.
10. van Luijk SJ, van der Vleuten CPM. A comparison of checklists and rating scales in performance-based testing. In : Hart IR, Harden RM, Des Marchais J, eds. Current developments in assessing clinical competence. Ottawa : IRH Medical Ltd 1992 357 62.
11. Keynan A, Friedman M, Benbassat J. Reliability of global rating scales in the assessment of clinical competence of medical students. Med Educ 1987 21 (6 477 81.
12. Regehr G, Freeman R, Robb A, Missiha N, Heisey R. OSCE performance evaluations made by standardised patients: comparing checklist and global rating scores. Acad Med 1999 10 (Suppl 135 7.
13. Martin JA, Regehr G, Reznick R, MacRae H, Murnaghan J, Hutchison C, Brown M. Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg 1997 84 (2 273 8.
14. Reznick R, Regehr G, MacRae H, Martin J, McCulloch W. Testing technical skill via an innovative 'bench station' examination. Am J Surg 1997 173 (3 226 30.
15. Winckel CP, Reznick RK, Cohen R, Taylor B. Reliability and construct validity of a structured technical skills assessment form. Am J Surg 1994 167 (4 423 7.
16. Fraser RC, Sarkhou ME, McKinley RK, van der Vleuten CPM. Regulatory end-point assessment of the consultation competence of family practice trainees in Kuwait. Eur J Public Health 2006 12 : 100 7.
17. Fraser RC, Lee RSY, Yui YK, Lam CLK, McKinley RK, van der Vleuten CPM. Regulatory assessment of the consultation competence of family physicians in Hong Kong. The Hong Kong Practitioner 2004 26 : 5 15.
18. McKinley RK, Fraser RC, van der Vleuten C, Hastings AM. Formative assessment of the consultation performance of medical students in the setting of general practice using a modified version of the Leicester Assessment Package. Med Educ 2000 34 : 573 9.
19. Accreditation Council for Graduate Medical Education. General Competencies: ACGME Outcome Project 1999. http://www.acgme.org/outcome/comp/ compFull.asp. [Accessed 1 June 2005.]
20. General Medical Council. Maintaining Good Medical Practice. London : GMC 1998.
21. Nursing and Midwifery Council. The Code of Professional Conduct: Standards for Performance, Conduct and Ethics. London : NMC 2004.
22. Department of Health. The Essence of Care: Patient-focused Benchmarking for Health Care Practitioners. http://www.dh.gov.uk/en/ Publicationsandstatistics/Publications/PublicationsPolicyAndGuidance/DH_4005475. 2001. [Accessed 11 June 2007.]
23. New South Wales Medical Board. Good Medical Practice. Duties of a Doctor Registered with the New South Wales Medical Board. http://www.medeserv.com.au/ nswmb/publications/Code_-_Duties_of_a_Doctor_ams.pdf [Accessed 12 December 2005.]
24. Medical Council of Canada. Objectives for the Qualifying Examination. http://www.mcc.ca/Objectives_online/. [Accessed 1 December 2005.]
25. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977 33 (1 159 74.
26. Glaser B, Strauss A. The Discovery of Grounded Theory. Chicago : Aldine 1967.
27. Altman DG, Schulz KF, Moher D, Egger M, Davidoff F, Elbourne D, Gotzsche PC, Lang T, CONSORT Group (Consolidated Standards of Reporting Trials). The revised CONSORT statement for reporting randomised trials: explanation and elaboration. Ann Intern Med 2001 134 (8 663 94.
28. Moher D, Cook DJ, Eastwood S, Olkin I, Rennie D, Stroup DF. Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement. Quality of Reporting of Meta-analyses. Lancet 1999 354 (9193 1896 1900.
29. Swanson DB, Norman GR, Linn RL. Performance-based assessment: lessons from the health professions. Educ Res 1995 25 (5 5 11.
30. Norcini J. The Importance of Workplace-based Assessment in the Foundation Programme. http://www.mmc.nhs.uk/download/ The_importance_of_workplace_based_assessment_in_the_Foundation_Programme.ppt. 2006. Skipton House, Room 531B, 80 London Road, London, SE1 6LH, Modernising Medical Careers. [Accessed 5 April 2006.]
31. Moorthy K, Vincent C, Darzi A. Simulation-based training. BMJ 2005 330 (7490 493 4.
32. Kidd J, Patel V, Peile E, Carter Y. Clinical and communication skills. BMJ 2005 330 (7488 374 5.
33. Bousdras V, Aghabeigi B, Petrie A, Evans A. Assessment of surgical skills in implant dentistry. Int J Oral Maxillofac Implants 2004 19 (4 542 8.
34. Evans AW. Assessing competence in surgical dentistry. Br Dent J 2001 190 (7 343 6.
35. Macluskey M, Hanson C, Kershaw A, Wight AJ, Oghden GR. Development of a structured clinical operative test (SCOT) in the assessment of practical ability in the oral surgery undergraduate curriculum. Br Dent J 2004 196 (4 225 8.
36. Mossey PA, Newton JP. The structured clinical operative test (SCOT) in dental competency assessment. Br Dent J 2001 190 (7 387 90.
37. Scott BJ, Evans DJ, Drummond JR, Mossey PA, Stirrups DR. An investigation into the use of a structured clinical operative test for the assessment of a clinical skill. Eur J Dent Educ 2001 5 (1 31 7.
38. Barsuk D, Ziv A, Lin G, Blumenfeld A, Rubin O, Keidan I, Munz Y, Berkenstadt H. Using advanced simulation for recognition and correction of gaps in airway and breathing management skills in pre-hospital trauma care. Anesth Analg 2005 100 (3 803 9.
39. Bjork I, Kirkevold M. From simplicity to complexity: developing a model of practical skill performance in nursing. J Clin Nurs 2000 9 (4 620 31.
40. Day T, Farnell S, Haynes S, Wainwright S, Wilson B. Tracheal suctioning: an exploration of nurses' knowledge and competence in acute and high-dependency ward areas. J Adv Nurs 2002 39 (1 35 45.
41. Maylor ME. Compression therapy award. Teaching bandaging and Doppler usage for venous ulcer treatment. Br J Nurs 2002 11 (20 20.
42. Morse JM, Penrod J, Kassab C, Dellasega C. Evaluating the efficiency and effectiveness of approaches to nasogastric tube insertion during trauma care. Am J Crit Care 2000 9 (5 325 33.
43. Norris R, Ngo J, Nolan K, Hooker G. Physicians and lay people are unable to apply pressure immobilisation properly in a simulated snakebite scenario. Wilderness Environ Med 2005 16 (1 16 21.
44. Welch SK. Certification of staff nurses to insert enteral feeding tubes using a research-based procedure. Nutr Clin Pract 1996 11 (1 21 7.
45. Abraham S. Gynaecological examination: a teaching package integrating assessment with learning. Med Educ 1998 32 (1 76 81.
46. Brehmer M, Tolley D. Validation of a bench model for endoscopic surgery in the upper urinary tract. Eur Urol 2002 42 (2 175 9.
47. Brotzman GL, Apgar BS. Assessing colposcopic skills: the instructor's handbook. Fam Med 1998 30 (5 350 5.
48. Cullen L, Fraser D, Symonds I. Strategies for interprofessional education: the Interprofessional Team Objective Structured Clinical Examination for midwifery and medical students. Nurse Educ Today 2003 23 (6 427 33.
49. Kelly MH, Campbell LM, Murray TS. Clinical skills assessment. Br J Gen Pract 1999 49 (443 447 50.
50. Nielsen P, Foglia L, Mandel LS, Chow G. Objective structured assessment of technical skills for episiotomy repair. Am J Obstet Gynecol 2003 189 (5 1257 60.
51. Agarwal M, Williamson SN. Objective structured practical examination (OSPE). Nurs J India 1999 90 (12 276 8.
52. Alinier G. Nursing students' and lecturers' perspectives of objective structured clinical examination incorporating simulation. Nurse Educ Today 2003 23 (6 419 26.
53. Barnsley L, Lyon P, Ralston S, Hibbert E, Cunningham I, Gordon F, Field M. Clinical skills in junior medical officers: a comparison of self- reported confidence and observed competence. Med Educ 2004 38 (4 358 67.
54. Drevenhorn E, Hakansson A, Petersson K. Blood pressure measurement - an observational study of 21 public health nurses. J Clin Nurs 2001 10 (2 189 94.
55. Gurvis JP, Grey MT. The anatomy of a competency. J Nurs Staff Dev 1995 11 (5 247 52.
56. McKane C. Clinical objectives: a method to evaluate clinical performance in critical care orientation. J Nurses Staff Dev 2004 20 (3 134 9.
57. Nicol M, Freeth D. Assessment of clinical skills: a new approach to an old problem. Nurse Educ Today 1998 18 (8 601 9.
58. Brennan RT, Braslow A, Batcheller AM, Kaye W. A reliable and valid method for evaluating cardiopulmonary resuscitation training outcomes. Resuscitation 1996 32 (2 85 93.
59. Cronin C, Cheang S, Hlynka D, Adair E, Roberts S. Videoconferencing can be used to assess neonatal resuscitation skills. Med Educ 2001 35 (11 1013 23.
60. Davies N, Gould D. Updating cardiopulmonary resuscitation skills: a study to examine the efficacy of self-instruction on nurses' competence. J Clin Nurs 2000 9 (3 400 10.
61. Gaba DM, Howard SK, Flanagan B, Smith BE, Fishn KJ, Botney R. Assessment of clinical performance during simulated crises using both technical and behavioural ratings. Anesthesiology 1998 89 (1 8 18.
62. Hohenhaus SM. Nurse educator. Assessing competency: the Broselow-Luten resuscitation tape. J Emerg Nurs 2002 28 (1 70 2.
63. Hollis S, Gillespie N. An audit of basic life support skills amongst general practitioner principals: is there a need for regular training? Resuscitation 2000 44 (3 171 5.
64. Kovacs G, Bullock G, Ackroyd S, Cain E, Petrie D. A randomised controlled trial on the effect of educational interventions in promoting airway management skill maintenance. Ann Emerg Med 2000 36 (4 301 9.
65. Kuhnigk H, Sefrin P, Paulus T. Skills and self-assessment in cardio-pulmonary resuscitation of hospital nursing staff. Eur J Emerg Med 1994 1 (4 193 8.
66. Naik VN, Matsumoto ED, Houston PL, Hamstra SJ, Yeung RY, Mallon J, Martire TM. Fibreoptic orotracheal intubation on anaesthetised patients: do manipulation skills learned on a simple model transfer into the operating room? Anesthesiology 2001 95 (2 343 8.
67. O'Connor HM, McGraw RC. Clinical skills training: developing objective assessment instruments. Med Educ 1997 31 (5 359 63.
68. Quan L, Shugerman RP, Kunkel NC, Brownlee CJ. Evaluation of resuscitation skills in new residents before and after pediatric advanced life support course. Pediatrics 2001 108 (6 110.
69. Whitfield R, Newcombe R, Woollard M. Reliability of the Cardiff Test of basic life support and automated external defibrillation version 31. Resuscitation 2003 59 (3 291 314.
70. Birnbach DJ, Santos AC, Bourlier RA, Meadows WE, Datta S, Stein DJ, Kuroda MM, Thys DM. The effectiveness of video technology as an adjunct to teach and evaluate epidural anaesthesia performance skills. Anesthesiology 2002 96 (1 5 9.
71. Camp-Sorrell D, Fernandez K, Reardon MB. Teaching oncology nurses about epidural catheters. Oncol Nurse Forum 1990 17 (5 683 9.
72. Dugger B. Intravenous nursing competency: why is it important? J Intraven Nurs 1997 20 (6 287 97.
73. Engum SA, Jeffries P, Fisher L. Intravenous catheter training system: computer-based education versus traditional learning methods. Am J Surg 2003 186 (1 67 74.
74. Fearon M. Assessment and measurement of competence in practice. Nurs Stand 1998 12 (22 43 7.
75. Hill R, Hooper C, Wahl S. Look, learn, and be satisfied: video playback as a learning strategy to improve clinical skills performance. J Nurses Staff Dev 2000 16 (5 232 9.
76. Liddell MJ, Davidson SK, Taub H, Whitecross LE. Evaluation of procedural skills training in an undergraduate curriculum. Med Educ 2002 36 (11 1035 41.
77. Mason S, Fletcher A, McCormick S, Perrin J, Rigby A. Developing assessment of emergency nurse practitioner competence - a pilot study. J Adv Nurs 2005 50 (4 425 32.
78. Rudzik J. Establishing and maintaining competency. J Intraven Nurs 1999 22 (2 69 73.
79. Snelling PC, Duffy L. Developing self-directed training for intravenous cannulation. Prof Nurse 2002 18 (3 137 42.
80. St John RE, Malen JF. Contemporary issues in adult tracheostomy management. Crit Care Nurs Clin North Am 2004 16 (3 413 30.
81. Szumlas GA. Development of an office-based curriculum of common pediatric primary care skills for residents. Acad Med 2002 77 (7 749.
82. Thorburn J, Dean M, Finn T, King J, Wilkinson M. Student learning through video assessment. Contemp Nurse 2001 10 (1 39 45.
83. Velmahos G, Toutouzas K, Sillin L, Chan L, Clark R, Theodorou D, Maupin F. Cognitive task analysis for teaching technical skills in an inanimate surgical skills laboratory. Am J Surg 2004 187 (1 114 9.
84. Wang T, Schwartz J, Karimipour D, Orringer J, Hamilton T, Johnson T. An education theory-based method to teach a procedural skill. Arch Dermatol 2004 140 (11 1357 61.
85. Adrales GL, Donnelly MB, Chu UB, Witzke DB, Hoskins JD, Mastrangelo MJ Jr., Gandsas A, Park AE. Determinants of competency judgements by experienced laparoscopic surgeons. Surg Endosc 2004 18 (2 323 7.
86. Backstein D, Agnidis Z, Regehr G, Reznick R. The effectiveness of video feedback in the acquisition of orthopaedic technical skills. Am J Surg 2004 187 (3 427 32.
87. Cauraugh JH, Martin M, Martin KK. Modelling surgical expertise for motor skill acquisition. Am J Surg 1999 177 (4 331 6.
88. Dayal R, Faries P, Lin S et al. Computer simulation as a component of catheter-based training. J Vasc Surg 2004 40 (6 1112 7.
89. Eubanks TR, Clements RH, Pohl D, Williams N, Schaad DC, Horgan S, Pellegrini C. An objective scoring system for laparoscopic cholecystectomy. J Am Coll Surg 1999 189 (6 566 74.
90. Grober ED, Hamstra SJ, Wanzel KR, Reznick RK, Matsumoto ED, Sidhu RS, Jarvi KA. Laboratory-based training in urological microsurgery with bench model simulators: a randomised controlled trial evaluating the durability of technical skill. J Urol 2004 172 (1 378 81.
91. Jackson MJ, Pandey V, Wolfe JHN. Training for infrainguinal bypass surgery. Eur J Vasc Endovasc Surg 2003 26 (5 457 66.
92. Khan NUZ. Plastibell technique of circumcision: an easy and a practical procedure. J Med Sci (Faisalabad, Pakistan) 2004 20 (3 277.
93. Matsumoto ED, Hamstra SJ, Radomski SB, Cusimano MD. A novel approach to endourological training: training at the surgical skills centre. J Urol 2001 166 (4 1261 6.
94. Mayooran Z, Pearce S, Tsaltas J, Rombauts L, Brown T Jr., Lawrence A, Fraser K, Healy D. Ignorance of electrosurgery among obstetricians and gynaecologists. BJOG 2004 111 (12 1413 8.
95. Montague M, Lee M, Hussain SSM. Human error identification: an analysis of myringotomy and ventilation tube insertion. Arch Otolaryngol Head Neck Surg 2004 130 (10 1153 7.
96. Moorthy K, Munz Y, Sarker SK, Darzi A. Objective assessment of technical skills in surgery. BMJ 2003 327 (7422 1032 7.
97. Rosen J, MacFarlane M, Richards C, Hannaford B, Sinanan M. Surgeon-tool force/torque signatures - evaluation of surgical skills in minimally invasive surgery. Stud Health Technol Inform 1999 62 : 290 6.
98. Shah S, Thomas G, Brooker J, Suzuki N, Williams C, Thapar C, Saunders B. Use of video and magnetic endoscope imaging for rating competence at colonoscopy: validation of a measurement tool. Gastrointest Endosc 2002 56 (4 568 73.
99. Wilhelm D, Ogan K, Roehrborn C, Cadeddu J, Pearle M. Assessment of basic endoscopic performance using a virtual reality simulator. J Am Coll Surg 2002 195 (5 675 81.
100. Zhang H, Payandeh S, Dill J, Lomax A. Acquiring laparoscopic manipulative skills: a virtual tissue dissection training module. Stud Health Technol Inform 2004 98 : 419 21.
101. Boulet JR, Gimpel JR, Dowling DJ, Finley M. Assessing the ability of medical students to perform osteopathic manipulative treatment techniques. J Am Osteopath Assoc 2004 104 (5 203 11.
102. Cross V. Approaching consensus in clinical competence assessment: third round of Delphi study of academics' and clinicians' perceptions of physiotherapy undergraduates. Physiotherapy 2001 87 (7 341 50.
103. Cross V, Hicks C, Barwell F. Comparing the importance of clinical competence criteria across specialties: impact on undergraduate assessment. Physiotherapy 2001 87 (7 351 67.
104. Marshall G, Harris P. A study of the role of an objective structured clinical examination (OSCE) in assessing clinical competence in third year student radiographers. Radiography 2000 : 6 (2 117 22.
105. Olympio MA, Goldstein MM, Mathes DD. Instructional review improves performance of anaesthesia apparatus checkout procedures. Anesth Analg 1996 83 (3 618 22.
106. Roberts LW, Mines J, Voss C, Koinis C, Mitchell S, Obenshain SS, McCarty T. Assessing medical students' competence in obtaining informed consent. Am J Surg 1999 178 (4 351 5.