Learn, See, Practice, Prove, Do, Maintain: An Evidence-Based Pedagogical Framework for Procedural Skill Training in Medicine

Academic Medicine

Volumn 90, Issue 8, 2015, Pages 1025-1033

  Sawyer, Taylor ^a   White, Marjorie ^b   Zaveri, Pavan ^c   Chang, Todd ^d   Ades, Anne ^e   French, Heather ^e   Anderson, Jodee ^f   Auerbach, Marc ^g   Johnston, Lindsay ^g   Kessler, David ^h  

^a UNIVERSITY OF WASHINGTON SCHOOL OF MEDICINE   (United States)

^b University of Alabama at Birmingham   (United States)

^c CHILDREN'S NATIONAL MEDICAL CENTER   (United States)

^d CHILDREN S HOSPITAL LOS ANGELES   (United States)

^e CHILDREN S HOSPITAL OF PHILADELPHIA   (United States)

^f OREGON HEALTH AND SCIENCE UNIVERSITY   (United States)

^g YALE UNIVERSITY SCHOOL OF MEDICINE   (United States)

^h College of Phys and Surg ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLINICAL COMPETENCE; CURRICULUM; EDUCATION; EDUCATIONAL MODEL; EVIDENCE BASED MEDICINE; FEMALE; HUMAN; LEARNING; MALE; PROCEDURES;

CLINICAL COMPETENCE; COMPETENCY-BASED EDUCATION; EDUCATIONAL MEASUREMENT; EVIDENCE-BASED MEDICINE; FEMALE; HUMANS; LEARNING; MALE; MODELS, EDUCATIONAL;

EID: 84938254136     PISSN: 10402446     EISSN: 1938808X     Source Type: Journal    
DOI: 10.1097/ACM.0000000000000734     Document Type: Review

References (90)

1. Ziv A, Wolpe PR, Small SD, Glick S. Simulationbased medical education: An ethical imperative. Acad Med. 2003;78:783-788
2. Lenchus JD. End of the see one, do one, teach one era: The next generation of invasive bedside procedural instruction. J Am Osteopath Assoc. 2010;110:340-346
3. Cook DA, Hatala R, Brydges R, et al. Technology-enhanced simulation for health professions education: A systematic review and meta-analysis. JAMA. 2011;306:978-988
4. McGaghie WC, Issenberg SB, Petrusa ER, Scalese RJ. A critical review of simulationbased medical education research: 2003-2009. Med Educ. 2010;44:50-63
5. Schaefer J, Venderbilt A, Cason C, et al. Instructional design and pedagogy science in healthcare simulation. Simul Healthc. 2011;6:S30-S41
6. McGaghie WC, Draycott TJ, Dunn WF, Lopez CM, Stefanidis D. Evaluating the impact of simulation on translational patient outcomes. Simul Healthc. 2011;6(suppl):S42-S47
7. Gunberg J. Simulation and psychomotor skill acquisition: A review of the literature. Clin Simul Nurs. 2012;8:e429-435
8. Zendejas B, Brydges R, Wang AT, Cook DA. Patient outcomes in simulation-based medical education: A systematic review. J Gen Intern Med. 2013;28:1078-1089
9. Scholtz AK, Monachino AM, Nishisaki A, Nadkarni VM, Lengetti E. Central venous catheter dress rehearsals: Translating simulation training to patient care and outcomes. Simul Healthc. 2013;8:341-349
10. Ross J. Simulation and psychomotor skill acquisition: A review of the literature. Clin Simul Nurs. 2012;8:e429-e435
11. Philbert I, ed. Accreditation Council for Graduate Medical Education (ACGME) Bulletin. Published December 2005. https:// tulane.edu/som/sim/faculty/upload/ bulletin12-05.pdf. Accessed March 11, 2015
12. Eva KW. On the limits of systematicity. Med Educ. 2008;42:852-853
13. Cook D. Narrowing the focus and broadening horizons: Complementary roles for systematic and nonsystematic reviews. Adv Health Sci Educ. 2008;13:391-395
14. Foley RP, Spilansy J. Teaching Techniques-A Handbook for Health Professionals. New York, NY: McGraw Hill; 1980:71-91
15. Dreyfus S, Dreyfus H. A Five Stage Model of the Mental Activities Involved in Directed Skill Acquisition. Published February 1980. http://www.dtic.mil/cgibin/ GetTRDoc?AD=ADA084551. Accessed March 11, 2015
16. Simpson E. The Classification of Educational Objectives in the Psychomotor Domain. Washington, DC: Gryphon House; 1972
17. Harrow A. A Taxonomy of the Psychomotor Domain. New York, NY: David McKay; 1972:14-31
18. Kovacs G. Procedural skills in medicine: Linking theory with practice. J Emerg Med. 1997;15:387-391
19. Norris TE, Cullison SW, Fihn SD. Teaching procedural skills. J Gen Intern Med. 1997;12(suppl 2):S64-S70
20. Lammers RL, Davenport M, Korley F, et al. Teaching and assessing procedural skills using simulation: Metrics and methodology. Acad Emerg Med. 2008;15:1079-1087
21. Kneebone R. Evaluating clinical simulations for learning procedural skills: A theory-based approach. Acad Med. 2005;80:549-553
22. McLeod PJ, Steinert Y, Trudel J, Gottesman R. Seven principles for teaching procedural and technical skills. Acad Med. 2001;76:1080
23. Wang E, Quinones J, Fitch M, et al. Developing technical expertise in emergency medicine-the role of simulation in procedural skill acquisition. Acad Emerg Med. 2008;15:1046-1057
24. Grantcharov TP, Reznick RK. Teaching procedural skills. BMJ. 2008;336:1129-1131
25. Brodsky D, Smith C. A structured approach to teaching medical procedures. NeoReviews. 2012;13:e635-e641
26. Paulman P. A simple five-step method for teaching clinical skills. Fam Med. 2001;33:577-578
27. Cook DA, Hamstra SJ, Brydges R, et al. Comparative effectiveness of instructional design features in simulation-based education: Systematic review and metaanalysis. Med Teach. 2013;35:e867-e898
28. Srivastava G, Roddy M, Langsam D, Agrawal D. An educational video improves technique in performance of pediatric lumbar punctures. Pediatr Emerg Care. 2012;28:12-16
29. Ventres WB, Senf JH. Introducing a procedure using videotape instruction: The case of the lateral birth position. Fam Med. 1994;26:434-436
30. Peyton JWR. Teaching and Learning in Medical Practice. Rickmansworth, UK: Manticore Publishing House Europe Limited; 1998
31. Bjerrum AS, Hilberg O, van Gog T, Charles P, Eika B. Effects of modelling examples in complex procedural skills training: A randomised study. Med Educ. 2013;47:888-898
32. Kessler DO, Arteaga G, Ching K, et al. Interns success with clinical procedures in infants after simulation training. Pediatrics. 2013;131:e811-e820
33. Gaies MG, Morris SA, Hafler JP, et al. Reforming procedural skills training for pediatric residents: A randomized, interventional trial. Pediatrics. 2009;124:610-619
34. Berg D, Berg K, Riesenberg LA, et al. The development of a validated checklist for thoracentesis: Preliminary results. Am J Med Qual. 2013;28:220-226
35. Berg K, Riesenberg LA, Berg D, et al. The development of a validated checklist for radial arterial line placement: Preliminary results. Am J Med Qual. 2014;29:242-246
36. Riesenberg LA, Berg K, Berg D, et al. The development of a validated checklist for femoral venous catheterization: Preliminary results. Am J Med Qual. 2014;29:445-450
37. Riesenberg LA, Berg K, Berg D, et al. The development of a validated checklist for paracentesis: Preliminary results. Am J Med Qual. 2013;28:227-231
38. Berg K, Riesenberg LA, Berg D, et al. The development of a validated checklist for adult lumbar puncture: Preliminary results. Am J Med Qual. 2013;28:330-334
39. Riesenberg LA, Berg K, Berg D, et al. The development of a validated checklist for nasogastric tube insertion: Preliminary results. Am J Med Qual. 2013;28:429-433
40. Huang GC, Newman LR, Schwartzstein RM, et al. Procedural competence in internal medicine residents: Validity of a central venous catheter insertion assessment instrument. Acad Med. 2009;84:1127-1134
41. Ericsson KA, Krampe RT, Tesch-Romer C. The role of deliberate practice in the acquisition of expert performance. Psychol Rev. 1993;100:363-406
42. Ericsson KA. Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. Acad Med. 2004;79(10 suppl):S70-S81
43. Ericsson KA. Deliberate practice and acquisition of expert performance: A general overview. Acad Emerg Med. 2008;15:988-994
44. Adams JA. A closed-loop theory of motor learning. J Mot Behav. 1971;3:111-149
45. Adams J. A historical review and appraisal of research on the learning, retention and transfer of human motor skills. Psychol Bull. 1987;101:41-47
46. Kessler DO, Auerbach M, Pusic M, Tunik MG, Foltin JC. A randomized trial of simulation-based deliberate practice for infant lumbar puncture skills. Simul Healthc. 2011;6:197-203
47. Sawyer T, Sierocka-Castaneda A, Chan D, Berg B, Lustik M, Thompson M. Deliberate practice using simulation improves neonatal resuscitation performance. Simul Healthc. 2011;6:327-336
48. Clapper T, Kardong-Edgren S. Using deliberate practice and simulation to improve nursing skills. Clin Simul Nurs. 2012;8:e109-e113
49. Issenberg SB, McGaghie WC, Gordon DL, et al. Effectiveness of a cardiology review course for internal medicine residents using simulation technology and deliberate practice. Teach Learn Med. 2002;14:223-228
50. McGaghie WC, Issenberg SB, Cohen ER, Barsuk JH, Wayne DB. Does simulationbased medical education with deliberate practice yield better results than traditional clinical education? A meta-analytic comparative review of the evidence. Acad Med. 2011;86:706-711
51. McGaghie WC, Issenberg SB, Cohen ER, Barsuk JH, Wayne DB. Medical education featuring mastery learning with deliberate practice can lead to better health for individuals and populations. Acad Med. 2011;86:e8-e9
52. Cohen ER, Barsuk JH, Moazed F, et al. Making July safer: Simulation-based mastery learning during intern boot cAMP. Acad Med. 2013;88:233-239
53. Wayne DB, Butter J, Siddall VJ, et al. Mastery learning of advanced cardiac life support skills by internal medicine residents using simulation technology and deliberate practice. J Gen Intern Med. 2006;21:251-256
54. Barsuk JH, McGaghie WC, Cohen ER, OLeary KJ, Wayne DB. Simulation-based mastery learning reduces complications during central venous catheter insertion in a medical intensive care unit. Crit Care Med. 2009;37:2697-2701
55. Barsuk JH, McGaghie WC, Cohen ER, Balachandran JS, Wayne DB. Use of simulation-based mastery learning to improve the quality of central venous catheter placement in a medical intensive care unit. J Hosp Med. 2009;4:397-403
56. Barsuk JH, Ahya SN, Cohen ER, McGaghie WC, Wayne DB. Mastery learning of temporary hemodialysis catheter insertion by nephrology fellows using simulation technology and deliberate practice. Am J Kidney Dis. 2009;54:70-76
57. Barsuk JH, Cohen ER, Caprio T, McGaghie WC, Simuni T, Wayne DB. Simulation-based education with mastery learning improves residents lumbar puncture skills. Neurology. 2012;79:132-137
58. Cook DA, Brydges R, Zendejas B, Hamstra SJ, Hatala R. Mastery learning for health professionals using technology-enhanced simulation: A systematic review and metaanalysis. Acad Med. 2013;88:1178-1186
59. Kamdar G, Kessler DO, Tilt L, et al. Qualitative evaluation of just-in-time simulation-based learning: The learners perspective. Simul Healthc. 2013;8:43-48
60. Downing SM. Validity: On meaningful interpretation of assessment data. Med Educ. 2003;37:830-837
61. Downing SM. Reliability: On the reproducibility of assessment data. Med Educ. 2004;38:1006-1012
62. Cook D, Beckman T. Current concepts in validity and reliability for psychomotor instruments: Theory and application. Am J Med. 2006;119:e7-e16
63. Jelovsek JE, Kow N, Diwadkar GB. Tools for the direct observation and assessment of psychomotor skills in medical trainees: A systematic review. Med Educ. 2013;47:650-673
64. Ahmed K, Miskovic D, Darzi A, Athanasiou T, Hanna GB. Observational tools for assessment of procedural skills: A systematic review. Am J Surg. 2011;202:469-480.e6
65. Hales B, Terblanche M, Fowler R, Sibbald W. Development of medical checklists for improved quality of patient care. Int J Qual Health Care. 2008;20:22-30
66. Miller GE. The assessment of clinical skills/ competence/performance. Acad Med. 1990;65(9 suppl):S63-S67
67. Rethans JJ, Norcini JJ, Barón-Maldonado M, et al. The relationship between competence and performance: Implications for assessing practice performance. Med Educ. 2002;36:901-909
68. ten Cate O. Trust, competence, and the supervisors role in postgraduate training. BMJ. 2006;333:748-751
69. Ten Cate O. Nuts and bolts of entrustable professional activities. J Grad Med Educ. 2013;5:157-158
70. Beard J. Workplace-based assessment: The need for continued evaluation and refinement. Surgeon. 2011;9(suppl 1):S12-S13
71. Ali JM. Getting lost in translation? Workplace based assessments in surgical training. Surgeon. 2013;11:286-289
72. Smith CC, Gordon CE, Feller-Kopman D, et al. Creation of an innovative inpatient medical procedure service and a method to evaluate house staff competency. J Gen Intern Med. 2004;19(5 pt 2):510-513
73. Lenhard A, Moallem M, Marrie RA, Becker J, Garland A. An intervention to improve procedure education for internal medicine residents. J Gen Intern Med. 2008;23:288-293
74. Huang GC, Smith CC, York M, Weingart SN. Asking for help: Internal medicine residents use of a medical procedure service. J Hosp Med. 2009;4:404-409
75. Mourad M, Kohlwes J, Maselli J, Auerbach AD; MERN Group. Supervising the supervisors-procedural training and supervision in internal medicine residency. J Gen Intern Med. 2010;25:351-356
76. Huang GC, Smith CC, Gordon CE, et al. Beyond the comfort zone: Residents assess their comfort performing inpatient medical procedures. Am J Med. 2006;119:71.e17-71.e24
77. Review Committee for Otolaryngology, Accreditation Council for Graduate Medical Education. Required minimum number of key indicator procedures for graduating residents. Published March 6, 2013. http:// www.acgme.org/acgmeweb/Portals/0/ PFAssets/ProgramResources/280-Required- Minimum-Number-of-Key-Indicator- Procedures.pdf. Accessed February 27, 2015
78. Review Committee for Thoracic Surgery, Accreditation Council for Graduate Medical Education. Case requirements for residents beginning residency. Published 2012. http://www.acgme.org/acgmeweb/ Portals/0/PFAssets/ProgramResources/460- CaseRequirements-ResidentsBeginning- OnorAfter-July012012.pdf. Accessed March 11, 2015
79. Review Committee for Emergency Medicine, Accreditation Council for Graduate Medical Education. Frequently asked questions: Emergency medical services. Published 2014. http://www.acgme.org/acgmeweb/Portals/0/ PDFs/FAQ/112-emergency-medical-svcs- FAQs.pdf. Accessed February 27, 2015
80. Program Directors of Pediatric Urology Programs, Accreditation Council for Graduate Medical Education. Review committee for urology. Minimum numbers memorandum. Published July 1, 2013. http://www.acgme.org/acgmeweb/Portals/0/ PFAssets/ProgramResources/480-Memo- Ped-Uro-Operative-Minimum-Numbers. pdf. Accessed February 27, 2015
81. Filho G. The construction of learning curves for basic skills in anesthetic procedures: An application for cumulative sum method. Anesth Analg. 2002;95:411-416
82. Dalal P, Dalal G, Pott L, Bezinover D, Prozesky J, Murray WB. Learning curves of novice anesthesiology residents performing simulated fiberoptic upper airway endoscopy. Can J Anesth. 2011;58:802-809
83. Ward ST, Mohammed MA, Walt R, Valori R, Ismail T, Dunckley P. An analysis of the learning curve to achieve competency at colonoscopy using the JETS database. Gut. 2014;63:1746-1754
84. Levitt LK. Use it or lose it: Is de-skilling evidence-based? Rural Remote Health. 2001;1:81
85. Kneebone RL, Scott W, Darzi A, Horrocks M. Simulation and clinical practice: Strengthening the relationship. Med Educ. 2004;38:1095-1102
86. Kovacs G, Bullock G, Ackroyd-Stolarz S, Cain E, Petrie D. A randomized controlled trial on the effect of educational interventions in promoting airway management skill maintenance. Ann Emerg Med. 2000;36:301-309
87. Niles D, Sutton RM, Donoghue A, et al. Rolling Refreshers: A novel approach to maintain CPR psychomotor skill competence. Resuscitation. 2009;80:909-912
88. Sam J, Pierse M, Al-Qahtani A, Cheng A. Implementation and evaluation of a simulation curriculum for paediatric residency programs including just-in-time in situ mock codes. Paediatr Child Health. 2012;17:e16-e20
89. Bender J, Kennally K, Shields R, Overly F. Does simulation booster impact retention of resuscitation procedural skills and teamwork? J Perinatol. 2014;34:664-668
90. Steadman RH, Huang YM. Simulation for quality assurance in training, credentialing and maintenance of certification. Best Pract Res Clin Anaesthesiol. 2012;26:3-15