Optimal acquisition and assessment of proficiency on simulators in surgery

Surgical Clinics of North America

Volumn 90, Issue 3, 2010, Pages 475-489

  Stefanidis, Dimitrios ^a,b  

^a UNIVERSITY OF NORTH CAROLINA AT CHARLOTTE   (United States)

^b CAROLINAS MEDICAL CENTER   (United States)

Author keywords

Automaticity; Performance assessment; Simulators; Skills proficiency; Skills training

Indexed keywords

CLINICAL COMPETENCE; CLINICAL PRACTICE; CONCEPTUAL FRAMEWORK; CURRICULUM; FEEDBACK SYSTEM; LEARNING THEORY; MOTIVATION; PERFORMANCE MEASUREMENT SYSTEM; PRIORITY JOURNAL; REVIEW; SIMULATOR; SURGICAL TRAINING; TASK PERFORMANCE; WORKLOAD;

CLINICAL COMPETENCE; COMPETENCY-BASED EDUCATION; COMPUTER-ASSISTED INSTRUCTION; GENERAL SURGERY; HUMANS; KNOWLEDGE OF RESULTS (PSYCHOLOGY); MOTIVATION; MOTOR SKILLS; PRACTICE (PSYCHOLOGY);

EID: 77953102594     PISSN: 00396109     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.suc.2010.02.010     Document Type: Review

References (92)

1. Osborne M.P. William Stewart Halsted: his life and contributions to surgery. Lancet Oncol 2007, 8(3):256-265.
2. Reznick R.K., MacRae H. Teaching surgical skills-changes in the wind. N Engl J Med 2006, 355(25):2664-2669.
3. Satava R.M. Disruptive visions: surgical education. Surg Endosc 2004, 18(5):779-781.
4. Fried G.M. Lessons from the surgical experience with simulators: incorporation into training and utilization in determining competency. Gastrointest Endosc Clin N Am 2006, 16(3):425-434.
5. Fitts P.M., Posner M.I. Human performance 1967, Brooks/Cole, Belmont (CA).
6. Stefanidis D., Scerbo M.W., Sechrist C., et al. Do novices display automaticity during simulator training?. Am J Surg 2008, 195(2):210-213.
7. Gallagher A.G., Ritter E.M., Champion H., et al. Virtual reality simulation for the operating room: proficiency-based training as a paradigm shift in surgical skills training. Ann Surg 2005, 241(2):364-372.
8. Aggarwal R., Grantcharov T.P., Darzi A. Framework for systematic training and assessment of technical skills. J Am Coll Surg 2007, 204(4):697-705.
9. McClusky D.A., Smith C.D. Design and development of a surgical skills simulation curriculum. World J Surg 2008, 32(2):171-181.
10. Ericsson K.A. Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. Acad Med 2004, 79(10 Suppl):S70-S81.
11. Ericsson K.A., Lehmann A.C. Expert and exceptional performance: evidence of maximal adaptation to task constraints. Annu Rev Psychol 1996, 47:273-305.
12. Chang L., Petros J., Hess D.T., et al. Integrating simulation into a surgical residency program: is voluntary participation effective?. Surg Endosc 2007, 21(3):418-421.
13. Stefanidis D., Acker C.E., Swiderski D., et al. Challenges during the implementation of a laparoscopic skills curriculum in a busy general surgery residency program. J Surg Educ 2008, 65(1):4-7.
14. Magill R.A. Motor learning and control. Concepts and applications 2004, McGraw-Hill, New York. 7th edition.
15. Strom P., Hedman L., Sarna L., et al. Early exposure to haptic feedback enhances performance in surgical simulator training: a prospective randomized crossover study in surgical residents. Surg Endosc 2006, 20(9):1383-1388.
16. Cao C.G., Zhou M., Jones D.B., et al. Can surgeons think and operate with haptics at the same time?. J Gastrointest Surg 2007, 11(11):1564-1569.
17. Panait L., Akkary E., Bell R.L., et al. The role of haptic feedback in laparoscopic simulation training. J Surg Res 2009, 156(2):312-316.
18. van der Meijden O.A., Schijven M.P. The value of haptic feedback in conventional and robot-assisted minimal invasive surgery and virtual reality training: a current review. Surg Endosc 2009, 23(6):1180-1190.
19. Ende J. Feedback in clinical medical education. JAMA 1983, 250(6):777-781.
20. Xeroulis G.J., Park J., Moulton C.A., et al. Teaching suturing and knot-tying skills to medical students: a randomized controlled study comparing computer-based video instruction and (concurrent and summary) expert feedback. Surgery 2007, 141(4):442-449.
21. Porte M.C., Xeroulis G., Reznick R.K., et al. Verbal feedback from an expert is more effective than self-accessed feedback about motion efficiency in learning new surgical skills. Am J Surg 2007, 193(1):105-110.
22. Mahmood T., Darzi A. The learning curve for a colonoscopy simulator in the absence of any feedback: no feedback, no learning. Surg Endosc 2004, 18(8):1224-1230.
23. Chang J.Y., Chang G.L., Chien C.J., et al. Effectiveness of two forms of feedback on training of a joint mobilization skill by using a joint translation simulator. Phys Ther 2007, 87(4):418-430.
24. Kruglikova I., Grantcharov T.P., Drewes A.M., et al. The impact of constructive feedback on training in gastrointestinal endoscopy using high fidelity virtual reality simulation. A randomized controlled trial. Gut 2010, 59(2):181-185.
25. Pearson A.M., Gallagher A.G., Rosser J.C., et al. Evaluation of structured and quantitative training methods for teaching intracorporeal knot tying. Surg Endosc 2002, 16(1):130-137.
26. Stefanidis D., Korndorffer J.R., Heniford B.T., et al. Limited feedback and video tutorials optimize learning and resource utilization during laparoscopic simulator training. Surgery 2007, 142(2):202-206.
27. Rogers D.A., Regehr G., Howdieshell T.R., et al. The impact of external feedback on computer-assisted learning for surgical technical skill training. Am J Surg 2000, 179(4):341-343.
28. Winstein C.J., Schmidt R.A. Reduced frequency of knowledgeof results enhances motor skill learning. J Exp Psychol Learn Mem Cogn 1990, 16:677-691.
29. Schmidt R.A., Wulf G. Continuous concurrent feedback degrades skill learning: implications for training and simulation. Hum Factors 1997, 39(4):509-525.
30. Hodges N.J., Franks I.M. Modelling coaching practice: the role of instruction and demonstration. J Sports Sci 2002, 20(10):793-811.
31. McGraw-Hunter M., Faw G.D., Davis P.K. The use of video self-modelling and feedback to teach cooking skills to individuals with traumatic brain injury: a pilot study. Brain Inj 2006, 20(10):1061-1068.
32. Scherer L.A., Chang M.C., Meredith J.W., et al. Videotape review leads to rapid and sustained learning. Am J Surg 2003, 185(6):516-520.
33. Jowett N., LeBlanc V., Xeroulis G., et al. Surgical skill acquisition with self-directed practice using computer-based video training. Am J Surg 2007, 193(2):237-242.
34. Rosser J.C., Herman B., Risucci D.A., et al. Effectiveness of a CD-ROM multimedia tutorial in transferring cognitive knowledge essential for laparoscopic skill training. Am J Surg 2000, 179(4):320-324.
35. Takiguchi S., Sekimoto M., Yasui M., et al. Cyber visual training as a new method for the mastery of endoscopic surgery. Surg Endosc 2005, 19(9):1204-1210.
36. Summers A.N., Rinehart G.C., Simpson D., et al. Acquisition of surgical skills: a randomized trial of didactic, videotape, and computer-based training. Surgery 1999, 126(2):330-336.
37. Dail T.K., Christina R.W. Distribution of practice and metacognition in learning and long-term retention of a discrete motor task. Res Q Exerc Sport 2004, 75(2):148-155.
38. Lee T., Genovese E. Distribution of practice in motor skill acquisition: learning and performance effects reconsidered. Res Q 1988, 59:277-287.
39. Moulton C.A., Dubrowski A., Macrae H., et al. Teaching surgical skills: what kind of practice makes perfect?: a randomized, controlled trial. Ann Surg 2006, 244(3):400-409.
40. Lee T.D., Genovese E.D. Distribution of practice in motor skill acquisition: different effects for discrete and continuous tasks. Res Q Exerc Sport 1989, 60(1):59-65.
41. Mackay S., Morgan P., Datta V., et al. Practice distribution in procedural skills training: a randomized controlled trial. Surg Endosc 2002, 16(6):957-961.
42. Garcia J.A., Moreno F.J., Reina R., et al. Analysis of effects of distribution of practice in learning and retention of a continuous and a discrete skill presented on a computer. Percept Mot Skills 2008, 107(1):261-272.
43. Karni A., Meyer G., Rey-Hipolito C., et al. The acquisition of skilled motor performance: fast and slow experience-driven changes in primary motor cortex. Proc Natl Acad Sci U S A 1998, 95(3):861-868.
44. Donovan J., Radosevich D.J. A meta-analytic review of the distribution of practice effect: now you see it, now you don't. J Appl Psychol 1999, 84(5):795-805.
45. Zoog E., Acker C.E., Swiderski D., et al. Do shorter training intervals lead to superior skill acquisition during proficiency-based simulator training?. J Am Coll Surg 2009, 209(3):S109.
46. Issenberg S.B., McGaghie W.C., Petrusa E.R., et al. Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review. Med Teach 2005, 27(1):10-28.
47. Hall K.G., Magill R.A. Variability of practice and contextual interference in motor skill learning. J Mot Behav 1995, 27(4):299-309.
48. Giuffrida C.G., Shea J.B., Fairbrother J.T. Differential transfer benefits of increased practice for constant, blocked, and serial practice schedules. J Mot Behav 2002, 34(4):353-365.
49. Stefanidis D., Korndorffer J.R., Markley S., et al. Closing the gap in operative performance between novices and experts: does harder mean better for laparoscopic simulator training?. J Am Coll Surg 2007, 205(2):307-313.
50. Ali M.R., Mowery Y., Kaplan B., et al. Training the novice in laparoscopy. More challenge is better. Surg Endosc 2002, 16(12):1732-1736.
51. Aggarwal R., Grantcharov T., Moorthy K., et al. A competency-based virtual reality training curriculum for the acquisition of laparoscopic psychomotor skill. Am J Surg 2006, 191(1):128-133.
52. Wulf G., Lee T.D. Contextual interference in movements of the same class: differential effects on program and parameter learning. J Mot Behav 1993, 25(4):254-263.
53. Jarus T., Wughalter E.H., Gianutsos J.G. Effects of contextual interference and conditions of movement task on acquisition, retention, and transfer of motor skills by women. Percept Mot Skills 1997, 84(1):179-193.
54. Proteau L., Blandin Y., Alain C., et al. The effects of the amount and variability of practice on the learning of a multi-segmented motor task. Acta Psychol (Amst) 1994, 85(1):61-74.
55. Bortoli L., Robazza C., Durigon V., et al. Effects of contextual interference on learning technical sports skills. Percept Mot Skills 1992, 75(2):555-562.
56. Kurahashi A., Leming K., Carnahan H., et al. Effects of expertise, practice and contextual interference on adaptations to visuo-motor misalignment. Stud Health Technol Inform 2008, 132:225-229.
57. Brady F. Contextual interference: a meta-analytic study. Percept Mot Skills 2004, 99(1):116-126.
58. Korndorffer J.R., Dunne J.B., Sierra R., et al. Simulator training for laparoscopic suturing using performance goals translates to the operating room. J Am Coll Surg 2005, 201(1):23-29.
59. Ahlberg G., Enochsson L., Gallagher A.G., et al. Proficiency-based virtual reality training significantly reduces the error rate for residents during their first 10 laparoscopic cholecystectomies. Am J Surg 2007, 193(6):797-804.
60. Seymour N.E., Gallagher A.G., Roman S.A., et al. Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Ann Surg 2002, 236(4):458-463. [discussion: 463-4].
61. Stefanidis D., Acker C., Heniford B.T. Proficiency-based laparoscopic simulator training leads to improved operating room skill that is resistant to decay. Surg Innov 2008, 15(1):69-73.
62. Walters K.C., Acker C.E., Heniford B.T., et al. Performance goals on simulators boost resident motivation and skills lab attendance. J Am Coll Surg 2008, 207(3):S88.
63. Stefanidis D., Heniford B.T. The formula for a successful laparoscopic skills curriculum. Arch Surg 2009, 144(1):77-82. [discussion: 82].
64. Madan A.K., Harper J.L., Taddeucci R.J., et al. Goal-directed laparoscopic training leads to better laparoscopic skill acquisition. Surgery 2008, 144(2):345-350.
65. Brydges R., Carnahan H., Safir O., et al. How effective is self-guided learning of clinical technical skills? It's all about process. Med Educ 2009, 43(6):507-515.
66. Ericsson K.A. Deliberate practice and acquisition of expert performance: a general overview. Acad Emerg Med 2008, 15(11):988-994.
67. Stefanidis D., Scerbo M.W., Korndorffer J.R., et al. Redefining simulator proficiency using automaticity theory. Am J Surg 2007, 193(4):502-506.
68. O'Donnell R.D., Eggemeier F.T. Workload assessment methodology. Cognitive processes and performance 1986, vol. 2:1-49. Wiley, New York. K.R. Boff, L. Kaufman, J.P. Thomas (Eds.).
69. Vassiliou M.C., Feldman L.S., Andrew C.G., et al. A global assessment tool for evaluation of intraoperative laparoscopic skills. Am J Surg 2005, 190(1):107-113.
70. Martin J.A., Regehr G., Reznick R., et al. Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg 1997, 84(2):273-278.
71. Regehr G., MacRae H., Reznick R.K., et al. Comparing the psychometric properties of checklists and global rating scales for assessing performance on an OSCE-format examination. Acad Med 1998, 73(9):993-997.
72. Hodges B., Regehr G., McNaughton N., et al. OSCE checklists do not capture increasing levels of expertise. Acad Med 1999, 74(10):1129-1134.
73. Shiffrin R.M., Schneider W. Controlled and automatic human information processing: II. Perceptual learning, automatic attending, and a general theory. Psychol Rev 1977, 84:127-190.
74. Logan G.D. Automaticity, resources, and memory: theoretical controversies and practical implications. Hum Factors 1988, 30(5):583-598.
75. Floyer-Lea A., Matthews P.M. Changing brain networks for visuomotor control with increased movement automaticity. J Neurophysiol 2004, 92(4):2405-2412.
76. Wickens C.D., Hollands J.G. Engineering psychology and human performance 2000, Prentice Hall, Upper Saddle River (NJ). 3rd edition.
77. Schmidt R.A., Lee T.D. Motor control and learning: a behavioral emphasis 2005, Human Kinetics Publishers, Champain (IL).
78. Stefanidis D., Haluck R., Pham T., et al. Construct and face validity and task workload for laparoscopic camera navigation: virtual reality versus video trainer systems at the SAGES Learning Center. Surg Endosc 2007, 21(7):1158-1164.
79. Weinger M.B., Herndon O.W., Zornow M.H., et al. An objective methodology for task analysis and workload assessment in anesthesia providers. Anesthesiology 1994, 80(1):77-92.
80. Berguer R., Smith W.D., Chung Y.H. Performing laparoscopic surgery is significantly more stressful for the surgeon than open surgery. Surg Endosc 2001, 15(10):1204-1207.
81. Munch-Petersen H.R., Rosenberg J. Ugeskr Laeger 2008, 170(8):624-629. [in Danish].
82. Schuetz M., Gockel I., Beardi J., et al. Three different types of surgeon-specific stress reactions identified by laparoscopic simulation in a virtual scenario. Surg Endosc 2008, 22(5):1263-1267.
83. Young G., Zavelina L., Hooper V. Assessment of workload using NASA Task Load Index in perianesthesia nursing. J Perianesth Nurs 2008, 23(2):102-110.
84. Hart S.G., Staveland L.E. Development of NASA-TLX (task load index): Results of empirical and theoretical research. Human mental workload 1988, 139-183. Elsevier, Amsterdam (The Netherlands). P.A. Hancock, N. Meshkati (Eds.).
85. Weinger M.B., Vredenburgh A.G., Schumann C.M., et al. Quantitative description of the workload associated with airway management procedures. J Clin Anesth 2000, 12(4):273-282.
86. Stefanidis D., Wang F., Korndorffer J.R., et al. Robotic assistance improves intracorporeal suturing performance and safety in the operating room while decreasing operator workload. Surg Endosc 2010, 24(2):377-382.
87. Roscoe A.H. Assessing pilot workload. Why measure heart rate, HRV and respiration?. Biol Psychol 1992, 34(2-3):259-287.
88. Veltman J.A., Gaillard A.W. Physiological workload reactions to increasing levels of task difficulty. Ergonomics 1998, 41(5):656-669.
89. Jorna P.G. Heart rate and workload variations in actual and simulated flight. Ergonomics 1993, 36(9):1043-1054.
90. Mongin C., Dufour F., Lattanzio F., et al. J Chir (Paris) 2008, 145(2):138-142. [in French].
91. Bohm B., Rotting N., Schwenk W., et al. A prospective randomized trial on heart rate variability of the surgical team during laparoscopic and conventional sigmoid resection. Arch Surg 2001, 136(3):305-310.
92. Prabhu A., Smith W., Yurko Y.Y., et al. Increased stress levels may explain the incomplete transfer of simulator-acquired skill to the operating room. Surgery 2010, [Epub ahead of print].