Recognizing residents with a deficiency in operative performance as a step closer to effective remediation

Journal of the American College of Surgeons

Volumn 216, Issue 1, 2013, Pages 114-122

  Sanfey, Hilary ^a   Williams, Reed ^a   Dunnington, Gary ^b  

^a SOUTHERN ILLINOIS UNIVERSITY SCHOOL OF MEDICINE   (United States)

^b INDIANA UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

ABS; American Board of Surgery; Cognitive Task Analysis; CTA; deficiencies in operative performance; DOP; operative performance rating system; OPRS; SIU; Southern Illinois University

Indexed keywords

HUMAN; JOB PERFORMANCE; LAPAROSCOPY; MALPRACTICE; MEDICAL PRACTICE; PATIENT SAFETY; POSTOPERATIVE COMPLICATION; PRIORITY JOURNAL; RESIDENCY EDUCATION; REVIEW; SURGICAL ERROR; SURGICAL TECHNIQUE; SURGICAL TRAINING;

CLINICAL COMPETENCE; CURRICULUM; GENERAL SURGERY; HUMANS; INTERNSHIP AND RESIDENCY; MEDICAL ERRORS; PATIENT SAFETY; REMEDIAL TEACHING; TASK PERFORMANCE AND ANALYSIS; UNITED STATES;

EID: 84871191767     PISSN: 10727515     EISSN: 18791190     Source Type: Journal    
DOI: 10.1016/j.jamcollsurg.2012.09.008     Document Type: Review

References (90)

1. W.S. Halsted The training of the surgeon Bull Johns Hopkins Hosp 15 1904 267
2. American Board of Surgery. General surgery resident assessments. Available at: http://www.absurgery.org/default.jsp?certgsqe-resassess. Accessed September 12, 2012.
3. G. Ahlberg, L. Enochsson, and A.G. Gallagher Proficiency-based virtual reality training significantly reduces the error rate for residents during their first 10 laparoscopic cholecystectomies Am J Surg 193 2007 797 804
4. R. Brydges, A. Kurahashi, and V. Brümmer Developing criteria for proficiency-based training of surgical technical skills using simulation: changes in performances as a function of training year J Am Coll Surg 206 2008 205 211R.S
5. T. Grantcharov, and R.K. Reznick Training tomorrow's surgeons: what are we looking for and how can we achieve it? ANZ J Surg 9 2009 104 107
6. D. Stefanidis, C. Acker, and B.T. Heniford Proficiency-based laparoscopic simulator training leads to improved operating room skill that is resistant to decay Surg Innov 15 2008 69 73
7. H. Yeo, E. Bucholz, and J. Ann Sosa A national study of attrition in general surgery training: which residents leave and where do they go? Ann Surg 252 2010 529 536
8. H. Sanfey, and G.L. Dunnington Basic surgical skills testing for junior residents: current views of a general surgery program director cohort J Am Coll Surg 212 2011 406 412
9. R.A. Naylor, J.S. Reisch, and J. Valentine Factors related to attrition in surgery residency based on application data Arch Surg 143 2008 647 651
10. R.G. Williams, N.K. Roberts, and C.J. Schwind The nature of general surgery resident performance problems Surgery 145 2009 651 658
11. L.T. Kohn, J.M. Corrigan, and M.S. Donaldson To Err is Human: Building a Safer Health System 1999 National Academy Press Washington, DC
12. P.J. Fabri, and J.L. Zayas-Castro Human error, not communication and systems, underlies surgical complications Surgery 144 2008 557 563
13. A.A. Gawande, M.J. Zinner, and D.M. Studdert Analysis of errors reported by surgeons at three teaching hospitals Surgery 133 2003 614 621
14. S.E. Regenbogen, C.C. Greenberg, and D.M. Studdert Patterns of technical error among surgical malpractice claims: an analysis of strategies to prevent injury to surgical patients Ann Surg 246 2007 705 711
15. C.S. Hwang, C.R. Pagano, and K.A. Wichterman Resident versus no resident: a single institutional study on operative complications, mortality, and cost Surgery 144 2008 339 344
16. E.J. Thomas, E.J. Orav, and T.A. Brennan Hospital ownership and preventable adverse events J Gen Intern Med 15 2000 211 219
17. M. Wilkiemeyer, T.N. Pappas, and A. Giobbie-Hurder Does resident post graduate year influence the outcomes of inguinal hernia repair? Ann Surg 241 2005 879 882
18. J.C. Kairys, K. McGuire, and A. Crawford Cumulative operative experience is decreasing during general surgery residency: a worrisome trend for surgical trainees? J Am Coll Surg 206 2008 804 813
19. R.H. Bell Jr., T.W. Biester, and A.W. Tabuenca Operative experience of residents in US general surgery programs: a gap between expectation and experience Ann Surg 249 2009 719 724
20. B.S. Edeiken Remedial program for diagnostic radiology residents Invest Radiol 28 1993 269 274
21. N.L. Harthun, B.D. Schirmer, and H. Sanfey Remediation of low ABSITE scores Curr Surg 62 2005 539 542
22. K.E. Hauer, A. Ciccone, and T.R. Henzel Remediation of the deficiencies of physicians across the continuum from medical school to practice: a thematic review of the literature Acad Med 84 2009 1822 1832
23. E.D. Katz, R. Dahms, and A.T. Sadosty Guiding principles for resident remediation: recommendations of the CORD Remediation Task Force Acad Emerg Med 17 Suppl 2 2010 S95 S103
24. H. Sanfey, D. DaRosa, and G. Hickson Pursuing professional accountability: an evidence based approach to addressing residents with behavior problems Arch Surg 147 2012 642 647
25. J.S. Wu, B. Siewert, and P.M. Boiselle Resident evaluation and remediation: a comprehensive approach J Grad Med Educ 2010 242 245
26. R.E. Hawkins, and E.S. Holmboe Constructing an evaluation system for an educational program E.S. Holmboe, R.E. Hawkins, Practical Guide to the Evaluation of Clinical Competence 2008 Mosby Elsevier St Louis, MO 216 237
27. X.P. Chen, R.G. Williams, and H.A. Sanfey How do supervising surgeons evaluate guidance provided in the operating room? Am J Surg 203 2012 44 48
28. M. Kim, R. Williams, and M. Boehler Refining the evaluation of operating room performance J Surg Educ 66 2009 352 356
29. J.L. Larson, R.G. Williams, and J. Ketchum Feasibility, reliability and validity of an operative performance rating system for evaluating surgery residents Surgery 138 2005 640 649
30. H. Sanfey, R.G. Williams, and X. Chen Evaluating resident operative performance: a qualitative analysis of expert opinions Surgery 150 2011 759 770
31. R.G. Williams, X. Chen, and H. Sanfey The measured impact of delay in completing operative performance ratings on clarity and detail of ratings assigned Ann Surg 256 2012 177 187
32. R. Williams, H. Sanfey, and G. Dunnington A controlled study to determine measurement conditions necessary for a reliable and valid operative performance assessment: a controlled prospective observational study Ann Surg 256 2012 177 187
33. R.G. Williams, S.J. Verhulst, and J.A. Colliver A template for reliable assessment of resident operative performance: assessment intervals, number of cases and raters Surgery 2012 Aug 27 [Epub ahead of print]
34. R.H. Bell Why Johnny can't operate Surgery 146 2009 533 542
35. M.L. Boehler, D.A. Rogers, and C.J. Schwind A senior elective designed to prepare medical students for surgical residency Am J Surg 187 2004 695 697
36. M.L. Boehler, C.J. Schwind, and D.A. Rogers A theory-based curriculum for enhancing surgical skillfulness J Am Coll Surg 205 2007 492 497
37. D. DaRosa, D.A. Rogers, and R.G. Williams Impact of a structured skills laboratory curriculum on surgery residents' intraoperative decision-making and technical skills Acad Med 83 Suppl 2008 S68 S71
38. V. Datta, S.D. Mackay, and M. Mandalia The use of electromagnetic motion tracking analysis to objectively measure open surgical skill in the laboratory-based model J Am Coll Surg 193 2001 479 485
39. H. Faulkner, G. Regehr, and J. Martin Validation of an objective structured assessment of technical skill for surgical residents Acad Med 71 1996 1363 1365
40. G.M. Fried, L.S. Feldman, and S. Liane Proving the value of simulation in laparoscopic surgery Ann Surg 240 2004 518 525
41. J.A. Martin, G. Regehr, and R. Reznick Objective Structured Assessment of Technical Skill (OSATS) for surgical residents Br J Surg 84 1997 273 278
42. R. Reznick, G. Regehr, and H. MacRae Testing technical skills via an innovative "bench station" examination Am J Surg 173 1997 226 230
43. N. Taffinder, C. Sutton, and R.J. Fishwick Validation of virtual reality to teach and assess psychomotor skills in laparoscopic surgery: results from randomised controlled studies using the MIST VR laparoscopic simulator Stud Health Technol Inform 50 1998 124 130
44. H. Sanfey, J. Ketchum, and J. Bartlett Verification of proficiency in basic skills for PGY1 residents Surgery 148 2010 759 776
45. A.M. Derossis, G.M. Fried, and M. Abrahamowicz Development of a model for training and evaluation of laparoscopic skills Am J Surg 175 1998 482 487
46. American College of Surgeons and Association of Program Directors in Surgery. Surgical Skills Curriculum. American College of Surgeons: Division of Education, 2008. Available at: http://elearning.facs.org/login/index.php. Accessed June 30, 2012.
47. M.C. Vassiliou, L.S. Feldman, and C.G. Andrew A global assessment tool for evaluation of intraoperative laparoscopic skills Am J Surg 190 2005 107 113
48. Southern Illinois University, Department of Surgery. Operative performance evaluation. Available at: http://www.siumed.edu/surgery/surgical- education/op-evaluation.html. Accessed July 12, 2012.
49. Y.Y. Hu, S.E. Peyre, and A.F. Arriaga Postgame analysis: using video-based coaching for continuous professional development J Am Coll Surg 214 2012 115 124
50. C. Moulton, G. Regehr, and L. Lingard Operating from the other side of the table: control dynamics and the surgeon educator J Am Coll Surg 210 2010 79 86
51. J.E. Driskell, C. Copper, and A. Moran Does mental practice enhance performance? J Appl Psychol 79 1994 481 492
52. K.A. Martin, S.E. Moritz, and C.R. Hall Imagery use in sport: a literature review and applied model Sport Psychol 13 1999 245 268
53. C.A. Moulton, G. Regehr, and M. Mylopoulos Slowing down when you should: a new model of expert judgment Acad Med 82 Suppl 2007 S109 S116
54. P. Van Meer, and N.C.M. Theunissen Prospective educational applications of mental simulation: a meta-review Educ Psych Rev 21 2009 93 112
55. R. Weinberg Does imagery work? Effects on performance and mental skills J Imagery Res Sport Phys Activity 3 2008 1 21
56. S. Arora, R. Aggarwal, and N. Sevdalis Development and validation of mental practice as a training strategy for laparoscopic surgery Surg Endosc 24 2010 179 187
57. S. Arora, R. Aggarwal, and Sirimanna Mental practice enhances surgical technical skills: a randomized controlled study Ann Surg 253 2011 265 270
58. M. Immenroth, T. Burger, and J. Brenner Mental training in surgical education: a randomized controlled trial Ann Surg 245 2007 385 391
59. C.W. Sanders, M. Sadoski, and R. Bramson Comparing the effects of physical practice and mental imagery rehearsal on learning basic surgical skills by medical students Am J Obstet Gynecol 191 2004 1811 1814
60. C.W. Sanders, M. Sadoski, and K. van Walsum Learning basic surgical skills with mental imagery: using the simulation centre in the mind Med Educ 42 2008 607 612
61. D.A. Schön The Reflective Practitioner: How Professionals Think in Action 1983 Basic Books New York
62. P. Croskerry A universal model of diagnostic reasoning Acad Med 84 2009 1022 1028
63. R.E. Clark, and F. Estes Cognitive task analysis for training Int J Educ Res 25 1996 403 417
64. D.K. Andersen How can educators use simulation applications to teach and assess surgical judgment? Acad Med 87 2012 934 941
65. E.M. Wohaibi, D.B. Earle, and F.E. Ansanitis A new web-based operative skills assessment tool effectively tracks progression in surgical resident performance J Surg Educ 64 2007 333 341
66. R. Jacklin, N. Sevdalis, and C. Harries Judgment analysis: a method for quantitative evaluation of trainee surgeons' judgments of surgical risk Am J Surg 195 2008 183 188
67. M.B. Marshall, B.M. Wilson, and Y.M. Carter Thoracic surgery skill proficiency with chest wall tumor simulator J Surg Res 174 2012 250 256
68. C.M. Pugh, D.A. DaRosa, and S. Santacatarina Faculty evaluation of simulation-based modules for assessment of intraoperative decision making Surgery 149 2011 534 542
69. C. Pugh, S. Plachta, and E. Auyang Outcome measures for surgical simulators: is the focus on technical skills the best approach? Surgery 147 2010 646 654
70. M.E. Sullivan, C.V.R. Brown, and S.E. Peyre The use of cognitive task analysis to improve the learning of percutaneous tracheostomy placement Am J Surg 193 2007 96 99
71. P. Joice, G.B. Hanna, and A. Cuschieri Errors enacted during endoscopic surgery - a human reliability analysis Appl Ergon 29 1998 409 414
72. B. Tang, G.B. Hanna, and P. Joice Identification and characterization of technical errors by observational clinical human reliability assessment (OCHRA) during laparoscopic cholecystectomy Arch Surg 139 2004 1215 1220
73. Baker DP, Gustafson S, Beaubien JM, et al. Medical team training programs in health care. In: Advances in Patient Safety: from Research to Implementation, AHRQ Publication No. 050021, Volume 4. Rockville, MD: Agency for Healthcare Research and Quality; February 2005:253-267.
74. C.K. Christian, M.L. Gustafson, and E.M. Roth A prospective study of patient safety in the operating room Surgery 139 2006 159 173
75. L. Lingard, R. Reznick, and S. Espin Team communications in the operating room: talk patterns, sites of tension, and implications for novices Acad Med 77 2002 232 237
76. M.A. Makary, J.B. Sexton, and J.A. Freischlag Operating room teamwork among physicians and nurses: teamwork in the eye of the beholder J Am Coll Surg 202 2006 746 752
77. K. Moorthy, Y. Munz, and D. Forrest Surgical crisis management skills training and assessment: a simulation-based approach to enhancing operating room performance Ann Surg 244 2006 139 147
78. J. Capella, S. Smith, and A. Philip Teamwork training improves the clinical care of trauma patients J Surg Educ 67 2010 439 443
79. TeamSTEPPS on the Agency for Healthcare Research and Quality. Available at: http://teamstepps.ahrq.gov/. Accessed July 24, 2012.
80. Sutyak J, Roberts N, Schwind C, et al. SMART Team training improves ad-hoc trauma team dynamics. Presented at the American Association for the Surgery of Trauma Annual Meetings, September 12-15, 2012.
81. N. Sevdalis, R. Davis, and M. Koutantji Reliability of a revised NOTECHS scale for use in surgical teams Am J Surg 196 2008 184 190
82. P.G. Gauger, L.S. Hauge, and P.B. Andreatta Laparoscopic simulation training with proficiency targets improves practice and performance of novice surgeons Am J Surg 199 2010 72 80
83. J.R. Korndorffer, J.B. Dunne, and R. Sierra Simulator training for laparoscopic suturing using performance goals translates to the operating room J Am Coll Surg 201 2005 23 29
84. N.K. Roberts, R.G. Williams, and M. Kim The briefing, intraoperative teaching, debriefing model for teaching in the operating room J Am Coll Surg 208 2009 299 303
85. C.R. Larsen, J.L. Soerensen, and T.P. Grantcharov Effect of virtual reality training on laparoscopic surgery: randomised controlled trial BMJ 338 2009 b1802
86. N.E. Seymour, A.G. Gallagher, and S.A. Roman Virtual reality training improves operating room performance: results of a randomized, double-blinded study Ann Surg 236 2002 458 463
87. R.G. Williams, C.J. Schwind, and G.L. Dunnington The effects of group dynamics on resident progress committee deliberations Teach Learn Med 17 2005 96 100
88. N. Roberts, and R. Williams The hidden costs of failing to fail residents J Grad Med Educ 3 2011 127 129
89. American with Disabilities Act. Available at: http://www.ada.gov/. Accessed July 24, 2012.
90. B.L. Bass, H.C. Polk, and R.S. Jones Surgical privileging and credentialing: a report of a discussion and study group of the American Surgical Association J Am Coll Surg 209 2009 396 404