Empirical validation of the Operative Entrustability Assessment using resident performance in autologous breast reconstruction and hand surgery

American Journal of Surgery

Volumn 213, Issue 2, 2017, Pages 227-232

  Bello, Ricardo J ^a   Major, Melanie R ^a   Cooney, Damon S ^a   Rosson, Gedge D ^a   Lifchez, Scott D ^a   Cooney, Carisa M ^a  

^a JOHNS HOPKINS UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

Education technology; Graduate medical education; Operative skills; Operative time; Resident evaluation; Resident performance

Indexed keywords

ARTICLE; ASSESSMENT OF HUMANS; AUTOLOGOUS BREAST RECONSTRUCTION; BREAST RECONSTRUCTION; CONSTRUCT VALIDITY; HAND SURGERY; HUMAN; OPERATION DURATION; OPERATIVE ENTRUSTABILITY ASSESSMENT; PERFORMANCE; PRIORITY JOURNAL; RESIDENT; RETROSPECTIVE STUDY; SCORING SYSTEM; CLINICAL COMPETENCE; EDUCATION; FEEDBACK SYSTEM; FEMALE; HAND; MALE; MARYLAND; MEDICAL EDUCATION; MIDDLE AGED; PLASTIC SURGERY; PROCEDURES; SURGERY; VALIDATION STUDY;

CLINICAL COMPETENCE; EDUCATION, MEDICAL, GRADUATE; EDUCATIONAL MEASUREMENT; FEEDBACK; FEMALE; HAND; HUMANS; INTERNSHIP AND RESIDENCY; MALE; MAMMAPLASTY; MARYLAND; MIDDLE AGED; OPERATIVE TIME; RETROSPECTIVE STUDIES; SURGERY, PLASTIC;

EID: 85006052112     PISSN: 00029610     EISSN: 18791883     Source Type: Journal    
DOI: 10.1016/j.amjsurg.2016.09.054     Document Type: Article

References (35)

1. 1 Nasca, T.J., Philibert, I., Brigham, T., Flynn, T.C., The next GME accreditation system–rationale and benefits. N Engl J Med 366:11 (2012 Mar 15), 1051–1056.
2. 2 Albo, D. Jr., Taylor, C.W., Page, B., Chang, F.C., Moody, F.G., Multifactor evaluations of surgical trainees and teaching services. Surgery 80:1 (1976 Jul), 115–121.
3. 3 Trehan, A., Barnett-Vanes, A., Carty, M.J., McCulloch, P., Maruthappu, M., The impact of feedback of intraoperative technical performance in surgery: a systematic review. BMJ Open, 5(6), 2015 Jun 15, e006759.
4. 4 Clifton, M.S., Wulkan, M.L., Innovation in pediatric surgical education. Semin Pediatr Surg 24:3 (2015 Jun), 122–123.
5. 5 Pellegrini, V.D. Jr., Ferguson, P.C., Cruess, R., Cruess, S., Briggs, T.W., Sufficient competence to enter the unsupervised practice of orthopaedics: what is it, when does it occur, and do we know it when we see It? AOA critical issues. J Bone Jt Surg Am 97:17 (2015 Sep 2), 1459–1464.
6. 6 Bancroft, G.N., Basu, C.B., Leong, M., Mateo, C., Hollier, L.H. Jr., Stal, S., Outcome-based residency education: teaching and evaluating the core competencies in plastic surgery. Plast Reconstr Surg 121:6 (2008 Jun), 441e–448e.
7. 7 Cooney, C.M., Cooney, D.S., Bello, R.J., Bojovic, B., Redett, R.J., Lifchez, S.D., Comprehensive observations of resident evolution: a novel method for assessing procedure-based residency training. Plast Reconstr Surg 137:2 (2016 Feb), 673–678.
8. 8 Birkmeyer, J.D., Finks, J.F., O'Reilly, A., et al. Michigan Bariatric Surgery Collaborative. Surgical skill and complication rates after bariatric surgery. N Engl J Med 369:15 (2013 Oct 10), 1434–1442.
9. 9 D'Angelo, A.L., Rutherford, D.N., Ray, R.D., et al. Idle time: an underdeveloped performance metric for assessing surgical skill. Am J Surg 209:4 (2015 Apr), 645–651.
10. 10 Campbell, D.A. Jr., Henderson, W.G., Englesbe, M.J., et al. Surgical site infection prevention: the importance of operative duration and blood transfusion–results of the first american college of surgeons-national surgical quality improvement program best practices initiative. J Am Coll Surg 207:6 (2008 Dec), 810–820.
11. 11 Cooney, C.M., Redett, R.J., Dorafshar, A.H., Zarrabi, B., Lifchez, S.D., Integrating the NAS milestones and hand-held technology to improve residency training and assessment. J Surg Educ 71:1 (2014 Jan-Feb), 39–42.
12. 12 Williams, R.G., Verhulst, S., Mellinger, J.D., Dunnington, G.L., Is a single-item operative performance rating sufficient?. J Surg Educ 72:6 (2015 Nov-Dec), e212–e217.
13. 13 Rekman, J., Gofton, W., Dudek, N., Gofton, T., Hamstra, S.J., Entrustability scales: outlining their usefulness for competency-based clinical assessment. Acad Med 91:2 (2016 Feb), 186–190.
14. 14 Reynolds, K., Barnhill, D., Sias, J., Young, A., Polite, F.G., Use of the QR reader to provide real-time evaluation of residents’ skills following surgical procedures. J Grad Med Educ 6:4 (2014 Dec), 738–741.
15. 15 Winckel, C.P., Reznick, R.K., Cohen, R., Taylor, B., Reliability and construct validity of a structured technical skills assessment form. Am J Surg 167:4 (1994 Apr), 423–427.
16. 16 Reznick, R.K., MacRae, H., Teaching surgical skills–changes in the wind. N Engl J Med 355:25 (2006 Dec 21), 2664–2669.
17. 17 McGoldrick, R.B., Davis, C.R., Paro, J., Hui, K., Nguyen, D., Lee, G.K., Motion analysis for microsurgical training: objective measures of dexterity, economy of movement, and ability. Plast Reconstr Surg 136:2 (2015 Aug), 231e–240e.
18. 18 Berger, A.J., Gaster, R.S., Lee, G.K., Development of an affordable system for personalized video-documented surgical skill analysis for surgical residency training. Ann Plast Surg 70:4 (2013 Apr 1), 442–446.
19. 19 Taylor, N.W., Webb, K., Neumeister, M.W., Bueno, R.A. Jr., Assessment of resident microsurgical skill using an online video system. Plast Reconstr Surg, 133(1), 2014 Jan 78e-9e.
20. 20 Day, R.W., Fleming, J., Katz, M.H., et al. Rapid assessment of technical competency: the 8-min suture test. J Surg Res 200:1 (2016 Jan), 46–52.
21. 21 Al-Bustani, S., Halvorson, E.G., Status of microsurgical simulation training in plastic surgery: a survey of United States program directors. Ann Plast Surg 76:6 (2016 Jun), 713–716.
22. 22 Grossman, L.B., Komatsu, D.E., Badalamente, M.A., Braunstein, A.M., Hurst, L.C., Microsurgical simulation exercise for surgical training. J Surg Educ 73:1 (2016 Jan-Feb), 116–120.
23. 23 Anaya-Prado, R., Ortega, L.H., Ramírez, M.E., et al. Evaluación objetiva de habilidades quirúrgicas. Modelo mexicano. Rev Latinoam Cir 1 (2011), 27–33.
24. 24 Hadley, C., Lam, S.K., Briceño, V., Luerssen, T.G., Jea, A., Use of a formal assessment instrument for evaluation of resident operative skills in pediatric neurosurgery. J Neurosurg Pediatr, 2015 Aug 28, 1–8 [Epub ahead of print].
25. 25 Wagner, J.P., Chen, D.C., Donahue, T.R., et al. Assessment of resident operative performance using a real-time mobile Web system: preparing for the milestone age. J Surg Educ 71:6 (2014 Nov-Dec), e41–e46.
26. 26 Gofton, W.T., Dudek, N.L., Wood, T.J., Balaa, F., Hamstra, S.J., The Ottawa surgical competency operating room evaluation (O-SCORE): a tool to assess surgical competence. Acad Med 87:10 (2012 Oct), 1401–1407.
27. 27 MacEwan, M.J., Dudek, N.L., Wood, T.J., Gofton, W.T., Continued validation of the O-SCORE (Ottawa surgical competency operating room evaluation): use in the simulated environment. Teach Learn Med 28:1 (2016 Jan-Mar), 72–79.
28. 28 Sehli, D.N., Esene, I.N., Baeesa, S.S., A proposed Resident's operative case tracking and evaluation system. World Neurosurg 87 (2016 Mar), 548–556.
29. 29 Vassiliou, M.C., Feldman, L.S., Andrew, C.G., et al. A global assessment tool for evaluation of intraoperative laparoscopic skills. Am J Surg 190:1 (2005 Jul), 107–113.
30. 30 Middleton, R.M., Baldwin, M.J., Akhtar, K., Alvand, A., Rees, J.L., Which global rating Scale? A comparison of the ASSET, BAKSSS, and IGARS for the assessment of simulated arthroscopic skills. J Bone Jt Surg Am 98:1 (2016 Jan 6), 75–81.
31. 31 Lau BD, Arnaoutakis GJ, Streiff MB, et al. Individualized performance feedback to surgical residents improves appropriate venous thromboembolism prophylaxis prescription and reduces potentially preventable VTE: a prospective cohort study. Ann Surg. Advance online publication. doi:10.1097/SLA.0000000000001512.
32. 32 Dedy, N.J., Fecso, A.B., Szasz, P., Bonrath, E.M., Grantcharov, T.P., Implementation of an effective strategy for teaching nontechnical skills in the operating room: a single-blinded nonrandomized trial. Ann Surg 263:5 (2016 May), 937–941.
33. 33 Francis, D.O., Eavey, R.D., Wright, H.V., Sinard, R.J., Incorporating postoperative debriefing into surgical education. J Surg Educ 73:3 (2016 May-Jun), 448–452.
34. 34 Jensen, A.R., Wright, A.S., Kim, S., Horvath, K.D., Calhoun, K.E., Educational feedback in the operating room: a gap between resident and faculty perceptions. Am J Surg 204:2 (2012 Aug), 248–255.
35. 35 Min, H., Morales, D.R., Orgill, D., Smink, D.S., Yule, S., Systematic review of coaching to enhance surgeons’ operative performance. Surgery 158:5 (2015 Nov), 1168–1191.