Continuous, Data-Rich Appraisal of Surgical Trainees' Operative Abilities: A Novel Approach for Measuring Performance and Providing Feedback

Journal of Surgical Education

Volumn 66, Issue 5, 2009, Pages 255-263

  Roach, Paul B ^a   Roggin, Kevin K ^b   Selkov Jr , Gene ^b   Posner, Mitchell C ^b   Silverstein, Jonathan C ^b  

^a NAVAL MEDICAL CENTER PORTSMOUTH   (United States)

^b UNIVERSITY OF CHICAGO   (United States)

Author keywords

(Technical Skill) Patient Care; Clinical competence; educational measurement; Journal of Surgical Education; Medical Knowledge; Practice Based Learning and Improvement; Professionalism; quality

Indexed keywords

ARTICLE; CLINICAL COMPETENCE; COMPUTER GRAPHICS; COMPUTER PROGRAM; CONTROLLED STUDY; HUMAN; INDEPENDENCE; MOTIVATION; PATIENT CARE; PERFORMANCE MEASUREMENT SYSTEM; PRIORITY JOURNAL; QUALITY BASED SURGICAL TRAINING; QUALITY CONTROL; SURGICAL TECHNIQUE; SURGICAL TRAINING; SURGICAL TRAINING AND ASSESSMENT TOOL;

CLINICAL COMPETENCE; EDUCATION, MEDICAL, GRADUATE; EDUCATIONAL MEASUREMENT; FEEDBACK; FEMALE; HUMANS; INTERNSHIP AND RESIDENCY; MALE; MEDICAL RECORDS SYSTEMS, COMPUTERIZED; MEDICAL STAFF, HOSPITAL; QUALITY OF HEALTH CARE; SPECIALTIES, SURGICAL; SURGICAL PROCEDURES, OPERATIVE; TASK PERFORMANCE AND ANALYSIS; UNITED STATES;

EID: 71549131900     PISSN: 19317204     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jsurg.2009.10.001     Document Type: Article

References (38)

1. Debas H.T., Bass B.L., Brennan M.F., et al. American Surgical Association Blue Ribbon Committee Report on Surgical Education: 2004. Ann Surg 241 (2005) 1-8
2. Pellegrini C.A., Warshaw A.L., and Debas H.T. Residency training in surgery in the 21st century: A new paradigm. Surgery 136 (2004) 953-965
3. Bass B.L. Fundamental changes in general surgery residency training. Am Surg 73 (2007) 109-113
4. Thomas W.E. Teaching and assessing surgical competence. Ann R Coll Surg Engl 88 (2006) 429-432
5. Brennan M.F., and Debas H.T. Surgical education in the United States: Portents for change. Ann Surg 240 (2004) 565-572
6. Request for proposal for a comprehensive literature review and analysis of residency training and duty hours experience. http://www.acgme.org/acWebsite/home/acgme_nascaletter_RFP.pdf
7. Mestres C.A., Revuelta J.M., and Yankah A.C. The European Working Time Directive: quo vadis?. A well-planned and organized assassination of surgery. Eur J Cardio Thorac Surg 30 (2006) 571-573
8. Kelly A., and Canter R. A new curriculum for surgical training within the UK: context and model. J Surg Educ 64 (2007) 10-19
9. Canter R., and Kelly A. A new curriculum for surgical training within the UK: the first stages of implementation. J Surg Educ 64 (2007) 20-26
10. Bell R.H. Surgical council on resident education: a new organization devoted to graduate surgical education. J Am Coll Surg 204 (2007) 341-346
11. ACGME. Accreditation Council for Graduate Medical Education (ACGME) General competencies. In: ACGME; September 28, 1999; Chicago, IL; 1999.
12. Delaney P.V., Hennessy T.P., Quill R.D., et al. Assessment of operative surgical skills. Ir Med J 71 (1978) 438-441
13. Sidhu R.S., Grober E.D., Musselman L.J., et al. Assessing competency in surgery: where to begin?. Surgery 135 (2004) 6-20
14. Sachdeva A.K. Invited commentary: educational interventions to address the core competencies in surgery. Surgery 135 (2004) 43-47
15. Aggarwal R., Grantcharov T.P., and Darzi A. Framework for systematic training and assessment of technical skills. J Am Coll Surg 204 (2007) 697-705
16. In: Watts F. (Ed). Assessment of Technical Skills (1985), Springer, New York 259-274
17. Datta V., Bann S., Beard J., et al. Comparison of bench test evaluations of surgical skill with live operating performance assessments. J Am Coll Surg 199 (2004) 603-606
18. Moorthy K., Munz Y., Sarker S.K., et al. Objective assessment of technical skills in surgery. BMJ 327 (2003) 1032-1037
19. NOTSS handbook. http://www.abdn.ac.uk/iprc/notss
20. Yule S., Flin R., Paterson-Brown S., et al. Development of a rating system for surgeons' nontechnical skills. Med Education 40 (2006) 1098-1104
21. Roach P.B., Roggin K.K., Selkov Jr. E., et al. Use of a novel, web-based educational platform facilitates intraoperative training in a surgical oncology fellowship program. Ann Surg Oncol 16 (2009) 1100-1107
22. Cleveland W.S. Robust locally-weighted regression and smoothing scatterplots. Journal of the American Statistical Association 74 (1979) 829-836
23. Kopta J.A. An approach to the evaluation of operative skills. Surgery 70 (1971) 297-303
24. In: Crosby P.B. (Ed). Quality is Free: the art of making quality certain (1979), McGraw-Hill Book Company, New York
25. Martin J.A., Regehr G., Reznick R., et al. Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg 84 (1997) 273-278
26. Vassiliou M.C., Feldman L.S., Andrew C.G., et al. A global assessment tool for evaluation of intraoperative laparoscopic skills. Am J Surg 190 (2005) 107-113
27. Deming W.E. Out of the Crisis (2000), MIT Press, Cambridge, MA
28. Winslow F., and Taylor M.E. Scientific Management (1911), Harper & Row, New York
29. Ishikawa. Guide in Quality Control (1986), Asian Productivity Organization, Japan
30. Juran J. Quality Control Handbook. 3rd ed. (1974), McGraw-Hill, New York
31. Epstein R.M. Assessment in medical education. N Engl J Med 356 (2007) 387-396
32. Reznick R., Regehr G., MacRae H., et al. Testing technical skill via an innovative "bench station" examination. Am J Surg 173 (1997) 226-230
33. Darosa D.A. It takes a faculty. Surgery 131 (2002) 205-209
34. Ward M., MacRae H., Schlachta C., et al. Resident self-assessment of operative performance. Am J Surg 185 (2003) 521-524
35. Newble D.I., and Jaeger K. The effect of assessments and examinations on the learning of medical students. Med Education 17 (1983) 165-171
36. Spencer J.A., and Jordan R.K. Learner centered approaches in medical education. BMJ 318 7193 (1999) 1280-1283
37. ACGME Outcomes Project. http://www.acgme.org/Outcome/
38. Williams R.G. The 10 commandments of performance appraisal provide a foundation for the surgical training process. http://www.facs.org/education/rap/williams.html