Development and verification of a taxonomy of assessment metrics for surgical technical skills

Academic Medicine

Volumn 89, Issue 1, 2014, Pages 153-161

  Schmitz, Connie C ^a   Darosa, Debra ^b   Sullivan, Maura E ^c   Meyerson, Shari ^b   Yoshida, Ken ^a   Korndorffer, James R ^d  

^a UNIVERSITY OF MINNESOTA MEDICAL SCHOOL   (United States)

^b NORTHWESTERN UNIVERSITY   (United States)

^c UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^d TULANE UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84893637114     PISSN: 10402446     EISSN: 1938808X     Source Type: Journal    
DOI: 10.1097/ACM.0000000000000056     Document Type: Article

References (40)

1. Association of American Medical Colleges Task Force on the Clinical Skills Education of Medical Students. Recommendations for Clinical Skills Curricula for Undergraduate Medical Education. https://members.aamc.org/eweb/ upload/Recommendations%20 for%20Clinical%20Skills%20Curricula%20 2005.pdf. Accessed September 24, 2013.
2. Accreditation Council for Graduate Medical Education. Specialty-Specific Duty-Hour Definitions. http://www.acgme.org/acgmeweb/Portals/0/PDFs/DH- Definitions. pdf. Accessed September 23, 2013.
3. American Board of Surgery. General Surgery Resident Assessments: Assessment Requirements. http://www.absurgery.org/default.jsp?certgsqe- resassess. Accessed September 23, 2013.
4. Accreditation Council for Graduate Medical Education and American Board of Emergency Medicine. General Surgery Milestones Project, July 2013. http://www.acgme-nas.org/assets/pdf/Milestones/GeneralSurgeryMilestones.pdf. Accessed September 23, 2013.
5. Reznick R, Regehr G, MacRae H, Martin J, McCulloch W. Testing technical skill via an innovative "bench station" examination. Am J Surg. 1997;173:226-230.
6. Ritchie WP Jr. The measurement of competence. Current plans and future initiatives of the American Board of Surgery. Bull Am Coll Surg. 2001;86:10-15.
7. Satava RM, Cuschieri A, Hamdorf J; Metrics for Objective Assessment of Surgical Skills Workshop. Metrics for objective assessment. Surg Endosc. 2003;17:220-226.
8. Satava RM, Gallagher AG, Pellegrini CA. Surgical competence and surgical proficiency: Definitions, taxonomy, and metrics. J Am Coll Surg. 2003;196:933-937.
9. Satava RM. Disruptive visions: Surgical education. Surg Endosc. 2004;18:779-781.
10. Swing SR. Assessing the ACGME general competencies: General considerations and assessment methods. Acad Emerg Med. 2002;9:1278-1288.
11. Pellegrini CA, Sachdeva AK, Johnson KA. Accreditation of education institutes by the American College of Surgeons: A new program folowing an old tradition. Bull Am Coll Surg. 2006;91:8-12.
12. Simpson MG. Plant systematics: An overview. Ch. 1 In: Plant Systematics. 2nd ed. Academic Press; 2010.
13. van der Vleuten CP, Schuwirth LW. Assessing professional competence: From methods to programmes. Med Educ. 2005;39:309-317.
14. Michelson JD, Manning L. Competency assessment in simulation-based procedural education. Am J Surg. 2008;196:609-615.
15. Sanfey H, Ketchum J, Bartlett J, et al. Verification of proficiency in basic skills for postgraduate year 1 residents. Surgery. 2010;148:759-766.
16. Boehler ML, Schwind CJ, Rogers DA, et al. A theory-based curriculum for enhancing surgical skillfulness. J Am Coll Surg. 2007;205:492-497.
17. Brydges R, Kurahashi A, Brümmer V, Satterthwaite L, Classen R, Dubrowski A. Developing criteria for proficiency-based training of surgical technical skills using simulation: Changes in performances as a function of training year. J Am Coll Surg. 2008;206:205-211.
18. Hodges B, McIlroy JH. Analytic global OSCE ratings are sensitive to level of training. Med Educ. 2003;37:1010-1016.
19. Sanne MB, Boten IH, de Hingh JT, Jakimowicz JJ. Meaningful assessment method for laparoscopic suturing training in augmented reality. Surg Endosc. 2009;23:2221-2228.
20. Hamstra SJ, Dubrowski A, Backstein D. Teaching technical skills to surgical residents: A survey of empirical research. Clin Orthop Relat Res. 2006;449:108-115.
21. Thijssen AS, Schijven MP. Contemporary virtual reality laparoscopy simulators: Quicksand or solid grounds for assessing surgical trainees? Am J Surg. 2010;199:529-541.
22. Moorthy K, Munz Y, Sarker SK, Darzi A. Objective assessment of technical skills in surgery. BMJ. 2003;327:1032-1037.
23. Stefanidis D. Optimal acquisition and assessment of proficiency on simulators in surgery. Surg Clin North Am. 2010;90:475-489.
24. Aggarwal R, Grantcharov TP, Darzi A. Framework for systematic training and assessment of technical skills. J Am Coll Surg. 2007;204:697-705.
25. Fried GM. Lessons from the surgical experience with simulators: Incorporation into training and utilization in determining competency. Gastrointest Endosc Clin N Am. 2006;16:425-434.
26. Shiffin RM, Schneider W. Controlled and automatic human information processing: Perceptual learning, automatic attending, and a general theory. Psychol Rev. 1977;84: 127-190.
27. Datta V, Bann S, Beard J, Mandalia M, Darzi A. Comparison of bench test evaluations of surgical skill with live operating performance assessments. J Am Coll Surg. 2004;199: 603-606.
28. Gallagher AG, Leonard G, Traynor OJ. Role and feasibility of psychomotor and dexterity testing in selection for surgical training. ANZ J Surg. 2009;79:108-113.
29. Goff B, Mandel L, Lentz G, et al. Assessment of resident surgical skills: Is testing feasible? Am J Obstet Gynecol. 2005;192:1331-1338.
30. Guru KA, Kuvshinoff BW, Pavlov-Shapiro S, et al. Impact of robotics and laparoscopy on surgical skills: A comparative study. J Am Coll Surg. 2007;204:96-101.
31. Källström R, Hjertberg H, Svanvik J. Impact of virtual reality-simulated training on urology residents' performance of transurethral resection of the prostate. J Endourol. 2010;24:1521-1528.
32. Knudson MM, Khaw L, Bullard MK, et al. Trauma training in simulation: Translating skills from SIM time to real time. J Trauma. 2008;64:255-263.
33. Okrainec A, Soper NJ, Swanstrom LL, Fried GM. Trends and results of the first 5 years of Fundamentals of Laparoscopic Surgery (FLS) certification testing. Surg Endosc. 2011;25:1192-1198.
34. Parent RJ, Plerhoples TA, Long EE, et al. Early, intermediate, and late effects of a surgical skills "boot camp" on an objective structured assessment of technical skills: A randomized controlled study. J Am Coll Surg. 2010;210:984-989.
35. Aucar JA, Groch NR, Troxel SA, Eubanks SW. A review of surgical simulation with attention to validation methodology. Surg Laparosc Endosc Percutan Tech. 2005;15:82-89.
36. Sutherland LM, Middleton PF, Anthony A, et al. Surgical simulation: A systematic review. Ann Surg. 2006;243:291-300.
37. Sturm LP, Windsor JA, Cosman PH, Cregan P, Hewett PJ, Maddern GJ. A systematic review of skills transfer after surgical simulation training. Ann Surg. 2008;248:166-179.
38. Van Nortwick SS, Lendvay TS, Jensen AR, Wright AS, Horvath KD, Kim S. Methodologies for establishing validity in surgical simulation studies. Surgery. 2010;147:622-630.
39. Bloom BS, Krathwaohl DR. Taxonomy of Educational Objectives, Book I: Cognitive Domain. White Plains, NY: Longman Publishing; 1956.
40. Andreatta PB, Woodrum DT, Gauger PG, Minter RM. LapMentor metrics possess limited construct validity. Simul Healthc. 2008;3:16-25.