Assessing the surgeons technical skills: Analysis of the available tools

Academic Medicine

Volumn 85, Issue 5, 2010, Pages 869-880

  Memon, Muhammed Ashraf ^a,b,c,d   Brigden, David ^d,e,f   Subramanya, Manjunath S ^g   Memon, Breda ^a  

^a Ipswich General Hospital   (Australia)

^b UNIVERSITY OF QUEENSLAND   (Australia)

^c BOND UNIVERSITY   (Australia)

^d UNIVERSITY OF BOLTON   (United Kingdom)

^e BANGOR UNIVERSITY   (United Kingdom)

^f UNIVERSITY OF LIVERPOOL   (United Kingdom)

^g Mount Isa Base Hospital   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CHECKLIST; CLINICAL COMPETENCE; COMPUTER; COMPUTER SIMULATION; FEEDBACK SYSTEM; GENERAL SURGERY; HUMAN; OBSERVATION; STANDARD; SURGERY;

CHECKLIST; CLINICAL COMPETENCE; COMPUTER SIMULATION; COMPUTERS; FEEDBACK; GENERAL SURGERY; HUMANS; OBSERVATION; SURGICAL PROCEDURES, OPERATIVE;

EID: 77953603229     PISSN: 10402446     EISSN: None     Source Type: Journal    
DOI: 10.1097/ACM.0b013e3181d74bad     Document Type: Article

References (59)

1. Lowenfels AB. Highlights of the Royal College of Surgeons of Edinburgh Quincentenary Congress. Medscape Gen Surg. 2005;7(2).
2. Smith R. All changed, changed utterly. BMJ. 1998;316:1917-1918.
3. Sinclair CM. The Report of the Manitoba Pediatric Cardiac Surgery Inquest: An Inquiry Into Twelve Deaths in the Winnipeg Health Sciences Centre in 1994. Available at: www.pediatriccardiacinquest.mb.ca. Accessed July 18, 2009.
4. Chandler J. The scandal of "Dr. Death." The Age. May 28, 2005. Available at: http://www. theage.com.au/news/General/The-scandal-of- Dr-Death/2005/05/27/1117129900672.html. Accessed July 18, 2009.
5. Darzi A, Smith S, Taffinder N. Assessing operative skill needs to become more objective. BMJ. 1999;318:887-888.
6. Beard JD, Jolly BC, Newble DI, Thomas WE, Donnelly J, Southgate LJ. Assessing the technical skills of surgical trainees. Br J Surg. 2005;92:778-782.
7. Spencer F. Teaching and measuring surgical techniques-The technical evaluation of competence. Bull Am Coll Surg. 1978;63:9-12.
8. Kirkpatrick JJ, Naylor IL. The qualities and conduct of an English surgeon in 1446: As described in a manuscript attributed to Thomas Morstede. Ann R Coll Surg Engl. 1997;79:225-228.
9. Department of Health-UK-. Modernising Medical Careers: The Next Steps: The Future Shape of Foundation, Specialist and General Practice Training Programmes. London, UK: Her Majesty's Stationery Office; 2004.
10. Chikwe J, de Souza AC, Pepper JR. No time to train the surgeons: More and more reforms result in less and less time for training. BMJ. 2004;328:418-419.
11. Moorthy K, Munz Y, Sarker SK, Darzi A. Objective assessment of technical skills in surgery. BMJ. 2003;327:1032-1037.
12. Memon MA, Joughin GR, Memon B. Oral assessment and postgraduate medical examinations: Establishing conditions for validity, reliability and fairness. Adv Health Sci Educ Theory Pract. April 2, 2008.-Epub ahead of print. doi:10.1007/s10459-008-9111-9-
13. Scott DJ, Bergen PC, Rege RV, et al. Laparoscopic training on bench models: Better and more cost effective than operating room experience? J Am Coll Surg. 2000;191: 272-283.
14. Regulations relating to the examinations for the diploma of fellow; Quarterly Council, 1946. In: Minutes of Council 1945-1947. London, UK: Royal College of Surgeons of England; 1947:447-461.
15. Gallagher AG, Satava RM. Virtual reality as a metric for the assessment of laparoscopic psychomotor skills. Surg Endosc. 2002;16: 1746-1752.
16. Regher G, MacRae H, Reznick RK, Szalay D. Comparing the psychomotor properties of checklists and global rating scales for assessing performance on an OSCE-format examination. Acad Med. 1998;73:993-997.
17. Reznick RK. Teaching and testing surgical skills. Am J Surg. 1993;165:358-361.
18. Intercollegiate Surgical Curriculum Programme. The New Intercollegiate Curriculum for Surgical Education. Available at: http://www.iscp.ac.uk. Accessed July 18, 2009.
19. Rowley D, Pitts, D, Galasko C. The Competence Assessment Working Party Report for The Joint Committee on Higher Surgical Training. Edinburgh, UK: JCHST Publications; 2002.
20. Wakeford R. Principles of student assessment. In: Fry H, Ketteridge S, Marshall S. 2nd ed. A Handbook for Teaching & Learning in Higher Education. London, UK: Kogan Page Ltd:42-61.
21. Grantcharov TP, Bardram L, Funch-Jensen P, Rosenberg J. Assessment of technical surgical skills. Eur J Surg. 2002;168:139-144.
22. Quality Assurance Agency for Higher Education. Section 6: Assessment of students. In: Code of Practice for the Assurance of Academic Quality and Standards in Higher Education. Available at: http://www.qaa.ac. uk/academicinfrastructure/codeofpractice/ section6/COP-AOS.pdf. Accessed July 18, 2009.
23. Schuwirth LW, van der Vleuten CP. The use of clinical simulation in assessment. Med Educ. 2003;37(suppl 1):65-71.
24. Szalay D, MacRae H, Regehr G, Reznick R. Using operative outcome to assess technical skill. Am J Surg. 2000;180:234-237.
25. American Educational Research Association; American Psychological Association; National Council on Measurement in Education. Standards for Educational and Psychological Testing. Washington, DC: American Educational Research Association; 1999.
26. Pitts D, Rowley DI, Sher JL. Assessment of performance in orthopaedic training. J Bone Joint Surg. 2005;87:1187-1191.
27. Department of Health-UK-. Hospital Doctors: Training for the Future. The Report of the Working Group on Specialist Medical Training. London, UK: Her Majesty's Stationery Office; 1999.
28. Sher JL, Reed MR, Calvert P, Wallace WA, Lamb A. Influencing the national training agenda. The UK and Ireland Orthopaedic eLogbook. J Bone Joint Surg. 2005;87:1182-1188.
29. Sidbu RS, Grober ED, Musselman LJ, Reznick RK. Assessing competency in surgery: Where to begin? Surgery. 2004;135: 6-20.
30. Miller GE. The assessment of clinical skills/ competence/performance. Acad Med. 1990; 65(9 suppl):S63-S67.
31. Norcini JJ, Blank LL, Arnold GK, Kimball HR. The mini-CEX (clinical evaluation exercise): A preliminary review. Ann Intern Med. 1995;123:795-799.
32. Norcini JJ, Blank LL, Duffy FD, Fortna GS. The mini-CEX: A method for assessing clinical skills. Ann Intern Med. 2003;138: 476-481.
33. Intercollegiate Surgical Curriculum Programme. Guidance for Surgical DOPS. Available at: http://www.iscp.ac.uk/pdf/ assessment/Surgical-DOPS- Guidance.pdf. Accessed July 18, 2009.
34. Mandel L, Lentz G, Goff B. Teaching and evaluating surgical skills. Obstet Gynecol. 2000;95:783-785.
35. Wilkinson J, Benjamin A, Wade W. Assessing the performance of doctors in training. BMJ. 2003;327:s91-s92.
36. Greaves J, Grant J. Watching anaesthetists work: Using the professional judgement of consultants to assess the developing clinical competence of trainees. Br J Anaes. 2000;84: 525-533.
37. Chisholm C, Whenmouth L, Daly E, Cordell W, Giles B, Brizedine E. An evaluation of emergency medicine resident interaction time with faculty in different teaching venues. Acad Emerg Med. 2004;11:149-155.
38. Morris A, Hewitt J, Roberts C. Practical experience of using directly observed procedures, mini clinical evaluation examinations and peer observation in preregistration house officer (FY1) trainees. Postgrad Med J. 2006;82:285-288.
39. Kopta JA. An approach to the evaluation of operative skills. Surgery. 1971;70:297-303.
40. Winckel CP, Reznick RK, Cohen R, Taylor B. Reliability and construct validity of a structured technical skills assessment form. Am J Surg. 1994;167:423-427.
41. Martin JA, Regher G, Reznick R, et al. Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg. 1997;84:272-278.
42. Reznick R, Regehr G, MacRae H, Martin J, McCulloch W. Testing technical skill via an innovative 'bench station' examination. Am J Surg. 1997;172:226-230.
43. Faulkner H, Rehehr G, Martin J, Reznick R. Validation of an objective assessment of technical skill for surgical residents. Acad Med. 1996;71:1363-1365.
44. Darzi A, Datta V, Mackay S. The challenge of objective assessment of surgical skill. Am J Surg. 2001;181:484-486.
45. Ault G, Reznick R, MacRae H, et al. Exporting a technical skills evaluation technology to other sites. Am J Surg. 2001; 182:254-256.
46. Pandey VA, Wolfe HN, Liapis CD, Bergqvist D, on behalf of the European Board of Vascular Surgery. The examination assessment of technical competence in vascular surgery. Br J Surg. 2006;93:1132-1138.
47. Beard JD, Choksy S, Khan S; Vascular Society of Great Britain and Ireland. Assessment of operative competence during carotid endarterectomy. Br J Surg. 2007;94:726-730.
48. Stylopoulos N, Vosburgh KG. Assessing technical skill in surgery and endoscopy: A set of metrics and an algorithm (C-PASS) to assess skills in surgical and endoscopic procedures. Surg Innov. 2007;14:113-121.
49. Datta V, Mackay S, Mandalia M, Darzi A. The use of electromagnetic motion tracking analysis to objectively measure open surgical skill in the laboratory based model. J Am Coll Surg. 2001;193:479-485.
50. Taffinder N, Smith S, Mair J, Russell R, Darzi A. Can a computer measure surgical precision? Reliability, validity and feasibility of the ISCAD. Surg Endosc. 1999;13(suppl 1):81.
51. Francis NK, Hanna GB, Cuschieri A. The performance of master surgeons on the advanced Dundee endoscopic psychomotor tester. Arch Surg. 2002;137:841-844.
52. Joice P, Hanna GB, Cuschieri A. Errors enacted during endoscopic surgery-A human reliability analysis. Appl Ergon. 1998; 29:409-414.
53. Tang B, Hanna GB, Carter F, Adamson GD, Martindale JP, Cuschieri A. Competence assessment of laparoscopic operative and cognitive skills: Objective Structured Clinical Examination (OSCE) or Observational Clinical Human Reliability Assessment (OCHRA). World J Surg. 2006;30:527-534.
54. Vassiliou MC, Feldman LS, Andrew CG, et al. A global assessment tool for evaluation of intraoperative laparoscopic skills. Am J Surg. 2005;190:107-113.
55. Gumbs AA, Hogle NJ, Fowler DL. Evaluation of resident laparoscopic performance using global operative assessment of laparoscopic skills. J Am Coll Surg. 2007;204:308-313.
56. Bhatti NI, Cummings CW. Competency in surgical residency training: Defining and raising the bar. Acad Med. 2007;82:569-573.
57. Harris D. Assessment. In: Peyton JWR, ed. Teaching & Learning in Medical Practice. Heronsgate, UK: Manticore Europe Ltd; 1998:256.
58. Scott DJ, Rege RV, Bergen PC, et al. Measuring operative performance after laparoscopic skills training: Edited videotape versus direct observation. J Laparoendosc Adv Surg Tech A. 2000;10:183-190.
59. Harden RM, Stevenson M, Downie WW, Wilson GM. Assessment of clinical competence using objective structured examination. BMJ. 1975;1:447-451.