Which global rating scale?: A comparison of the ASSET, BAKSSS, and IGARS for the assessment of simulated arthroscopic skills

Journal of Bone and Joint Surgery - American Volume

Volumn 98, Issue 1, 2016, Pages 75-81

  Middleton, Robert M ^a   Baldwin, Mathew J ^b   Akhtar, Kash ^c,d   Alvand, Abtin ^a   Rees, Jonathan L ^a  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b ROYAL BERKSHIRE HOSPITAL   (United Kingdom)

^c QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

^d BARTS HEALTH NHS TRUST   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ARTHROSCOPIC SURGICAL SKILL EVALUATION TOOL; ARTICLE; BASIC ARTHROSCOPIC KNEE SKILL SCORING SYSTEM; CONSTRUCT VALIDITY; CONTROLLED STUDY; HUMAN; HUMAN EXPERIMENT; IMPERIAL GLOBAL ARTHROSCOPY RATING SCALE; INTERMETHOD COMPARISON; INTERRATER RELIABILITY; INTRARATER RELIABILITY; MUSCULOSKELETAL DISEASE ASSESSMENT; NORMAL HUMAN; PRIORITY JOURNAL; SIMULATOR; TASK PERFORMANCE; VIRTUAL REALITY SIMULATOR; ADVERSE EFFECTS; ANATOMIC MODEL; ARTHROSCOPY; CLINICAL COMPETENCE; COMPARATIVE STUDY; COMPUTER INTERFACE; COMPUTER SIMULATION; CURRICULUM; EDUCATION; KNEE; NONPARAMETRIC TEST; OBSERVER VARIATION; ORTHOPEDICS; PATHOLOGY; PROCEDURES; REPRODUCIBILITY; SURGERY; UNIVERSITY HOSPITAL;

ARTHROSCOPY; CLINICAL COMPETENCE; COMPETENCY-BASED EDUCATION; COMPUTER SIMULATION; HOSPITALS, UNIVERSITY; HUMANS; KNEE JOINT; MODELS, ANATOMIC; OBSERVER VARIATION; ORTHOPEDICS; REPRODUCIBILITY OF RESULTS; STATISTICS, NONPARAMETRIC; TASK PERFORMANCE AND ANALYSIS; USER-COMPUTER INTERFACE;

EID: 84973434357     PISSN: 00219355     EISSN: 15351386     Source Type: Journal    
DOI: 10.2106/JBJS.O.00434     Document Type: Article

References (27)

1. Landrigan CP, Rothschild JM, Cronin JW, Kaushal R, Burdick E, Katz JT, Lilly CM, Stone PH, Lockley SW, Bates DW, Czeisler CA. Effect of reducing interns' work hours on serious medical errors in intensive care units. N Engl J Med. 2004 Oct 28;351(18):1838-48.
2. Grantcharov TP, Bardram L, Funch-Jensen P, Rosenberg J. Laparoscopic performance after one night on call in a surgical department: Prospective study. BMJ. 2001 Nov 24;323(7323):1222-3.
3. Philibert I, Friedmann P, Williams WT; ACGME Work Group on Resident Duty Hours. Accreditation Council for Graduate Medical Education. New requirements for resident duty hours. JAMA. 2002 Sep 4;288(9):1112-4.
4. Benes V. The European working time directive and the effects on training of surgical specialists (doctors in training): A position paper of the surgical disciplines of the countries of the EU. Acta Neurochir (Wien). 2006 Nov;148(11):1227-33.
5. The Royal College of Surgeons of England. The implementation of the working time directive, and its impact on the NHS and health professionals. 2014 Mar. https://www.rcseng.ac.uk/policy/documents/wtd-taskforce-report-2014. Accessed 2015 Sep 18.
6. Temple J. Time for training: A review of the impact of the European working time directive on the quality of training. 2010 May. http://hee.nhs.uk/healtheducationengland/files/2012/08/Time-for-training-report.pdf. Accessed 2015 Sep 18.
7. Dennis BM, Long EL, Zamperini KM, Nakayama DK. The effect of the 16-hour intern workday restriction on surgical residents' in-hospital activities. J Surg Educ. 2013 Nov-Dec;70(6):800-5. Epub 2013 Apr 9.
8. Pitts D, Rowley DI, Marx C, Sher L, Banks T, Murray A. Specialist training in trauma and orthopaedics. 2007. https://www.iscp.ac.uk/static/orthocurriculum/content/15350-whole-doc-19.pdf. Accessed 2015 Sep 18.
9. Milburn JA, Khera G, Hornby ST, Malone PS, Fitzgerald JEF. Introduction, availability and role of simulation in surgical education and training: Review of current evidence and recommendations from the Association of Surgeons in Training. Int J Surg. 2012;10(8):393-8. Epub 2012 May 18.
10. Howells NR, Brinsden MD, Gill RS, Carr AJ, Rees JL. Motion analysis: A validated method for showing skill levels in arthroscopy. Arthroscopy. 2008 Mar;24(3):335-42.
11. Martin JA, Regehr G, Reznick R, MacRae H, Murnaghan J, Hutchison C, Brown M. Objective Structured Assessment of Technical Skill (OSATS) for surgical residents. Br J Surg. 1997 Feb;84(2):273-8.
12. Ahmed K, Miskovic D, Darzi A, Athanasiou T, Hanna GB. Observational tools for assessment of procedural skills: A systematic review. Am J Surg. 2011 Oct;202 (4):469-480.e6. Epub 2011 Jul 28.
13. van Hove PD, Tuijthof GJM, Verdaasdonk EGG, Stassen LPS, Dankelman J. Objective assessment of technical surgical skills. Br J Surg. 2010 Jul;97(7):972-87.
14. Memon MA, Brigden D, Subramanya MS, Memon B. Assessing the surgeon's technical skills: Analysis of the available tools. Acad Med. 2010 May;85(5):869-80.
15. Insel A, Carofino B, Leger R, Arciero R, Mazzocca AD. The development of an objective model to assess arthroscopic performance. J Bone Joint Surg Am. 2009 Sep;91(9):2287-95.
16. Regehr G, MacRae H, Reznick RK, Szalay D. Comparing the psychometric properties of checklists and global rating scales for assessing performance on an OSCE-format examination. Acad Med. 1998 Sep;73(9):993-7.
17. Niitsu H, Hirabayashi N, Yoshimitsu M, Mimura T, Taomoto J, Sugiyama Y, Murakami S, Saeki S, Mukaida H, Takiyama W. Using the Objective Structured Assessment of Technical Skills (OSATS) global rating scale to evaluate the skills of surgical trainees in the operating room. Surg Today. 2013 Mar;43(3):271-5. Epub 2012 Sep 1.
18. Alvand A, Logishetty K, Middleton R, Khan T, Jackson WFM, Price AJ, Rees JL. Validating a global rating scale to monitor individual resident learning curves during arthroscopic knee meniscal repair. Arthroscopy. 2013 May;29(5):906-12.
19. Koehler RJ, Amsdell S, Arendt EA, Bisson LJ, Braman JP, Butler A, Cosgarea AJ, Harner CD, Garrett WE, Olson T, Warme WJ, Nicandri GT. The Arthroscopic Surgical Skill Evaluation Tool (ASSET). Am J Sports Med. 2013 Jun;41(6):1229-37. Epub 2013 Apr 2.
20. Olson T, Koehler R, Butler A, Amsdell S, Nicandri G. Is there a valid and reliable assessment of diagnostic knee arthroscopy skill? Clin Orthop Relat Res. 2013 May;471(5):1670-6. Epub 2012 Dec 20.
21. Bayona S, Akhtar K, Gupte C, Emery RJH, Dodds AL, Bello F. Assessing performance in shoulder arthroscopy: The Imperial Global Arthroscopy Rating Scale (IGARS). J Bone Joint Surg Am. 2014 Jul 2;96(13):e112. [Epub ahead of print].
22. Fucentese SF, Rahm S, Wieser K, Spillmann J, Harders M, Koch PP. Evaluation of a virtual-reality-based simulator using passive haptic feedback for knee arthroscopy. Knee Surg Sports Traumatol Arthrosc. 2015 Apr;23(4):1077-85. Epub 2014 Feb 12.
23. Aggarwal R, Grantcharov T, Moorthy K, Milland T, Darzi A. Toward feasible, valid, and reliable video-based assessments of technical surgical skills in the operating room. Ann Surg. 2008 Feb;247(2):372-9.
24. Nasr A, Carrillo B, Gerstle JT, Azzie G. Motion analysis in the pediatric laparoscopic surgery (PLS) simulator: validation and potential use in teaching and assessing surgical skills. J Pediatr Surg. 2014 May;49(5):791-4. Epub 2014 Feb 22.
25. Mason JD, Ansell J, Warren N, Torkington J. Is motion analysis a valid tool for assessing laparoscopic skill? Surg Endosc. 2013 May;27(5):1468-77. Epub 2012 Dec 12.
26. Datta V, Chang A, Mackay S, Darzi A. The relationship between motion analysis and surgical technical assessments. Am J Surg. 2002 Jul;184(1):70-3.
27. Pellen M, Horgan L, Roger Barton J, Attwood S. Laparoscopic surgical skills assessment: can simulators replace experts? World J Surg. 2009 Mar;33(3): 440-7.