Reliability of a procedural checklist as a high-stakes measurement of advanced technical skill

American Journal of Surgery

Volumn 199, Issue 1, 2010, Pages 110-114

  Peyré, Sarah E ^a   Peyré, Christian G ^a   Hagen, Jeffrey A ^b   Sullivan, Maura E ^b  

^a BRIGHAM AND WOMEN S HOSPITAL   (United States)

^b UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

Assessment; Procedural checklist; Reliability; Technical skill

Indexed keywords

ACCURACY; ARTICLE; CONTROLLED STUDY; HUMAN; LAPAROSCOPY; PRIORITY JOURNAL; STOMACH FUNDOPLICATION; SURGEON; SURGICAL TRAINING; VIDEORECORDER; LAPAROSCOPIC SURGERY; RELIABILITY; SKILL; SURGICAL TECHNIQUE; VIDEORECORDING;

CHECKLIST; CLINICAL COMPETENCE; FEMALE; FUNDOPLICATION; HUMANS; LAPAROSCOPY; MALE; PHYSICIAN'S PRACTICE PATTERNS; QUALITY CONTROL; REPRODUCIBILITY OF RESULTS; TASK PERFORMANCE AND ANALYSIS; VIDEOTAPE RECORDING;

EID: 72049083456     PISSN: 00029610     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.amjsurg.2009.10.003     Document Type: Article

References (17)

1. Bhatti N.I., and Cummings C.W. Viewpoint: competency in surgical residency training: defining and raising the Bar. Acad Med 82 (2007) 569-573
2. Gallagher A.G., Ritter E.M., and Satava R.M. Fundamental principles of validation, and reliability: rigorous science for the assessment of surgical education and training. Surg Endosc 17 (2003) 1525-1529
3. Salkind N. Tests and Measurement for People Who (Think They) Hate Tests and Measurement (2006), Sage Publications, Thousand Oaks, CA
4. APA/AREA/NCME. Standards for Educational and Psychological Testing (1999), APA, Washington, DC
5. Downing S.M. Reliability: on the reproducibility of assessment data. Med Educ 38 (2004) 1006-1012
6. Peyre S., Peyre C., Hagen J., et al. Laparoscopic Nissen fundoplication assessment: task analysis as a model for the development of a procedural checklist. Surg Endosc 23 (2009) 1227-1232
7. Fleiss J.L. Measuring nominal scale agreement among many raters. Psychological Bulletin 76 (1971) 378-382
8. Brasel K.J., Bragg D., Simpson D.E., et al. Meeting the Accreditation Council for Graduate Medical Education competencies using established residency training program assessment tools. Am J Surg 188 (2004) 9-12
9. Scott D., Valentine R., Bergen P., et al. Evaluating surgical competency with the American Board of Surgery In-training examination, skill testing, and intraoperative assessment. Surgery 128 (2000) 613-622
10. Tavakol M., Mohagheghi M.A., and Dennick R. Assessing the skills of surgical residents using simulation. J Surg Educ 65 (2008) 77-83
11. Reznick R., Regehr G., MacRae H., et al. Testing technical skill via an innovative "bench station" examination. Am J Surg 173 (1997) 226-230
12. Ault G., Reznick R., MacRae H., et al. Exporting a technical skills evaluation technology to other sites. Am J Surg 182 (2001) 254-256
13. Willems M.C., van der Vliet J.A., Williams V., et al. Assessing endovascular skills using the simulator for testing and rating endovascular skills (STRESS) machine. Eur J Vasc Endovasc Surg 37 (2009) 431-436
14. Bann S., Khan M., Datta V., et al. Surgical skill is predicted by the ability to detect errors. Am J Surg 189 (2005) 412-415
15. Beard J.D., Choksy S., and Khan S. Assessment of operative competence during carotid endarterectomy. Br J Surg 94 (2007) 726-730
16. Larson J.L., Williams R.G., Ketchum J., et al. Feasibility, reliability and validity of an operative performance rating system for evaluating surgery residents. Surgery 138 (2005) 640-649
17. Aggarwal R., Grantcharov T., Moorthy K., et al. Toward feasible, valid, and reliable video-based assessments of technical surgical skills in the operating room. Ann Surg 247 (2008) 372-379