A controlled study to determine measurement conditions necessary for a reliable and valid operative performance assessment: A controlled prospective observational study

Annals of Surgery

Volumn 256, Issue 1, 2012, Pages 177-187

  Williams, Reed G ^a   Sanfey, Hilary ^a   Chen, Xiaodong Phoenix ^a   Dunnington, Gary L ^a  

^a SOUTHERN ILLINOIS UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CLINICAL ASSESSMENT; CLINICAL EVALUATION; HUMAN; INTERRATER RELIABILITY; LAPAROSCOPIC SURGERY; MEASUREMENT; OPERATIVE PERFORMANCE RATING; PERFORMANCE MEASUREMENT SYSTEM; POSTGRADUATE EDUCATION; PRIORITY JOURNAL; RATING SCALE; RELIABILITY; RESIDENCY EDUCATION; SURGEON; SURGICAL TRAINING; VALIDITY;

CHOLECYSTECTOMY, LAPAROSCOPIC; CLINICAL COMPETENCE; COMPETENCY-BASED EDUCATION; EDUCATIONAL MEASUREMENT; GENERAL SURGERY; HUMANS; INTERNSHIP AND RESIDENCY; PROSPECTIVE STUDIES; PSYCHOMETRICS; REPRODUCIBILITY OF RESULTS; SURGICAL PROCEDURES, OPERATIVE; TASK PERFORMANCE AND ANALYSIS;

EID: 84863321531     PISSN: 00034932     EISSN: 15281140     Source Type: Journal    
DOI: 10.1097/SLA.0b013e31825b6de4     Document Type: Article

References (11)

1. Larson JL, Williams RG, Ketchum J, et al. Feasibility, reliability and validity of an operative performance rating system for evaluating surgical residents. Surgery. 2005;138:640-649.
2. KimMJ,Williams RG, Boehler ML, et al. Refining the evaluation of operating room performance. J Surg Educ. 2009;66:352-356.
3. Ritchie WP, Jr, Rhodes RS, Biester TW. Work loads and practice patterns of general surgeons in the United States, 1995-1997: a report from the American Board of Surgery. Ann Surg. 1999;230:533-542; discussion 542-543.
4. Bell RH, Jr, Biester TW, Tabuenca A, et al. Operative experience of residents in US general surgery programs: a gap between expectation and experience. Ann Surg. 2009;249:719-724.
5. Martin JA, Regehr G, Reznick R, et al. Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg. 1997;84:273-278.
6. Williams RG, Dunnington GL, Klamen DL. Forecasting residents' performance-partly cloudy. Acad Med. 2005;80:415-422.
7. Norcini JJ. Setting standards on educational tests. Med Educ. 2003;37:464-469.
8. Glass G, Hopkins K. Statistical Methods in Education and Psychology. 2nd ed. Englewood Cliffs, NJ: Prentice-Hall; 1970.
9. Schmidt FL, Hunter JE. Interrater reliability coefficients cannot be computed when only one stimulus is rated. J Appl Psychol. 1989;74:368-370.
10. Williams RG, Klamen DA, McGaghie WC. Cognitive, social and environmental sources of bias in clinical competence ratings. Teach Learn Med. 2003;15:270-292.
11. Harris MM, Smith DE, Champagne D. A field study of performance appraisal purpose: research versus administrative-based ratings. Personnel Psychology 1995;48:151-160.