Reliability of surgical skills scores in otolaryngology residents: Analysis using generalizability theory

Evaluation and the Health Professions

Volumn 31, Issue 4, 2008, Pages 419-436

  Fernandez, Soledad A ^a   Wiet, Gregory J ^a   Butler, Nancy N ^a   Welling, Bradley ^a   Jarjoura, David ^a  

^a OHIO STATE UNIVERSITY   (United States)

Author keywords

Measurement error variance; Mixed models; Performance measures

Indexed keywords

ARTICLE; CLINICAL COMPETENCE; EAR NOSE THROAT SURGERY; EDUCATION; HUMAN; MEDICAL EDUCATION; METHODOLOGY; OTORHINOLARYNGOLOGY; REPRODUCIBILITY; STANDARD;

CLINICAL COMPETENCE; EDUCATIONAL MEASUREMENT; HUMANS; INTERNSHIP AND RESIDENCY; OTOLARYNGOLOGY; OTORHINOLARYNGOLOGIC SURGICAL PROCEDURES; REPRODUCIBILITY OF RESULTS;

EID: 57049096577     PISSN: 01632787     EISSN: 15523918     Source Type: Journal    
DOI: 10.1177/0163278708324444     Document Type: Article

References (14)

1. Brennan, R.L. (2000 a). Performance assessments from the perspective of generalizability theory. Applied Psychological Measurement, 24, 339-353.
2. Brennan, R.L. (2000 b). Generalizability theory. New York: Springer.
3. Butler, N.N., & Wiet, G.J. (2007, October). Reliability of the Welling Scale (WS1) for rating temporal bone dissection performance. Laryngoscope, 117 (10). 1803-1808.
4. Elstein, A.S., Shulman, L.S., & Sprafka, S.A. (1978). Medical problem solving: An analysis of clinical reasoning. Cambridge, MA: Harvard University Press.
5. Faulkner, H., Regehr, G., Martin, J., & Reznick, R. (1996). Validation of an objective structured assessment of technical skill for surgical residents. Academic Medicine, 71, 1363-1365.
6. Gross, L.J. (1994). Inter-rater reliability reconsidered: Performance assessment using one examiner per candidate. Evaluation & the Health Professions, 17, 465-484.
7. Hosmer, D.W., & Lemeshow, S. (2000). Applied logistic regression (2 nd ed.). New York: John Wiley.
8. Jarjoura, D., Early, L., & Androulakakis, V. (2004). A multivariate generalizability model for clinical skills assessments. Educational and Psychological Measurement, 64 (1). 22-39.
9. Linn, R., & Burton, E. (1994). Performance-based assessments: Implications of task specificity. Educational Measurement: Issues and Practice, 13, 5-8.
10. Martin, J.A., Regehr, G., Reznick, R., MacRae, H., Murnaghan, J., Hutchison, C., et al. (1997). Objective structured assessment of technical skill (OSATS) for surgical residents. British Journal of Surgery, 84 (2). 273-278.
11. SAS Institute Inc. (2008). SAS, version 9.1. Cary, NC: Author.
12. Shah, J., & Darzi, A. (2001). Surgical skills assessment: An ongoing debate. BJU International, 88, 655-660.
13. Wiet, G.J., Stredney, D., Sessana, D., Bryan, J., Welling, D.B., & Schmalbrock, P. (2002). Virtual temporal bone dissection: An interactive surgical simulator. Otolaryngology-Head and Neck Surgery, 127, 79-83.
14. Zirkle, M., Taplin, M.A., Anthony, R., & Dubrowski, A. (2007). Objective assessment of temporal bone drilling skills. Annals of Otology, Rhinology and Laryngology, 116 (11). 793-798.