A method for identifying extreme OSCE examiners

Clinical Teacher

Volumn 10, Issue 1, 2013, Pages 27-31

  Bartman, Ilona ^a   Smee, Sydney ^a   Roy, Marguerite ^a  

^a Medical Council of Canada   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CLINICAL COMPETENCE; EDUCATION; HUMAN; MEDICAL EDUCATION; OBSERVER VARIATION; STANDARD;

CLINICAL COMPETENCE; EDUCATION, MEDICAL; EDUCATIONAL MEASUREMENT; HUMANS; OBSERVER VARIATION;

EID: 84872144990     PISSN: 17434971     EISSN: 1743498X     Source Type: Journal    
DOI: 10.1111/j.1743-498X.2012.00607.x     Document Type: Article

References (13)

1. Downing SM. Threats to the validity of clinical teaching assessments: What about rater error? Medical Education 2005;39:350-355.
2. Raymond MR, Viswesvaran C. Least squares models to correct for rater effects in performance assessment. Journal of Educational Measurement 1993;30:253-268.
3. Harasym PH, Woloschuck W, Cunning L. Undesired variance due to rater stringency/leniency effect in communication skill scores assessed in OSCEs. Advances in Health Sciences Education 2008;13:617-632.
4. McManus IC, Thompson M, Mollon J. Assessment of examiner leniency and stringency ('hawk-dove effect') in the MRCP(UK) clinical examination (PACES): using multi-facet Rasch modeling. BMC Medical Education. 2006;6:42. DOI: 10.1186/1472-6920-6-42.
5. Boulet JR, Mckinley DW, Whelan GP, Hambleton RK. Quality Assurance Methods for Performance-Based Assessment. Advances in Health Sciences Education 2003;8:27-47.
6. Roberts C, Rothnie I, Zoanetti N, Crossley J. Should candidate scores be adjusted for interviewer stringency or leniency in the multiple mini-interview? Med Educ 2010;44:690-698.
7. Bernardin HJ, Buckley MR. Strategies in rater training. Academy of Management 1981;6:205-222.
8. Iramaneerat C, Yudkowsky R. Rater errors in a clinical skills assessment of medical students. Evaluation of Health Professionals 2007;30:266-283.
9. Ivancevich JM. Longitudinal study of the effects of rater training on psychometric error in ratings. Journal of AppliedPsychology 1979;64:502-508.
10. Muzzin LJ, Hart L. Oral examinations. In: Neufeld VR, Norman GR (eds), Assessing Clinical Competence. New York: Springer; 1985, pp. 71-93.
11. Humphris GM, Kaney S. Examiner fatigue in communication skills of objective structured clinical examinations. Med Educ 2001;35:444-449.
12. Kingsbury FA. Analyzing ratings and training raters. Journal of Personnel Research 1922;1:377-388.
13. Harik P, Clauser B, Grabovsky I, Nungester R, Swanson D, Nandakumar R. An Examination of Rater Drift Within a Generalizability Theory Framework. Journal of Educational Measurement 2009;46:43-58.