Should candidate scores be adjusted for interviewer stringency or leniency in the multiple mini-interview?

Medical Education

Volumn 44, Issue 7, 2010, Pages 690-698

  Roberts, Chris ^a   Rothnie, Imogene ^b   Zoanetti, Nathan ^c   Crossley, Jim ^d  

^a HORNSBY KU RING GAI HOSPITAL   (Australia)

^b UNIVERSITY OF SYDNEY   (Australia)

^c UNIVERSITY OF MELBOURNE   (Australia)

^d UNIVERSITY OF SHEFFIELD   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CLINICAL COMPETENCE; EDUCATION; HUMAN; INTERPERSONAL COMMUNICATION; INTERVIEW; MEDICAL SCHOOL; METHODOLOGY; OBSERVER VARIATION; PSYCHOMETRY; STANDARD;

CLINICAL COMPETENCE; COMMUNICATION; EDUCATIONAL MEASUREMENT; FACULTY, MEDICAL; HUMANS; INTERVIEWS AS TOPIC; OBSERVER VARIATION; PSYCHOMETRICS; SCHOOL ADMISSION CRITERIA;

EID: 77953740032     PISSN: 03080110     EISSN: 13652923     Source Type: Journal    
DOI: 10.1111/j.1365-2923.2010.03689.x     Document Type: Article

References (21)

1. Eva KW, Rosenfeld J, Reiter HI, Norman GR. An admissions OSCE: the multiple mini-interview. Med Educ 2004 38 : 314 326.
2. Harris S, Owen C. Discerning quality: using the multiple mini-interview in student selection for the Australian National University Medical School. Med Educ 2007 41 : 234 241.
3. Lemay J-F, Lockyer JM, Collin VT, Brownell AK. Assessment of non-cognitive traits through the admissions multiple mini-interview. Med Educ 2007 41 : 573 579.
4. Roberts C, Walton M, Rothnie I, Crossley J, Kumar K, Lyon PM, Tiller D. Factors affecting the utility of the multiple mini-interview in selecting candidates for graduate-entry medical school. Med Educ 2008 42 : 396 404.
5. van der Vleuten CPM. The assessment of professional competence: developments, research and practical implications. Adv Health Sci Educ 1996 1 : 41 67.
6. Crossley J, Russell J, Jolly BC, Ricketts C, Roberts C, Schuwirth L, Norcini J. 'I'm pickin' up good regressions': the governance of generalisability analyses. Med Educ 2007 41 : 926 934.
7. Reiter HI, Eva KW, Rosenfeld J, Norman GR. Multiple mini-interviews predict clerkship and licensing examination performance. Med Educ 2007 41 : 378 384.
8. Eva KW, Reiter H, Rosenfeld J, Norman GR. The relationship between interviewers' characteristics and ratings assigned during a multiple mini-interview. Acad Med 2004 79 : 602 609.
9. Kumar K, Roberts C, Walton M, Rothnie I, du Fresne C. Experiences of the multiple mini-interview (MMI): a qualitative analysis. Med Educ 2009 43 : 360 367.
10. Newble DI, Hoare J, Sheldrake PF. The selection and training of examiners for clinical examinations. Med Educ 1980 14 : 345 349.
11. Linacre JM. Many-Facet Rasch Measurement.
12. Roberts C, Zoanetti N, Rothnie I. Validating a multiple mini-interview question bank assessing entry-level reasoning skills in professionalism for graduate medicine and dentistry programmes. Med Educ 2009 43 : 350 359.
13. Downing SM. Threats to the validity of clinical teaching assessments: what about rater error? Med Educ 2005 39 : 353 355.
14. McManus IC, Thompson M, Mollon J. Assessment of examiner leniency and stringency ('hawk-dove effect') in the MRCP(UK) clinical examination (PACES) using multi-facet Rasch modelling. BMC Med Educ 2006 6 : 1272 1294.
15. Harasym PH, Woloschuk W, Cunning L. Undesired variance due to examiner stringency/leniency effect in communication skill scores assessed in OSCEs. Adv Health Sci Educ 2008 13 : 617 632.
16. Griffin P, Zoanetti N. Moderation of interviewer judgement in tests of spoken English. Proceedings of the 40th Annual TESOL Convention and Exhibit, Tampa, FL, March 15-18 2006.
17. Harasym PH. Multiple mini-interview symposium: sources of error variance. Proceedings of the Association of Medical Educators of Europe (AMEE), Malaga, 29 August-2 September 2009.
18. Linacre JM. A User's Guide to facets Rasch-Model Computer Programs, Program Manual 3.65.0.
19. Bond TG, Fox CM. Applying the RASCH Model: Fundamental Measurement in the Human Sciences, 2nd edn.
20. Lievens F, Thornton GC. Assessment centers: recent developments in practice and research In : Evers A, Anderson N, Voskuijl O, Eds. The Blackwell Handbook of Personnel Selection.
21. Iramaneerat C, Yudkowsky R, Myford CM, Downing SM. Quality control of an OSCE using generalizability theory and many-faceted Rasch measurement. Adv Health Sci Educ 2008 13 : 479 493.