Global clinical performance rating, reliability and validity in an undergraduate clerkship

Netherlands Journal of Medicine

Volumn 63, Issue 7, 2005, Pages 279-284

  Daelmans, H E M ^a   van der Hem Stokroos, H H ^a   Hoogenboom, R J I ^b   Scherpbier, A J J A ^b   Stehouwer, C D A ^a,b   van der Vleuten, C P M ^b  

^a VU UNIVERSITY MEDICAL CENTER   (Netherlands)

^b MAASTRICHT UNIVERSITY   (Netherlands)

Author keywords

Clerkship; Disattenuation; Global clinical performance rating; Inter rater reliability; Predictive validity

Indexed keywords

ARTICLE; CLINICAL EDUCATION; COMPETENCE; HUMAN; HUMAN RELATION; JOB PERFORMANCE; MEDICAL EDUCATION; MEDICAL STUDENT; NETHERLANDS; PREDICTION; PSYCHOMETRY; RATING SCALE; RELIABILITY; RESIDENCY EDUCATION;

CLINICAL CLERKSHIP; EDUCATIONAL MEASUREMENT; HUMANS; NETHERLANDS; OBSERVER VARIATION; REPRODUCIBILITY OF RESULTS; STUDENTS, MEDICAL;

EID: 23844500326     PISSN: 03002977     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (36)

1. Magarian GJ, Mazur DJ. Evaluation of students in medicine clerkships. Acad Med 1990;65:341-5.
2. Kassebaum DG, Eaglen RH. Shortcomings in the evaluation of students' clinical skills and behavior in medical school. Acad Med 1999;74:842-9.
3. Dielman TE, Hull A, Davis WK. Psychometric properties of clinical performance ratings. Evaluation and the Health Professions 1980;3:103-17.
4. Maxim BR, Dielman TE. Dimensionality, internal consistency and interrater reliability of clinical performance ratings. Med Educ 1987;21:130-7.
5. Haber RJ, Avins AL. Do ratings on the American Board of Internal Medicine resident evaluation form detect differences in clinical competence. J Gen Int Med 1994;9(3):140-5.
6. Kwolek CJ, Donnelly MB, Sloan DA, Birrell SN, Strodel WE, Schwartz RW. Ward evaluations: should they be abandoned? J Surg Res 1997;69(1):1-6.
7. Davis JD. Comparison of faculty, peer, self and nurse assessment of obstetrics and gynecology residents. Obstet Gynecol 2002;99:647-51.
8. Durning SJ, Cation LJ, Jackson JL. The reliability and validity of the American Board of Internal Medicine monthly evaluation form. Acad Med 2003;78:1175-82.
9. Remmen R, Denekens J, Scherpbier A, et al. An evaluation study of the didactic quality of clerkships. Med Educ 2000;34:460-4.
10. Busari JO, Scherpbier AJJA, van der Vleuten CPM, Essed GGM. The perceptions of attending doctors of the role of residents as teachers of undergraduate clinical students. Med Educ 2003;37:241-7.
11. Kachalia A, Studdert DM. Professional liability issues in graduate medical education. JAMA 2004;292:1060-1.
12. Keynan A, Friedman M, Benbassat J. Reliability of global rating scales in the assessment of clinical competence of medical students. Med Educ 1987;21:477-81.
13. DaRosa DA, Dawson-Saunders B, Folse R. A comparison of objective and subjective measures of clinical competence. Evaluations and Program Planning 1985;8:327-30.
14. Adusumilli S, Cohan RH, Korobkin M, Fitzgerald JT, Oh MS. Correlation between radiology resident rotation performance and examination scores. Acad Radiol 2000;7:920-6.
15. Callahan CA, Erdmann JB, Hojat M, et al. Validity of faculty ratings of students' clinical competence in core clerkships in relation to scores on licensing examinations and supervisors' ratings in residency. Acad Med 2000;75:S71-3.
16. Norcini JJ, Webster GD, Grosso LJ, Blank LL, Benson JA Jr. Ratings of residents' clinical competence and performance on certification examination. J Med Educ 1987;62:457-62.
17. Pedhazur EJ. Multiple Regression in Behavioral Research - Explanation and Prediction. 2nd Edition. New York: Holt, Rinehart and Winston, 1982. p. 112-4.
18. Metheny WP. Limitations of physician ratings in the assessment of student clinical performance in an obstetrics and gynecology clerkship. Obstet Gynecol 1991;78:136-41.
19. Streiner DL. Global rating scales. In: Neufield VR, Norman GR (eds). Assessing Clinical Competence. New York: Springer Publishing Company, 1985. p.114-41
20. Turnbull J, van Barneveld C. Assessment of clinical performance: in-training evaluation. In: Norman GR, van der Vleuten CPM, Newble DI (eds). International Handbook of Research in Medical Education. Dordrecht/Boston/London: Kluwer Academic Publishers, 2002. p. 793-810.
21. Turnbull J, MacFadyen J, van Barneveld C, Norman G. Clinical work sampling: a new approach to the problem of in training evaluation. J Gen Intern Med 2000;15:556-61.
22. Daelmans HEM, van der Hem-Stokroos HH, Hoogenboom R, Scherpbier AJJA, Stehouwer CDA, van der Vleuten CPM. Feasibility and reliability of an in-training assessment programme in an undergraduate clerkship. Med Educ 2004;12:1270-7.
23. Kreiter DC, Ferguson K, Lee W, Brennan RL, Densen P. A generalizability study of a new standardized rating form used to evaluate students' clinical clerkship performances. Acad Med 1998;73:1294-8.
24. McKinstry BH, Cameron HS, Elton RA, Riley SC. Leniency and halo effects in marking undergraduate short research projects. BMC Med Educ 2004;4:28.
25. Van Luijk SJ, van der Vleuten CPM. A comparison of checklists and rating scales in performance-based testing. In: Hart IR, Harden RM, DesMarchais J (eds). Current Developments in Assessing Clinical Competence. Montreal: Can Health Publications, 1992. p. 357-82.
26. Rothstein HR. Inter-rater reliability of job performance ratings: growth to asymptote level with increasing opportunity to observe. J Appl Psychol 1990;75(3):322-7.
27. Noel GL, Herbers JEJ, Caplow MP, Cooper GS, Pangaro LN, Harvey J. How well do internal medicine faculty members evaluate the clinical skills of residents? Ann Int Med 1992;80:1294-8.
28. Newble DI, Hoare J, Sheldrake PK. The selection and training of examiners for clinical examinations. Med Educ 1980;14:345-9.
29. Carline JD, Paauw DS, Thiede KW, Ramsey PG. Factors affecting the reliability of ratings of students' clinical skills in a medicine clerkship. J Gen Int Med 1992;7:506-10.
30. Ramsey PG, Wenrich MD, Carline JD, Inui TS, Larson EB, LoGerfo JP. Use of peer ratings to evaluate physician performance. JAMA 1993;269:1655-60.
31. Heneman RL. The effects of time delay in rating and amount of information observed on performance rating accuracy. Academy of Management Journal 1983;26:677-86.
32. Kassin S, Tubb V, Hosch H, Memon A. On the "general acceptance" of eyewitness testimony research: a new survey of the experts. Am Psychol 2001;56:405-16.
33. Ferguson KJ, Kreiter CD. Using a longitudinal database to assess the validity of preceptors' ratings of clerkship performance. Adv Health Sci Educ Theory Pract 2004;9:39-46.
34. Swanson DB. A measurement framework for performance-based tests. In: Hart I, Harden RJ (eds). Further Developments in Assessing Clinical Competence. Montreal: Can-Health Publications, 1987. p. 13-45.
35. Petrusa ER. Clinical performance assessment. In: Norman GR, Van der Vleuten CPM, Newble DI (eds). International Handbook of Research in Medical Education. Dordrecht/ Boston/ London: Kluwer Academic Publishers, 2002. p. 673-709.
36. Williams RG, Klamen DA, McGaghie WC. Cognitive, social and environmental sources of bias in clinical performance ratings. Teach Learn Med 2003;15:270-92.