Threats to the validity of clinical teaching assessments: What about rater error?

Medical Education

Volumn 39, Issue 4, 2005, Pages 353-355

  Downing, Steven M ^a  

^a UNIVERSITY OF ILLINOIS   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANALYSIS OF VARIANCE; ANALYTIC METHOD; ANALYTICAL ERROR; CALCULATION; CLINICAL EDUCATION; EVALUATION; HUMAN; MEDICAL STUDENT; NOTE; OBSERVER VARIATION; PUBLICATION; RATING SCALE; RELIABILITY; RESIDENT; STATISTICAL ANALYSIS; TEACHER; TEACHING; UNIVERSITY;

EDUCATION, MEDICAL; REPRODUCIBILITY OF RESULTS; TEACHING;

EID: 17044384508     PISSN: 03080110     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1365-2929.2005.02138.x     Document Type: Note

References (10)

1. Beckman TJ, Ghosh AK, Cook DA, Erwin PJ, Mandrekar JN, How reliable are assessments of clinical teaching? J Gen Intern Med 2004;19:971-7.
2. Messick S. Validity. In: Linn, RL, ed. Educational Measurement, 3rd edn. New York: American Council on Education and Macmillan 1989, 13-104.
3. Downing SM. Validity: on the meaningful interpretation of assessment data. Med Educ 2003;37:830-7.
4. Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika 1951;16:297-334.
5. Downing SM. Reliability: on the reproducibility of assessment data. Med Educ 2004;38:1006-12.
6. Haladyna TM, Downing SM. Construct-irrelevant variance in high-stakes testing. Educ Meas: Issues & Practice 2004;23:17-27.
7. Kreiter CD, Ferguson KJ. Examining the Generalizability of ratings across clerkships using a clinical evaluation form. Evaluation & The Health Professions 2001;24:36-46.
8. Williams RG, Klamen DA, McGaghie WC. Cognitive, social and environmental sources of bias in clinical performance ratings. Teach Learn Med 2003;15 (4):270-92.
9. Brennan RL. Generalizability Theory. New York: Springer-Verlag 2001.
10. Myford CM, Wolfe EW. Detecting and measuring rater effects using many-facet Rasch measurement: Part I. J Appl Meas 2003;4 (4):386-422.