Standards and reliability in evaluation: When rules of thumb don't apply

Academic Medicine

Volumn 74, Issue 10, 1999, Pages 1088-1090

  Norcini Jr , John J ^a,b  

^a AMERICAN BOARD OF INTERNAL MEDICINE   (United States)

^b ABIM Foundation   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACADEMIC ACHIEVEMENT; DECISION MAKING; EVALUATION; EXAMINATION; MEDICAL EDUCATION; MEDICAL STUDENT; PRIORITY JOURNAL; RELIABILITY; REVIEW; SCORING SYSTEM; STANDARD;

EID: 0032746698     PISSN: 10402446     EISSN: None     Source Type: Journal    
DOI: 10.1097/00001888-199910000-00010     Document Type: Review

References (8)

1. Norcini JJ, Shea JA. The credibility and comparability of standards. Applied Measurement in Education. 1997;10 39-59
2. Berk RA. A consumer's guide to setting performance standards on criterion-referenced tests. Review of Educational Research. 1986;56(1) 137-72.
3. Brennan RL Elements of Generalizability Theory. Iowa City, IA: ACT Publications, 1983.
4. Norcini JJ, Blank LL, Arnold GK, Kimball HR. The mini-CEX (clinical evaluation exercise): a preliminary investigation. Ann Intern Med. 1995; 123:795-9.
5. Subkoviak MJ. Estimating the reliability of mastery-nonmastery classifications. In: Berk RA (ed) A Guide to Criterion-referenced Test Construction. Baltimore, MD Johns Hopkins University Press, 1984.
6. Swaminathan H, Hambleton RK, Algina J. Reliability of criterion-referenced tests a decision-theoretic formulation. Journal of Educational Measurement. 1974;11:263-7.
7. Cohen JA A coefficient of agreement for nominal scales. Educational and Psychological Measurement. 1960;29:323-7.
8. Berk RA. Selecting the index of reliability. In: Berk RA. A Guide to Criterion-referenced Test Construction. Baltimore, MD Johns Hopkins University Press, 1984.