A plea for the proper use of criterion-referenced tests in medical assessment

Medical Education

Volumn 43, Issue 12, 2009, Pages 1141-1146

  Ricketts, Chris ^a,b  

^a UNIVERSITY OF PLYMOUTH   (United Kingdom)

^b PLYMOUTH UNIVERSITY PENINSULA SCHOOLS OF MEDICINE AND DENTISTRY   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

CRITERION REFERENCED TEST; EDUCATIONAL THEORY; MEASUREMENT ERROR; MEDICAL EDUCATION; NORM REFERENCED TEST; PSYCHOMETRY; RELIABILITY; REVIEW; STANDARD;

COMPETENCY-BASED EDUCATION; EDUCATION, MEDICAL; EDUCATIONAL MEASUREMENT; HUMANS; MODELS, EDUCATIONAL; REPRODUCIBILITY OF RESULTS; RESEARCH DESIGN;

EID: 70450205334     PISSN: 03080110     EISSN: 13652923     Source Type: Journal    
DOI: 10.1111/j.1365-2923.2009.03541.x     Document Type: Review

References (22)

1. Norcini JJ. Standards and reliability in evaluation: when rules of thumb don't apply. Acad Med 1999 74 (10 1088 1090.
2. Nitko AJ. Defining 'criterion-referenced test'. In : Berk RA, ed. A Guide to Criterion-Referenced Test Construction. Baltimore, MD : Johns Hopkins University Press 1984 8 28.
3. Berk RA, ed. A Guide to Criterion-Referenced Test Construction. Baltimore, MD : Johns Hopkins University Press 1984.
4. Hambleton RK. The rise and fall of criterion-referenced measurement? Educ Meas Issues Pract 1994 13 (4 21 6.
5. Burton RF. Sampling knowledge and understanding: how long should a test be? Assess Eval High Educ 2006 31 (5 569 582.
6. Millman J, Popham WJ. The issue of item and test variance for criterion-referenced tests: a clarification. J Educ Measure 1974 11 : 137 138.
7. van der Vleuten CPM. The assessment of professional competence: developments, research and practical implications. Adv Health Sci Educ Theory Pract 1996 1 : 41 67.
8. Bock RD, Thyssen D, Zymowski MF. IRT estimation of domain scores. J Educ Measure 1997 34 : 197 211.
9. Schuwirth LWT, van der Vleuten CPM. A plea for new psychometric models in educational assessment. Med Educ 2006 40 : 296 300.
10. Popham WJ, Husek TR. Implications of criterion-referenced measurement. J Educ Measure 1969 6 : 1 9.
11. Brennan RL. Estimating the dependability of the scores. In : Berk RA, ed. A Guide to Criterion-Referenced Test Construction. Baltimore, MD : Johns Hopkins University Press 1984 292 334.
12. Rust J, Golombok S. Modern Psychometrics: the Science of Psychological Assessment. London : Routledge 1999 50 3.
13. Berk RA. Conducting the item analysis. In : Berk RA, ed. A Guide to Criterion-Referenced Test Construction. Baltimore, MD : Johns Hopkins University Press 1984 97 143.
14. Traub RE, Rowley GL. Reliability of test scores and decisions. Appl Psychol Meas 1980 4 : 517 545.
15. Downing SM. Reliability: on the reproducibility of assessment data. Med Educ 2004 38 : 1006 1012.
16. Berk RA. Selecting the index of reliability. In : Berk RA, ed. A Guide to Criterion-Referenced Test Construction. Baltimore, MD : Johns Hopkins University Press 1984 231 66.
17. Lord FM, Novick MR. Statistical Theories of Mental Test Scores. Reading, MA : Addison-Wesley 1968 250 52.
18. Downing SM, Tekian A, Yudkowsky R. Procedures for establishing defensible absolute passing scores on performance examinations in health professions education. Teach Learn Med 2006 18 (1 50 7.
19. General Medical Council. Professional and Linguistic Assessments Board (PLAB) Part 2 Borderline Group Scoring Method - Frequently Asked Questions. http://www.gmc-uk.org/doctors/plab/borderline-group-scoring-faqs.asp. [Accessed 11 August 2009.]
20. Schoonheim-Klein M, Muijtens A, Habets L, Manogue M, van der Vleuten C, Hoogstraten J, van der Velden U. On the reliability of a dental OSCE using SEM: effect of different days. Eur J Dent Educ 2008 12 (3 131 137.
21. Ricketts C. Assessing Medical Knowledge - Some Lessons from Progress Testing. Presented at the Association for Medical Education in Europe (AMEE) Conference, Trondheim, 25-29 August 2007.
22. Downing SM, Haladyna TM. Validity and its threats. In : Downing SM, Yudkowsky R, eds. Assessment in Health Professions Education. London; New York, NY : Routledge 2009 21 55.