Sources of validity evidence for an internal medicine student evaluation system: An evaluative study of assessment methods

Medical Education

Volumn 39, Issue 3, 2005, Pages 276-283

  Auewarakul, Chirayu ^a   Downing, Steven M ^b   Jaturatamrong, Uapong ^a   Praditsuwan, Rungnirand ^a  

^a MAHIDOL UNIVERSITY   (Thailand)

^b UNIVERSITY OF ILLINOIS AT CHICAGO   (United States)

Author keywords

Clinical competence *standards; Education, medical, undergraduate *standards; Educational assessment standards; Evaluation study; Internal medicine *education standards; Reproducibility of results

Indexed keywords

ARTICLE; ATTITUDE; CLINICAL EXAMINATION; COMPETENCE; EDUCATION PROGRAM; EVALUATION; HUMAN; INTERNAL MEDICINE; MEDICAL EDUCATION; MEDICAL STUDENT; MULTIPLE CHOICE TEST; NORMAL HUMAN; OUTPATIENT DEPARTMENT; REPRODUCIBILITY; SKILL; TEACHER; VALIDATION PROCESS; WARD;

CLINICAL COMPETENCE; COHORT STUDIES; EDUCATION, MEDICAL, UNDERGRADUATE; HEALTH KNOWLEDGE, ATTITUDES, PRACTICE; HUMANS; INTERNAL MEDICINE; REPRODUCIBILITY OF RESULTS; RETROSPECTIVE STUDIES; STUDENTS, MEDICAL; THAILAND;

EID: 15244351260     PISSN: 03080110     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1365-2929.2005.02090.x     Document Type: Article

References (26)

1. van der Vleuten CPM. The assessment of professional competence: developments, research and practical implications. Adv Health Sci Educ 1996;1:41-67.
2. Collins JP, Gamble GD. A multi-format interdisciplinary final examination. Med Educ 1996;30:259-65.
3. Wass V, van der Vleuten CPM, Shatzer J, Jones R. Assessment of clinical competence. Lancet 2001;357:945-9.
4. McManus IC, Mooney-Somers J, Dacre JE, Vale JA. Reliability of the MRCP (UK) Part I examination, 1984-2001. Med Educ 2003;37:609-11.
5. Miller GE. The assessment of clinical skills/competence/performance. Acad Med 1990;65 (Suppl):63-7.
6. Thomas CS, Mellop C, Callander J, Crawshaw J, Ellis PM, Hall A. The oral examination: a study of academic and non-academic factors. Med Educ 1993;27:433-9.
7. Harden R, Stevenson M, Downie W, Wilson G. Assessment of clinical competence using objective structured examinations. BMJ 1975;1:447-51.
8. van der Vleuten C. Validity of final examinations in undergraduate medical training. BMJ 2000;321:1217-9.
9. Newble DI, Jaeger K. The effects of assessment and examinations on the learning of medical students. Med Educ 1983;17:165-71.
10. Boulet JR, McKinley DW, Whelan GP, Hambleton RK. Quality assurance methods for performance-based assessments. Adv Health Sci Educ 2003;8:27-47.
11. Messick SJ. Validity. In: Linn RL, ed. Educational Measurement. 3rd edn. New York: American Council on Education and Macmillan 1989;13-104.
12. Downing SM. Validity: on the meaningful interpretation of assessment data. Med Educ 2003;37:830-7.
13. American Educational Research Association American Psychological Association, National Council on Measurement in Education. Standards for Educational and Psychological Testing. Washington, DC: American Educational Research Association 1999.
14. Kassam N. Some validity evidence of an undergraduate internal medicine OSCE. Unpublished Masters thesis. Chicago: University of Illinois at Chicago 2003.
15. Kuder GF, Richardson MW. The theory of the estimation for test reliability. Psychometrica 1937;2:151-60.
16. Brennan RL. Generalisability Theory. New York: Springer Verlag 2001.
17. Thissen D, Wainer H. Test Scoring. Mahwah, New Jersey: Lawrence Erlbaum 2001.
18. Newble DI, Swanson DB. Psychometric characteristics of the objective structured clinical examination. Med Educ 1988;22:325-34.
19. Prislin MD, Fitzpatrick CF, Lie D, Gigluio M, Radecki S, Lewis E. Use of an objective structured clinical examination in evaluating student performance. Fam Med 1998;30:338-44.
20. Schwartz RW, Donnelly MB, Sloan DA et al. The relationship between faculty ward evaluations, OSCE and ABSITE as measures of surgical intern performance. Am J Surg 1995;169:414-7.
21. van der Vleuten CPM, Van Luijk SJ, Beckers HJM. A written test as an alternative to performance testing. Med Educ 1989;23:97-107.
22. Hull AL, Hodder S, Berger B, Ginsberg D, Lindheim N, Quan J, Kleinhenz ME. Validity of three clinical performance assessments of internal medicine clerks. Acad Med 1995;70:517-22.
23. Streiner C. Clinical ratings-ward rating. In: Shannon S, Norman G, eds. Evaluation Methods: a Resource Handbook. Hamilton, Ontario: Program for Educational Development, McMaster University 1995;29-32.
24. Matsell DG, Wolfish NM, Hsu E. Reliability and validity of the objective structured clinical examination in paediatrics. Med Educ 1991;25:293-9.
25. Gruppen LD, Davis WK, Fitzgerald JT, McQuillan MA. Reliability, number of stations and examination length in an objective structured clinical examination. Proceedings of the 7th Ottawa International Conference on Medical Education and Assessment, Maastricht, the Netherlands 1996.
26. Wilkinson TJ, Newble DI, Wilson PD, Cater JM, Helms RM. Development of a three-centre simultaneous objective structured clinical examination. Med Educ 2000;34:798-807.