Improving the fairness of multiple-choice questions: A literature review

Medical Teacher

Volumn 26, Issue 8, 2004, Pages 709-712

  McCoubrie, Paul ^a  

^a BRISTOL ROYAL INFIRMARY   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ATTENTION; AWARENESS; COGNITION; COMPETENCE; COMPUTER SYSTEM; CORRELATION FUNCTION; EVIDENCE BASED MEDICINE; HUMAN; LEARNING; MEDICAL LITERATURE; MENTAL PERFORMANCE; MULTIPLE CHOICE TEST; PERCEPTION; PREDICTION; PSYCHOMETRY; RELIABILITY; REVIEW; STANDARDIZATION; VALIDATION PROCESS; WRITING;

EDUCATION, MEDICAL; EDUCATIONAL MEASUREMENT; HUMANS; STUDENTS, MEDICAL;

EID: 12344296502     PISSN: 0142159X     EISSN: None     Source Type: Journal    
DOI: 10.1080/01421590400013495     Document Type: Review

References (40)

1. Ben-David, M.F. (2000) AMEE Guide No. 18: Standard setting in student assessment, Medical Teacher, 22, pp. 120-130.
2. Berk, R.A. (1986) A consumer's guide to setting performance standards on criterion-referenced tests, Review of Educational Research, 56, pp. 137-172.
3. Beullens, J., Van Damme, B., Jaspaert, H. & Janssen, P.J. (2002) Are extended-matching multiple-choice items appropriate for a final test in medical education, Medical Teacher, 24, pp. 390-395.
4. Brown, S. (1992) Trends in assessment, in: R. Harden, I. Hart & H. Mulholland (Eds) Approaches to the Assessment of Clinical Competence, Vol. 1 (Dundee, Centre for Medical Education), pp. 3-8.
5. Case, S.M. (1994) The use of imprecise terms in examination questions: how frequently is frequently?, Academic Medicine, 69, pp. S4-S6.
6. Case, S.M. & Swanson, D.B. (1993) Extended matching items: a practical alternative to free response questions, Teaching and Learning in Medicine, 5, pp. 107-115.
7. Case, S.M. & Swanson, D.B. (2001) Constructing Written Test Questions for the Basic and Clinical Sciences, 3rd edn (Philadelphia, National Board of Medical Examiners).
8. Case, S.M., Swanson, D.B. & Becker, D.F. (1996) Verbosity, window dressing and red herrings: do they make a better test item?, Academic Medicine, 71, pp. S28-S30.
9. Clauser, B.E. & Schuwirth, L.W.T. (2002) The use of computers in assessment, in: G. Norman, C. van der Vleuten & D. Newble (Eds) International Handbook of Research in Medical Education, Vol. 2 (Dordrecht, Kluwer), pp. 757-792.
10. Coles, C.R. (1998) How students learn: the process of learning, in: B. Jolly & L. Rees (Eds) Medical Education in the Millennium (Oxford, Oxford University Press), pp. 63-82.
11. Cusimano, M.D. (1996) Standard setting in medical education, Academic Medicine, 71, pp. S112-119.
12. Dixon, R.A. (1994) Evaluating and improving multiple choice papers: true-false questions in public health medicine, Medical Education, 28, pp. 400-408.
13. Downing, S.M. (2002) Assessment of knowledge with written test formats, in: G. Norman, C. Van Der Vleuten & D. Newble (Eds) International Handbook of Research in Medical Education, Vol. 2 (Dordrecht, Kluwer), pp. 647-672.
14. Duffield, K.E. & Spencer, J.A (2002) A survey of medical students' views about the purposes and fairness of assessment. Medical Education, 36, 879-886.
15. Fajardo, L.L. & Chan, K.M. (1993) Evaluation of medical students in radiology: written testing using uncued multiple choice questions, Investigative Radiology, 28, pp. 964-968.
16. Fenderson, B.A., Dawjanov, I., Robeson, M.R., Veloski, J.J. & Rubin, E. (1997) The virtues of extended matching and uncued tests as alternatives to multiple choice questions, Human Pathology, 28, pp. 526-532.
17. Fowell, S.L., Maudsley, G., Maguire, P., Leinster, S.J. & Bligh, J. (2000) Student assessment in undergraduate medical education in the United Kingdom 1998: report of findings, Medical Education, 34, pp. 1-61.
18. Glaser, R. (1984) Education and thinking: the role of knowledge, American Psychology, 39, pp. 193-202.
19. Glick, S.M. (2001) Cheating at medical school, British Medical Journal, 322, pp. 250-251.
20. Herskovic, P (1999) Reutilization of multiple-choice questions. Medical Teacher, 21, 430-431.
21. Holsgrove, G. & Elzubeir, M. (1998) Imprecise terms in UK medical multiple-choice questions: what examiners think they mean, Medical Education, 32, pp. 342-350.
22. Hutchinson, L., Aitken, P. & Hayes, T. (2002) Are medical postgraduate certification processes valid? A systematic review of the published evidence, Medical Education, 36, pp. 73-91.
23. Jolly, B. (1999) Assessment and examination, Advances in Psychiatric Treatment, 5, pp. 405-414.
24. Kaufman, D.M. (2001) Assessing medical students: hit or miss, Student BMJ, 9, pp. 87-88.
25. Lee, G. & Weerakoon, P. (2001) The role of computer-aided assessment in health professional education: a comparison of student performance in computer-based and paper-and-pen multiple choice tests, Medical Teacher, 23, pp. 152-157.
26. Lowe, D.G., Foulkes, J. & Russeel, R.C.G. (1998) ABS to MRCS at the RCS: philosophy, format and future, Annals of the Royal College of Surgeons of England, 80, pp. 213-218.
27. Miller, D.R., Blackmore, D.E., Boujais, A.-P. & Dauphinee, W.D. (2002) The challenges of creating a computer program designed to administer a high-stake licensing examination, in: AMEE 2002: Approaches to Better Teaching (Conference Proceedings) Lisbon, Portugal, pp. 4-105.
28. Newble, D.I. & Jaeger, K. (1983) The effect of assessment and examinations on the learning of medical students, Medical Education 13, pp. 263-268.
29. Norman, G.R. (1996) Multiple choice questions, in: S. Shannon & G. Norman (Eds) Evaluation Methods: A Resource Handbook, 3rd edn (Hamilton, Canada), pp. 47-54.
30. Peitzman, S.J., Nieman, L.Z. & Gracley, E.J. (1990) Comparison of fact recall with high order questions in multiple choice examinations as predictors of clinical performance of medical students, Academic Medicine, 65, pp. S59-S60.
31. Schuwirth, L.W.T. (2001) General concerns about assessment [available online at: www.fdg.unimaas.nl/educ/lambert/ubc, accessed 12 December 2002].
32. Schuwirth, L.W.T., Van Der Vleuten, C., Stoffers, H.E.J.H. & Peperkamp, A.G.W. (1996a) Computerized long-menu questions as an alternative to open-ended questions in computerized assessment, Medical Education, 30, pp. 50-55.
33. Schuwirth, L.W.T., Van Der Vleuten, C.P.M. & Donkers, H.H.L.M. (1996b) A closer look a cueing effects in multiple-choice questions, Medical Education, 30, pp. 44-49.
34. Sinclair, S. (1997) Making Doctors: An Institutional Apprenticeship (Oxford, Berg).
35. Swanson, D.B. & Case, S.M. (1997) Assessment in basic science instruction: directions for practice and research, Advances in Health Sciences Education, 2, pp. 71-84.
36. Synder, B.R. (1971) The Hidden Curriculum (New York, Knopf).
37. Van Der Vleuten, C. (1996) The assessment of professional competence: developments, research and practical implications, Advances in Health Sciences Education, 1, pp. 41-67.
38. Veloski, J.J., Rabinowitz, H.K., Robeson, M.R. & Young, P.R. (1999) Patients don't present with five choices: an alternative to multiple-choice tests in assessing physicians' competence, Academic Medicine, 74, pp. 539-546.
39. Williams, C., Trigwell, P. & Yeomans, D. (1996) MCQ technique, British Journal of Hospital Medicine, 55, pp. 479-481.
40. Wise, S.L. & Kingsbury, G.G. (2000) Practical issues in developing and maintaining a computerized adaptive testing program, Psicologica, 21, pp. 135-155.