The effects of violating standard item writing principles on tests and students: The consequences of using flawed test items on achievement examinations in medical education

Advances in Health Sciences Education

Volumn 10, Issue 2, 2005, Pages 133-143

  Downing, Steven M ^a  

^a UNIVERSITY OF ILLINOIS   (United States)

Author keywords

Achievement testing in medical education; Construct irrelevant variance (CIV); Flawed test items; Item difficulty effects from flawed items; Item writing principles; Multiple choice questions (MCQs); Pass fail effects from flawed items; Standard test items

Indexed keywords

ARTICLE; DECISION MAKING; EDUCATION; HUMAN; MEDICAL EDUCATION; PSYCHOMETRY; STANDARD; UNITED STATES; WRITING;

CHOICE BEHAVIOR; EDUCATION, MEDICAL, UNDERGRADUATE; EDUCATIONAL MEASUREMENT; HUMANS; PSYCHOMETRICS; UNITED STATES; WRITING;

EID: 23844432754     PISSN: 13824996     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10459-004-4019-5     Document Type: Article

References (19)

1. M. Albanese 1993 Type K and other complex multiple-choice items: An analysis of research and item properties Educational Measurement: Issues and Practices 12 28 33
2. Case S.M. Downing S.M. (1989). Performance of various multiple-choice item types on medical specialty examinations: Types A,B,C, K, and X. Proceedings of the Twenty-Eighth Annual Conference on Research in Medical Education, pp. 167-172
3. D.B. CaseS.M. Swanson 1998 Constructing Written Test Questions for the Basic and Clinical Sciences National Board of Medical Examiners Philadelphia, PA
4. K.D. Crehan T.M. Haladyna 1991 The validity of two item-writing rules Journal of Experimental Education 59 183 192
5. Dawson-Saunders B., Nungester R.J. Downing S.M. (1989). A comparison of single best answer multiple-choice items (A-type) and complex multiple-choice items (K-type). Proceedings of the Twenty-Eighth Annual Conference on Research in Medical Education, pp. 161-166
6. S.M. Downing 2002 Construct-irrelevant variance and flawed test questions: Do multiple-choice item writing principles make any difference? Academic Medicine 77 s103 104
7. S.M. Downing R.A. Baranowski L.J. Grosso J.J. Norcini 1995 Item type and cognitive ability measured: The validity evidence for multiple true-false items in medical specialty certification Applied Measurement in Education 8 89 199
8. Downing S.M., Dawson-Saunders B., Case S.M. Powell R.D. (April, 1991). The psychometric effects of negative stems, unfocused questions, and heterogeneous options on NBME Part I and Part II characteristics. A paper presented at the annual meeting of the National Council on Measurement in Education, Chicago, IL
9. R.B. Frary 1991 The none-of-the-above option: An empirical study Applied Measurement in Education 4 115 124
10. T.M. Haladyna 2004 Developing and Validating Multiple-choice Test Items Lawrence Erlbaum Associates Hillsdale, NJ
11. T.M. Haladyna M.C. DowningS.M. Rodriguez 2002 A review of multiple-choice item-writing guidelines Applied Measurement in Education 15 309 334
12. P.H. Harasym E.J. Leong C. Violato R. Brant F.F. Lorscheider 1998 Cuing effect of "all of the above" on the reliability and validity of multiple-choice test items Evaluation and the Health Profession 21 120 133
13. R.F. Jozefowicz B.M. Koeppen S. Case R. Galbraith D. Swanson H. Glew 2002 The quality of in-house medical school examinations Academic Medicine 77 156 161
14. R.L. Linn N.E. Gronlund 2000 Measurement and Assessment in Teaching 8 Prentice-Hall Upper Saddle River, NJ
15. W.A. Mehrens I.J. Lehmann 1991 Measurement and Evaluation in Education and Psychology Harcourt Brace New York
16. S. Messick 1989 Validity R.L. Linn Educational Measurement 3 American Council on Education and Macmillan New York 13 104
17. L. Nedelsky 1954 Absolute grading standards for objective tests Educational and Psychological Measurement 14 181 201
18. A.J. Nitko 1996 Educational Assessment of Students Merrill Englewood Cliffs, NJ
19. P. Tamir 1993 Positive and negative multiple choice items: How difficult are they? Studies in Educational Evaluation 19 311 32