A New Look at the Influence of Guessing on the Reliability of Multiple-Choice Tests

Applied Psychological Measurement

Volumn 27, Issue 5, 2003, Pages 357-371

  Zimmerman, Donald W ^a,c   Williams, Richard H ^b  

^a CARLETON UNIVERSITY   (Canada)

^b UNIVERSITY OF MIAMI   (United States)

^c NONE   (Canada)

Author keywords

Chance success; Error score; Guessing; Multiple choice test; Observed score; Reliability; True score; True false test; Validity

Indexed keywords

EID: 0042287726     PISSN: 01466216     EISSN: None     Source Type: Journal    
DOI: 10.1177/0146621603254799     Document Type: Article

References (14)

1. Angoff, W. H. (1989). Does guessing really help? Journal of Educational Measurement, 26, 323-336.
2. Carroll, J. B. (1945). The effect of difficulty and chance success on correlations between items or between tests. Psychometrika, 10, 1-19.
3. Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory. New York: Holt, Rinehart, & Winston.
4. Frary, R. B., & Zimmerman, D. W. (1970). Effect of variation in probability of guessing correctly on reliability of multiple-choice tests. Educational and Psychological Measurement, 30, 595-605.
5. Gross, M. E., & Wright, B. A. (1985). Validity and reliability of true-false tests. Educational and Psychological Measurement, 45, 1-13.
6. Horst, P. (1933). The difficulty of a multiple-choice test item. Journal of Educational Psychology, 24, 229-232.
7. Lord, F. M. (1952). The relationship of the reliability of multiple-choice items to the distribution of item difficulties. Psychometrika, 18, 181-194.
8. Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.
9. Plumlee, L. B. (1952). The effect of difficulty and chance success on item-test correlation and on test reliability, Psychometrika, 17, 69-86.
10. Roberts, A. O. H. (1962). The maximum reliability of a multiple-choice test. Psychologia Africana, 9, 286-293.
11. Sutcliffe, J. P. (1965). A probability model for errors of classification: I. General considerations. Psychometrika, 30, 73-96.
12. Zimmerman, D. W., & Williams, R. H. (1982). Element of chance and comparative reliability of matching tests and multiple-choice tests. Psychological Reports, 50, 975-980.
13. Zimmerman, D. W., & Williams, R. H. (1998). Reliability of gain scores under realistic assumptions about properties of pretest and posttest scores. British Journal of Mathematical and Statistical Psychology, 51, 343-351.
14. Zimmerman, D. W., Williams, R. H., & Symons, D. L. (1984). Empirical estimates of the comparative reliability of matching tests and multiple-choice tests. Journal of Experimental Education, 52, 179-182.