Multiple-Choice Exams and Guessing: Results from a One-Year Study of General Chemistry Tests Designed to Discourage Guessing

Journal of Chemical Education

Volumn 92, Issue 7, 2015, Pages 1194-1200

  Campbell, Mark L ^a  

^a UNITED STATES NAVAL ACADEMY   (United States)

Author keywords

Curriculum; First Year Undergraduate General; Problem Solving Decision Making; Testing Assessment

Indexed keywords

EID: 84946901689     PISSN: 00219584     EISSN: 19381328     Source Type: Journal    
DOI: 10.1021/ed500465q     Document Type: Article

References (20)

1. Burton, R. F. Quantifying the Effects of Chance in Multiple Choice and True/False Tests: Question Selection and Guessing of Answers Assess. Eval. High. Educ. 2001, 26, 41-50
2. Burton, R. F. Sampling Knowledge and Understanding: How Long Should a Test Be? Assess. Eval. High. Educ. 2006, 31, 569-582
3. Bodner, G. M. Statistical Analysis of Multiple-Choice Exams J. Chem. Educ. 1980, 57, 188-190
4. Budescu, D. V.; Nevo, B. Optimal Number of Options: An Investigation of the Assumption of Proportionality J. Educ. Meas. 1985, 22, 183-196
5. Cassels, J. R. T.; Johnstone, A. H. The Effect of Language on Student Performance on Multiple Choice Tests in Chemistry J. Chem. Educ. 1984, 61, 613-615
6. Stanley, J. C.; Hopkins, K. D. Educational and Psychological Measurement and Evaluation; Prentice Hall: Englewood Cliffs, NJ, 1972.
7. Tellinghuisen, J.; Sulikowski, M. M. Does the Answer Order Matter on Multiple-Choice Exams? J. Chem. Educ. 2008, 85, 572-575
8. Lord, F. M. Formula Scoring and Number-Right Scoring J. Educ. Meas. 1975, 12, 7-11
9. Muijtjens, A. M. M.; van Mameren, H.; Hoogenboom, R. F. I.; Evers, F. L. H.; van der Vleuten, C. P. M. The Effect of a 'Don't Know' Option on Test Scores: Number-Right and Formula Scoring Compared Med. Educ. 1999, 33, 267-275
10. Grunert, M. L.; Raker, J. R.; Murphy, K. L.; Holme, T. A. Polytomous versus Dichotomous Scoring on Multiple-Choice Examinations: Development of a Rubric for Partial Credit J. Chem. Educ. 2013, 90, 1310-1315
11. Towns, M. H. Guide to Developing High-Quality, Reliable, and Valid Multiple-Choice Assessments J. Chem. Educ. 2014, 91 (9) 1426-1431
12. Mattson, D. The Effects of Guessing on the Standard Error of Measurement and the Reliability of Test Scores Educ. Psychol. Meas. 1965, 25, 727-731
13. Hartman, J. R.; Lin, S. Analysis of Student Performance on Multiple-Choice Questions in General Chemistry J. Chem. Educ. 2011, 88, 1223-1230
14. Traub, R. B.; Hambleton, R. K.; Singh, B. Effects of Promised Reward and Threatened Penalty on Performance of a Multiple-Choice Vocabulary Test Educ. Psychol. Meas. 1969, 29, 847-861
15. Lord, F. M. Formula Scoring and Validity Educ. Psychol. Meas. 1963, 23, 663-672
16. Burton, R. F. Multiple Choice and True/False Tests: Reliability Measures and Some Implications of Negative Marking Assess. Eval. High. Educ. 2004, 29, 585-595
17. Burton, R. F.; Miller, D. J. Statistical Modelling of Multiple-Choice and True/False Tests: Way of Considering, and of Reducing, the Uncertainties Attributable to Guessing Assess. Eval. High. Educ. 1999, 24, 399-411
18. Hinkley, C. C.; Lagowski, J. J. A Versatile Computer-Graded Examination J. Chem. Educ. 1966, 43, 575-578
19. Cronbach, L. J. Coefficient Alpha and the Internal Structure of Tests Psychometrika 1951, 16, 297-334
20. Ebel, R. L. Blind Guessing on Objective Achievement Tests J. Educ. Meas. 1968, 5, 321-324