Optimal correction for guessing in multiple-choice tests

Journal of Mathematical Psychology

Volumn 54, Issue 5, 2010, Pages 415-425

  Espinosa, María Paz ^a   Gardeazabal, Javier ^a  

^a UNIVERSITY OF THE BASQUE COUNTRY UPV EHU   (Spain)

Author keywords

Decision theory; Formula scoring; Optimal penalty; Risk aversion

Indexed keywords

EID: 77956162918     PISSN: 00222496     EISSN: 10960880     Source Type: Journal    
DOI: 10.1016/j.jmp.2010.06.001     Document Type: Article

References (56)

1. Arrow K.J. Aspects of the theory of risk-bearing 1965, Yrjö Hahnsson Foundation.
2. Arrow K.J. Essays in the theory of risk bering 1971, Markham, Chicago, IL.
3. Avila C., Torrubia R. Personality, expectations, and response strategies in multiple-choice question examinations in university students: a test of Gray's hypothesis. European Journal of Personality 2004, 18:45-59.
4. Bar-Hillel M., Budescu D., Attali Y. Scoring and keying multiple choice tests: a case study in irrationality. Mind and Society 2005, 4:2-12.
5. Becker W.E., Johnston C. The relationship between multiple choice and essay response questions in assessing economics understanding. The Economic Record 1999, 75(231):348-357.
6. Bereby-Meyer Y., Meyer J., Flascher O.M. Prospect theory analysis of guessing in multiple choice tests. Journal of Behavioral Decision Making 2002, 15:313-327.
7. Bernardo J.M. A decision analysis approach to multiple choice examinations. Applied decision analysis 1998, 195-207. Kluwer, Boston. F.J. Girón (Ed.).
8. Bliss L.B. A test of Lord's assumption regarding examinee guessing behavior on multiple-choice tests using elementary school students. Journal of Educational Measurement 1980, 17:147-153.
9. Bogacz R., Brown E., Moehlis E., Holmes P., Cohen J.D. The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced choice tasks. Psychological Review 2006, 113:700-765.
10. Bredon G. Take-home tests in economics. Economic Analysis and Policy 2003, 33(1):52-60.
11. Budescu D., Bar-Hillel M.( To guess or not to guess: a decision-theoretic view of formula scoring. Journal of Educational Measurement 1993, 30:227-291.
12. Chan N., Kennedy P. Are multiple-choice exams easier for economics students? a comparison of multiple-choice and "equivalent" constructed-response exam questions. Southern Economic Journal 2002, 68(4):957-971.
13. Charter N., Oaksford M. The rational analysis of mind and behavior. Synthese 2000, 122:93-131.
14. Collet L.S. Elimination scoring: an empirical evaluation. Journal of Educational Measurement 1971, 8:209-214.
15. Cross L.H., Frary R.B. An empirical test of lord's theoretical results regarding formula scoring of multiple choice tests. Journal of Educational Measurement 1977, 14:313-321.
16. Cureton E.E. The correction for guessing. Journal of Experimental Education 1966, 34:44-47.
17. Davis F.B. A note on the correction for chance success. Journal of Experimental Education 1967, 35:42-47.
18. Diamond J., Evans W. The correction for guessing. Review of Educational Research 1973, 43:181-191.
19. Dohmen T.Falk A.Huffman D.Sunde U.Schupp J.Wagner G(2009) Individual risk attitudes: measurement, determinants and behavioral consequeResearch memoranda no. 007. Maastricht: ROA, Research Centre for Education and the Labour Market.
20. Ebel R.L. Blind guessing on objective achievement tests. Journal of Educational Measurement 1968, 5:321-325.
21. Edgington E.S. Scoring formulas that correct for guessing. Journal of Experimental Education 1965, 32:345-346.
22. Espinosa M. P. and Gardeazabal J. (2005). Do students behave rationally in multiple-choice tests? evidence from a field experiment. SSRN paper. Bilbao, Spain: University of the Basque Country.
23. Felt L.S. The relationship between the distribution of item difficulties and test reliability. Applied Measurement in Education 1993, 6:37-48.
24. Frary R.B. A simulation study of reliability and validity of multiple-choice tests scores under six response-scoring modes. Journal of Educational Statistics 1982, 7:333-351.
25. Frary R.B. Formula scoring of multiple-choice tests (correction for guessing). Educational Measurement: Issues and Practice 1988, 7:33-38.
26. Frary R.B. The effect of inappropriate omissions on formula scores: a simulation study. Journal of Educational Measurement 1989, 26:41-53.
27. Friedman M., Savage L.P. The utility analysis of choices involving risk. Journal of Political Economy 1948, 56:279-304.
28. García-Pérez A., Frary R.B. Psychometric properties of finite-state scores versus number-correct and formula scores: a simulation study. Applied Psychological Measurement 1989, 13:403-417.
29. Guttman L. The basis for scalogram analysis. Measurement and prediction 1950, 78-80. Princeton University Press, Princeton, NJ. S.A. Stouffer (Ed.).
30. Harden R.M., Brown R.A., Biran L.A., Dallas Ross W.P., Wakeford R.E. Multiple choice tests: to guess or not to guess. Medical Education 1976, 10:27-32.
31. Heck J.L., Stout D.E. Multiple-choice vs. open-ended exam problems: evidence of their impact on student performance in introductory finance. Financial Practice and Education 1997, 8:83-93.
32. Highham P.A. No special k! a signal detection framework for the strategic regulation of memory accuracy. Journal of Experimental Psychology: General 2007, 136:1-22.
33. Jensen J.L.W.V. Sur les functions convexes et les inégalités entre les valeurs moyennes. Acta Mathematica 1906, 30:175-193.
34. Kahneman D., Tversky A. Prospect theory: an analysis of decision under risk. Econometrica 1979, 47:263-299.
35. Little E.B. Overcorrection and undercorrection in multiple-choice test scoring. Journal of Experimental Education 1966, 35:44-47.
36. Lord F.M. Formula scoring and number-right scoring. Journal of Educational Measurement 1975, 12:7-11.
37. Lord F.M., Novick M.R. Statistical theories of mental test scores 1974, Addison Wesley, Reading, MA.
38. McKenzie C. Rational models as theories-not standards-of behavior. Trends in Cognitive Sciences 2003, 7:403-406.
39. McLeod I., Zhang Y., Yu H. Multiple-choice randomization. Journal of Statistics Education 2003, 11.
40. McMillen T., Holmes P. The dynamics of choice among multiple alternatives. Journal of Mathematical Psychology 2006, 50:30-57.
41. Muijtjens A.M.M., van Mameren H., Hoogenboom R.J.I. The effect of a "don't know" option on test scores: number-right and formula scoring compared. Medical Education 1999, 33:267-275.
42. Mura P.L. Projective expeceted utility. Journal of Mathematical Psychology 2009, 53:408-414.
43. Pratt J. Risk aversion in the small and in the large. Econometrica 1964, 32:122-136.
44. Prieto G., Delgado A.R. The role of instructions in the variability of sex-related differences in multiple-choice tests. Personality and Individual Differences 1999, 27:1067-1077.
45. Sabers D.L., Feldt L.S. An empirical study of the effect of the correction for chance success on the reliability and validity of an aptitude test. Journal of Educational Measurement 1968, 5:251-258.
46. San Martín E., del Pino G., De Boeck P. Irt models for ability-based guessing. Applied Psychological Measurement 2006, 30:183-203.
47. Sanderson P.H. The "don't know" option in MCQ examinations. British Journal of Medical Education 1973, 7:25-29.
48. Sax G., Collet L. The effects of differing instructions and guessing formulas on reliability and validity. Educational and Psychological Measurement 1968, 28:1127-1136.
49. Sherriffs A.C., Boomer D.S. Who is penalized by the penalty for guessing?. Journal of Educational Psychology 1954, 45:81-90.
50. Siegfried J.J., Saunders P., Stinar E., Zhang H. How is introductory economics taught in America?. Economic Inquiry 1996, 34:182-192.
51. Slakter M.J. The effects of guessing strategy on objective test scores. Journal of Educational Measurement 1968, 5:217-222.
52. Slakter M.J. The penalty for not guessing. Journal of Educational Measurement 1968, 5:141-144.
53. von Neumann J., Morgenstern O. The theory of games and economic behavior 1944, Princeton University Press, Princeton, NJ.
54. Walstad W.B., Becker W. Achievement differences on multiple-choice and essay tests in economics. American Economic Review 1994, 84(2):193-196.
55. Weber E. Risk attitude and preference. Advanced Review 2010, 1:79-88.
56. Weber E., Blais A., Betz N. A domain-specific risk-attitude scale: measuring risk perceptions and risk behaviors. Journal of Behavioral Decision Making 2002, 15:263-290.