Cognitive reflection vs. calculation in decision making

Frontiers in Psychology

Volumn 6, Issue MAY, 2015, Pages

  Sinayev, Aleksandr ^a   Peters, Ellen ^a  

^a OHIO STATE UNIVERSITY   (United States)

Author keywords

Biases; Cognitive reflection test; Dual system theory; Financial outcomes; Individual differences; Numeracy

Indexed keywords

EID: 84930935511     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2015.00532     Document Type: Article

References (59)

1. Alter, A. L., Oppenheimer, D. M., Epley, N., and Eyre, R. N. (2007). Overcoming intuition: metacognitive difficulty activates analytic reasoning. J. Exp. Psychol. Gen. 136, 569-576. doi: 10.1037/0096-3445.136.4.569
2. Babyak, M. A. (2004). What you see may not be what you get: a brief, nontechnical introduction to overfitting in regression-type models. Psychosom. Med. 66, 411-421. doi: 10.1097/01.psy.0000127692.23278.a9
3. Baron, J., Scott, S., Fincher, K., and Metz, S. E. (2014). Why does the cognitive reflection test (sometimes) predict utilitarian moral judgment (and other things)? J. Appl. Res. Mem. Cogn. doi: 10.1016/j.jarmac.2014.09.003
4. Benjamin, D. J., Brown, S. A., and Shapiro, J. M. (2013). Who is "behavioral"? Cognitive ability and anomalous preferences. J. Eur. Econ. Assoc. 11, 1231-1255. doi: 10.1111/jeea.12055
5. Böckenholt, U. (2012a). Modeling multiple response processes in judgment and choice. Psychol. Methods 17, 665-678. doi: 10.1037/2325-9965.1.S.83
6. Böckenholt, U. (2012b). The cognitive-miser response model: Testing for intuitive and deliberate reasoning. Psychometrika 77, 388-399. doi: 10.1007/s11336-012-9251-y
7. Bodenhausen, G. V. (1990). Stereotypes as judgmental heuristics: evidence of circadian variations in discrimination. Psychol. Sci. 1, 319-322. doi: 10.1111/j.1467-9280.1990.tb00226.x
8. Bourgeois-Gironde, S., and Van der Henst, J. B. (2009). "How to open the door to System 2: Debiasing the bat-and-ball problem," in Rational Animals, Irrational Humans eds S. Watanabe, A. P. Bloisdell, L. Huber, and A. Young (Tokyo: Keio University Press), 235-252.
9. Bruine de Bruin, W., Parker, A. M., and Fischhoff, B. (2007). Individual differences in adult decision-making competence. J. Pers. Soc. Psychol. 92, 938-956. doi: 10.1037/0022-3514.92.5.938
10. Campitelli, G., and Gerrans, P. (2014). Does the cognitive reflection test measure cognitive reflection? A mathematical modeling approach. Mem. Cogn. 42, 434-447. doi: 10.3758/s13421-013-0367-9
11. Campitelli, G., and Labollita, M. (2010). Correlations of cognitive reflection with judgments and choices. Judgm. Decis. Mak. 5, 182-191.
12. Chandler, J., Mueller, P., and Paolacci, G. (2014). Nonnaïveté among Amazon Mechanical Turk workers: consequences and solutions for behavioral researchers. Behav. Res. Methods 46, 112-130. doi: 10.3758/s13428-013-0365-7
13. Cronbach, L. J., and Shavelson, R. J. (2004). My current thoughts on coefficient alpha and successor procedures. Educ. Psychol. Meas. 64, 391-418. doi: 10.1177/0013164404266386
14. De Boeck, P., and Partchev, I. (2012). IRTrees: tree-based item response models of the GLMM family. J. Stat. Softw. 48, 1-28.
15. Del Missier, F., Mäntylä, T., and Bruine de Bruin, W. (2012). Decision-making competence, executive functioning, and general cognitive abilities. J. Behav. Decis. Mak. 25, 331-351. doi: 10.1002/bdm.731
16. De Neys, W., Rossi, S., and Houdé, O. (2013). Bats, balls, and substitution sensitivity: cognitive misers are no happy fools. Psychon. Bull. Rev. 20, 269-273. doi: 10.3758/s13423-013-0384-5
17. Diemand-Yauman, C., Oppenheimer, D. M., and Vaughan, E. B. (2011). Fortune favors the bold (and the iized): effects of disfluency on educational outcomes. Cognition 118, 111-115. doi: 10.1016/j.cognition.2010.09.012
18. Enders, C. K. (2010). Applied Missing Data Analysis. New York, NY: Guilford Press.
19. Evans, J. S., Barston, J. L., and Pollard, P. (1983). On the conflict between logic and belief in syllogistic reasoning. Mem. Cognit. 11, 295-306. doi: 10.3758/BF03196976
20. Fagerlin, A., Zikmund-Fisher, B. J., Ubel, P. A., Jankovic, A., Derry, H. A., and Smith, D. M. (2007). Measuring numeracy without a math test: development of the subjective numeracy scale. Med. Decis. Making 27, 672-680. doi: 10.1177/0272989X07304449
21. Frederick, S. (2005). Cognitive reflection and decision making. J. Econ. Perspect. 19, 25-42. doi: 10.1257/089533005775196732
22. Gächter, S., and Renner, E. (2010). The effects of (incentivized) belief elicitation in public goods experiments. Exp. Econ. 13, 364-377. doi: 10.1007/s10683-010-9246-4
23. Ghazal, S., Cokely, E. T., and Garcia-Retamero, R. (2014). "Numeracy components and decision making skill," in Poster presented at the annual meeting of the Society for Judgment and Decision Making (Long Beach, CA).
24. Holland, P. W., and Welsch, R. E. (1977). Robust regression using iteratively reweighted least-squares. Commun. Stat. Theory Methods 6, 813-827. doi: 10.1080/03610927708827533
25. Holt, C. A., and Laury, S. K. (2002). Risk aversion and incentive effects. Am. Econ. Rev. 92, 1644-1655. doi: 10.1257/000282802762024700
26. Hoppe, E. I., and Kusterer, D. J. (2011). Behavioral biases and cognitive reflection. Econ. Lett. 110, 97-100. doi: 10.1016/j.econlet.2010.11.015
27. Kahneman, D. (2003). A perspective on judgment and choice: mapping bounded rationality. Am. Psychol. 58, 697-720. doi: 10.1037/0003-066X.58.9.697
28. Kahneman, D. (2011). Thinking, Fast and Slow. New York, NY: Farrar, Straus and Giroux.
29. Kahneman, D., and Frederick, S. (2002). "Representativeness revisited: attribute substitution in intuitive judgment," in Heuristics and Biases: The Psychology of Intuitive Judgment, eds T. Gilovich, D. Griffin and D. Kahneman (Cambridge, England: Cambridge University Press), 49-81.
30. Låg, T., Bauger, L., Lindberg, M., and Friborg, O. (2014). The role of numeracy and intelligence in health-risk estimation and medical data interpretation. J. Behav. Decis. Mak. 27, 95-108. doi: 10.1002/bdm.1788
31. Liberali, J. M., Reyna, V. F., Furlan, S., Stein, L. M., and Pardo, S. T. (2012). Individual differences in numeracy and cognitive reflection, with implications for biases and fallacies in probability judgment. J. Behav. Decis. Mak. 25, 361-381. doi: 10.1002/bdm.752
32. Loewenstein, G. F., Weber, E. U., Hsee, C. K., and Welch, N. (2001). Risk as feelings. Psychol. Bull. 127, 267-286. doi: 10.1037/0033-2909.127.2.267
33. Maniaci, M. R., and Rogge, R. D. (2014). Caring about carelessness: participant inattention and its effects on research. J. Res. Pers. 48, 61-83. doi: 10.1016/j.jrp.2013.09.008
34. Mastrogiorgio, A., and Petracca, E. (2014). Numerals as triggers of System 1 and System 2 in the 'bat and ball' problem. Mind Soc. 13, 135-148. doi: 10.1007/s11299-014-0138-8
35. McArdle, J. J., Smith, J. P., and Willis, R. (2009). Cognition and Economic Outcomes in the Health and Retirement Survey (Working Paper No. 15266). Available online at: http://www.nber.org/papers/w15266. doi: 10.3386/w15266
36. Nigg, J. T., Wong, M. M., Martel, M. M., Jester, J. M., Puttler, L. I., Glass, J. M., et al. (2006). Poor response inhibition as a predictor of problem drinking and illicit drug use in adolescents at risk for alcoholism and other substance use disorders. J. Am. Acad. Child Adolesc. Psychiatry 45, 468-475. doi: 10.1097/01.chi.0000199028.76452.a9
37. Oechssler, J., Roider, A., and Schmitz, P. W. (2009). Cognitive abilities and behavioral biases. J. Econ. Behav. Organ. 72, 147-152. doi: 10.1016/j.jebo.2009.04.018
38. Oppenheimer, D. M., Meyvis, T., and Davidenko, N. (2009). Instructional manipulation checks: detecting satisficing to increase statistical power. J. Exp. Soc. Psychol. 45, 867-872. doi: 10.1016/j.jesp.2009.03.009
39. Paxton, J. M., Ungar, L., and Greene, J. D. (2012). Reflection and reasoning in moral judgment. Cogn. Sci. 36, 163-177. doi: 10.1111/j.1551-6709.2011.01210.x
40. Pennycook, G., Cheyne, J. A., Koehler, D. J., and Fugelsang, J. A. (2015). Is the cognitive reflection test a measure of both reflection and intuition? Behav. Res. Methods. doi: 10.3758/s13428-015-0576-1. [Epub ahead of print].
41. Peters, E. (2012). Beyond comprehension: the role of numeracy in judgments and decisions. Curr. Dir. Psychol. Sci. 21, 31-35. doi: 10.1177/0963721411429960
42. Peters, E., Baker, D. P., Dieckmann, N. F., Leon, J., and Collins, J. (2010). Explaining the effect of education on health a field study in Ghana. Psychol. Sci. 21, 1369-1376. doi: 10.1177/0956797610381506
43. Peters, E., and Bjalkebring, P. (2014). Multiple numeric competencies: when a number is not just a number. J. Pers. Soc. Psychol. doi: 10.1037/pspp0000019. [Epub ahead of print].
44. Peters, E., Dieckmann, N. F., Västfjäll, D., Mertz, C. K., Slovic, P., and Hibbard, J. H. (2009). Bringing meaning to numbers: the impact of evaluative categories on decisions. J. Exp. Psychol. Appl. 15, 213-227. doi: 10.1037/a0016978
45. Peters, E., Västfjäll, D., Slovic, P., Mertz, C. K., Mazzocco, K., and Dickert, S. (2006). Numeracy and decision making. Psychol. Sci. 17, 407-413. doi: 10.1111/j.1467-9280.2006.01720.x
46. Pinheiro, J., Bates, D., DebRoy, S., and Sarkar, D. (2014). Linear and Nonlinear Mixed Effects Models [Computer Software and Manual]. Available online at: cran.r-project.org/package=nlme.
47. Reyna, V. F., Nelson, W. L., Han, P. K., and Dieckmann, N. F. (2009). How numeracy influences risk comprehension and medical decision making. Psychol. Bull. 135, 943-973. doi: 10.1037/a0017327
48. Roca, M., Torralva, T., López, P., Cetkovich, M., Clark, L., and Manes, F. (2008). Executive functions in pathologic gamblers selected in an ecologic setting. Cogn. Behav. Neurol. 21, 1-4. doi: 10.1097/WNN.0b013e3181684358
49. Royzman, E. B., Landy, J. F., and Leeman, R. F. (2014). Are thoughtful people more utilitarian? CRT as a unique predictor of moral minimalism in the dilemmatic context. Cogn. Sci. 39, 325-352. doi: 10.1111/cogs.12136
50. Slovic, P., Finucane, M. L., Peters, E., and MacGregor, D. G. (2004). Risk as analysis and risk as feelings: some thoughts about affect, reason, risk, and rationality. Risk Anal. 24, 311-322. doi: 10.1111/j.0272-4332.2004.00433.x
51. Soll, J. B., Keeney, R. L., and Larrick, R. P. (2013). Consumer misunderstanding of credit card use, payments, and debt: causes and solutions. J. Public Policy Mark. 32, 66-81. doi: 10.1509/jppm.11.061
52. Stanovich, K. E., and West, R. F. (1998). Individual differences in rational thought. J. Exp. Psychol. Gen. 127, 161-188. doi: 10.1037/0096-3445.127.2.161
53. Thaler, R. H., and Sunstein, C. R. (2008). Nudge: Improving Decisions about Health, Wealth, and Happiness. New Haven, CT: Yale University Press.
54. Toplak, M. E., West, R. F., and Stanovich, K. E. (2011). The cognitive reflection test as a predictor of performance on heuristics-and-biases tasks. Mem. Cogn. 39, 1275-1289. doi: 10.3758/s13421-011-0104-1
55. Toplak, M. E., West, R. F., and Stanovich, K. E. (2014). Assessing miserly information processing: an expansion of the Cognitive Reflection Test. Think. Reason. 20, 147-168. doi: 10.1080/13546783.2013.844729
56. Venables, W. N., and Ripley, B. D. (2002). Modern Applied Statistics with S. New York, NY: Springer. doi: 10.1007/978-0-387-21706-2
57. Vohs, K. D., and Faber, R. (2003). Self-regulation and impulsive spending patterns. Adv. Consum. Res. 30, 125-126.
58. Weller, J. A., Dieckmann, N. F., Tusler, M., Mertz, C. K., Burns, W. J., and Peters, E. (2013). Development and testing of an abbreviated numeracy scale: a Rasch analysis approach. J. Behav. Decis. Mak. 26, 198-212. doi: 10.1002/bdm.1751
59. Winman, A., Juslin, P., Lindskog, M., Nilsson, H., and Kerimi, N. (2014). The role of ANS acuity and numeracy for the calibration and the coherence of subjective probability judgments. Front. Psychol. 5:851. doi: 10.3389/fpsyg.2014.00851