Decomposing the roles of perseveration and expected value representation in models of the Iowa gambling task

Frontiers in Psychology

Volumn 4, Issue SEP, 2013, Pages

  Worthy, Darrell A ^a   Pang, Bo ^a   Byrne, Kaileigh A ^a  

^a TEXAS A AND M UNIVERSITY   (United States)

Author keywords

Computational modeling of decision; Decision making; Expected value; Iowa gambling task; Perseveration

Indexed keywords

EID: 84885361038     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2013.00640     Document Type: Article

References (34)

1. Agay, N., Yechiam, E., Carmel, Z., and Levkovitz, Y. (2010). Non-specific effects of methylphenidate (Ritalin) on cognitive ability and decision-making of ADHD and healthy adults. Psychopharmacology 210, 511-519. doi:10.1007/s00213-010-1853-4.
2. Ahn, W. Y., Busemeyer, J. R., Wagenmakers, E. J., and Stout, J. C. (2008). Comparison of decision learning models using the generalization criterion method. Cogn. Sci. 32, 1376-1402. doi:10.1080/03640210802352992.
3. Ahn, W. Y., Krawitz, A., Kim, W., Busemeyer, J. R., and Brown, J. W. (2011). A model-based fMRI analysis with hierarchical Bayesian parameter estimation. J. Neurosci. Psychol. Econ. 4, 95-110. doi:10.1037/a0020684.
4. Akaike, H. (1974). A new look at the statistical model identification. Automatic Control IEEE Trans 19, 716-723. doi:10.1109/TAC.1974.1100705.
5. Bechara, A., Damasio, A. R., Damasio, H., and Anderson, S. W. (1994). Insensitivity to future consequences following damage to human prefrontal cortex. Cognition 50, 7-15. doi:10.1016/0010-0277(94)90018-3.
6. Bechara, A., Dolan, S., Denburg, N., Hindes, A., Anderson, S. W., and Nathan, P. E. (2001). Decision-making deficits, linked to a dysfunctional ventromedial prefrontal cortex, revealed in alcohol and stimulant abusers. Neuropsychologia 39, 376-389. doi:10.1016/S0028-3932(00)00136-6.
7. Boeka, A. G., and Lokken, K. L. (2006). The Iowa gambling task as a measure of decision making in women with bulimia nervosa. J. Int. Neuropsychol. Soc. 12, 741-745. doi:10.1017/S1355617706060887.
8. Busemeyer, J. R., and Stout, J. C. (2002). A contribution of cognitive decision models to clinical assessment:decomposing performance on the Bechara gambling task. Psychol. Assess. 14, 253-262. doi:10.1037/1040-3590.14.3.253.
9. Busemeyer, J. R., and Wang, Y.-M. (2000). Model comparisons and model selections based on generalization criterion methodology. J. Math. Psychol. 44, 171-189. doi:10.1006/jmps.1999.1282.
10. Chiu, Y.-C., Lin, C.-H., Huang, J.-T., Lin, S., Lee, P.-L., and Hsieh, J.-C. (2008). Immediate gain is long-term loss:are there foresighted decision makers in the Iowa Gambling Task. Behav. Brain Funct. 4, 13. doi:10.1186/1744-9081-4-13.
11. Erev, I., and Roth, A. E. (1998). Predicting how people play games:reinforcement learning in experimental games with unique, mixed strategy equilibria. Am. Econ. Rev. 88, 848-881.
12. Gureckis, T. M., and Love, B. C. (2009a). Learning in noise:dynamic decision-making in a variable environment. J. Math. Psychol. 53, 180-193. doi:10.1016/j.jmp.2009.02.004.
13. Gureckis, T. M., and Love, B. C. (2009b). Short-term gains, long-term pains:how cues about state aid learning in dynamic environments. Cognition 113, 293-313. doi:10.1016/j.cognition.2009.03.013.
14. Hochman, G., Yechiam, E., and Bechara, A. (2010). Recency gets larger as lesions move from anterior to posterior locations within the ventromedial prefrontal cortex. Behav. Brain Res. 213, 27-34. doi:10.1016/j.bbr.2010.04.023.
15. Kahneman, D., and Tversky, A. (1979). Prospect theory:an analysis of decision under risk. Econ. J. Econom. Soc. 47, 263-291. doi:10.2307/1914185.
16. Kovach, C. K., Daw, N. D., Rudrauf, D., Tranel, D., O'Doherty, J. P., and Adolphs, R. (2012). Anterior prefrontal cortex contributes to action selection through tracking of recent reward trends. J. Neurosci. 32, 8434-8442. doi:10.1523/JNEUROSCI.5468-11.2012.
17. Kudryavtsev, A., and Pavlodsky, J. (2012). Description-based and experience-based decisions:individual analysis. Judgm. Decis. Mak. 7, 316-331.
18. Lakey, C. E., Goodie, A. S., and Campbell, W. K. (2007). Frequent card playing and pathological gambling:the utility of the Georgia Gambling Task and Iowa Gambling Task for predicting pathology. J. Gambl. Stud. 23, 285-297. doi:10.1007/s10899-006-9034-4.
19. Lau, B., and Glimcher, P. W. (2005). Dynamic response-by-response models of matching behavior in rhesus monkeys. J. Exp. Anal. Behav. 84, 555-579. doi:10.1901/jeab.2005.110-04.
20. Lin, C.-H., Chiu, Y.-C., Lee, P.-L., and Hsieh, J.-C. (2007). Is deck B a disadvantageous deck in the Iowa Gambling Task? Behav. Brain Funct. 3, 16. doi:10.1186/1744-9081-3-16.
21. Rescorla, R. A., and Wagner, A. R. (1972). "A theory of Pavlovian conditioning:variations in the effectiveness of reinforcement and nonreinforcement," in Classical Conditioning II:Current Research and Theory, eds A. H. Black, and W. F. Prokasy (New York, NY:Appleton Century Crofts), 64-99.
22. Schönberg, T., Daw, N. D., Joel, D., and O'Doherty, J. P. (2007). Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making. J. Neurosci. 27, 12860-12867. doi:10.1523/JNEUROSCI.2496-07.2007.
23. Schwarz, G. (1978). Estimating the dimension of a model. Ann. Stat. 6, 461-464. doi:10.1214/aos/1176344136.
24. Sutton, R. S., and Barto, A. G. (1998). Reinforcement Learning:An Introduction. Vol. 1. Cambridge, MA:Cambridge University Press.
25. Weller, J. A., Levin, I. P., and Bechara, A. (2010). Do individual differences in Iowa Gambling Task performance predict adaptive decision making for risky gains and losses? J. Clin. Exp. Neuropsychol. 32, 141-150. doi:10.1080/13803390902881926.
26. Wetzels, R., Vandekerckhove, J., Tuerlinckx, F., and Wagenmakers, E.-J. (2010). Bayesian parameter estimation in the Expectancy Valence model of the Iowa gambling task. J. Math. Psychol. 54, 14-27. doi:10.1016/j.jmp.2008.12.001.
27. Worthy, D. A., Hawthorne, M. J., and Otto, A. R. (2013). Heterogeneity of strategy use in the Iowa gambling task:a comparison of win-stay/lose-shift and reinforcement learning models. Psychon. Bull. Rev. 20, 364-371. doi:10.3758/s13423-012-0324-9.
28. Worthy, D. A., and Maddox, W. T. (2012). Age-based differences in strategy use in choice tasks. Front. Neurosci. 5:145. doi:10.3389/fnins.2011.00145.
29. Worthy, D. A., Maddox, W. T., and Markman, A. B. (2007). Regulatory fit effects in a choice task. Psychon. Bull. Rev. 14, 1125-1132. doi:10.3758/BF03193101.
30. Worthy, D. A., Otto, A. R., and Maddox, W. T. (2012). Working-memory load and temporal myopia in dynamic decision making. J. Exp. Psychol. Lear. Mem. Cogn. 38, 1640-1658. doi:10.1037/a0028146.
31. Yechiam, E., Arshavsky, O., Shamay-Tsoory, S. G., Yaniv, S., and Aharon, J. (2010). Adapted to explore:reinforcement learning in autistic spectrum conditions. Brain Cogn. 72, 317-324. doi:10.1016/j.bandc.2009.10.005.
32. Yechiam, E., and Busemeyer, J. R. (2005). Comparison of basic assumptions embedded in learning models for experience-based decision making. Psychono. Bull. Rev. 12, 387-402. doi:10.3758/BF03193783.
33. Yechiam, E., and Busemeyer, J. R. (2008). Evaluating generalizability and parameter consistency in learning models. Games Econ. Behav. 63, 370-394. doi:10.1016/j.geb.2007.08.011.
34. Yechiam, E., Busemeyer, J. R., Stout, J. C., and Bechara, A. (2005). Using cognitive models to map relations between neuropsychological disorders and human decision-making deficits. Psychol. Sci. 16, 973-978. doi:10.1111/j.1467-9280.2005.01646.x.