Absolute performance of reinforcement-learning models for the Iowa Gambling Task

Decision

Volumn 1, Issue 3, 2014, Pages 161-183

  Steingroever, Helen ^a   Wetzels, Ruud ^b   Wagenmakers, Eric Jan ^a  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

^b European Foundation for the Improvement of Living and Working Conditions   (Ireland)

Author keywords

Bayesian hierarchical analysis; Decision making; Expectancy valence model; Prospect valence learning model

Indexed keywords

EID: 84906355709     PISSN: 23259965     EISSN: 23259973     Source Type: Journal    
DOI: 10.1037/dec0000005     Document Type: Article

References (59)

1. Agay, N., Yechiam, E., Carmel, Z., & Levkovitz, Y. (2010). Non-specific effects of methylphenidate (Ritalin) on cognitive ability and decision-making of ADHD and healthy adults. Psychopharmacology, 210, 511-519
2. Ahn, W.-Y., Busemeyer, J. R., Wagenmakers, E.-J., & Stout, J. C. (2008). Comparison of decision learning models using the generalization criterion method. Cognitive Science, 32, 1376-1402
3. Ahn, W.-Y., Krawitz, A., Kim, W., Busemeyer, J. R., & Brown, J. W. (2011). A model-based fMRI analysis with hierarchical Bayesian parameter estimation. Journal of Neuroscience Psychology and Economics, 4, 95-110
4. Barron, G., & Erev, I. (2003). Small feedback-based decisions and their limited correspondence to description-based decisions. Journal of Behavioral Decision Making, 16, 215-233
5. Bayarri, M., & Berger, J. O. (1999). Quantifying surprise in the data and model verification. In A. P. D. J. M. Bernardo, J. O. Berger, & A. F. M. Smith (Eds.), Bayesian Statistics (Vol. 6, p. 53-82). Oxford, UK: Oxford University Press
6. Bayarri, M., & Berger, J. O. (2000). P values for composite null models. Journal of the American Statistical Association, 95, 1127-1142
7. Bechara, A., Damasio, A. R., Damasio, H., & Anderson, S. W. (1994). Insensitivity to future consequences following damage to human prefrontal cortex. Cognition, 50, 7-15
8. Bechara, A., Damasio, H., Tranel, D., & Damasio, A. R. (1997). Deciding advantageously before knowing the advantageous strategy. Science, 275, 1293-1295
9. Beta distribution. (n.d.). In Wikipedia. Retrieved from http://en.wikipedia.org/wiki/Beta_distribution
10. Blair, R. J. R., Colledge, E., & Mitchell, D. G. V. (2001). Somatic markers and response reversal: Is there orbitofrontal cortex dysfunction in boys with psychopathic tendencies? Journal of Abnormal Child Psychology, 29, 499-511
11. Brambilla, P., Perlini, C., Bellani, M., Tomelleri, L., Ferro, A., Cerruti, S., Frangou, S. (2012). Increased salience of gains versus decreased associative learning differentiate bipolar disorder from schizophrenia during incentive decision making. Psychological Medicine, 1, 1-10
12. Busemeyer, J. R., & Stout, J. C. (2002). A contribution of cognitive decision models to clinical assessment: Decomposing performance on the Bechara gambling task. Psychological Assessment, 14, 253-262
13. Busemeyer, J. R., Stout, J. C., & Finn, P. R. (2003). Using computational models to help explain decision making: Processes of substance abusers. In D. Barch (Ed.), Cognitive and affective neuroscience of psychopathology. New York: Oxford University Press
14. Busemeyer, J. R., & Wang, Y.-M. (2000). Model comparisons and model selections based on generalization criterion methodology. Journal of Mathematical Psychology, 44, 171-189
15. Caroselli, J. S., Hiscock, M., Scheibel, R. S., & Ingram, F. (2006). The simulated gambling paradigm applied to young adults: An examination of university students' performance. Applied Neuropsychology, 13, 203-212
16. Cavedini, P., Riboldi, G., D'Annucci, A., Belotti, P., Cisima, M., & Bellodi, L. (2002). Decisionmaking heterogeneity in obsessive-compulsive disorder: Ventromedial prefrontal cortex function predicts different treatment outcomes. Neuropsychologia, 40, 205-211
17. Cavedini, P., Riboldi, G., Keller, R., D'Annucci, A., & Bellodi, L. (2002). Frontal lobe dysfunction in pathological gambling patients. Biological Psychiatry, 51, 334-341
18. Chiu, Y.-C., & Lin, C.-H. (2007). Is deck C an advantageous deck in the Iowa Gambling Task? Behavioral and Brain Functions, 3, 37
19. Chiu, Y.-C., Lin, C.-H., Huang, J.-T., Lin, S., Lee, P.-L., & Hsieh, J.-C. (2008). Immediate gain is long-term loss: Are there foresighted decision makers in the Iowa Gambling Task? Behavioral 6 and Brain Functions, 4, 13
20. Dunn, B. D., Dalgleish, T., & Lawrence, A. D. (2006). The somatic marker hypothesis: A critical evaluation. Neuroscience & Biobehavioral Reviews, 30, 239-271
21. Erev, I., & Haruvy, E. (2005). Generality, repetition, and the role of descriptive learning models. Journal of Mathematical Psychology, 49, 357-371
22. Erev, I., & Roth, A. E. (1998). Predicting how people play games: Reinforcement learning in experimental games with unique, mixed strategy equilibria. American Economic Review, 88, 848-881
23. Farah, H., Yechiam, E., Bekhor, S., Toledo, T., & Polus, A. (2008). Association of risk proneness in overtaking maneuvers with impaired decision making. Transportation Research Part F: Traffic Psychology and Behaviour, 11, 313-323
24. Fernie, G., & Tunney, R. J. (2006). Some decks are better than others: The effect of reinforcer type and task instructions on learning in the Iowa Gambling Task. Brain and Cognition, 60, 94-102
25. Fridberg, D. J., Queller, S., Ahn, W.-Y., Kim, W., Bishara, A. J., Busemeyer, J. R., Stout, J. C. (2010). Cognitive mechanisms underlying risky decision-making in chronic cannabis users. Journal of Mathematical Psychology, 54, 28-38
26. Gelman, A., Meng, X.-L., & Stern, H. (1996). Posterior predictive assessment of model fitness via realized discrepancies. Statistica Sinica, 6, 733-760
27. Gelman, A., & Rubin, D. (1992). Inference from iterative simulation using multiple sequences. Statistical Science, 7, 457-472
28. Gullo, M. J., & Stieger, A. A. (2011). Anticipatory stress restores decision-making deficits in heavy drinkers by increasing sensitivity to losses. Drug and Alcohol Dependence, 117, 204-210
29. Johnson, S. A., Yechiam, E., Murphy, R. R., Queller, S., & Stout, J. C. (2006). Motivational processes and autonomic responsivity in Asperger's disorder: Evidence from the Iowa Gambling Task. Journal of the International Neuropsychological Society, 12, 668-676
30. Kjome, K. L., Lane, S. D., Schmitz, J. M., Green, C., Ma, L., Prasla, I., Moeller, F. G. (2010). Relationship between impulsivity and decision making in cocaine dependence. Psychiatry Research, 178, 299-304
31. Laud, P. W., & Ibrahim, J. G. (1995). Predictive model selection. Journal of the Royal Statistical Society, 57B, 247-262
32. Lev, D., Hershkovitz, E., & Yechiam, M. (2008). Decision making and personality in traffic offenders: 7 A study of Israeli drivers. Accident Analysis and Prevention, 40, 223-230
33. Lewandowsky, S. (1995). Base-rate neglect in ALCOVE: A critical reevaluation. Psychological Review, 102, 185-191
34. Lin, C.-H., Chiu, Y.-C., Lee, P.-L., & Hsieh, J.-C. (2007). Is deck B a disadvantageous deck in the Iowa Gambling Task? Behavioral and Brain Functions, 3, 16
35. Luce, R. (1959). Individual choice behavior. New York, NY: Wiley
36. Lunn, D. (2003). Winbugs development interface (WBDev). ISBA Bulletin, 10, 10-11
37. Lunn, D., Jackson, C., Best, N., Thomas, A., & Spiegelhalter, D. (2012). The BUGS book: A practical introduction to Bayesian analysis. Boca Raton, FL: Chapman & Hall/CRC
38. MacPherson, S. E., Phillips, L. H., & Della Sala, S. (2002). Age, executive function, and social decision making: A dorsolateral prefrontal theory of cognitive aging. Psychology and Aging, 17, 598-609
39. Martino, D. J., Bucay, D., Butman, J. T., & Allegri, R. F. (2007). Neuropsychological frontal impairments and negative symptoms in schizophrenia. Psychiatry Research, 152, 121-128
40. Meng, X.-L. (1994). Posterior predictive p-values. The Annals of Statistics, 3, 1142-1160
41. Pitt, M. A., Kim, W., & Myung, I. J. (2003). Flexibility versus generalizability in model selection. Psychonomic Bulletin & Review, 10, 29-44
42. Premkumar, P., Fannon, D., Kuipers, E., Simmons, A., Frangou, S., & Kumari, V. (2008). Emotional decision-making and its dissociable components in schizophrenia and schizoaffective disorder: A behavioural and MRI investigation. Neuropsychologia, 46, 2002-2012
43. Rescorla, R. A., & Wagner, A. R. (1972). A theory of pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In A. H. Black & W. F. Prokasy (Eds.), Classical conditioning II: Current research and theory (pp. 64-99). New York, NY: Appleton-Century-Crofts
44. Rodríguez-Sánchez, J. M., Crespo-Facorro, B., Iglesias, R. P., Bosch, C. G.-B., álvarez, M., Llorca, J., & Vázquez-Barquero, J. L. (2005). Prefrontal cognitive functions in stabilized firstepisode patients with schizophrenia spectrum disorders: A dissociation between dorsolateral and orbitofrontal functioning. Schizophrenia Research, 77, 279-288
45. Steingroever, H., Wetzels, R., Horstmann, A., Neumann, J., & Wagenmakers, E.-J. (2013). Performance of healthy participants on the Iowa Gambling Task. Psychological Assessment, 25, 180-193
46. Steingroever, H., Wetzels, R., & Wagenmakers, E.-J. (2013). A comparison of reinforcement-learning models for the Iowa Gambling Task using parameter space partitioning. The Journal of Problem Solving, 5, Article 2
47. Stout, J., Busemeyer, J., Lin, A., Grant, S., & Bonson, K. (2004). Cognitive modeling analysis of decision-making processes in cocaine abusers. Psychonomic Bulletin & Review, 11, 742-747
48. Toplak, M., Jain, U., & Tannock, R. (2005). Executive and motivational processes in adolescents with attention-deficit-hyperactivity disorder (ADHD). Behavioral and Brain Functions, 1, 1-12
49. Tversky, A., & Kahneman, D. (1992). Advances in prospect theory: Cumulative representation of uncertainty. Journal of Risk and Uncertainty, 5, 297-323
50. Wetzels, R., Lee, M., & Wagenmakers, E.-J. (2010). Bayesian inference using WBDev: A tutorial for social scientists. Behavior Research Methods, 42, 884-897
51. Wetzels, R., Vandekerckhove, J., Tuerlinckx, F., & Wagenmakers, E.-J. (2010). Bayesian parameter estimation in the Expectancy Valence Model of the Iowa Gambling Task. Journal of Mathematical Psychology, 54, 14-27
52. Wilder, K. E., Weinberger, D. R., & Goldberg, T. E. (1998). Operant conditioning and the orbitofrontal cortex in schizophrenic patients: Unexpected evidence for intact functioning. Schizophrenia Research, 30, 169-174
53. Wood, S., Busemeyer, J., Koling, A., Cox, C. R., & Davis, H. (2005). Older adults as adaptive decision makers: Evidence from the Iowa Gambling Task. Psychology and Aging, 20, 220-225
54. Worthy, D. A., Hawthorne, M. J., & Otto, A. R. (2013). Heterogeneity of strategy use in the Iowa Gambling Task: A comparison of win-stay/loseshift and reinforcement learning models. Psychonomic Bulletin & Review, 20, 364-371
55. Yechiam, E., & Busemeyer, J. (2005). Comparison of basic assumptions embedded in learning models for experience-based decision making. Psychonomic Bulletin & Review, 12, 387-402
56. Yechiam, E., & Busemeyer, J. R. (2008). Evaluating generalizability and parameter consistency in learning models. Games and Economic Behavior, 63, 370-394
57. Yechiam, E., Busemeyer, J. R., Stout, J. C., & Bechara, A. (2005). Using cognitive models to map relations between neuropsychological disorders and human decision-making deficits. Psychological Science, 16, 973-978
58. Yechiam, E., & Ert, E. (2007). Evaluating the reliance on past choices in adaptive learning models. Journal of Mathematical Psychology, 51, 75-84
59. Yechiam, E., Kanz, J. E., Bechara, A., Stout, J. C., Busemeyer, J. R., Altmaier, E. M., & Paulsen, J. S. (2008). Neurocognitive deficits related to poor decision making in people behind bars. Psychonomic Bulletin & Review, 15, 44-51