Comparison of decision learning models using the generalization criterion method

Cognitive Science

Volumn 32, Issue 8, 2008, Pages 1376-1402

  Ahn, Woo Young ^a   Busemeyer, Jerome R ^a   Wagenmakers, Eric Jan ^b   Stout, Julie C ^a,c  

^a INDIANA UNIVERSITY   (United States)

^b UNIVERSITY OF AMSTERDAM   (Netherlands)

^c MONASH UNIVERSITY   (Australia)

Author keywords

Decision making; Generalization criterion; Reinforcement learning

Indexed keywords

EID: 42549101410     PISSN: 03640213     EISSN: None     Source Type: Journal    
DOI: 10.1080/03640210802352992     Document Type: Conference Paper

References (40)

1. Anderson, J. R., Bothell, D., Byrne, M. D., Douglass, S., Lebiere, C. and Qin, Y. (2004) An integrated theory of Mind. An integrated theory of mind. Psychological Review, 111, pp. 1036-1060.
2. Anderson, J. R. and Qin, Y. (2008) Using Brain Imaging to Extract the Structure of Complex Events at the Rational Time Band Using brain imaging to extract the structure of complex events at the rational time band. Journal of Cognitive Neuroscience, 20, pp. 1624-1636.
3. Barren, G. and Erev, I. (2003) Small feedback-based decisions and their limited correspondence to description-based decisionsSmall feedback-based decisions and their limited correspondence to description-based decisions. Journal of Behavioral Decision Making, 16, pp. 215-233.
4. Bechara, A., Damasio, H., Tranel, D. and Anderson, S. (1994) Insensitivity to future consequences following damage to human prefrontal cortexInsensitivity to future consequences following damage to human prefrontal cortex. Cognition, 50, pp. 7-15.
5. Bechara, A., Damasio, H., Tranel, D. and Damasio, A. R. (1997) Deciding Advantageously Before Knowing the Advantageous StrategyDeciding advantageously before knowing the advantageous strategy. Science, 275, pp. 1293-1295.
6. Berry, D. A. and Fristedt, B. (1985) Bandit Problems: Sequential Allocation of Experiments Bandit problems: Sequential allocation of experiments, Chapman & Hall, London
7. Brown, J. W. and Braver, T. S. (2005) Learned predictions of error likelihood in the anterior cingulate cortexLearned predictions of error likelihood in the anterior cingulate cortex. Science, 307, pp. 1118-1121.
8. Browne, M. (2000) Cross-Validation MethodsCross-validation methods. Journal of Mathematical Psychology, 44, pp. 108-132.
9. Busemeyer, J. R. and Stout, J. C. (2002) A contribution of cognitive decision models to clinical assessment: Decomposing performance on the Bechara Gambling TaskA contribution of cognitive decision models to clinical assessment: Decomposing performance on the Bechara Gambling Task. Psychological Assessment, 14:3, pp. 253-262.
10. Busemeyer, J. R. and Wang, Y. M. (2000) Model comparisons and model selections based on generalization criterion methodologyModel comparisons and model selections based on generalization criterion methodology. Journal of Mathematical Psychology, 44, pp. 171-189.
11. Chiu, Y. C., Lin, C. H., Huang, J. T., Lin, S. and Huang, J. T. (2006) Reexamining the effect of long-term outcome and gain-loss frequency: from uncertainty to certainty. Paper presented at the 4th annual meeting of the Society for Neuroeconoimics Park City, Utah
12. Chiu, Y. C., Lin, C. H., Huang, J. T., Lin, S., Lee, P. L. and Hsieh, J. C. (2008) Immediate gain is long-term loss: Are there foresighted decision makers in the Iowa Gambling Task?Immediate gain is long-term loss: Are there foresighted decision makers in the Iowa Gambling Task?. Behavioral and Brain Functions, 4, p. 13.
13. Damasio, A. R. (1994) Descartes' Error: Emotion, Reason, and the Human Brain, Putnam, New York
14. Dawid, A. P. (1984) Statistical Theory: The Prequential Approach Statistical theory: The prequential approach. Journal of the Royal Statistical Society, pp. 278-292.
15. Desmeules, R., Bechara, A. and Dube, L. (2007) Subjective valuation and aymmetrical motivational systems: Implications of scope insensitivity for decision making. Subjective valuation and aymmetrical motivational systems: Implications of scope insensitivity for decision making. Journal of Behavioral Decision Making, 21:2, pp. 211-224.
16. Erev, I. and Barron, G. (2005) On adaptation, maximization, and reinforcement learning among cognitive strategiesOn adaptation, maximization, and reinforcement learning among cognitive strategies. Psychological Review, 112:4, pp. 912-931.
17. Erev, I., Ert, E. and Yechiam, E. Loss Aversion, Diminishing Sensitivity, and the Effect of Experience on Repeated Decisions
18. Erev, I. and Haruvy, E. (2005) Generality, repetition, and the role of descriptive learning models Generality, repetition, and the role of descriptive learning models. Journal of Mathematical Psychology, 49, pp. 357-371.
19. Erev, I. and Roth, A. E. (1998) Predicting how people play games: Reinforcement learning in experimental games with unique, mixed strategy equilibria Predicting how people play games: Reinforcement learning in experimental games with unique, mixed strategy equilibria. American Economic Review, 88, pp. 848-881.
20. Estes, W. K. (1950) Toward a Statistical Theory of Learning Toward a statistical theory of learning. Psychological Review, 57, pp. 94-107.
21. Forster, M. R. (2000) Key Concepts in Model Selection: Performance and Generalizability Key concepts in model selection: Performance and generalizability. Journal of Mathematical Psychology, 44, pp. 205-231.
22. Gluck, M. A. and Bower, G. H. (1988) From conditioning to category learning: An adaptive network model From conditioning to category learning: An adaptive network model. Journal of Experimental Psychology: General, 117, pp. 227-247.
23. Hampton, A. N., Bossaerts, P. and O'Doherty, J. P. (2006) The role of the ventromedial prefrontal cortex in abstract state-based inference during decision making in humansThe role of the ventromedial prefrontal cortex in abstract state-based inference during decision making in humans. Journal of Neuroscience, 26, pp. 8360-8367.
24. Hertwig, R., Barren, G., Weber, E. U. and Erev, I. (2004) Decisions from experience and the effect of rare events in risky choice Decisions from experience and the effect of rare events in risky choice. Psychological Science, 15, pp. 534-539.
25. Kaelbling, L. P., Littman, M. L. and Moore, A. W. (1996) Reinforcement Learning: A SurveyReinforcement learning: A survey. Journal of Artificial Intelligence Research, 4, pp. 237-285.
26. Luce, R. D. (1959) Individual choice behavior Individual choice behavior, Wiley, New York
27. Nelder, J. A. and Mead, R. (1965) A simplex method for function minimizationA simplex method for function minimization. Computer Journal, 7, pp. 308-313.
28. Rescorla, R. A. and Wagner, A. R. (1972) A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement, Appleton-Century-Crofts, New York
29. Rieskamp, J., Busemeyer, J. R. and Laine, T. (2003) How do people learn to allocate resources? Comparing Two Learning Theories. How do people learn to allocate resources? Comparing two learning theories. Journal of Experimental Psychology: Learning, Memory and Cognition, 29, pp. 1066-1081.
30. Rumelhart, D. E., McClelland, J. L. and The PDP Research Group (1987) Parallel distributed processing: Explorations in the micro structure of cognition (Vols 1 & 2), MIT Press, Cambridge, MA
31. Schwartz, G. (1978) Estimating the dimension of a model Estimating the dimension of a model. Annals of Statistics, 5, pp. 461-464.
32. Shiffrin, R. M., Lee, M., Wagenmakers, E. J. and Kim, W. Model Evaluation and Selection: Established Methods and Recent Development
33. Sutton, R. S. and Barto, A. G. (1998) Reinforcement learning: An introduction Reinforcement learning: An introduction, MIT Press, Cambridge, MA
34. Tversky, A. and Kahneman, D. (1992) Advances in Prospect Theory: Cumulaive Representations of UncertaintyAdvances in prospect theory: Cumulaive representations of uncertainty. Journal of Risk and Uncertainty, 5, pp. 297-323.
35. Vintzileos, A., Delecluse, P. and Sadourny, R. (1999) On the mechanisms in a tropical ocean-global atmosphere coupled general circulation model. Part I: Mean state and the seasonal cycle.On the mechanisms in a tropical ocean-global atmosphere coupled general circulation model. Part I: Mean state and the seasonal cycle. Climate Dynamics, 15:1, pp. 43-62.
36. Wagenmakers, E. -J., Grunwald, P. and Steyvers, M. (2006) Accumulative Prediction Error and the Selection of Time Series ModelsAccumulative prediction error and the selection of time series models. Journal of Mathematical Psychology, 50, pp. 149-166.
37. Yechiam, E. and Busemeyer, J. R. (2005) Comparison of basic assumptions embedded in learning models for experience-based decision makingComparison of basic assumptions embedded in learning models for experience-based decision making. Psychonomic Bulletin & Review, 12, pp. 387-402.
38. Yechiam, E. and Busemeyer, J. R. (2008) Evaluating generalizability and parameter consistency in learning modelsEvaluating generalizability and parameter consistency in learning models. Games and Economic Behavior, 63, pp. 370-394.
39. Yechiam, E. and Ert, E. (2007) Evaluating the reliance on past choices in adaptive learning models Evaluating the reliance on past choices in adaptive learning models. Journal of Mathematical Psychology, 51, pp. 75-84.
40. Yechiam, E., Stout, J. C., Busemeyer, J. R., Rock, S. L. and Finn, P. R. (2005) Individual Differences in the Response to Foregone Payoffs: An Examination of High Functioning Drug Abusers Individual differences in the response to foregone payoffs: An examination of high functioning drug abusers. Journal of Behavioral Decision Making, 18, pp. 97-110.