Evaluating generalizability and parameter consistency in learning models

Games and Economic Behavior

Volumn 63, Issue 1, 2008, Pages 370-394

  Yechiam, Eldad ^a   Busemeyer, Jerome R ^b  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

^b INDIANA UNIVERSITY   (United States)

Author keywords

Cognitive models; Decay; Interference; Model selection; Reinforcement learning

Indexed keywords

EID: 41649105475     PISSN: 08998256     EISSN: 10902473     Source Type: Journal    
DOI: 10.1016/j.geb.2007.08.011     Document Type: Article

References (47)

1. Atkinson R.C., and Shiffrin R.M. Human memory: A proposed system and its control processes. In: Spence K.W., and Spence J.T. (Eds). The Psychology of Learning and Motivation, vol. 2 (1968), Academic Press, New York 89-195
2. Barron G., and Erev I. Small feedback-based decisions and their limited correspondence to description-based decisions. J. Behav. Dec. Making 16 (2003) 215-233
3. Bechara A., Damasio A.R., Damasio H., and Anderson S. Insensitivity to future consequences following damage to human prefrontal cortex. Cognition 50 (1994) 7-15
4. Bereby-Meyer Y., and Erev I. On learning to become a successful loser: A comparison of alternative abstractions of learning processes in the loss domain. J. Math. Psychol. 42 (1998) 266-286
5. Broadbent D.E. Perception and Communication (1958), Pergamon, London
6. Busemeyer J.R., and Myung I.J. An adaptive approach to human decision-making: Learning theory, decision theory, and human performance. J. Exper. Psychol. General 121 (1992) 177-194
7. Busemeyer J.R., and Stout J.C. A contribution of cognitive decision models to clinical assessment: Decomposing performance on the Bechara gambling task. Psychol. Assessment 14 (2002) 253-262
8. Camerer C., and Ho T.-H. Experience-weighted attraction learning in normal form games. Econometrica 67 (1999) 827-874
9. Cheung Y.-W., and Friedman D. Individual learning in normal form games: Some laboratory results. Games Econ. Behav. 19 (1997) 46-76
10. Denrell J., and March J.G. Adaptation as information restriction: The hot stove effect. Organ. Sci. 12 (2001) 523-538
11. Efron B. Bootstrap methods: Another look at the jackknife. Ann. Statist. 7 (1979) 1-26
12. Erev I., and Barron G. On adaptation, maximization, and reinforcement learning among cognitive strategies. Psychol. Rev. 112 (2005) 912-931
13. Erev I., and Rapoport A. Magic, reinforcement learning and coordination in a market entry game. Games Econ. Behav. 23 (1998) 146-175
14. Erev I., and Roth A.E. Predicting how people play games: Reinforcement learning in experimental games with unique, mixed strategy equilibria. Amer. Econ. Rev. 88 (1998) 848-881
15. Erev I., Bereby-Meyer Y., and Roth A.E. The effect of adding a constant to all payoffs: Experimental investigation, and implications for reinforcement learning models. J. Econ. Behav. Organ. 39 (1999) 111-128
16. Fowles D.C. Psychophysiology and psychopathology: A motivational approach. Psychophysiology 25 (1988) 373-391
17. Fudenberg D., and Levine D.K. Consistency and cautious fictitious play. J. Econ. Dynam. Control 19 (1995) 1065-1089
18. Gluck M.A., and Bower G.H. From conditioning to category learning: An adaptive network model. J. Exper. Psychol. General 128 (1988) 309-331
19. Gray J.A. Personality dimensions and emotion systems. In: Ekman P., and Davidson R.J. (Eds). The Nature of Emotion: Fundamental Questions (1994), Oxford Univ. Press, New York 329-331
20. Higgins E.T. Beyond pleasure and pain. Amer. Psychol. 52 (1997) 1280-1300
21. Hjelle L.A., and Ziegler D.J. Personality Theories (1981), McGraw-Hill, Auckland
22. Kahneman D., and Tversky A. Prospect theory: An analysis of decision under risk. Econometrica 47 (1979) 263-291
23. Lejuez C.W., Read J.P., Kahler C.W., Richards J.B., Ramsey S.E., Stuart G.L., Strong D.R., and Brown R.A. Evaluation of a behavioral measure of risk taking: The Balloon Analogue Risk Task (BART). J. Exper. Psychol. Applied 8 (2002) 75-84
24. Lev, D., Hershkovitz, E., Yechiam, E., in press. Decision making and personality in traffic offenders: A study of Israeli drivers. Accident Anal. Prevention
25. Luce R.D. Individual Choice Behavior (1959), Wiley, New York
26. Myung I.J. The importance of complexity in model selection. J. Math. Psychol. 44 (2000) 190-204
27. Nelder J.A., and Mead R. A simplex method for function minimization. Comput. J. 7 (1965) 308-313
28. Newell A. Unified theories of cognition and the role of soar. In: Michon J.A., and Anureyk A. (Eds). Soar: A Cognitive Architecture in Perspective (1992), Kluwer Academic, Dordrecht 25-75
29. Newman J.P., Widom C.S., and Nathan S. Passive avoidance in syndromes of disinhibition, psychopathy and extraversion. J. Personality Soc. Psychol. 48 (1985) 1316-1327
30. Oberauer K., and Kliegl R. Beyond resources-Formal models for complexity effects and age differences in working memory. Europ. J. Cogn. Psychol. 13 (2001) 187-215
31. Rieskamp J., Busemeyer J., and Laine T. How do people learn to allocate resources? Comparing two learning theories. J. Exper. Psychol. Learning 29 (2003) 1066-1081
32. Roth A.E., and Erev I. Learning in extensive form games: Experimental data and simple dynamic models in the intermediate term. Games Econ. Behav. 8 (1995) 164-212
33. Rumelhart D.E., McClelland J.E., and PDP Research Group. Parallel Distributed Processing: Explorations in the Microstructure of Cognition. vols. 1 and 2 (1986), MIT Press, Cambridge, MA
34. Sarin R., and Vahid F. Payoff assessments without probabilities: A simple dynamic model of choice. Games Econ. Behav. 28 (1999) 294-309
35. Sarin R., and Vahid F. Predicting how people play games: A simple dynamic model of choice. Games Econ. Behav. 34 (2001) 104-122
36. Schwartz G. Estimating the dimension of a model. Ann. Statist. 5 (1978) 461-464
37. Stahl D. Boundedly rational rule learning in a guessing game. Games Econ. Behav. 16 (1996) 303-330
38. Sutton R.S., and Barto A.G. Reinforcement Learning: An Introduction (1998), MIT Press, Cambridge, MA
39. Thaler R.H., Tversky A., Kahneman D., and Schwartz A. The effect of myopia and loss aversion on risk taking: An experimental test. Quart. J. Econ. 112 (1997) 647-661
40. Wagenmakers E.J., Ratcliff R., Gomez P., and Iverson J. Assessing model mimicry using the parametric bootstrap. J. Math. Psychol. 48 (2004) 28-50
41. Wallsten T.W., Pleskac T., and Lejuez C.W. Modeling a sequential risk-taking task. Psychol. Rev. 112 (2005) 862-880
42. Yechiam E., and Budescu D.V. The sensitivity of probability assessments to time units and performer characteristics. Risk Anal. 3 (2006) 177-193
43. Yechiam E., and Busemeyer J.R. Comparison of basic assumptions embedded in learning models for experience based decision-making. Psychonomic Bull. Rev. 12 (2005) 387-402
44. Yechiam E., and Busemeyer J.R. The effect of foregone payoffs on underweighting small probability events. J. Behav. Dec. Making 19 (2006) 1-16
45. Yechiam E., Busemeyer J.R., Stout J.C., and Bechara A. Using cognitive models to map relations between neuropsychological disorders and human decision making deficits. Psychol. Sci. 16 (2005) 973-978
46. Yechiam E., Veinott E.S., Busemeyer J.R., and Stout J.C. Cognitive models for evaluating basic decision processes in clinical populations. In: Neufeld R. (Ed). Advances in Clinical Cognitive Science: Formal Modeling and Assessment of Processes and Symptoms (2007), APA Publications, Washington, DC 81-111
47. Yechiam, E., Kanz, J., Bechara, A., Stout, J.C., Busemeyer, J.R., Altmaier, E.M., Paulsen, J., in press. Neurocognitive deficits related to poor decision-making in people behind bars. Psychonomic Bull. Rev