You don't want to know what you're missing: When information about forgone rewards impedes dynamic decision making

Judgment and Decision Making

Volumn 5, Issue 1, 2010, Pages 1-10

  Ross Otto, A ^a   Love, Bradley C ^a  

^a UNIVERSITY OF TEXAS AT AUSTIN   (United States)

Author keywords

Decision making; Delay of gratification; Dynamic environments; Learning; Reinforcement learning; Self control

Indexed keywords

EID: 77449100663     PISSN: None     EISSN: 19302975     Source Type: Journal    
DOI: None     Document Type: Article

References (23)

1. Bogacz, R., McClure, S. M., Li, J., Cohen, J. D., & Montague, P. R. (2007). Short-term memory traces for action bias in human reinforcement learning. Brain Research, 1153, 111-21.
2. Boorman, E. D., Behrens, T. E., Woolrich, M. W., & Rushworth, M. F. (2009). How Green Is the Grass on the Other Side? Frontopolar Cortex and the Evidence in Favor of Alternative Courses of Action. Neuron, 62, 733-743.
3. Busemeyer, J. R. (2002). Dynamic Decision Making. In Smelser, N. J. & Baltes, P. B. (Eds.) International Encyclopedia of the Social and Behavioral Sciences. Oxford: Elsevier Press Vol. 6., 3903-3908.
4. Camerer, C., & Ho, T. (1999). Experienced-Weighted Attraction Learning in Normal Form Games. Econometrica, 67, 827-874.
5. Christakis, N. A., & Fowler, J. H. (2007). The Spread of Obesity in a Large Social Network over 32 Years. The New England Journal of Medicine, 357, 370-379.
6. Daw, N. D., O'Doherty, J. P., Dayan, P., Seymour, B., & Dolan, R. J. (2006). Cortical substrates for exploratory decisions in humans. Nature, 441, 876-879.
7. Denrell, J., & March, J. G. (2001). Adaptation as Information Restriction: The Hot Stove Effect. Organization Science, 12, 523-538.
8. Ert, E., & Erev, I. (2007). Replicated alternatives and the role of confusion, chasing, and regret in decisions from experience. Journal of Behavioral Decision Making, 20,305-322.
9. Grosskopf, B., Erev, I., & Yechiam, E. (2006). Foregone with the Wind: Indirect Payoff Information and its Implications for Choice. International Journal of Game Theory, 34, 285-302.
10. Gureckis, T. M., & Love, B. C. (2009). Short-term gains, long-term pains: How cues about state aid learning in dynamic environments. Cognition, 113, 293-313.
11. Hare, T. A., Camerer, C. F., & Rangel, A. (2009). Self-control in decision-making involves modulation of the vmpfc valuation system. Science, 324, 646-648.
12. Herrnstein, R. J., Loewenstein, G. F., Prelec, D., & Vaughn, W. (1993). Utility maximization and melio-ration: Internalities in individual choice. Journal of Behavioral Decision Making, 6, 149-185.
13. Metcalfe, J., & Mischel, W. (1999). A hot/cool-system analysis of delay of gratification: dynamics of willpower. Psychological Review, 106, 3-19.
14. Mischel, W., Shoda, Y., & Rodriguez, M. (1989). Delay of gratification in children. Science, 244, 933-938.
15. Otto, A. R., Gureckis, T. M., Markman, A. B., & Love, B. C. (2009). Navigating through abstract decision spaces: Evaluating the role of state generalization in a dynamic decision-making task. Psychonomic Bulletin & Review, 16, 957-963.
16. Payne, J., Bettman, J., & Johnson, E. (1993). The Adaptive Decision Maker. New York: Cambridge University Press.
17. Rachlin, H. (1995). Self-control: Beyond commitment. Behavioral and Brain Sciences, 18, 109-159.
18. Rick, S., & Loewenstein, G. (2008). Intangibility in intertemporal choice. Philosophical Transactions of the Royal Society B: Biological Sciences, 363, 3813-3824.
19. Rodriguez, M. L., Mischel, W., & Shoda, Y. (1989). Cognitive person variables in the delay of gratification of older children at risk. Journal of Personality and Social Psychology, 57, 358-367.
20. Schultz, W., Dayan, P., & Montague, P. R. (1997). A Neural Substrate of Prediction and Reward. Science, 275,1593-1599.
21. Stroebe, W. (2008). Dieting, overweight, and obesity: self-regulation in a food-rich environment. Washington, D.C.: American Psychological Association.
22. Sutton, R., & Barto, A. G. (1998). Reinforcement Learning. Cambridge, MA: MIT Press.
23. Tunney, R. J., & Shanks, D. R. (2002). A re-examination of melioration and rational choice. Journal of Behavioral Decision Making, 15, 291-311.