Navigating through abstract decision spaces: Evaluating the role of state generalization in a dynamic decision-making task

Psychonomic Bulletin and Review

Volumn 16, Issue 5, 2009, Pages 957-963

  Otto, A Ross ^a   Gureckis, Todd M ^b   Markman, Arthur B ^a   Love, Bradley C ^a  

^a UNIVERSITY OF TEXAS AT AUSTIN   (United States)

^b NEW YORK UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; ASSOCIATION; DECISION MAKING; HUMAN; LEARNING; REWARD; TASK PERFORMANCE;

CUES; DECISION MAKING; GENERALIZATION, RESPONSE; HUMANS; REWARD; TASK PERFORMANCE AND ANALYSIS;

EID: 74849131215     PISSN: 10699384     EISSN: 15315320     Source Type: Journal    
DOI: 10.3758/PBR.16.5.957     Document Type: Article

References (16)

1. Bogacz, R., McClure, S. M., Li, J., Cohen, J. D., & Montague, P. R. (2007). Short-term memory traces for action bias in human reinforcement learning. Brain Research, 1153, 111-121. doi:10.1016/j.brainres.2007.03.057
2. Cartwright, B. A., & Collett, T. S. (1982). How honey bees use landmarks to guide their return to a food source. Nature, 295, 560-564. doi:10.1038/295560a0
3. Daw, N. D., O'Doherty, J. P., Dayan, P., Seymour, B., & Dolan, R. J. (2006). Cortical substrates for exploratory decisions in humans. Nature, 441, 876-879.
4. Erev, I., & Barron, G. (2005). On adaptation, maximization, and reinforcement learning among cognitive strategies. Psychological Review, 112, 912-931.
5. Gureckis, T. M., & Love, B. C. (in press). Short-term gains, long-term pains: How cues about state aid learning in dynamic environments. Cognition. doi:10.1016/j.cognition.2009.03.013
6. Herrnstein, R. J., Loewenstein, G. F., Prelec, D., & Vaughn, W. (1993). Utility maximization and melioration: Internalities in individual choice. Journal of Behavioral Decision Making, 6, 149-185. doi:10.1002/bdm.3960060302
7. Myerson, J., & Green, L. (1995). Discounting of delayed rewards: Models of individual choice. Journal of the Experimental Analysis of Behavior, 64, 263-276. doi:10.1901/jeab.1995.64-263
8. Neth, H., Sims, C. R., & Gray, W. D. (2006). Melioration dominates maximization: Stable suboptimal performance despite global feedback. In R. Sun & N. Miyake (Eds.), Proceedings of the 28th Annual Meeting of the Cognitive Science Society (pp. 627-632). Hillsdale, NJ: Erlbaum.
9. O'Keefe, J., & Nadel, L. (1978). The hippocampus as a cognitive map. Oxford: Oxford University Press, Clarendon Press.
10. Rachlin, H. (1995). Self-control: Beyond commitment. Behavioral & Brain Sciences, 18, 109-159.
11. Siegel, A. W., & White, S. H. (1975). The development of spatial representations of large-scale environments. Advances in Child Develop- ment & Behavior, 10, 9-55.
12. Stankiewicz, B. J., Legge, G. E., Mansfield, J. S., & Schlicht, E. J. (2006). Lost in virtual space: Studies in human and ideal spatial navigation. Journal of Experimental Psychology: Human Perception & Performance, 32, 688-704. doi:10.1037/0096-1523.32.3.688
13. Sutton, R., & Barto, A. G. (1998). Reinforcement learning. Cambridge, MA: MIT Press.
14. Tunney, R. J., & Shanks, D. R. (2002). A re-examination of melioration and rational choice. Journal of Behavioral Decision Making, 15, 291-311. doi:10.1002/bdm.415
15. Warry, C. J., Remington, B., & Sonuga-Barke, E. J. S. (1999). When more means less: Factors affecting human self-control in a local versus global choice paradigm. Learning & Motivation, 30, 53-73. doi:10.1006/lmot.1998.1018
16. Whitehead, S. D., & Ballard, D. H. (1991). Learning to perceive and act by trial and error. Machine Learning, 7, 45-83. doi:10.1023/ A:1022619109594