Dopamine ramps are a consequence of reward prediction errors

Neural Computation

Volumn 26, Issue 3, 2014, Pages 467-471

  Gershman, Samuel J ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DOPAMINE;

ALGORITHM; ANIMAL; ARTICLE; BIOLOGICAL MODEL; CORPUS STRIATUM; DEPTH PERCEPTION; LEARNING; MAZE TEST; METABOLISM; MOTIVATION; PHYSIOLOGY; RAT; REWARD;

ALGORITHMS; ANIMALS; CORPUS STRIATUM; DOPAMINE; GOALS; LEARNING; MAZE LEARNING; MODELS, NEUROLOGICAL; RATS; REWARD; SPACE PERCEPTION;

EID: 84893432758     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/NECO_a_00559     Document Type: Article

References (15)

1. Bradtke, S. J., & Barto, A. G. (1996). Linear least-squares algorithms for temporal difference learning. Machine Learning, 22, 33-57.
2. Cheng, K. (1990). More psychophysics of the pigeon's use of landmarks. Journal of Comparative Physiology A, 166, 857-863.
3. Cheng, K., Srinivasan, M., & Zhang, S. (1999). Error is proportional to distance measured by honeybees: Weber's law in the odometer. Animal Cognition, 2, 11-16.
4. Daw, N. D., Courville, A. C., & Touretzky, D. S. (2006). Representation and timing in theories of the dopamine system. Neural Computation, 18, 1637-1677.
5. Foster, D., Morris, R., & Dayan, P. (2000). A model of hippocampally dependent navigation, using the temporal difference learning rule. Hippocampus, 10, 1-16.
6. Glimcher, P. W. (2011). Understanding dopamine and reinforcement learning: The dopamine reward prediction error hypothesis. Proceedings of the National Academy of Sciences, 108, 15647-15654.
7. Gustafson, N. J., & Daw, N. D. (2011). Grid cells, place cells, and geodesic generalization for spatial reinforcement learning. PLoS Computational Biology, 7(10), e1002235.
8. Howe, M.W., Tierney, P. L., Sandberg, S. G., Phillips, P. E., & Graybiel, A. M. (2013). Prolonged dopamine signalling in striatum signals proximity and value of distant rewards. Nature, 500, 575-579.
9. Kurth-Nelson, Z., & Redish, A. D. (2009). Temporal-difference reinforcement learning with distributed representations. PloS One, 4, e7362.
10. Ludvig, E. A., Sutton, R. S., & Kehoe, E. J. (2008). Stimulus representation and the timing of reward-prediction errors in models of the dopamine system. Neural Computation, 20, 3034-3054.
11. Niv, Y. (2013). Neuroscience: Dopamine ramps up. Nature, 500, 533-535.
12. Niv, Y., & Schoenbaum, G. (2008). Dialogues on prediction errors. Trends in Cognitive Sciences, 12, 265-272.
13. O'Keefe, J., & Burgess, N. (1996). Geometric determinants of the place fields of hippocampal neurons. Nature, 381, 425-428.
14. Schultz, W., Dayan, P., & Montague, P. R. (1997). A neural substrate of prediction and reward. Science, 275, 1593-1599.
15. Sutton,R. S.,&Barto, A. G. (1998). Reinforcement learning: An introduction. Cambridge, MA: MIT Press.