Different cortico-basal ganglia loops specialize in reward prediction on different time scales

Advances in Neural Information Processing Systems

Volumn , Issue , 2004, Pages

  Tanaka, Saori ^a   Doya, Kenji ^a   Okada, Go ^b   Ueda, Kazutaka ^b   Okamoto, Yasumasa ^b   Yamawaki, Shigeto ^b  

^a JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

^b HIROSHIMA UNIV SCHOOL OF MEDICINE   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

MAPS; TIME MEASUREMENT;

BRAIN ACTIVITY; BRAIN MECHANISMS; DIFFERENT TIME SCALE; EXPLANATORY VARIABLES; MARKOV DECISION; PERFORMANCE DATA; REWARD-PREDICTION ERROR; TOPOGRAPHIC MAP;

FORECASTING;

EID: 78649903166     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. Rogers, R.D., et al. (1999) Dissociable deficits in the decision-making cognition of chronic amphetamine abusers, opiate abusers, patients with focal damage to prefrontal cortex, and tryptophan-depleted normal volunteers: Evidence for monoaminergic mechanisms. Neuropsychopharmacology 20(4):322-339.
2. Evenden, J.L. & Ryan, C.N. (1996) The pharmacology of impulsive behaviour in rats: The effects of drugs on response choice with varying delays of reinforcement. Psychopharmacology (Berl) 128(2):161-170.
3. Mobini, S., et al. (2000) Effects of central 5-hydroxytryptamine depletion on sensitivity to delayed and probabilistic reinforcement. Psychopharmacology (Berl) 152(4):390-397.
4. Bechara, A., et al. (1994) Insensitivity to future consequences following damage to human prefrontal cortex. Cognition 50(1-3):7-15.
5. Bechara, A., Tranel, D. & Damasio, H. (2000) Characterization of the decision- making deficit of patients with ventromedial prefrontal cortex lesions. Brain 123:2189-2202.
6. Mobini, S., et al. (2002) Effects of lesions of the orbitofrontal cortex on sensitivity to delayed and probabilistic reinforcement. Psychopharmacology (Berl) 160(3):290-298.
7. Doya, K. (2002) Metalearning and neuromodulation. Neural Netw 15(4-6):495-506.
8. Sutton, R.S., Barto, A. G. (1998) Reinforcement learning. Cambridge, MA: MIT press.
9. Houk, J.C., Adams, J.L. & Barto, A.G., A model of how the basal ganglia generate and use neural signals that predict reinforcement, in Models of information processing in the basal ganglia, J.C. Houk, J.L. Davis, and D.G. Beiser, Editors. 1995, MIT Press: Cambridge, Mass. p. 249-270.
10. Schultz, W., Dayan, P. & Montague, P.R. (1997) A neural substrate of prediction and reward. Science 275(5306):1593-1599.
11. Doya, K. (2000) Complementary roles of basal ganglia and cerebellum in learning and motor control. Curr Opin Neurobiol 10(6):732-739.
12. Berns, G.S., et al. (2001) Predictability modulates human brain response to reward. J Neurosci 21(8):2793-2798.
13. O'Doherty, J.P., et al. (2003) Temporal difference models and reward-related learning in the human brain. Neuron 38(2):329-337.
14. Koepp, M.J., et al. (1998) Evidence for striatal dopamine release during a video game. Nature 393(6682):266-268.
15. Rogers, R.D., et al. (1999) Choosing between small, likely rewards and large, unlikely rewards activates inferior and orbital prefrontal cortex. J Neurosci 19(20):9029-9038.
16. Elliott, R., Friston, K.J. & Dolan, R.J. (2000) Dissociable neural responses in human reward systems. J Neurosci 20(16):6159-6165.
17. Breiter, H.C., et al. (2001) Functional imaging of neural responses to expectancy and experience of monetary gains and losses. Neuron 30(2):619-639.
18. Knutson, B., et al. (2001) Anticipation of increasing monetary reward selectively recruits nucleus accumbens. J Neurosci 21(16):RC159.
19. O'Doherty, J.P., et al. (2002) Neural responses during anticipation of a primary taste reward. Neuron 33(5):815-826.
20. Pagnoni, G., et al. (2002) Activity in human ventral striatum locked to errors of reward prediction. Nat Neurosci 5(2):97-98.
21. Haber, S.N., et al. (1995) The orbital and medial prefrontal circuit through the primate basal ganglia. J Neurosci 15(7 Pt 1):4851-4867.
22. Celada, P., et al. (2001) Control of dorsal raphe serotonergic neurons by the medial prefrontal cortex: Involvement of serotonin-1A, GABA(A), and glutamate receptors. J Neurosci 21(24):9917-9929.
23. Martin-Ruiz, R., et al. (2001) Control of serotonergic function in medial prefrontal cortex by serotonin-2A receptors through a glutamate-dependent mechanism. J Neurosci 21(24):9856-9866.