Overlapping prediction errors in dorsal striatum during instrumental learning with juice and money reward in the human brain

Journal of Neurophysiology

Volumn 102, Issue 6, 2009, Pages 3384-3391

  Valentin, Vivian V ^a   O'Doherty, John P ^a,b  

^a CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

^b TRINITY COLLEGE DUBLIN   (Ireland)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; CAUDATE NUCLEUS; CONTROLLED STUDY; CORPUS STRIATUM; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; INSTRUMENTAL CONDITIONING; MALE; NEUROIMAGING; NORMAL HUMAN; PRIORITY JOURNAL; REINFORCEMENT; REWARD; TASK PERFORMANCE; VISUAL STIMULATION;

ADULT; BRAIN; CHOICE BEHAVIOR; CONDITIONING, OPERANT; CORPUS STRIATUM; CUES; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; OXYGEN; PHOTIC STIMULATION; REINFORCEMENT (PSYCHOLOGY); REWARD; YOUNG ADULT;

EID: 72749098381     PISSN: 00223077     EISSN: 15221598     Source Type: Journal    
DOI: 10.1152/jn.91195.2008     Document Type: Article

References (30)

1. Abler B, Walter H, Erk S, Kammerer H, Spitzer M. Prediction error as a linear function of reward probability is coded in human nucleus accumbens. NeuroImage 31: 790-795, 2006. (Pubitemid 43776671)
2. Balleine BW, Daw ND, and O'Doherty J P. Multiple forms of value learning and the function of dopamine. In: Neuroeconomics: Decision Making and the Brain, edited by Glimcher PW, Camerer CF, Poldrack RA, Fehr E. New York: Academic Press, 2008, p. 367-388.
3. Balleine BW, Dickinson A. Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 37: 407-419, 1998. (Pubitemid 28306930)
4. Barto AG. Reinforcement learning and adaptive critic methods. In: Handbook of Intelligent Control: Neural, Fuzzy, and Adaptive Approaches, edited by White DA, Sofge DA. New York: Van Norstrand Reinhold, 1992, p. 469-491.
5. Barto AG. Adaptive critics and the basal ganglia. In: Models of Information Processing in the Basal Ganglia, edited by Houk JC, Davis JL, Beiser BG. Cambridge, MA: MIT Press, 1995, p. 215-232.
6. Bray S, O'Doherty J. Neural coding of reward-prediction error signals during classical conditioning with attractive faces. J Neurophysiol 97: 3036-3045, 2007. (Pubitemid 46557731)
7. Daw ND, Niv Y, Dayan P. Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat Neurosci 8: 1704-1711, 2005. (Pubitemid 41683198)
8. Dayan P, Balleine BW. Reward, motivation, and reinforcement learning. Neuron 36: 285-298, 2002.
9. Deichmann R, Gottfried JA, Hutton C, Turner R. Optimized EPI for fMRI studies of the orbitofrontal cortex. Neuroimage 19: 430-441, 2003. (Pubitemid 39665693)
10. Dickinson A. Actions and habits: the development of a behavioural autonomy. Philos Trans R Soc Lond B Biol Sci 308: 67-78, 1985.
11. Friston KJ, Holmes AP, Poline JB, Grasby PJ, Williams SC, Frackowiak RS, Turner R. Analysis of fMRI time-series revisited. Neuroimage 2: 45-53, 1995.
12. Hare TA, O'Doherty J, Camerer CF, Schultz W, Rangel A. Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors. J Neurosci 28: 5623-5630, 2008.
13. Haruno M, Kawato M. Different neural correlates of reward expectation and reward expectation error in the putamen and caudate nucleus during stimulus-action-reward association learning. J Neurophysiol 95: 948-959, 2006. (Pubitemid 44699097)
14. Holland PC, Straub JJ. Differential effects of two ways of devaluing the unconditioned stimulus after Pavlovian appetitive conditioning. J Exp Psychol Anim Behav Process 5: 65-78, 1979.
15. Kim H, Shimojo S, O'Doherty JP. Is avoiding an aversive outcome rewarding? Neural substrates of avoidance learning in the human brain. PLoS Biol 4:e233, 2006.
16. Konorski, J. Conditioned Reflexes and Neuron Organization. Cambridge, UK: Cambridge Univ. Press, 1948.
17. McClure SM, Berns GS, Montague PR. Temporal prediction errors in a passive learning task activate human striatum. Neuron 38: 339-346, 2003.
18. Mirenowicz J, Schultz W. Importance of unpredictability for reward responses in primate dopamine neurons. J Neurophysiol 72: 1024-1027, 1994. (Pubitemid 24273601)
19. Montague PR, Berns GS. Neural economics and the biological substrates of valuation. Neuron 36: 265-284, 2002. (Pubitemid 35217891)
20. Montague PR, Dayan P, Sejnowski TJ. A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci 16: 1936-1947, 1996.
21. Montague PR, King-Casas B, Cohen JD. Imaging valuation models in human choice. Annu Rev Neurosci 29: 417-448, 2006. (Pubitemid 44476852)
22. Morris G, Nevet A, Arkadir D, Vaadia E, Bergman H. Midbrain dopamine neurons encode decisions for future action. Nat Neurosci 9: 1057-1063, 2006. (Pubitemid 44264919)
23. O'Doherty JP. Lights, camembert, action! The role of human orbitofrontal cortex in encoding stimuli, rewards, and choices. Ann NY Acad Sci 1121: 254-272, 2007.
24. O'Doherty JP, Buchanan TW, Seymour B, Dolan RJ. Predictive neural coding of reward preference involves dissociable responses in human ventral midbrain and ventral striatum. Neuron 49: 157-166, 2006. (Pubitemid 43017193)
25. O'Doherty J, Dayan P, Friston K, Critchley H, Dolan RJ. Temporal difference models and reward-related learning in the human brain. Neuron 38: 329-337, 2003. (Pubitemid 36555657)
26. O'Doherty J, Dayan P, Schultz J, Deichmann R, Friston K, Dolan RJ. Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304: 452-454, 2004. (Pubitemid 38495943)
27. Pessiglione M, Seymour B, Flandin G, Dolan RJ, Frith CD. Dopamine-dependent prediction errors underpin reward-seeking behavior in humans. Nature 442: 1042-1045, 2006. (Pubitemid 44330261)
28. Roesch MR, Calu DJ, Schoenbaum G. Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards. Nat Neurosci 10: 1615-1624, 2007. (Pubitemid 350175882)
29. Schultz W. Predictive reward signal of dopamine neurons. J Neurophysiol 80: 1-27, 1998. (Pubitemid 28326237)
30. Tanaka SC, Doya K, Okada G, Ueda K, Okamoto Y, Yamawaki S. Prediction of immediate and future rewards differentially recruits corticobasal ganglia loops. Nat Neurosci 7: 887-893, 2004. (Pubitemid 38989513)