Neural correlates of instrumental contingency learning: Differential effects of action-reward conjunction and disjunction

Journal of Neuroscience

Volumn 31, Issue 7, 2011, Pages 2474-2480

  Liljeholm, Mimi ^a   Tricomi, Elizabeth ^b   O'Doherty, John P ^a,c   Balleine, Bernard W ^d,e  

^a CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

^b RUTGERS UNIVERSITY   (United States)

^c TRINITY COLLEGE DUBLIN   (Ireland)

^d UNIVERSITY OF CALIFORNIA   (United States)

^e UNIVERSITY OF SYDNEY   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; BEHAVIOR; CORPUS STRIATUM; DECISION MAKING; FEMALE; HUMAN; HUMAN EXPERIMENT; LEARNING; MIDDLE FRONTAL GYRUS; NORMAL HUMAN; ORBITAL CORTEX; PARIETAL LOBE; PRIORITY JOURNAL; REWARD; THEORY; VENTROMEDIAL PREFRONTAL CORTEX;

BRAIN; BRAIN MAPPING; CONDITIONING, OPERANT; FEMALE; GOALS; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; NEURAL PATHWAYS; OXYGEN; PROBABILITY; REWARD; STATISTICS AS TOPIC;

EID: 79951839136     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.3354-10.2011     Document Type: Article

References (32)

1. Balleine BW, Dickinson A (1998) Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 37:407-419. (Pubitemid 28306930)
2. Balleine BW, O'Doherty JP (2010) Human and rodent homologies in action control: cortico-striatal determinants of goal-directed and habitual action. Neuropsychopharmacology 35:48-69.
3. Brett M, Anton J, Valabregue R, Poline J (2002) Region of interest analysis using an SPM toolbox. Paper presented at the 8th International Conference on Functional Mapping of the Human Brain, Sendai, Japan, June 2-6, 2002. [Available on CD-ROM in Neuroimage 16(2).]
4. Bush G, Vogt BA, Holmes J, Dale AM, Greve D, Jenike MA, Rosen BR (2002) Dorsal anterior cingulate cortex: a role in reward-based decision making. Proc Natl Acad Sci U S A 99:523-528. (Pubitemid 34060394)
5. Chatlosh DL, Neunaber DJ, Wasserman EA (1985) Response-outcome contingency: behavioral and judgmental effects of appetitive and aversive outcomes with college students. Learn Motiv 16:1-34.
6. Corbit LH, Balleine BW (2003) The role of prelimbic cortex in instrumental conditioning. Behav Brain Res 146:145-157. (Pubitemid 37476141)
7. Corbit LH, Janak PH (2010) Posterior dorsomedial striatum is critical for both instrumental and Pavlovian reward learning. Eur J Neurosci 31:1312-1321.
8. Delgado MR, Miller MM, Inati S, Phelps EA (2005) An fMRI study of reward-related probability learning. Neuroimage 24:862-873. (Pubitemid 40094568)
9. Ernst M, Nelson EE, McClure EB, Monk CS, Munson S, Eshel N, Zarahn E, Leibenluft E, Zametkin A, Towbin K, Blair J, Charney D, Pine DS (2004) Choice selection and reward anticipation: an fMRI study. Neuropsychologia 42:1585-1597. (Pubitemid 39140870)
10. Esterman M, Tamber-Rosenau BJ, Chiu YC, Yantis S (2010) Avoiding non-independence in fMRI data analysis: leave one subject out. Neuroimage 50:572-576.
11. Forman SD, Cohen JD, Fitzgerald M, Eddy WF, Mintun MA, Noll DC (1995) Improved assessment of significant activation in functional magnetic resonance imaging (fMRI): use of a cluster-size threshold. Magn Reson Med 33:636-647.
12. Gläscher J, Hampton AN, O'Doherty JP (2009) Determining a role for ventromedial prefrontal cortex in encoding action-based value signals during reward-related decision making. Cereb Cortex 19:483-495.
13. Hammond LJ (1980) The effect of contingency upon the appetitive conditioning of free-operant behavior. J Exp Anal Behav 34:297-304.
14. Hampton AN, Bossaerts P, O'Doherty JP (2006) The role of the ventromedial prefrontal cortex in abstract state-based inference during decision making in humans. J Neurosci 26:8360-8367. (Pubitemid 44309850)
15. Kable JW, Glimcher PW (2007) The neural correlates of subjective value during intertemporal choice. Nat Neurosci 10:1625-1633. (Pubitemid 350175876)
16. Koch K, Schachtzabel C, Wagner G, Reichenbach JR, Sauer H, Schlösser R (2008) The neural correlates of reward-related trial-and-error learning: an fMRI study with a probabilistic learning task. Learn Mem 15:728-732.
17. Levitt JJ, McCarley RW, Dickey CC, Voglmaier MM, Niznikiewicz MA, Seidman LJ, Hirayasu Y, Ciszewski AA, Kikinis R, Jolesz FA, Shenton ME (2002) MRI study of caudate nucleus volume and its cognitive correlates in neuroleptic-naive patients with schizotypal personality disorder. Am J Psychiatry 159:1190-1197. (Pubitemid 34743260)
18. Maldjian JA, Laurienti PJ, Kraft RA, Burdette JH (2003) An automated method for neuroanatomic and cytoarchitectonic atlas-based interrogation of fMRI data sets. Neuroimage 19:1233-1239. (Pubitemid 36918259)
19. O'Doherty J, Critchley H, Deichmann R, Dolan RJ (2003) Dissociating value of outcome from behavioral control in human orbital and ventral prefrontal cortices. J Neurosci 23:7931-7939. (Pubitemid 37052362)
20. O'Doherty JP, Deichmann R, Critchley HD, Dolan RJ (2002) Neural responses during anticipation of a primary taste reward. Neuron 33:815-826. (Pubitemid 34219251)
21. Samejima K, Ueda Y, Doya K, Kimura M (2005) Representation of action-specific reward values in the striatum. Science 310:1337-1340. (Pubitemid 41698867)
22. Schlund MW, Cataldo MF (2005) Integrating functional neuroimaging and human operant research: brain activation correlated with presentation of discriminative stimuli. J Exp Anal Behav 84:505-519. (Pubitemid 43339122)
23. Schlund MW, Ortu D (2010) Experience-dependent changes in human brain activation during contingency learning. Neuroscience 165:151-158.
24. Seo H, Barraclough DJ, Lee D (2009) Lateral intraparietal cortex and reinforcement learning during a mixed-strategy game. J Neurosci 29:7278-7289.
25. Shanks DR, Dickinson A (1991) Instrumental judgment and performance under variations in action-outcome contingency and contiguity. Mem Cognit 19:353-360.
26. Smith DV, Hayden BY, Truong TK, Song AW, Platt ML, Huettel SA (2010) Distinct value signals in anterior and posterior ventromedial prefrontal cortex. J Neurosci 30:2490-2495.
27. Sutton RS, Barto AG (1998) Reinforcement learning. Cambridge, MA: MIT.
28. Tanaka SC, Balleine BW, O'Doherty JP (2008) Calculating consequences: Brain systems that encode the causal effects of actions. J Neurosci 28:6750-6755.
29. Tricomi EM, Delgado MR, Fiez JA (2004) Modulation of caudate activity by action contingency. Neuron 41:281-292. (Pubitemid 38125188)
30. Valentin VV, Dickinson A, O'Doherty JP (2007) Determining the neural substrates of goal-directed learning in the human brain. J Neurosci 27:4019-4026. (Pubitemid 46597159)
31. Wunderlich K, Rangel A, O'Doherty JP (2010) Economic choices can be made using only stimulus values. Proc Natl Acad Sci U S A 107:15005-15010.
32. Yin HH, Ostlund SB, Knowlton BJ, Balleine BW (2005) The role of the dorsomedial striatum in instrumental conditioning. Eur J Neurosci 22:513-523. (Pubitemid 41097624)