The role of the rat medial prefrontal cortex in adapting to changes in instrumental contingency

PLoS ONE

Volumn 7, Issue 4, 2012, Pages

  Coutureau, Etienne ^a,b   Esclassan, Frederic ^a,b   Di Scala, Georges ^a,b   Marchand, Alain R ^a,b  

^a UNIVERSITÉ DE BORDEAUX   (France)

^b CNRS   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTATION; ANIMAL BEHAVIOR; ANIMAL CELL; ANIMAL EXPERIMENT; ANIMAL TISSUE; ARTICLE; BRAIN MAPPING; CONTROLLED STUDY; DECISION MAKING; INSTRUMENTAL CONTINGENCY; MALE; MEDIAL PREFRONTAL CORTEX; NEUROTOXICITY; NONHUMAN; PERCEPTION; PREFRONTAL CORTEX; PROBABILITY; RAT; REWARD; TASK PERFORMANCE; TEMPORAL CORTEX; ANIMAL; COMPARATIVE STUDY; INSTRUMENTAL CONDITIONING; LONG EVANS RAT; PATHOPHYSIOLOGY; PHYSIOLOGY; REINFORCEMENT;

RATTUS;

ANIMALS; BEHAVIOR, ANIMAL; CHOICE BEHAVIOR; CONDITIONING, OPERANT; MALE; PREFRONTAL CORTEX; RATS; RATS, LONG-EVANS; REINFORCEMENT (PSYCHOLOGY); REWARD;

EID: 84859356932     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0033302     Document Type: Article

References (48)

1. Rangel A, Camerer C, Montague PR, (2008) A framework for studying the neurobiology of value-based decision making. Nat Rev Neurosci 9: 545-556.
2. Kargo WJ, Szatmary B, Nitz DA, (2007) Adaptation of prefrontal cortical firing patterns and their fidelity to changes in action-reward contingencies. J Neurosci 27: 3548-3559.
3. Tanaka SC, Balleine BW, O'Doherty JP, (2008) Calculating consequences: brain systems that encode the causal effects of actions. J Neurosci 28: 6750-6755.
4. Balleine BW, O'Doherty JP, (2010) Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology 35: 48-69.
5. Ostlund SB, Balleine BW, (2005) Lesions of medial prefrontal cortex disrupt the acquisition but not the expression of goal-directed learning. J Neurosci 25: 7763-7770.
6. Tran-Tu-Yen DA, Marchand AR, Pape JR, Di Scala G, Coutureau E, (2009) Transient role of the rat prelimbic cortex in goal-directed behaviour. Eur J Neurosci 30: 464-471.
7. Dutech A, Coutureau E, Marchand AR, (2011) A reinforcement learning approach to instrumental contingency degradation in rats. J Physiol Paris 105: 36-44.
8. Killcross S, Coutureau E, (2003) Coordination of actions and habits in the medial prefrontal cortex of rats. Cereb Cortex 13: 400-408.
9. Balleine BW, Dickinson A, (1998) Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 37: 407-419.
10. Corbit LH, Balleine BW, (2003) The role of prelimbic cortex in instrumental conditioning. Behav Brain Res 146: 145-157.
11. Naneix F, Marchand AR, Di Scala G, Pape JR, Coutureau E, (2009) A role for medial prefrontal dopaminergic innervation in instrumental conditioning. J Neurosci 29: 6599-6606.
12. Balleine BW, (2005) Neural bases of food-seeking: affect, arousal and reward in corticostriatolimbic circuits. Physiol Behav 86: 717-730.
13. Dickinson A, Squire S, Varga Z, Smith JW, (1998) Omission learning after instrumental pretraining. Q J Exp Psychol B 51: 271-286.
14. Paxinos G, Watson C, (1998) The Rat brain in stereotaxic coordinates San Diego (CA) Academic Press.
15. Shanks DR, Dickinson A, (1991) Instrumental judgment and performance under variations in action-outcome contingency and contiguity. Mem Cognit 19: 353-360.
16. Ishikawa A, Ambroggi F, Nicola SM, Fields HL, (2008) Contributions of the amygdala and medial prefrontal cortex to incentive cue responding. Neuroscience 155: 573-584.
17. Coutureau E, Marchand AR, Di Scala G, (2009) Goal-directed responding is sensitive to lesions to the prelimbic cortex or basolateral nucleus of the amygdala but not to their disconnection. Behav Neurosci 123: 443-448.
18. Mazaleski JL, Iwata BA, Vollmer TR, Zarcone JR, Smith RG, (1993) Analysis of the reinforcement and extinction components in DRO contingencies with self-injury. J Appl Behav Anal 26: 143-156.
19. Rushworth MF, Behrens TE, (2008) Choice, uncertainty and value in prefrontal and cingulate cortex. Nat Neurosci 11: 389-397.
20. Reynolds GS, (1961) Behavioral contrast. J Exp Anal Behav 4: 57-71.
21. Yin HH, Knowlton BJ, Balleine BW, (2006) Inactivation of dorsolateral striatum enhances sensitivity to changes in the action-outcome contingency in instrumental conditioning. Behav Brain Res 166: 189-196.
22. Ostlund SB, Winterbauer NE, Balleine BW, (2009) Evidence of action sequence chunking in goal-directed instrumental conditioning and its dependence on the dorsomedial prefrontal cortex. J Neurosci 29: 8280-8287.
23. Thompson RH, Iwata BA, Hanley GP, Dozier CL, Samaha AL, (2003) The effects of extinction, noncontingent reinforcement and differential reinforcement of other behavior as control procedures. J Appl Behav Anal 36: 221-238.
24. Vollmer TR, Ringdahl JE, Roane HS, Marcus BA, (1997) Negative side effects of noncontingent reinforcement. J Appl Behav Anal 30: 161-164.
25. Davis J, Bitterman ME, (1971) Differential reinforcement of other behavior (DRO): a yoked-control comparison. J Exp Anal Behav 15: 237-241.
26. Ringdahl JE, Vollmer TR, Borrero JC, Connell JE, (2001) Fixed-time schedule effects as a function of baseline reinforcement rate. J Appl Behav Anal 34: 1-15.
27. Williams BA, (1976) The effects of unsignalled delayed reinforcement. J Exp Anal Behav 26: 441-449.
28. Coutureau E, Killcross S, (2003) Inactivation of the infralimbic prefrontal cortex reinstates goal-directed responding in overtrained rats. Behav Brain Res 146: 167-174.
29. Dalley JW, Cardinal RN, Robbins TW, (2004) Prefrontal executive and cognitive functions in rodents: neural and neurochemical substrates. Neurosci Biobehav Rev 28: 771-784.
30. Fuster JM, (2001) The prefrontal cortex-an update: time is of the essence. Neuron 30: 319-333.
31. Azzi R, Fix DSR, Keller FS, Rocha e Silva MI, (1964) Exteroceptive control of response under delayed reinforcement. J Exp Anal Behav 7: 159-162.
32. Roesch MR, Calu DJ, Burke KA, Schoenbaum G, (2007) Should I stay or should I go? Transformation of time-discounted rewards in orbitofrontal cortex and associated brain circuits. Ann N Y Acad Sci 1104: 21-34.
33. Kheramin S, Body S, Ho MY, Velazquez-Martinez DN, Bradshaw CM, et al. (2004) Effects of orbital prefrontal cortex dopamine depletion on inter-temporal choice: a quantitative analysis. Psychopharmacology (Berl) 175: 206-214.
34. Miller EK, Cohen JD, (2001) An integrative theory of prefrontal cortex function. Annu Rev Neurosci 24: 167-202.
35. Bitterman ME, Schoel WM, (1970) Instrumental learning in animals: parameters of reinforcement. Annu Rev Psychol 21: 367-436.
36. Dickinson A, (1985) Actions and habits: the development of behavioural autonomy. Phil Trans R Soc Lond B Biol Sci 308: 67-78.
37. Maia TV, (2009) Reinforcement learning, conditioning, and the brain: Successes and challenges. Cogn Affect Behav Neurosci 9: 343-364.
38. Alexander WH, Brown JW, (2011) Medial prefrontal cortex as an action-outcome predictor. Nat Neurosci 14: 1338-1344.
39. Gläscher J, Daw N, Dayan P, O'Doherty JP, (2010) States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron 66: 585-595.
40. Faure A, Haberland U, Conde F, El Massioui N, (2005) Lesion to the nigrostriatal dopamine system disrupts stimulus-response habit formation. J Neurosci 25: 2771-2780.
41. Hitchcott PK, Quinn JJ, Taylor JR, (2007) Bidirectional modulation of goal-directed actions by prefrontal cortical dopamine. Cereb Cortex 17: 2820-2827.
42. Lex B, Hauber W, (2010) The role of dopamine in the prelimbic cortex and the dorsomedial striatum in instrumental conditioning. Cereb Cortex 20: 873-883.
43. Lammel S, Hetzel A, Hackel O, Jones I, Liss B, et al. (2008) Unique properties of mesoprefrontal neurons within a dual mesocorticolimbic dopamine system. Neuron 57: 760-773.
44. Fiorillo CD, Tobler PN, Schultz W, (2003) Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299: 1898-1902.
45. Matsumoto K, Tanaka K, (2004) The role of the medial prefrontal cortex in achieving goals. Curr Opin Neurobiol 14: 178-185.
46. Ragozzino ME, (2007) The contribution of the medial prefrontal cortex, orbitofrontal cortex, and dorsomedial striatum to behavioral flexibility. Ann N Y Acad Sci 1121: 355-375.
47. Daw ND, Niv Y, Dayan P, (2005) Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat Neurosci 8: 1704-1711.
48. Durstewitz D, Seamans JK, (2008) The dual-state theory of prefrontal cortex dopamine function with relevance to catechol-o-methyltransferase genotypes and schizophrenia. Biol Psychiatry 64: 739-749.