Differential representation of Pavlovian-instrumental transfer by prefrontal cortex subregions and striatum

European Journal of Neuroscience

Volumn 29, Issue 7, 2009, Pages 1461-1476

  Homayoun, Houman ^a   Moghaddam, Bita ^a  

^a UNIVERSITY OF PITTSBURGH SCHOOL OF MEDICINE   (United States)

Author keywords

Cue triggered motivation; Freely moving rat; Instrumental conditioning; Orbitofrontal cortex; Pavlovian conditioning

Indexed keywords

ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ANIMAL TISSUE; ARTICLE; BRAIN REGION; CONDITIONED REFLEX; CONTROLLED STUDY; CORPUS STRIATUM; INSTRUMENTAL CONDITIONING; LEARNING ENVIRONMENT; MALE; MOTIVATION; NERVE CELL; NONHUMAN; PREFRONTAL CORTEX; PRIORITY JOURNAL; RAT; RECORDING; REWARD; STIMULUS RESPONSE;

ACTION POTENTIALS; ANALYSIS OF VARIANCE; ANIMALS; BEHAVIOR, ANIMAL; CONDITIONING, OPERANT; CORPUS STRIATUM; DIZOCILPINE MALEATE; ELECTRODES, IMPLANTED; EXCITATORY AMINO ACID ANTAGONISTS; MALE; MICROELECTRODES; NEURONS; PREFRONTAL CORTEX; RATS; RATS, SPRAGUE-DAWLEY; REWARD; TIME FACTORS; TRANSFER (PSYCHOLOGY);

EID: 64049104800     PISSN: 0953816X     EISSN: 14609568     Source Type: Journal    
DOI: 10.1111/j.1460-9568.2009.06679.x     Document Type: Article

References (54)

1. Baldwin, A.E., Holahan, M.R., Sadeghian, K. Kelley, A.E. (2000) N-methyl-D-aspartate receptor-dependent plasticity within a distributed corticostriatal network mediates appetitive instrumental learning. Behav. Neurosci., 114, 84 98.
2. Balleine, B.W. Dickinson, A. (1998) Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology, 37, 407 419.
3. Barnes, T., Kubota, Y., Hu, D., Jin, D. Graybiel, A. (2005) Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories. Nature, 437, 1158 1161.
4. Bolla, K., Eldreth, D., London, E., Kiehl, K., Mouratidis, M., Contoreggi, C., Matochik, J., Kurianl, V., Cadet, J., Kimes, A., Funderburk, F. Ernst, M. (2003) Orbitofrontal cortex dysfunction in abstinent cocaine abusers performing a decision-making task. Neuroimage, 19, 1085 1094.
5. de Borchgrave, R., Rawlins, J., Dickinson, A. Balleine, B. (2002) Effects of cytotoxic nucleus accumbens lesions on instrumental conditioning in rats. Exp. Brain Res., 144, 50 68.
6. Burke, K.A., Franz, T.M., Miller, D.N. Schoenbaum, G. (2008) The role of the orbitofrontal cortex in the pursuit of happiness and more specific rewards. Nature, 454, 340 344.
7. Cardinal, R. Everitt, B. (2004) Neural and psychological mechanisms underlying appetitive learning: links to drug addiction. Curr. Opin. Neurobiol., 14, 156 162.
8. Cardinal, R., Parkinson, J., Hall, J. Everitt, B. (2002) Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex. Neurosci. Biobehav. Rev., 26, 321 352.
9. Christakou, A., Robbins, T. Everitt, B. (2004) Prefrontal cortical-ventral striatal interactions involved in affective modulation of attentional performance: implications for corticostriatal circuit function. J. Neurosci., 24, 773 780.
10. Chudasama, Y. Robbins, T. (2003) Dissociable contributions of the orbitofrontal and infralimbic cortex to pavlovian autoshaping and discrimination reversal learning: further evidence for the functional heterogeneity of the rodent frontal cortex. J. Neurosci., 23, 8771 8780.
11. Corbit, L. Balleine, B. (2003) The role of prelimbic cortex in instrumental conditioning. Behav. Brain Res., 146, 145 157.
12. Corbit, L., Muir, J. Balleine, B. (2001) The role of the nucleus accumbens in instrumental conditioning: evidence of a functional dissociation between accumbens core and shell. J. Neurosci., 21, 3251 3260.
13. Dickinson, A. Balleine, B. (1994) Motivational control of goal-directed action. Anim. Learn. Behav., 22, 1 8.
14. Dickinson, A., Smith, J. Mirenowicz, J. (2000) Dissociation of Pavlovian and instrumental incentive learning under dopamine antagonists. Behav. Neurosci., 114, 468 483.
15. Ersche, K., Fletcher, P., Lewis, S., Clark, L., Stocks-Gee, G., London, M., Deakin, J., Robbins, T. Sahakian, B. (2005) Abnormal frontal activations related to decision making in current and former amphetamine- and opiate-dependent individuals. Psychopharmacology, 180, 612 623.
16. Estes, W. (1948) Discriminative conditioning. II. Effects of a Pavlovian conditioned stimulus upon a subsequently established operant response. J. Exp. Physiol., 38, 173 177.
17. Everitt, B., Dickinson, A. Robbins, T. (2001) The neuropsychological basis of addictive behaviour. Brain Res. Brain Res. Rev., 36, 129 138.
18. Gallagher, M., McMahan, R. Schoenbaum, G. (1999) Orbitofrontal cortex and representation of incentive value in associative learning. J. Neurosci., 19, 6610 6614.
19. Ghitza, U., Prokopenko, V., West, M. Fabbricatore, A. (2006) Higher magnitude accumbal phasic firing changes among core neurons exhibiting firing increases during cocaine self-administration. Neuroscience, 137, 1075 1085.
20. Goldstein, R.Z., Tomasi, D., Rajaram, S., Cottone, L.A., Zhang, L., Maloney, T., Telang, F., Alia-Klein, N. Volkow, N.D. (2007a) Role of the anterior cingulate and medial orbitofrontal cortex in processing drug cues in cocaine addiction. Neuroscience, 144, 1153 1159.
21. Goldstein, R.Z., Alia-Klein, N., Tomasi, D., Zhang, L., Cottone, L.A., Maloney, T., Telang, F., Caparelli, E.C., Chang, L., Ernst, T., Samaras, D., Squires, N.K. Volkow, N.D. (2007b) Is decreased prefrontal cortical sensitivity to monetary reward associated with impaired motivation and self-control in cocaine addiction? Am. J. Psych., 164, 43 51.
22. Hall, J., Parkinson, J., Connor, T., Dickinson, A. Everitt, B. (2001) Involvement of the central nucleus of the amygdala and nucleus accumbens core in mediating Pavlovian influences on instrumental behaviour. Eur. J. Neurosci., 13, 1984 1992.
23. Hitchcott, P.K., Quinn, J.J. Taylor, J.R. (2007) Bidirectional modulation of goal-directed actions by prefrontal cortical dopamine. Cereb. Cortex, 17, 2820 2827.
24. Holland, P. Gallagher, M. (2003) Double dissociation of the effects of lesions of basolateral and central amygdala on conditioned stimulus-potentiated feeding and Pavlovian-instrumental transfer. Eur. J. Neurosci., 17, 1680 1694.
25. Homayoun, H. Moghaddam, B. (2006) Progression of cellular adaptations in medial prefrontal and orbitofrontal cortex in response to repeated amphetamine. J. Neurosci., 26, 8025 8039.
26. Homayoun, H. Moghaddam, B. (2008a) Divergent plasticity of prefrontal cortex networks. Neuropsychopharmacology, 33, 42 55.
27. Homayoun, H. Moghaddam, B. (2008b) Orbitofrontal cortex neurons as a common cellular target for different classes of antipsychotic drugs. Proc. Natl Acad. Sci. USA, 105, 18041 18046.
28. Homayoun, H., Jackson, M.E. Moghaddam, B. (2004) Activation of metabotropic glutamate 2/3 (mGlu2/3) receptors reverses the effects of NMDA receptor hypofunction on prefrontal cortex unit activity in awake rats. J. Neurophysiol., 93, 1989 2001.
29. Jackson, M., Homayoun, H. Moghaddam, B. (2004) NMDA receptor hypofunction produces concomitant firing rate potentiation and burst activity reduction in the prefrontal cortex. Proc. Natl Acad. Sci. USA, 101, 6391 6396.
30. Kapur, S. (2003) Psychosis as a state of aberrant salience: a framework linking biology, phenomenology, and pharmacology in schizophrenia. Am. J. Psych., 160, 13 23.
31. Kelley, A. (2004) Memory and addiction: shared neural circuitry and molecular mechanisms. Neuron, 44, 161 179.
32. Killcross, S. Coutureau, E. (2003) Coordination of actions and habits in the medial prefrontal cortex of rats. Cereb. Cortex, 13, 400 408.
33. Lovibond, P. (1983) Facilitation of instrumental behavior by a Pavlovian appetitive conditioned stimulus. J. Exp. Psychol. Anim. Behav. Proc., 9, 225 247.
34. McCormick, D.A., Connors, B.W., Lighthall, J.W. Prince, D.A. (1985) Comparative electrophysiology of pyramidal and sparsely spiny stellate neurons of the neocortex. J. Neurophysiol., 54, 782 806.
35. Moghaddam, B. Jackson, M.E. (2003) Glutamatergic animal models of schizophrenia. Ann. N. Y. Acad. Sci., 1003, 131 137.
36. Mulder, A.B., Nordquist, R.E., Orgut, O. Pennartz, C.M. (2003) Learning-related changes in response patterns of prefrontal neurons during instrumental conditioning. Behav. Brain Res., 146, 77 88.
37. Murschall, A. Hauber, W. (2006) Inactivation of the ventral tegmental area abolished the general excitatory influence of Pavlovian cues on instrumental performance. Learn. Mem., 13, 123 126.
38. Nicolelis, M., Dimitrov, D., Carmena, J., Crist, R., Lehew, G., Kralik, J. Wise, S. (2003) Chronic, multisite, multielectrode recordings in macaque monkeys. Proc. Natl Acad. Sci. USA, 100, 11041 11046.
39. Ostlund, S. Balleine, B. (2007) Orbitofrontal cortex mediates outcome encoding in Pavlovian but not instrumental conditioning. J. Neurosci., 27, 4819 4825.
40. Pasupathy, A. Miller, E. (2005) Different time course of learning-related activity in the prefrontal cortex and striatum. Nature, 433, 873 876.
41. Paxinos, G. Watson, C. (1998) The Rat Brain in Stereotaxic Coordinates. Academic Press, San Diego.
42. Pecinna, S., Schulkin, J. Berridge, K. (2006) Nucleus accumbens corticotropin-releasing factor increases cue-triggered motivation for sucrose reward: paradoxical positive incentive effects in stress? BMC Biol., 4, 8.
43. Peters, Y., O'Donnell, P. Carelli, R. (2005) Prefrontal cortical cell firing during maintenance, extinction, and reinstatement of goal-directed behavior for natural reward. Synapse, 56, 74 83.
44. Rescorla, R. Solomon, R. (1967) Two-process learning theory: relationships between Pavlovian conditioning and instrumental learning. Psychol. Rev., 74, 151 172.
45. Saddoris, M., Gallagher, M. Schoenbaum, G. (2005) Rapid associative encoding in basolateral amygdala depends on connections with orbitofrontal cortex. Neuron, 46, 321 331.
46. Schoenbaum, G., Setlow, B., Saddoris, M.P. Gallagher, M. (2003) Encoding predicted outcome and acquired value in orbitofrontal cortex during cue sampling depends upon input from basolateral amygdala. Neuron, 39, 855 867.
47. Stalnaker, T., Franz, T., Singh, T. Schoenbaum, G. (2007) Basolateral amygdala lesions abolish orbitofrontal-dependent reversal impairments. Neuron, 54, 51 58.
48. Tierney, P., Degenetais, E., Thierry, A.M., Glowinski, J. Gioanni, Y. (2004) Influence of the hippocampus on interneurons of the rat prefrontal cortex. Eur. J. Neurosci., 20, 514 524.
49. Tremblay, L. Schultz, W. (1999) Relative reward preference in primate orbitofrontal cortex. Nature, 398, 704 708.
50. Volkow, N.D. Fowler, J.S. (2000) Addiction, a disease of compulsion and drive: involvement of the orbitofrontal cortex. Cereb. Cor., 10, 318 325.
51. Volkow, N.D., Fowler, J.S. Wang, G.J. (2004) The addicted human brain viewed in the light of imaging studies: brain circuits and treatment strategies. Neuropharmacology, 47 (Suppl. 1 3 13.
52. Wyvell, C. Berridge, K. (2000) Intra-accumbens amphetamine increases the conditioned incentive salience of sucrose reward: enhancement of reward "wanting" without enhanced "liking" or response reinforcement. J. Neurosci., 20, 8122 8130.
53. Wyvell, C. Berridge, K. (2001) Incentive sensitization by previous amphetamine exposure: increased cue-triggered "wanting" for sucrose reward. J. Neurosci., 21, 7831 7840.
54. Yin, H., Ostlund, S., Knowlton, B. Balleine, B. (2005) The role of the dorsomedial striatum in instrumental conditioning. Eur. J. Neurosci., 22, 513 523.