Intact discrimination reversal learning but slowed responding to reward-predictive cues after dopamine D1 and D2 receptor blockade in the nucleus accumbens of rats

Psychopharmacology

Volumn 191, Issue 3, 2007, Pages 551-566

  Calaminus, Carsten ^a   Hauber, Wolfgang ^a  

^a UNIVERSITY OF STUTTGART   (Germany)

Author keywords

Dopamine; Instrumental conditioning; Prediction error; Raclopride; Rat; Reversal learning; SCH23390

Indexed keywords

8 CHLORO 2,3,4,5 TETRAHYDRO 3 METHYL 5 PHENYL 1H 3 BENZAZEPIN 7 OL HYDROGEN MALEATE; DOPAMINE 1 RECEPTOR; DOPAMINE 1 RECEPTOR BLOCKING AGENT; DOPAMINE 2 RECEPTOR; DOPAMINE 2 RECEPTOR BLOCKING AGENT; RACLOPRIDE;

ANIMAL EXPERIMENT; ANIMAL MODEL; ANIMAL TISSUE; ARTICLE; ASSOCIATION; CONTROLLED STUDY; DISCRIMINATION LEARNING; DOPAMINE RECEPTOR BLOCKING; DOSE RESPONSE; FOOD INTAKE; INSTRUMENTAL CONDITIONING; LEARNING; MENTAL TASK; NONHUMAN; NUCLEUS ACCUMBENS; PREDICTION; PRIORITY JOURNAL; RAT; REACTION TIME; REWARD; SIGNAL TRANSDUCTION; STATISTICAL ANALYSIS; VISUAL DISCRIMINATION;

(R)-2,3,4,5-TETRAHYDRO-8-CHLORO-3-METHYL-5-PHENYL-1H-3-BENZAZEPIN-7-OL; ANIMALS; BEHAVIOR, ANIMAL; CONDITIONING, OPERANT; CUES; DISCRIMINATION LEARNING; DOPAMINE; DOPAMINE ANTAGONISTS; DOSE-RESPONSE RELATIONSHIP, DRUG; MOTOR ACTIVITY; NUCLEUS ACCUMBENS; RACLOPRIDE; RATS; REACTION TIME; RECEPTORS, DOPAMINE D1; RECEPTORS, DOPAMINE D2; REVERSAL LEARNING; REWARD;

EID: 33847662054     PISSN: 00333158     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00213-006-0532-y     Document Type: Article

References (63)

1. Aberman JE, Salamone JD (1999) Nucleus accumbens dopamine depletions make rats more sensitive to high ratio requirements but do not impair primary food reinforcement. Neuroscience 92:545-552
2. Amalric M, Koob GF (1987) Depletion of dopamine in the caudate nucleus but not in nucleus accumbens impairs reaction-time performance in rats. J Neurosci 7:2129-2134
3. Annett LE, McGregor A, Robbins TW (1989) The effects of ibotenic acid lesions of the nucleus accumbens on spatial learning and extinction in the rat. Behav Brain Res 31:231-242
4. Balleine B, Killcross S (1994) Effects of ibotenic acid lesions of the nucleus accumbens on instrumental action. Behav Brain Res 65:181-193
5. Bassareo V, Di Chiara G (1999) Differential responsiveness of dopamine transmission to food-stimuli in nucleus accumbens shell/core compartments. J Neurosci 89:637-641
6. Bohn I, Giertler C, Hauber W (2003) NMDA receptors in the rat orbital prefrontal cortex are involved in guidance of instrumental behaviour under reversal conditions. Cereb Cortex 13:968-976
7. Brasted PJ, Humby T, Dunnett SB, Robbins TW (1997) Unilateral lesions of the dorsal striatum in rats disrupt responding in egocentric space. J Neurosci 17:8919-8926
8. Brown VJ, Bowman EM (1995) Discriminative cues indicating reward magnitude continue to determine reaction time of rats following lesions of the nucleus accumbens. Eur J Neurosci 7:2479-2485
9. Cardinal RN, Parkinson JA, Hall J, Everitt BJ (2002) Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex. Neurosci Biobehav Rev 26:321-352
10. Carelli RM, Ijames SG, Crumling AJ (2000) Evidence that separate neural circuits in the nucleus accumbens encode cocaine versus "natural" (water and food) reward. J Neurosci 20:4255-4266
11. Cochran WG, Cox GM (1957) Experimental Designs. Second Edition. Wiley & Sons, New York, pp 71-73
12. Cole BJ, Robbins TW (1989) Effects of 6-hydroxydopamine lesions of the nucleus accumbens septi on performance of a 5-choice serial reaction time task in rats: implications for theories of selective attention and arousal. Behav Brain Res 33:165-179
13. Colwill R, Rescorla R (1988) Associations between the discriminative stimulus and the reinforcer in instrumental learning. J Exp Psychol Anim Behav Processes 14:155-164
14. Colwill RM, Rescorla RA (1990) Effect of reinforcer devaluation on discriminative control of instrumental behavior. J Exp Psychol Anim Behav Processes 16:40-47
15. Corbit LH, Muir JL, Balleine BW (2001) The role of the nucleus accumbens in instrumental conditioning: evidence of a functional dissociation between accumbens core and shell. J Neurosci 21:3251-3260
16. Correa M, Carlson BB, Wisniecki A, Salamone JD (2002) Nucleus accumbens dopamine and work requirements on interval schedules. Behav Brain Res 137:179-187
17. de Borchgrave R, Rawlins JN, Dickinson A, Balleine BW (2002) Effects of cytotoxic nucleus accumbens lesions on instrumental conditioning in rats. Exp Brain Res 144:50-68
18. Di Ciano P, Everitt BJ (2001) Dissociable effects of antagonism of NMDA and AMPA/KA receptors in the nucleus accumbens core and shell on cocaine-seeking behavior. Neuropsychopharmacology 25:341-360
19. Dickinson A, Smith J, Mirenowicz J (2000) Dissociation of Pavlovian and instrumental incentive learning under dopamine antagonists. Behav Neurosci 114:468-483
20. Ferry AT, Lu XC, Price JL (2000) Effects of excitotoxic lesions in the ventral striatopallidal-thalamocortical pathway on odor reversal learning: inability to extinguish an incorrect response. Exp Brain Res 131:320-335
21. Galvan A, Hare TA, Davidson M, Spicer J, Glover G, Casey BJ (2005) The role of ventral frontostriatal circuitry in reward-based learning in humans. J Neurosci 25:8650-8656
22. Giertler C, Bohn I, Hauber W (2003) The rat nucleus accumbens is involved in guiding of instrumental responses by stimuli predicting reward magnitude. Eur J Neurosci 18:1993-1996
23. Giertler C, Bohn I, Hauber W (2005) Involvement of NMDA and AMPA/KA receptors in the nucleus accumbens core in instrumental learning guided by reward-predictive cues. Eur J Neurosci 21:1689-1702
24. Hall J, Parkinson JA, Connor TM, Dickinson A, Everitt BJ (2001) Involvement of the central nucleus of the amygdala and nucleus accumbens core in mediating Pavlovian influences on instrumental behaviour. Eur J Neurosci 13:1984-1992
25. Hauber W, Bohn I, Giertler C (2000) NMDA, but not dopamine D2, receptors in the rat nucleus accumbens are involved in guidance of instrumental behavior by stimuli predicting reward magnitude. J Neurosci 20:6282-6288
26. Hernandez PJ, Andrzejewski ME, Sadeghian K, Panksepp JB, Kelley AE (2005) AMPA/kainate, NMDA, and dopamine D1 receptor function in the nucleus accumbens core: a context-limited role in the encoding and consolidation of instrumental memory. Learn Mem 12:285-295
27. Holland PC, Straub JJ (1979) Differential effects of two ways of devaluing the unconditioned stimulus after Pavlovian appetitive conditioning. J Exp Psychol Anim Behav Processes 5:65-78
28. Hollerman JR, Tremblay L, Schultz W (1998) Influence of reward expectation on behaviour-related neuronal activity in primate striatum. J Neurophysiol 80:947-963
29. Ishiwari K, Weber SM, Mingote S, Correa M, Salamone JD (2004) Accumbens dopamine and the regulation of effort in foodseeking behavior: modulation of work output by different ratio or force requirements. Behav Brain Res 151:83-91
30. Ito R, Dalley JW, Howes SR, Robbins TW, Everitt BJ (2000) Dissociation in conditioned dopamine release in the nucleus accumbens core and shell in response to cocaine cues and during cocaine-seeking behavior in rats. J Neurosci 20:7489-7495
31. Kawagoe R, Takikawa Y, Hikosaka O (1998) Expectation of reward modulates cognitive signals in the basal ganglia. Nat Neurosci 1:411-416
32. Kelley AE, Baldo BA, Pratt WE, Will MJ (2005) Corticostriatal- hypothalamic circuitry and food motivation: integration of energy, action and reward. Physiol Behav 86:773-795
33. Knutson B, Cooper JC (2005) Functional magnetic resonance imaging of reward prediction. Curr Opin Neurol 18:411-417
34. Laubach M, Wessberg J, Nicolelis MA (2000) Cortical ensemble activity increasingly predicts behaviour outcomes during learning of a motor task. Nature 405:567-571
35. Louilot A, Taghzouti K, Simon H, Le Moal M (1989) Limbic system, basal ganglia, and dopaminergic neurons. Executive and regulatory neurons and their role in the organization of behavior. Brain Behav Evol 33:157-161
36. McClure SM, Daw ND, Read Montague P (2003) A computational substrate for incentive salience. Trends Neurosci 26:423-428
37. Murschall A, Hauber W (2005) Effects of a systemic AMPA/KA and NMDA receptor blockade on pavlovian-instrumental transfer. Psychopharmacology (Berl) 182:290-296
38. Nicola SM, Taha SA, Kim SW, Fields HL (2005) Nucleus accumbens dopamine release is necessary and sufficient to promote the behavioral response to reward-predictive cues. Neuroscience 135:1025-1033
39. Nowend KL, Arizzi M, Carlson BB, Salamone JD (2001) D1 or D2 antagonism in nucleus accumbens core or dorsomedial shell suppresses lever pressing for food but leads to compensatory increases in chow consumption. Pharmacol Biochem Behav 69:373-382
40. O'Doherty J (2003) Can't learn without you: predictive value coding in orbitofrontal cortex requires the basolateral amygdala. Neuron 39:731-733
41. O'Doherty JP, Buchanan TW, Seymour B, Dolan RJ (2006) Predictive neural coding of reward preference involves dissociable responses in human ventral midbrain and ventral striatum. Neuron 49:157-166
42. Pan WX, Schmidt R, Wickens JR, Hyland BI (2005) Dopamine cells respond to predicted events during classical conditioning: evidence for eligibility traces in the reward-learning network. J Neurosci 25:6235-6242
43. Parkinson JA, Cardinal RN, Everitt BJ (2000) Limbic cortical-ventral striatal systems underlying appetitive conditioning. Prog Brain Res 126:263-285
44. Paxinos G, Watson C (1997) The rat brain in stereotaxic coordinates. Academic, New York
45. Robbins TW (2005) Chemistry of the mind: neurochemical modulation of prefrontal cortical function. J Comp Neurol 493:140-146
46. Robbins TW, Giardini V, Jones GH, Reading P, Sahakian BJ (1990) Effects of dopamine depletion from the caudate-putamen and nucleus accumbens septi on the acquisition and performance of a conditional discrimination task. Behav Brain Res 38:243-261
47. Roitman MF, Stuber GD, Phillips PE, Wightman RM, Carelli RM (2004) Dopamine operates as a subsecond modulator of food seeking. J Neurosci 24:1265-1271
48. Sage JR, Knowlton BJ (2000) Effects of US devaluation on win-stay and win-shift radial maze performance in rats. Behav Neurosci 114:295-306
49. Salamone JD (1994) The involvement of nucleus accumbens dopamine in appetitive and aversive motivation. Behav Brain Res 61:117
50. Salamone JD, Correa M, Mingote SM, Weber SM (2005) Beyond the reward hypothesis: alternative functions of nucleus accumbens dopamine. Curr Opin Pharmacol 5:34-41
51. Schoenbaum G, Setlow B (2003) Lesions of nucleus accumbens disrupt learning about aversive outcomes. J Neurosci 23:9833-9841
52. Schultz W (2006) Behavioral theories and the neurophysiology of reward. Annu Rev Psychol 57:87-115
53. Schultz W, Tremblay L, Hollerman JR (2003) Changes in behavior-related neuronal activity in the striatum during learning. Trends Neurosci 26:321-328
54. Setlow B, Schoenbaum G, Gallagher M (2003) Neural encoding in ventral striatum during olfactory discrimination learning. Neuron 38:625-636
55. Sokoloff P, Andrieux M, Besancon R, Pilon C, Martres MP, Giros B, Schwartz JC (1992) Pharmacology of human dopamine D3 receptor expressed in a mammalian cell line: comparison with D2 receptor. Eur J Pharmacol 225:331-337
56. Sutton RS, Barto AG (1990) Time derivative models of Pavlovian reinforcement. In: M. Gabriel and J. Moore (eds) Learning and computational neuroscience: foundations of adaptive networks. MIT Press, Cambridge, MA, pp 497-537
57. Wakabayashi KT, Fields HL, Nicola SM (2004) Dissociation of the role of nucleus accumbens dopamine in responding to reward-predictive cues and waiting for reward. Behav Brain Res 154:19-30
58. Watanabe M, Cromwell HC, Tremblay L, Hollerman JR, Hikosaka K, Schultz W (2001) Behavioral reactions reflecting differential reward expectations in monkeys. Exp Brain Res 140:511-518
59. Woodward DJ, Chang JY, Janak P, Azarov A, Anstrom K (1999) Mesolimbic neuronal activity across behavioral states. Ann N Y Acad Sci 877:91-112
60. Wyvell CL, Berridge KC (2000) Intra-accumbens amphetamine increases the conditioned incentive salience of sucrose reward: enhancement of reward "wanting" without enhanced "liking" or response reinforcement. J Neurosci 20:8122-8130
61. Yun IA, Nicola SM, Fields HL (2004a) Contrasting effects of dopamine and glutamate receptor antagonist injection in the nucleus accumbens suggest a neural mechanism underlying cue-evoked goal-directed behavior. Eur J Neurosci 20:249-263
62. Yun IA, Wakabayashi KT, Fields HL, Nicola SM (2004b) The ventral tegmental area is required for the behavioral and nucleus accumbens neuronal firing responses to incentive cues. J Neurosci 24:2923-2933
63. Zahm DS (2000) An integrative neuroanatomical perspective on some subcortical substrates of adaptive responding with emphasis on the nucleus accumbens. Neurosci Biobehav Rev 24:85-105