Individual differences in dopamine efflux in nucleus accumbens shell and core during instrumental learning

Learning and Memory

Volumn 13, Issue 2, 2006, Pages 168-177

  Cheng, Jingjun ^a   Feenstra, Matthijs G P ^a  

^a NETHERLANDS INSTITUTE FOR NEUROSCIENCE   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

DOPAMINE;

ANIMAL EXPERIMENT; ARTICLE; CONTROLLED STUDY; DOPAMINERGIC ACTIVITY; EFFUSION; IN VIVO STUDY; LEARNING; MALE; MICRODIALYSIS; NONHUMAN; NUCLEUS ACCUMBENS; PRIORITY JOURNAL; RAT; TASK PERFORMANCE;

ANALYSIS OF VARIANCE; ANIMALS; APPETITIVE BEHAVIOR; CONDITIONING, OPERANT; DOPAMINE; EXPLORATORY BEHAVIOR; MALE; MICRODIALYSIS; NUCLEUS ACCUMBENS; RATS; RATS, WISTAR; REINFORCEMENT (PSYCHOLOGY); STATISTICS, NONPARAMETRIC;

EID: 33645507448     PISSN: 10720502     EISSN: 15495485     Source Type: Journal    
DOI: 10.1101/lm.1806     Document Type: Article

References (52)

1. Baldwin, A.E., Holahan, M.R., Sadeghian, K., and Kelley, A.E. 2000. N-Methyl-D-aspartate receptor-dependent plasticity within a distributed corticostriatal network mediates appetitive instrumental learning. Behav. Neurosci. 114: 1-15.
2. Baldwin, A.E., Sadeghian, K., Holahan, M.R., and Kelley, A.E. 2002a. Appetitive instrumental learning is impaired by inhibition of cAMP-dependent protein kinase within the nucleus accumbens. Neurobiol. Learn. Mem. 77: 44-62.
3. Baldwin, A.E., Sadeghian, K., and Kelley, A.E. 2002b. Appetitive instrumental learning requires coincident activation of NMDA and DA D1 receptors within medial prefrontal cortex. J. Neurosci. 22: 1063-1071.
4. Balleine, B.W. and Dickinson, A. 1998. Goal-directed instrumental action: Contingency and incentive learning and their cortical substrates. Neuropharmacology 37: 407-419.
5. Bassareo, V. and Di Chiara, G. 1997. Differential influence of associative and non-associative learning mechanisms on the responsivencess of prefrontal and accumbal dopamine transmission to food stimuli in rats fed ad libitum. J. Neurosci. 17: 851-861.
6. Bassareo, V., De Luca, M.A., and Di Chiara, G. 2002. Differential expression of motivational stimulus properties by dopamine in nucleus accumbens shell versus core and prefrontal cortex. J. Neurosci. 22: 4709-4719.
7. Beninger, R.J. 1983. The role of dopamine in locomotor activity and learning. Brain Res. Brain Res. Rev. 6: 173-196.
8. Berridge, K.C. and Robinson, T.E. 1998. What is the role of dopamine in reward: Hedonic impact, reward learning, or incentive salience? Brain Res. Brain Res.Rev. 28: 309-369.
9. Blackburn, J.R., Pfaus, J.G., and Phillips, A.G. 1992. Dopamine functions in appetitive and defensive behaviours. Prog. Neurobiol. 39: 247-279.
10. Brembs, B., Lorenzetti, F.D., Reyes, F.D., Baxter, D.A., and Byrne, J.H. 2002. Operant reward learning in Aplysia: Neuronal correlates and mechanisms. Science 296: 1706-1709.
11. Cardinal, R.N., Parkinson, J.A., Hall, J., and Everitt, B.J. 2002. Emotion and motivation: The role of the amygdala, ventral striatum, and prefrontal cortex. Neurosci. Biobehav. Rev. 26: 321-352.
12. Cheng, J.J., de Bruin, J.P.C., and Feenstra, M.G.P. 2003. Dopamine efflux in nucleus accumbens shell and core in response to appetitive classical conditioning. Eur. J. Neurosci. 18: 1306-1314.
13. Dalley, J.W., Lääne, K., Theobald, D.E.H., Armstrong, H.C., Corlett, P.R., Chudasama, Y., and Robbins, T.W. 2005. Time-limited modulation of appetitive Pavlovian memory by D1 and NMDA receptors in the nucelus accumbens. Proc. Natl. Acad. Sci. 102: 6189-6194.
14. Dayan, P. and Balleine, B.W. 2002. Reward, motivation, and reinforcement learning. Neuron 36: 285-298.
15. Dellu, F., Piazza, P.V., Mayo, W., Le Moal, M., and Simon, H. 1996. Novelty-seeking in rats - Biobehavioral characteristics and possible relationship with the sensation-seeking trait in man. Neuropsychobiology 34: 136-145.
16. Di Chiara, G. 2002. Nucleus accumbens shell and core dopamine: Differential role in behavior and addiction. Behav. Brain Res. 137: 75-114.
17. Di Ciano, P., Cardinal, R.N., Cowell, R.A., Little, S.J., and Everitt, B.J. 2001. Differential involvement of NMDA, AMPA/Kainate, and dopamine receptors in the nucleus accumbens core in the acquisition and performance of Pavlovian approach behavior. J. Neurosci. 21: 9471-9477.
18. Dickinson, A., Smith, J., and Mirenowicz, J. 2000. Dissociation of Pavlovian and instrumental learning under dopamine antagonists. Behav. Neurosci. 114: 468-483.
19. Feenstra, M.G.P. 2000. Dopamine and noradrenaline release in the prefrontal cortex in relation to unconditioned and conditioned stress and reward. Progr. Brain Res. 126: 133-163.
20. Feenstra, M.G.P. and Botterblom, M.H.A. 1996. Rapid sampling of extracellular dopamine in the rat prefrontal cortex during food consumption, handling and exposure to novelty. Brain Res. 742: 17-24.
21. Feenstra, M.G.P., Botterblom, M.H.A., and Mastenbroek, S. 2000. Dopamine and noradrenaline efflux in the prefrontal cortex in the light and dark period: Effects of novelty and handling and comparison to the nucleus accumbens. Neuroscience 100: 741-748.
22. Fiorillo, C.D., Tobler, P.N., and Schultz, W. 2003. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299: 1898-1902.
23. Flagel, S., Robinson, T., and Akil, H. 2004. Individual differences in Pavlovian conditioned approach behavior. Abstract Viewer/Itinerary Planner, Program No. 671.12. Society for Neuroscience, Washington, D.C.
24. Fried, I., Wilson, C.L., Morrow, J.W., Cameron, K.A., Behnke, E.D., Ackerson, L.C., and Maidment, N.T. 2001. Increased dopamine release in the human amygdala during performance of cognitive tasks. Nat. Neurosci. 4: 201-206.
25. Hernandez, L. and Hoebel, B.G. 1988. Feeding and hypothalamic stimulation increase dopamine turnover in the accumbens. Physiol. Behav. 44: 599-606.
26. Hernandez, P.J., Sadeghian, K., and Kelley, A.E. 2002. Early consolidation of instrumental learning requires protein synthesis in the nucleus accumbens. Nat. Neurosci. 5: 1327-1331.
27. Hollerman, J.R. and Schultz, W. 1998. Dopamine neurons report an error in the temporal prediction of reward during learning. Nat. Neurosci. 1: 304-309.
28. Ikemoto, S. and Panksepp, J. 1999. The role of nucleus accumbens dopamine in motivated behavior: A unifying interpretation with special reference to reward-seeking. Brain Res. Brain Res. Rev. 31: 6-41.
29. Izaki, Y., Hori, K., and Nomura, M. 1998. Dopamine and acetylcholine elevation on lever-press acquisition in rat prefrontal cortex. Neurosci. Lett. 258: 33-36.
30. Joseph, M.H. and Hodges, H. 1990. Lever pressing for food reward and changes in dopamine turnover and uric acid in rat caudate and nucleus accumbens studied chronically by in vivo voltammetry. J. Neurosci. Methods 34: 143-149.
31. Joseph, M.H., Datla, K., and Young, A.M. 2003. The interpretation of the measurement of nucleus accumbens dopamine by in vivo dialysis: The kick, the craving or the cognition? Neurosci. Biobehav. Rev. 27: 527-541.
32. Kelley, A.E. 1999. Neural integrative activities of nucleus accumbens subregions in relation to learning and motivation. Psychobiology 27: 198-213.
33. _. 2004. Memory and addiction: Shared neural circuitry and molecular mechanisms. Neuron 44: 161-179.
34. Kelley, A.E., Smith-Roe, S.L., and Holahan, M.R. 1997. Response-reinforcement learning is dependent on N-methyl-D-aspartate receptor activation in the nucleus accumbens core. Proc. Natl. Acad. Sci. 94: 12174-12179.
35. McCullough, L.D., Cousins, M.S., and Salamone, J.D. 1993. The role of nucleus accumbens dopamine in responding on a continuous reinforcement operant schedule: A neurochemical and behavioral study. Pharmacol. Biochem. Behav. 46: 581-586.
36. Montague, P.R., McClure, S.M., Baldwin, P.R., Phillips, P.E.M., Budygin, E.A., Stuber, G.D., Kilpatrick, M.R., and Wightman, R.M. 2004. Dynamic gain control of dopamine delivery in freely moving animals. J. Neurosci. 24: 1754-1759.
37. Pan, W.-X., Schmidt, R., Wickens, J.R., and Hyland, B.I. 2005. Dopamine cells respond to predicted events during classical conditioning: Evidence for eligibility traces in the reward-earning network. J. Neurosci. 25: 6235-6242.
38. Parkinson, J.A., Cardinal, R.N., and Everitt, B.J. 2000. Limbic cortical-ventral striatal systems underlying appetitive conditioning. Prog. Brain Res. 126: 263-285.
39. Paxinos, G. and Watson, C. 1997. The rat brain in stereotaxic coordinates, 3rd ed., Academic Press, London.
40. Redgrave, P., Prescott, T.J., and Gurney, K. 1999. Is the short-latency dopamine response too short to signal reward error? Trends Neurosci. 22: 146-151.
41. Reynolds, J.N.J., Hyland, B.I., and Wickens, J.R. 2001. A cellular mechanism of reward-related learning. Nature 413: 67-70.
42. Robbins, T.W. and Everitt, B.J. 1996. Neurobehavioural mechanisms of reward and motivation. Curr. Opin. Neurobiol. 6: 228-236.
43. Roitman, M.F., Stuber, G.D., Phillips, P.E.M., Wightman, R.M., and Carelli, R.M. 2004. Dopamine operates as a subsecond modulator of food seeking. J. Neurosci. 24: 1265-1271.
44. Salamone, J.D., Keller, R.W., Zigmond, M.J., and Stricker, E.M. 1989. Behavioural activation in rats increases striatal dopamine metabolism measured by dialysis perfusion. Brain Res. 487: 215-224.
45. Salamone, J.D., Correa, M., Mingote, S., and Weber, S.M. 2003. Nucleus accumbens dopamine and the regulation of effort in food-seeking behavior: Implications for studies of natural motivation, psychiatry, and drug abuse. J. Pharmacol. Exp. Ther. 305: 1-8.
46. Satoh, T., Nakai, S., Sato, T., and Kimura, M. 2003. Correlated coding of motivation and outcome of decision by dopamine neurons. J. Neurosci. 23: 9913-9923.
47. Schultz, W. 2002. Getting formal with dopamine and reward. Neuron 36: 241-263.
48. Smith-Roe, S.L. and Kelley, A.E. 2000. Coincident activation of NMDA and dopamine D1-receptors within the nucleus accumbens core is required for appetitive instrument learning. J. Neurosci. 20: 7737-7742.
49. Sokolowski, J.D., Conlan, A.N., and Salamone, J.D. 1998. A microdialysis study of nucleus accumbens core and shell dopamine during operant responding in the rat. Neuroscience 86: 1001-1009.
50. Stark, H., Bischof, A., and Scheich, H. 1999. Increase of extracellular dopamine in prefrontal cortex of gerbils during acquisition of the avoidance strategy in the shuttle-box. Neurosci. Lett. 264: 77-80.
51. Wightman, R.M. and Robinson, D.L. 2002. Transient changes in mesolimbic dopamine and their association with 'reward'. J. Neurochem. 82: 721-735.
52. Wise, R.A. 2004. Dopamine, learning and motivation. Nat. Rev. Neurosci. 5: 483-494.