Reward and reinforcement activity in the nucleus accumbens during learning

Frontiers in Behavioral Neuroscience

Volumn 8, Issue APR, 2014, Pages

  Gale, John T ^a   Shields, Donald C ^a   Ishizawa, Yumiko ^a   Eskandar, Emad N ^a  

^a MASSACHUSETTS GENERAL HOSPITAL   (United States)

Author keywords

Incentive salience; Learning; Nucleus accumbens; Operant conditioning; Reward

Indexed keywords

ANIMAL EXPERIMENT; ARTICLE; CONTROLLED STUDY; FEEDBACK SYSTEM; INSTRUMENTAL CONDITIONING; INTRACELLULAR RECORDING; LEARNING; MALE; NERVE FUNCTION; NEUROTRANSMISSION; NONHUMAN; NUCLEUS ACCUMBENS; REINFORCEMENT; REWARD; RHESUS MONKEY; STATE DEPENDENT LEARNING; STIMULUS RESPONSE; TASK PERFORMANCE; VISUOMOTOR COORDINATION;

EID: 84897478039     PISSN: 16625153     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnbeh.2014.00114     Document Type: Article

References (50)

1. Apicella, P. (2007). Leading tonically active neurons of the striatum from reward detection to context recognition. Trends Neurosci. 30, 299-306. doi: 10.1016/j.tins.2007.03.011
2. Bar-Gad, I., Morris, G., and Bergman, H. (2003). Information processing, dimensionality reduction and reinforcement learning in the basal ganglia. Prog. Neurobiol. 71, 439-473. doi: 10.1016/j.pneurobio.2003.12.001
3. Beckstead, R. M. (1979). An autoradiographic examination of corticocortical and subcortical projections of the mediodorsal-projection (prefrontal) cortex in the rat. J. Comp. Neurol. 184, 43-62. doi: 10.1002/cne.901840104
4. Berridge, K. C., and Robinson, T. E. (1998). What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain Res. Brain Res. Rev. 28, 309-369. doi: 10.1016/S0165-0173(98)00019-8
5. Brog, J. S., Salyapongse, A., Deutch, A. Y., and Zahm, D. S. (1993). The patterns of afferent innervation of the core and shell in the "accumbens" part of the rat ventral striatum: immunohistochemical detection of retrogradely transported fluoro-gold. J. Comp. Neurol. 338, 255-278. doi: 10.1002/cne.903380209
6. Daniel, R., and Pollmann, S. (2010). Comparing the neural basis of monetary reward and cognitive feedback during information-integration category learning. J. Neurosci. 30, 47-55. doi: 10.1523/JNEUROSCI.2205-09.2010
7. Day, J. J., and Carelli, R. M. (2007). The nucleus accumbens and Pavlovian reward learning. Neuroscientist 13, 148-159. doi: 10.1177/1073858406295854
8. Deutch, A. Y. (1993). Prefrontal cortical dopamine systems and the elaboration of functional corticostriatal circuits: implications for schizophrenia and Parkinson's disease. J. Neural Transm. Gen. Sect. 91, 197-221. doi: 10.1007/BF01245232
9. DiCiano, P., Cardinal, R. N., Cowell, R. A., Little, S. J., and Everitt, B. J. (2001). Differential involvement of NMDA, AMPA/kainate, and dopamine receptors in the nucleus accumbens core in the acquisition and performance of pavlovian approach behavior. J. Neurosci. 21, 9471-9477.
10. Frank, M. J., and O'Reilly, R. C. (2006). A mechanistic account of striatal dopamine function in human cognition: psychopharmacological studies with cabergoline and haloperidol. Behav. Neurosci. 120, 497-517. doi: 10.1037/0735-7044.120.3.497
11. Fudge, J. L., and Haber, S. N. (2002). Defining the caudal ventral striatum in primates: cellular and histochemical features. J. Neurosci. 22, 10078-10082.
12. Gao, G., Wang, X., He, S., Li, W., Wang, Q., Liang, Q., et al. (2003). Clinical study for alleviating opiate drug psychological dependence by a method of ablating the nucleus accumbens with stereotactic surgery. Stereotact. Funct. Neurosurg. 81, 96-104. doi: 10.1159/000075111
13. Giacobbe, P., and Kennedy, S. H. (2006). Deep brain stimulation for treatment-resistant depression: a psychiatric perspective. Curr. Psychiatry Rep. 8, 437-444. doi: 10.1007/s11920-006-0048-5
14. Graybiel, A. M. (2005). The basal ganglia: learning new tricks and loving it. Curr. Opin. Neurobiol. 15, 638-644. doi: 10.1016/j.conb.2005.10.006
15. Groenewegen, H. J., and Russchen, F. T. (1984). Organization of the efferent projections of the nucleus accumbens to pallidal, hypothalamic, and mesencephalic structures: a tracing and immunohistochemical study in the cat. J. Comp. Neurol. 223, 347-367. doi: 10.1002/cne.902230303
16. Haber, S. N., Lynd, E., Klein, C., and Groenewegen, H. J. (1990). Topographic organization of the ventral striatal efferent projections in the rhesus monkey: an anterograde tracing study. J. Comp. Neurol. 293, 282-298. doi: 10.1002/cne.902930210
17. Heimer, L., Zahm, D. S., Churchill, L., Kalivas, P. W., and Wohltmann, C. (1991). Specificity in the projection patterns of accumbal core and shell in the rat. Neuroscience 41, 89-125. doi: 10.1016/0306-4522(91)90202-Y
18. Ikemoto, S., and Panksepp, J. (1999). The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking. Brain Res. Brain Res. Rev. 31, 6-41. doi: 10.1016/S0165-0173(99)00023-5
19. Joel, D., and Weiner, I. (2000). The connections of the dopaminergic system with the striatum in rats and primates: an analysis with respect to the functional and compartmental organization of the striatum. Neuroscience 96, 451-474. doi: 10.1016/S0306-4522(99)00575-8
20. Jurado-Parras, M. T., Gruart, A., and Delgado-García, J. M. (2012). Observational learning in mice can be prevented by medial prefrontal cortex stimulation and enhanced by nucleus accumbens stimulation. Learn. Mem. 21, 99-106. doi: 10.1101/lm.024760.111
21. Knutson, B., Adams, C. M., Fong, G. W., and Hommer, D. (2001). Anticipation of increasing monetary reward selectively recruits nucleus accumbens. J. Neurosci. 21, RC159.
22. Krause, M., German, P. W., Taha, S. A., and Fields, H. L. (2010). A pause in nucleus accumbens neuron firing is required to initiate and maintain feeding. J. Neurosci. 30, 4746-4756. doi: 10.1523/JNEUROSCI.0197-10.2010
23. McClure, S. M., Berns, G. S., and Montague, P. R. (2003b). Temporal prediction errors in a passive learning task activate human striatum. Neuron 38, 339-346. doi: 10.1016/S0896-6273(03)00154-5
24. McClure, S. M., Daw, N. D., and Montague, P. R. (2003a). A computational substrate for incentive salience. Trends Neurosci. 26, 423-428. doi: 10.1016/S0166-2236(03)00177-2
25. Mogenson, G. J., Jones, D. L., and Yim, C. Y. (1980). From motivation to action: functional interface between the limbic system and the motor system. Prog. Neurobiol. 14, 69-97. doi: 10.1016/0301-0082(80)90018-0
26. Morris, G., Arkadir, D., Nevet, A., Vaadia, E., and Bergman, H. (2004). Coincident but distinct messages of midbrain dopamine and striatal tonically active neurons. Neuron 43, 133-143. doi: 10.1016/j.neuron.2004.06.012
27. Nicola, S. M., Surmeier, J., and Malenka, R. C. (2000). Dopaminergic modulation of neuronal excitability in the striatum and nucleus accumbens. Annu. Rev. Neurosci. 23, 185-215. doi: 10.1146/annurev.neuro.23.1.185
28. Parkinson, J. A., Dalley, J. W., Cardinal, R. N., Bamford, A., Fehnert, B., Lachenal, G., et al. (2002). Nucleus accumbens dopamine depletion impairs both acquisition and performance of appetitive Pavlovian approach behaviour: implications for mesoaccumbens dopamine function. Behav. Brain Res. 137, 149-163. doi: 10.1016/S0166-4328(02)00291-7
29. Paxinos, G., Huang, X. F., and Toga, A. W. (2000). The Rhesus Monkey Brain in Stereotaxic Coordinates. San Diego, CA: Academic Press.
30. Pizzagalli, D. A., Holmes, A. J., Dillon, D. G., Goetz, E. L., Birk, J. L., Bogdan, R., et al. (2009). Reduced caudate and nucleus accumbens response to rewards in unmedicated individuals with major depressive disorder. Am. J. Psychiatry 166, 702-710. doi: 10.1176/appi.ajp.2008.08081201
31. Poletti, C. E., and Creswell, G. (1977). Fornix system efferent projections in the squirrel monkey: an experimental degeneration study. J. Comp. Neurol. 175, 101-128. doi: 10.1002/cne.901750107
32. Robinson, T. E., and Berridge, K. C. (1993). The neural basis of drug craving: an incentive-sensitization theory of addiction. Brain Res. Brain Res. Rev. 18, 247-291. doi: 10.1016/0165-0173(93)90013-P
33. Russchen, F. T., Bakst, I., Amaral, D. G., and Price, J. L. (1985). The amygdalostriatal projections in the monkey. An anterograde tracing study. Brain Res. 329, 241-257. doi: 10.1016/0006-8993(85)90530-X
34. Salamone, J. D., Correa, M., Mingote, S. M., and Weber, S. M. (2005). Beyond the reward hypothesis: alternative functions of nucleus accumbens dopamine. Curr. Opin. Pharmacol. 5, 34-41. doi: 10.1016/j.coph.2004.09.004
35. Schultz, W. (1998). Predictive reward signal of dopamine neurons. J. Neurophysiol. 80, 1-27.
36. Schultz, W. (2000). Multiple reward signals in the brain. Nat. Rev. Neurosci. 1, 199-207. doi: 10.1038/35044563
37. Schultz, W., Apicella, P., Scarnati, E., and Ljungberg, T. (1992). Neuronal activity in monkey ventral striatum related to the expectation of reward. J. Neurosci. 12, 4595-4610.
38. Selemon, L. D., and Goldman-Rakic, P. S. (1985). Longitudinal topography and interdigitation of corticostriatal projections in the rhesus monkey. J. Neurosci. 5, 776-794.
39. Sesack, S. R., and Grace, A. A. (2010). Cortico-basal ganglia reward network: microcircuitry. Neuropsychopharmacology 35, 27-47. doi: 10.1038/npp.2009.93
40. Sheth, S. A., Abuelem, T., Gale, J. T., and Eskandar, E. N. (2011). Basal ganglia neurons dynamically facilitate exploration during associative learning. J. Neurosci. 31, 4878-4885. doi: 10.1523/JNEUROSCI.3658-10.2011
41. Simmons, J. M., Ravel, S., Shidara, M., and Richmond, B. J. (2007). A comparison of reward-contingent neuronal activity in monkey orbitofrontal cortex and ventral striatum: guiding actions toward rewards. Ann. N. Y. Acad. Sci. 1121, 376-394. doi: 10.1196/annals.1401.028
42. Smith, A. C., Frank, L. M., Wirth, S., Yanike, M., Hu, D., Kubota, Y., et al. (2004). Dynamic analysis of learning in behavioral experiments. J. Neurosci. 24, 447-461. doi: 10.1523/JNEUROSCI.2908-03.2004
43. Taha, S. A., Nicola, S. M., and Fields, H. L. (2007). Cue-evoked encoding of movement planning and execution in the rat nucleus accumbens. J. Physiol. 584, 801-818. doi: 10.1113/jphysiol.2007.140236
44. Williams, Z. M., and Eskandar, E. N. (2006). Selective enhancement of associative learning by microstimulation of the anterior caudate. Nat. Neurosci. 9, 562-568. doi: 10.1038/nn1662
45. Wirth, S., Yanike, M., Frank, L. M., Smith, A. C., Brown, E. N., and Suzuki, W. A. (2003). Single neurons in the monkey hippocampus and learning of new associations. Science 300, 1578-1581. doi: 10.1126/science.1084324
46. Wise, R. A. (2004). Dopamine, learning and motivation. Nat. Rev. Neurosci. 5, 483-494. doi: 10.1038/nrn1406
47. Wise, R. A., Spindler, J., deWit, H., and Gerberg, G. J. (1978a). Neuroleptic-induced "anhedonia" in rats: pimozide blocks reward quality of food. Science 201, 262-264. doi: 10.1126/science.566469
48. Wise, R. A., Spindler, J., and Legault, L. (1978b). Major attenuation of food reward with performance-sparing doses of pimozide in the rat. Can. J. Psychol. 32, 77-85. doi: 10.1037/h0081678
49. Wright, C. I., and Groenewegen, H. J. (1995). Patterns of convergence and segregation in the medial nucleus accumbens of the rat: relationships of prefrontal cortical, midline thalamic, and basal amygdaloid afferents. J. Comp. Neurol. 361, 383-403. doi: 10.1002/cne.903610304
50. Zahm, D. S. (2000). An integrative neuroanatomical perspective on some subcortical substrates of adaptive responding with emphasis on the nucleus accumbens. Neurosci. Biobehav. Rev. 24, 85-105. doi: 10.1016/S0149-7634(99)00065-2