Neurons in the nucleus accumbens promote selection bias for nearer objects

Journal of Neuroscience

Volumn 34, Issue 42, 2014, Pages 14147-14162

  Morrison, Sara E ^a   Nicola, Saleem M ^a,b  

^a Department of Psychiatry and Behavioral Science ^*  (United States)

^b ALBERT EINSTEIN COLLEGE OF MEDICINE   (United States)

Author keywords

Decision making; Effort; Impulsivity; Nucleus accumbens; Proximity; Reward

Indexed keywords

ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ARTICLE; BEHAVIOR; DECISION MAKING; HISTOLOGY; IMPULSIVENESS; LATENT PERIOD; LOCOMOTION; MALE; NONHUMAN; NUCLEUS ACCUMBENS; RAT; RECEIVER OPERATING CHARACTERISTIC; REWARD; SELECTION BIAS; SIGNAL TRANSDUCTION; TASK PERFORMANCE; TRAINING; VISUAL ORIENTATION; VISUAL STIMULATION; ANIMAL; LONG EVANS RAT; NERVE CELL; PHYSIOLOGY; SPATIAL BEHAVIOR;

ANIMALS; CHOICE BEHAVIOR; DECISION MAKING; MALE; NEURONS; NUCLEUS ACCUMBENS; RATS; RATS, LONG-EVANS; REWARD; SPATIAL BEHAVIOR;

EID: 84908004701     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.2197-14.2014     Document Type: Article

References (62)

1. Ambroggi F, Ghazizadeh A, Nicola SM, Fields HL (2011) Roles of nucleus accumbens core and shell in incentive-cue responding and behavioral inhibition. J Neurosci 31:6820–6830.
2. Baldo BA, Sadeghian K, Basso AM, Kelley AE (2002) Effects of selective dopamine D1 or D2 receptor blockade within nucleus accumbens subre-gions on ingestive behavior and associated motor activity. Behav Brain Res 137:165–177.
3. Bari A, Robbins TW (2013) Inhibition and impulsivity: behavioral and neural basis of response control. Prog Neurobiol 108:44–79.
4. Clark JJ, Hollon NG, Phillips PE (2012) Pavlovian valuation systems in learning and decision making. Curr Opin Neurobiol 22:1054–1061.
5. Cole BJ, Robbins TW (1989) Effects of 6-hydroxydopamine lesions of the nucleus accumbens septi on performance of a 5-choice serial reaction time task in rats: implications for theories of selective attention and arousal. Behav Brain Res 33:165–179.
6. Cromwell HC, Schultz W (2003) Effects of expectations for different reward magnitudes on neuronal activity in primate striatum. J Neurophysiol 89:2823–2838.
7. Day JJ, Jones JL, Carelli RM (2011) Nucleus accumbens neurons encode predicted and ongoing reward costs in rats. Eur J Neurosci 33:308–321.
8. Dayan P, Niv Y, Seymour B, Daw ND (2006) The misbehavior of value and the discipline of the will. Neural Netw 19:1153–1160.
9. Di Ciano P, Cardinal RN, Cowell RA, Little SJ, Everitt BJ (2001) Differential involvement of NMDA, AMPA/kainate, and dopamine receptors in the nucleus accumbens core in the acquisition and performance of pavlovian approach behavior. J Neurosci 21:9471–9477.
10. Drai D, Benjamini Y, Golani I (2000) Statistical discrimination of natural modes of motion in rat exploratory behavior. J Neurosci Methods 96: 119–131.
11. du Hoffmann J, Kim JJ, Nicola SM (2011) An inexpensive drivable cannu-lated microelectrode array for simultaneous unit recording and drug infusion in the same brain nucleus of behaving rats. J Neurophysiol 106: 1054–1064.
12. du Hoffmann J, Nicola SM (2014) Dopamine invigorates reward seeking by promoting cue-evoked excitation in the nucleus accumbens. J Neurosci, in press.
13. Economidou D, Theobald DE, Robbins TW, Everitt BJ, Dalley JW (2012) Norepinephrine and dopamine modulate impulsivity on the five-choice serial reaction time task through opponent actions in the shell and core sub-regions of the nucleus accumbens. Neuropsychopharmacology 37: 2057–2066.
14. Flagel SB, Robinson TE, Clark JJ, Clinton SM, Watson SJ, Seeman P, Phillips PE, Akil H (2010) An animal model of genetic vulnerability to behavioral disinhibition and responsiveness to reward-related cues: implications for addiction. Neuropsychopharmacology 35:388–400.
15. Flagel SB, Clark JJ, Robinson TE, Mayo L, Czuj A, Willuhn I, Akers CA, Clinton SM, Phillips PE, Akil H (2011) A selective role for dopamine in stimulus–reward learning. Nature 469:53–57.
16. Gage GJ, Stoetzner CR, Wiltschko AB, Berke JD (2010) Selective activation of striatal fast-spiking interneurons during choice execution. Neuron 67: 466–479.
17. Ghods-Sharifi S, Floresco SB (2010) Differential effects on effort discounting induced by inactivations of the nucleus accumbens core or shell. Behav Neurosci 124:179–191.
18. Goldstein BL, Barnett BR, Vasquez G, Tobia SC, Kashtelyan V, Burton AC, Bryden DW, Roesch MR (2012) Ventral striatum encodes past and predicted value independent of motor contingencies. J Neurosci 32:2027–2036.
19. Gomperts SN, Chen Z, Wilson MA (2013) VTA neuronal activity during learning in a spatial appetitive choice task. Soc Neurosci Abstr 39:771.09.
20. Gregorios-Pippas L, Tobler PN, Schultz W (2009) Short-term temporal discounting of reward value in human ventral striatum. J Neurophysiol 101: 1507–1523.
21. Hok V, Save E, Lenck-Santini PP, Poucet B (2005) Coding for spatial goals in the prelimbic/infralimbic area of the rat frontal cortex. Proc Natl Acad Sci U S A 102:4602–4607.
22. Hollerman JR, Tremblay L, Schultz W (1998) Influence of reward expectation on behavior-related neuronal activity in primate striatum. J Neuro-physiol 80:947–963.
23. Howe MW, Tierney PL, Sandberg SG, Phillips PE, Graybiel AM (2013) Prolonged dopamine signalling in striatum signals proximity and value of distant rewards. Nature 500:575–579.
24. Ito M, Doya K (2009) Validation of decision-making models and analysis of decision variables in the rat basal ganglia. J Neurosci 29:9861–9874.
25. Kable JW, Glimcher PW (2007) The neural correlates of subjective value during intertemporal choice. Nat Neurosci 10:1625–1633.
26. Khamassi M, Mulder AB, Tabuchi E, Douchamps V, Wiener SI (2008) Anticipatory reward signals in ventral striatal neurons of behaving rats. Eur J Neurosci 28:1849–1866.
27. Kim H, Sul JH, Huh N, Lee D, Jung MW (2009) Role of striatumin updating values of chosen actions. J Neurosci 29:14701–14712.
28. Kralik JD, Sampson WW (2012) A fruit in hand is worth many more in the bush: steep spatial discounting by free-ranging rhesus macaques (Macaca mulatta). Behav Processes 89:197–202.
29. Lansink CS, Jackson JC, Lankelma JV, Ito R, Robbins TW, Everitt BJ, Penn-artz CM (2012) Reward cues in space: commonalities and differences in neural coding by hippocampal and ventral striatal ensembles. J Neurosci 32:12444–12459.
30. Lee I, Griffin AL, Zilli EA, Eichenbaum H, Hasselmo ME (2006) Gradual translocation of spatial correlates of neuronal firing in the hippocampus toward prospective reward locations. Neuron 51:639–650.
31. Lim SL, O’Doherty JP, Rangel A (2011) The decision value computations in the vmPFC and striatum use a relative value code that is guided by visual attention. J Neurosci 31:13214–13223.
32. Mannella F, Gurney K, Baldassarre G (2013) The nucleus accumbens as a nexus between values and goals in goal-directed behavior: a review and a new hypothesis. Front Behav Neurosci 7:135.
33. McDannald MA, Lucantonio F, Burke KA, Niv Y, Schoenbaum G (2011) Ventral striatum and orbitofrontal cortex are both required for model-based, but not model-free, reinforcement learning. J Neurosci 31:2700–2705.
34. McGinty VB, Lardeux S, Taha SA, Kim JJ, Nicola SM (2013) Invigoration of reward seekingby cue and proximity encoding in the nucleus accumbens. Neuron 78:910–922.
35. Mingote S, Weber SM, Ishiwari K, Correa M, Salamone JD (2005) Ratio and time requirements on operant schedules: effort-related effects of nucleus accumbens dopamine depletions. EurJNeurosci 21:1749–1757.
36. Moreno M, Economidou D, Mar AC, López-Granero C, Caprioli D, Theobald DE, Fernando A, Newman AH, Robbins TW, Dalley JW (2013) Divergent effects of D(2)/(3) receptor activationin the nucleus accumbens core and shell onimpulsivity and locomotor activity inhigh and low impulsive rats. Psychopharmacology 228:19–30.
37. Nicola SM (2010) The flexible approach hypothesis: unification of effort and cue-responding hypotheses for the role of nucleus accumbens dopa-mine in the activation of reward-seeking behavior. J Neurosci 30:16585–16600.
38. Nicola SM, Yun IA, Wakabayashi KT, Fields HL (2004) Cue-evoked firing of nucleus accumbens neurons encodes motivational significance during a discriminative stimulus task. J Neurophysiol 91:1840–1865.
39. O’Connor DA, Meade B, Carter O, Rossiter S, Hester R (2014) Behavioral sensitivity to reward is reduced for far objects. Psychol Sci 25:271–277.
40. O’Doherty J, Dayan P, Schultz J, Deichmann R, Friston K, Dolan RJ (2004) Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304:452–454.
41. Parkinson JA, Olmstead MC, Burns LH, Robbins TW, Everitt BJ (1999) Dissociation in effects of lesions of the nucleus accumbens core and shell on appetitive pavlovian approach behavior and the potentiation of conditioned reinforcement and locomotor activity by D-amphetamine. J Neurosci 19:2401–2411.
42. Parkinson JA, Dalley JW, Cardinal RN, Bamford A, Fehnert B, Lachenal G, Rudarakanchana N, Halkerston KM, Robbins TW, Everitt BJ (2002) Nucleus accumbens dopamine depletion impairs both acquisition and performance of appetitive Pavlovian approach behaviour: implications for mesoaccumbens dopamine function. Behav Brain Res 137:149–163.
43. Paxinos G, Watson C (1998) The rat brain in stereotaxic coordinates, fourth edition. New York: Academic.
44. Pennartz CM, Ito R, Verschure PF, Battaglia FP, Robbins TW (2011) The hippocampal–striatal axis in learning, prediction and goal-directed behavior. Trends Neurosci 34:548–559.
45. Perrings C, Hannon B (2001) An introduction to spatial discounting. J Regional Sci 41:23–38.
46. Peters J, Büchel C (2009) Overlapping and distinct neural systems code for subjective value during intertemporal and risky decision making. J Neu-rosci 29:15727–15734.
47. Pfeiffer BE, Foster DJ (2013) Hippocampal place-cell sequences depict future paths to remembered goals. Nature 497:74–79.
48. Roesch MR, Singh T, Brown PL, Mullins SE, Schoenbaum G (2009) Ventral striatal neurons encode the value of the chosen action in rats deciding between differently delayed or sized rewards. J Neurosci 29:13365–13376.
49. Roitman MF, Wheeler RA, Carelli RM (2005) Nucleus accumbens neurons are innately tuned for rewarding and aversive taste stimuli, encode their predictors, and are linked to motor output. Neuron 45:587–597.
50. Salamone JD, Correa M, Farrar A, Mingote SM (2007) Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits. Psychopharmacology 191:461–482.
51. Saunders BT, Robinson TE (2012) The role of dopamine in the accumbens core inthe expressionofPavlovian-conditioned responses. EurJNeurosci 36:2521–2532.
52. Setlow B, Schoenbaum G, Gallagher M (2003) Neural encoding in ventral striatum during olfactory discrimination learning. Neuron 38:625–636.
53. Stevens JR, Rosati AG, Ross KR, Hauser MD (2005) Will travel for food: spatial discounting in two new world monkeys. Curr Biol 15:1855–1860.
54. van der Meer MA, Redish AD (2009) Covert expectation-of-reward in rat ventral striatum at decision points. Front Integr Neurosci 3:1.
55. van der Meer MA, Redish AD (2011) Ventral striatum: a critical look at models of learning and evaluation. Curr Opin Neurobiol 21:387–392.
56. Walton ME, Kennerley SW, Bannerman DM, Phillips PE, Rushworth MF (2006) Weighing up the benefits of work: behavioral and neural analyses of effort-related decision making. Neural Netw 19:1302–1314.
57. Walton ME, Groves J, Jennings KA, Croxson PL, Sharp T, Rushworth MF, Ban-nerman DM (2009) Comparingtheroleof the anterior cingulate cortex and 6-hydroxydopamine nucleus accumbens lesions on operant effort-based decision making. Eur J Neurosci 29:1678–1691.
58. Williams DR, Williams H (1969) Auto-maintenance in the pigeon: sustained pecking despite contingent non-reinforcement. J Exp Anal Behav 12:511–520.
59. Winstanley CA, Theobald DE, Dalley JW, Robbins TW (2005) Interactions between serotonin and dopamine in the control of impulsive choice in rats: therapeutic implications for impulse control disorders. Neuropsy-chopharmacology 30:669–682.
60. Winstanley CA, Eagle DM, Robbins TW (2006) Behavioral models of im-pulsivityin relation to ADHD: translation between clinical and preclinical studies. Clin Psychol Rev 26:379–395.
61. Young JJ, Shapiro ML (2011) Dynamic coding of goal-directed paths by orbital prefrontal cortex. J Neurosci 31:5989–6000.
62. Yun IA, Wakabayashi KT, Fields HL, Nicola SM (2004) The ventral tegmen-tal area is required for the behavioral and nucleus accumbens neuronal firing responses to incentive cues. J Neurosci 24:2923–2933.