Ramping ensemble activity in dorsal anterior cingulate neurons during persistent commitment to a decision

Journal of Neurophysiology

Volumn 114, Issue 4, 2015, Pages 2439-2449

  Blanchard, Tommy C ^a   Strait, Caleb E ^a   Hayden, Benjamin Y ^a  

^a UNIVERSITY OF ROCHESTER   (United States)

Author keywords

Anticipatory activity; Dorsal anterior cingulate cortex; Persistence; Reward signaling

Indexed keywords

ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ANTERIOR CINGULATE; ANTICIPATION; ARTICLE; CODING FORMAT VECTOR; CONTROLLED STUDY; CORRELATION COEFFICIENT; DECISION MAKING; DORSAL ANTERIOR CINGULATE CORTEX; ELECTROENCEPHALOGRAM; EUCLIDEAN DISTANCE; FIRING RATE; FOOD PREFERENCE; FORAGING; HISTOGRAM; LATENT PERIOD; MALE; MONITOR; NERVE CELL; NERVE POTENTIAL; NERVOUS SYSTEM PARAMETERS; NOISE; NONHUMAN; PERSISTENCE; PREFRONTAL CORTEX; PRIORITY JOURNAL; RAMPING ENSEMBLE ACTIVITY; REWARD; RHESUS MONKEY; SELF CONTROL; ACTION POTENTIAL; ANIMAL; CINGULATE GYRUS; EYE MOVEMENT; HIGH RISK BEHAVIOR; MICROELECTRODE; NEUROPSYCHOLOGICAL TEST; PHYSIOLOGY; SIGNAL PROCESSING; VISION;

ACTION POTENTIALS; ANIMALS; DECISION MAKING; EYE MOVEMENTS; GYRUS CINGULI; MACACA MULATTA; MALE; MICROELECTRODES; NEURONS; NEUROPSYCHOLOGICAL TESTS; REWARD; RISK-TAKING; SIGNAL PROCESSING, COMPUTER-ASSISTED; VISUAL PERCEPTION;

EID: 84944810007     PISSN: 00223077     EISSN: 15221598     Source Type: Journal    
DOI: 10.1152/jn.00711.2015     Document Type: Article

References (53)

1. Alexander WH, Brown JW. Competition between learned reward and erroroutcome predictions in anterior cingulate cortex. Neuroimage 49: 3210-3218, 2010.
2. Amiez C, Joseph JP, Procyk E. Reward encoding in the monkey anteriorcingulate cortex. Cereb Cortex 16: 1040-1055, 2006.
3. Azzi JC, Sirigu A, Duhamel JR. Modulation of value representation by socialcontext in the primate orbitofrontal cortex. Proc Natl Acad Sci USA 109:2126-2131, 2012.
4. Blanchard TC, Hayden BY. Neurons in dorsal anterior cingulate cortexsignal postdecisional variables in a foraging task. J Neurosci 34: 646-655,2014.
5. Blanchard TC, Hayden BY. Monkeys are more patient in a foraging task thanin a standard intertemporal choice task. PLoS One 10: e0117057, 2015.
6. Blanchard TC, Hayden BY, Bromberg-Martin ES. Orbitofrontal cortexuses distinct codes for different choice attributes in decisions motivated bycuriosity. Neuron 85: 602-614, 2015.
7. Blanchard TC, Pearson JM, Hayden BY. Postreward delays and systematicbiases in measures of animal temporal discounting. Proc Natl Acad Sci USA110: 15491-15496, 2013.
8. Botvinick MM, Braver TS, Barch DM, Carter CS, Cohen JD. Conflictmonitoring and cognitive control. Psychol Rev 108: 624-652, 2001.
9. Bush G, Vogt BA, Holmes J, Dale AM, Greve D, Jenike MA, Rosen BR.Dorsal anterior cingulate cortex: a role in reward-based decision making.Proc Natl Acad Sci USA 99: 523-528, 2002.
10. Camille N, Tsuchida A, Fellows LK. Double dissociation of stimulus-valueand action-value learning in humans with orbitofrontal or anterior cingulatecortex damage. J Neurosci 31: 15048-15052, 2011.
11. Chudasama Y, Daniels TE, Gorrin DP, Rhodes SEV, Rudebeck PH,Murray EA. The role of the anterior cingulate cortex in choices based onreward value and reward contingency. Cereb Cortex 23: 2884-2898, 2013.
12. Durstewitz D. Self-organizing neural integrator predicts interval times throughclimbing activity. J Neurosci 23: 5342-5353, 2003.
13. Fiorillo CD. Discrete coding of reward probability and uncertainty by dopamineneurons. Science 299: 1898-1902, 2003.
14. Fiorillo CD, Newsome WT, Schultz W. The temporal precision of rewardprediction in dopamine neurons. Nat Neurosci 11: 966-973, 2008.
15. Floden D, Stuss D. Inhibitory control is slowed in patients with right superiormedial frontal damage. J Cogn Neurosci 18: 1843-1849, 2006.
16. Gershman SJ. Dopamine ramps are a consequence of reward predictionerrors. Neural Comput 26: 467-471, 2014.
17. Gusnard DA, Ollinger JM, Shulman GL, Cloninger CR, Price JL, VanEssen DC, Raichle ME. Persistence and brain circuitry. Proc Natl Acad SciUSA 100: 3479-3484, 2003.
18. Hayden BY, Heilbronner SR, Pearson JM, Platt ML. Surprise signals inanterior cingulate cortex: neuronal encoding of unsigned reward predictionerrors driving adjustment in behavior. J Neurosci 31: 4178-4187, 2011a.
19. Hayden BY, Nair AC, McCoy AN, Platt ML. Posterior cingulate cortexmediates outcome-contingent allocation of behavior. Neuron 60: 19-25,2008.
20. Hayden BY, Pearson JM, Platt ML. Fictive reward signals in the anteriorcingulate cortex. Science 324: 948-950, 2009.
21. Hayden BY, Pearson JM, Platt ML. Neuronal basis of sequential foragingdecisions in a patchy environment. Nat Neurosci 14: 933-939, 2011b.
22. Hayden BY, Platt ML. Neurons in anterior cingulate cortex multiplexinformation about reward and action. J Neurosci 30: 3339-3346, 2010.
23. Hillman KL, Bilkey DK. Neurons in the rat anterior cingulate cortex dynamicallyencode cost-benefit in a spatial decision-making task. J Neurosci 30:7705-7713, 2010.
24. Holroyd CB, Coles MG. The neural basis of human error processing:reinforcement learning, dopamine, and the error-related negativity. PsycholRev 109: 679-709, 2002.
25. Howe MW, Tierney PL, Sandberg SG, Phillips PE, Graybiel AM. Prolongeddopamine signalling in striatum signals proximity and value ofdistant rewards. Nature 500: 575-579, 2013.
26. Kennerley SW, Walton ME, Behrens TE, Buckley MJ, Rushworth MF.Optimal decision making and the anterior cingulate cortex. Nat Neurosci 9:940-947, 2006.
27. Krebs JR, Erichsen JT, Webber MI, Charnov EL. Optimal prey selectionin the great tit (Parus major). Anim Behav 25: 30-38, 1977.
28. Ma L, Hyman JM, Phillips AG, Seamans JK. Tracking progress toward agoal in corticostriatal ensembles. J Neurosci 34: 2244-2253, 2014.
29. MacEvoy SP, Epstein RA. Decoding the representation of multiple simultaneousobjects in human occipitotemporal cortex. Curr Biol 19: 943-947,2009.
30. McGuire JT, Kable JW. Medial prefrontal cortical activity reflects dynamicre-evaluation during voluntary persistence. Nat Neurosci 18: 760-766,2015.
31. Narayanan NS, Horst NK, Laubach M. Reversible inactivations of ratmedial prefrontal cortex impair the ability to wait for a stimulus. Neuroscience139: 865-876, 2006.
32. Narayanan NS, Laubach M. Top-down control of motor cortex ensembles bydorsomedial prefrontal cortex. Neuron 52: 921-931, 2006.
33. Narayanan NS, Laubach M. Delay activity in rodent frontal cortex during asimple reaction time task. J Neurophysiol 101: 2859-2871, 2009.
34. Niv Y. Neuroscience: dopamine ramps up. Nature 500: 533-535, 2013.
35. Parvizi J, Rangarajan V, Shirer WR, Desai N, Greicius MD. The will topersevere induced by electrical stimulation of the human cingulate gyrus.Neuron 80: 1359-1367, 2013.
36. Paus T. Primate anterior cingulate cortex: where motor control, drive andcognition interface. Nat Rev Neurosci 2: 417-424, 2001.
37. Pearson JM, Hayden BY, Platt ML. Explicit information reduces discountingbehavior in monkeys. Front Hum Neurosci 1: 237, 2010.
38. Peters J, Büchel C. Episodic future thinking reduces reward delay discountingthrough an enhancement of prefrontal-mediotemporal interactions. Neuron66: 138-148, 2010.
39. Picton TW, Stuss DT, Alexander MP, Shallice T, Binns MA, Gillingham S. Effects of focal frontal lesions on response inhibition. Cereb Cortex 17:826-838, 2007.
40. Quilodran R, Rothé M, Procyk E. Behavioral shifts and action valuation inthe anterior cingulate cortex. Neuron 57: 314-325, 2008.
41. de Ridder DT, Lensvelt-Mulders G, Finkenauer C, Stok FM, BaumeisterRF. Taking stock of self-control: a meta-analysis of how traitself-control relates to a wide range of behaviors. Pers Soc Psychol Rev16: 76 -99, 2012.
42. Rigotti M, Barak O, Warden MR, Wang XJ, Daw ND, Miller EK, Fusi S.The importance of mixed selectivity in complex cognitive tasks. Nature 497:585-590, 2013.
43. Rushworth MF, Noonan MP, Boorman ED, Walton ME, Behrens TE.Frontal cortex and reward-guided learning and decision-making. Neuron 70:1054-1069, 2011.
44. Sallet J, Quilodran R, Rothé M, Vezoli J, Joseph JP, Procyk E. Expectations,gains, and losses in the anterior cingulate cortex. Cogn Affect BehavNeurosci 7: 327-336, 2007.
45. Schultz W, Dickinson A. Neuronal coding of prediction errors. Annu RevNeurosci 23: 473-500, 2000.
46. Shenhav A, Botvinick MM, Cohen JD. The expected value of control: anintegrative theory of anterior cingulate cortex function. Neuron 79: 217-240, 2013.
47. Shidara M, Richmond BJ. Anterior cingulate: single neuronal signals relatedto degree of reward expectancy. Science 296: 1709-1711, 2002.
48. Shima K, Tanji J. Role for cingulate motor area cells in voluntary movementselection based on reward. Science 282: 1335-1338, 1998.
49. Stephens DW, Krebs JR. Foraging Theory (1st ed.). Princeton, NJ: PrincetonUniv. Press, 1987.
50. Strait CE, Blanchard TC, Hayden BY. Reward value comparison viamutual inhibition in ventromedial prefrontal cortex. Neuron 82: 1357-1366, 2014.
51. Toda K, Sugase-Miyamoto Y, Mizuhiki T, Inaba K, Richmond BJ, ShidaraM. Differential encoding of factors influencing predicted reward valuein monkey rostral anterior cingulate cortex. PLoS One 7: e30190, 2012.
52. Wallis JD, Kennerley SW. Contrasting reward signals in the orbitofrontalcortex and anterior cingulate cortex. Ann NY Acad Sci 1239: 33- 42,2011.
53. Warden MR, Selimbeyoglu A, Mirzabekov JJ, Lo M, Thompson KR, KimSY, Adhikari A, Tye KM, Frank LM, Deisseroth K. A prefrontalcortex-brainstem neuronal projection that controls response to behaviouralchallenge. Nature 492: 428-432, 2012.