Autocorrelation structure at rest predicts value correlates of single neurons during reward-guided choice

eLife

Volumn 5, Issue OCTOBER2016, 2016, Pages

  Cavanagh, Sean E ^a   Wallis, Joni D ^b   Kennerley, Steven W ^a,b   Hunt, Laurence T ^a,c  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

DECISION MAKING; LEARNING; NERVE CELL; ORBITAL CORTEX; PREDICTION; RECEPTIVE FIELD; REST; REWARD; SPIKE; ANIMAL; NEUROPHYSIOLOGICAL MONITORING; PHYSIOLOGY; PREFRONTAL CORTEX; RHESUS MONKEY;

ANIMALS; CHOICE BEHAVIOR; DECISION MAKING; MACACA MULATTA; NEURONS; NEUROPHYSIOLOGICAL MONITORING; PREFRONTAL CORTEX; REST; REWARD;

EID: 84990234562     PISSN: None     EISSN: 2050084X     Source Type: Journal    
DOI: 10.7554/eLife.18937     Document Type: Article

References (71)

1. Akaishi R, Kolling N, Brown JW, Rushworth M. 2016. Neural mechanisms of credit assignment in a multicue environment. Journal of Neuroscience 36:1096–1112. doi: 10.1523/JNEUROSCI.3159-15.2016
2. Amit DJ, Brunel N. 1997. Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. Cerebral Cortex 7:237–252. doi: 10.1093/cercor/7.3.237
3. Bernacchia A, Seo H, Lee D, Wang XJ. 2011. A reservoir of time constants for memory traces in cortical neurons. Nature Neuroscience 14:366–372. doi: 10.1038/nn.2752
4. Bogacz R, Brown E, Moehlis J, Holmes P, Cohen JD. 2006. The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. Psychological Review 113:700–765. doi: 10.1037/0033-295X.113.4.700
5. Boorman ED, Behrens TE, Woolrich MW, Rushworth MF. 2009. How green is the grass on the other side? Frontopolar cortex and the evidence in favor of alternative courses of action. Neuron 62:733–743. doi: 10. 1016/j.neuron.2009.05.014
6. Buschman TJ, Denovellis EL, Diogo C, Bullock D, Miller EK. 2012. Synchronous oscillatory neural ensembles for rules in the prefrontal cortex. Neuron 76:838–846. doi: 10.1016/j.neuron.2012.09.029
7. Camille N, Tsuchida A, Fellows LK. 2011. Double dissociation of stimulus-value and action-value learning in humans with orbitofrontal or anterior cingulate cortex damage. Journal of Neuroscience 31:15048–15052. doi: 10.1523/JNEUROSCI.3164-11.2011
8. Cavanagh SE, Wallis JD, Kennerley SW, Hunt LT. 2016. Data from: Autocorrelation structure at rest predicts value correlates of single neurons during reward-guided choice. Dryad Digital Repository. doi: 10.5061/dryad. 5b331
9. Chau BK, Sallet J, Papageorgiou GK, Noonan MP, Bell AH, Walton ME, Rushworth MF. 2015. Contrasting roles for orbitofrontal cortex and amygdala in credit assignment and learning in macaques. Neuron 87:1106–1118. doi: 10.1016/j.neuron.2015.08.018
10. Chaudhuri R, Knoblauch K, Gariel MA, Kennedy H, Wang XJ. 2015. A large-scale circuit mechanism for hierarchical dynamical processing in the primate cortex. Neuron 88:419–431. doi: 10.1016/j.neuron.2015.09. 008
11. Chen J, Hasson U, Honey CJ, Christopher J. 2015. Processing timescales as an organizing principle for primate cortex. Neuron 88:244–246. doi: 10.1016/j.neuron.2015.10.010
12. Donoso M, Collins AG, Koechlin E. 2014. Human cognition. Foundations of human reasoning in the prefrontal cortex. Science 344:1481–1486. doi: 10.1126/science.1252254
13. Elston GN. 2003. Cortex, cognition and the cell: new insights into the pyramidal neuron and prefrontal function. Cerebral Cortex 13:1124–1138. doi: 10.1093/cercor/bhg093
14. Freedman DJ, Assad JA. 2006. Experience-dependent representation of visual categories in parietal cortex. Nature 443:85–88. doi: 10.1038/nature05078
15. Freedman DJ, Riesenhuber M, Poggio T, Miller EK. 2001. Categorical representation of visual stimuli in the primate prefrontal cortex. Science 291:312–316. doi: 10.1126/science.291.5502.312
16. Freeman WJ. 1995. The Hebbian paradigm reintegrated: Local reverberations as internal representations. Behavioral and Brain Sciences 18:631. doi: 10.1017/S0140525X0004022X
17. Gold JI, Shadlen MN. 2007. The neural basis of decision making. Annual Review of Neuroscience 30:535–574. doi: 10.1146/annurev.neuro.29.051605.113038
18. Hanks TD, Kopec CD, Brunton BW, Duan CA, Erlich JC, Brody CD. 2015. Distinct relationships of parietal and prefrontal cortices to evidence accumulation. Nature 520:220–223. doi: 10.1038/nature14066
19. Hayden BY, Pearson JM, Platt ML. 2011. Neuronal basis of sequential foraging decisions in a patchy environment. Nature Neuroscience 14:933–939. doi: 10.1038/nn.2856
20. Hosokawa T, Kennerley SW, Sloan J, Wallis JD. 2013. Single-neuron mechanisms underlying cost-benefit analysis in frontal cortex. Journal of Neuroscience 33:17385–17397. doi: 10.1523/JNEUROSCI.2221-13.2013
21. Huk AC, Shadlen MN. 2005. Neural activity in macaque parietal cortex reflects temporal integration of visual motion signals during perceptual decision making. Journal of Neuroscience 25:10420–10436. doi: 10.1523/ JNEUROSCI.4684-04.2005
22. Hunt LT, Behrens TE, Hosokawa T, Wallis JD, Kennerley SW. 2015. Capturing the temporal evolution of choice across prefrontal cortex. eLife 4:e11945. doi: 10.7554/eLife.11945
23. Hunt LT, Kolling N, Soltani A, Woolrich MW, Rushworth MF, Behrens TE. 2012. Mechanisms underlying cortical activity during value-guided choice. Nature Neuroscience 15:470–476. doi: 10.1038/nn.3017
24. Jocham G, Brodersen KH, Constantinescu AO, Kahn MC, Ianni AM, Walton ME, Rushworth MF, Behrens TE. 2016. Reward-guided learning with and without causal attribution. Neuron 90:177–190. doi: 10.1016/j.neuron. 2016.02.018
25. Kennerley SW, Behrens TE, Wallis JD. 2011. Double dissociation of value computations in orbitofrontal and anterior cingulate neurons. Nature Neuroscience 14:1581–1589. doi: 10.1038/nn.2961
26. Kennerley SW, Dahmubed AF, Lara AH, Wallis JD. 2009. Neurons in the frontal lobe encode the value of multiple decision variables. Journal of Cognitive Neuroscience 21:1162–1178. doi: 10.1162/jocn.2009.21100
27. Kennerley SW, Wallis JD. 2009. Evaluating choices by single neurons in the frontal lobe: outcome value encoded across multiple decision variables. European Journal of Neuroscience 29:2061–2073. doi: 10.1111/j.1460-9568.2009.06743.x
28. Kim S, Hwang J, Lee D. 2008. Prefrontal coding of temporally discounted values during intertemporal choice. Neuron 59:161–172. doi: 10.1016/j.neuron.2008.05.010
29. Kira S, Yang T, Shadlen MN. 2015. A neural implementation of Wald’s sequential probability ratio test. Neuron 85:861–873. doi: 10.1016/j.neuron.2015.01.007
30. Lara AH, Kennerley SW, Wallis JD. 2009. Encoding of gustatory working memory by orbitofrontal neurons. Journal of Neuroscience 29:765–774. doi: 10.1523/JNEUROSCI.4637-08.2009
31. Lopatina N, McDannald MA, Styer CV, Sadacca BF, Cheer JF, Schoenbaum G. 2015. Lateral orbitofrontal neurons acquire responses to upshifted, downshifted, or blocked cues during unblocking. eLife 4:e11299. doi: 10.7554/eLife.11299
32. Mante V, Sussillo D, Shenoy KV, Newsome WT. 2013. Context-dependent computation by recurrent dynamics in prefrontal cortex. Nature 503:78–84. doi: 10.1038/nature12742
33. Matsumoto M, Matsumoto K, Abe H, Tanaka K. 2007. Medial prefrontal cell activity signaling prediction errors of action values. Nature Neuroscience 10:647–656. doi: 10.1038/nn1890
34. Mazurek ME, Roitman JD, Ditterich J, Shadlen MN. 2003. A role for neural integrators in perceptual decision making. Cerebral Cortex 13:1257–1269. doi: 10.1093/cercor/bhg097
35. Meister ML, Hennig JA, Huk AC. 2013. Signal multiplexing and single-neuron computations in lateral intraparietal area during decision-making. Journal of Neuroscience 33:2254–2267. doi: 10.1523/JNEUROSCI.2984-12.2013
36. Miller EK, Erickson CA, Desimone R. 1996. Neural mechanisms of visual working memory in prefrontal cortex of the macaque. Journal of Neuroscience 16:5154–5167
37. Murray JD, Bernacchia A, Freedman DJ, Romo R, Wallis JD, Cai X, Padoa-Schioppa C, Pasternak T, Seo H, Lee D, Wang XJ. 2014. A hierarchy of intrinsic timescales across primate cortex. Nature Neuroscience 17:1661–1663. doi: 10.1038/nn.3862
38. Nichols TE, Holmes AP. 2002. Nonparametric permutation tests for functional neuroimaging: a primer with examples. Human Brain Mapping 15:1–25. doi: 10.1002/hbm.1058
39. Nishida S, Tanaka T, Shibata T, Ikeda K, Aso T, Ogawa T. 2014. Discharge-rate persistence of baseline activity during fixation reflects maintenance of memory-period activity in the macaque posterior parietal cortex. Cerebral Cortex 24:1671–1685. doi: 10.1093/cercor/bht031
40. Noonan MP, Walton ME, Behrens TE, Sallet J, Buckley MJ, Rushworth MF. 2010. Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex. PNAS 107:20547–20552. doi: 10. 1073/pnas.1012246107
41. Ogawa T, Komatsu H. 2010. Differential temporal storage capacity in the baseline activity of neurons in macaque frontal eye field and area V4. Journal of Neurophysiology 103:2433–2445. doi: 10.1152/jn.01066.2009
42. Padoa-Schioppa C, Assad JA. 2006. Neurons in the orbitofrontal cortex encode economic value. Nature 441: 223–226. doi: 10.1038/nature04676
43. Pinto L, Dan Y. 2015. Cell-type-specific activity in prefrontal cortex during goal-directed behavior. Neuron 87: 437–450. doi: 10.1016/j.neuron.2015.06.021
44. Premereur E, Vanduffel W, Janssen P. 2011. Functional heterogeneity of macaque lateral intraparietal neurons. Journal of Neuroscience 31:12307–12317. doi: 10.1523/JNEUROSCI.2241-11.2011
45. Raghuraman AP, Padoa-Schioppa C. 2014. Integration of multiple determinants in the neuronal computation of economic values. Journal of Neuroscience 34:11583–11603. doi: 10.1523/JNEUROSCI.1235-14.2014
46. Rangel A, Hare T. 2010. Neural computations associated with goal-directed choice. Current Opinion in Neurobiology 20:262–270. doi: 10.1016/j.conb.2010.03.001
47. Roitman JD, Shadlen MN. 2002. Response of neurons in the lateral intraparietal area during a combined visual discrimination reaction time task. Journal of Neuroscience 22:9475–9489
48. Rudebeck PH, Behrens TE, Kennerley SW, Baxter MG, Buckley MJ, Walton ME, Rushworth MF. 2008. Frontal cortex subregions play distinct roles in choices between actions and stimuli. Journal of Neuroscience 28:13775–13785. doi: 10.1523/JNEUROSCI.3541-08.2008
49. Rudebeck PH, Walton ME, Smyth AN, Bannerman DM, Rushworth MF. 2006. Separate neural pathways process different decision costs. Nature Neuroscience 9:1161–1168. doi: 10.1038/nn1756
50. Rustichini A, Padoa-Schioppa C. 2015. A neuro-computational model of economic decisions. Journal of Neurophysiology 114:1382–1398. doi: 10.1152/jn.00184.2015
51. Schoenbaum G, Roesch MR, Stalnaker TA, Takahashi YK. 2010. A new perspective on the role of the orbitofrontal cortex in adaptive behaviour. Nature Reviews Neuroscience 10:885–892. doi: 10.1038/nrn2753
52. Seo H, Barraclough DJ, Lee D. 2009. Lateral intraparietal cortex and reinforcement learning during a mixed- strategy game. Journal of Neuroscience 29:7278–7289. doi: 10.1523/JNEUROSCI.1479-09.2009
53. Seo H, Cai X, Donahue CH, Lee D. 2014. Neural correlates of strategic reasoning during competitive games. Science 346:340–343. doi: 10.1126/science.1256254
54. Seo H, Lee D. 2007. Temporal filtering of reward signals in the dorsal anterior cingulate cortex during a mixed- strategy game. Journal of Neuroscience 27:8366–8377. doi: 10.1523/JNEUROSCI.2369-07.2007
55. Stokes MG, Kusunoki M, Sigala N, Nili H, Gaffan D, Duncan J. 2013. Dynamic coding for cognitive control in prefrontal cortex. Neuron 78:364–375. doi: 10.1016/j.neuron.2013.01.039
56. Stokes MG, Wolff MJ, Spaak E. 2015. Decoding rich spatial information with high temporal resolution. Trends in Cognitive Sciences 19:636–638. doi: 10.1016/j.tics.2015.08.016
57. Stoll FM, Fontanier V, Procyk E. 2016. Specific frontal neural dynamics contribute to decisions to check. Nature Communications 7:11990. doi: 10.1038/ncomms11990
58. Takahashi YK, Roesch MR, Wilson RC, Toreson K, O’Donnell P, Niv Y, Schoenbaum G. 2011. Expectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex. Nature Neuroscience 14:1590–1597. doi: 10.1038/nn.2957
59. Wallis JD, Kennerley SW. 2010. Heterogeneous reward signals in prefrontal cortex. Current Opinion in Neurobiology 20:191–198. doi: 10.1016/j.conb.2010.02.009
60. Walton ME, Behrens TE, Buckley MJ, Rudebeck PH, Rushworth MF. 2010. Separable learning systems in the macaque brain and the role of orbitofrontal cortex in contingent learning. Neuron 65:927–939. doi: 10.1016/j. neuron.2010.02.027
61. Wang H, Stradtman GG, Wang XJ, Gao WJ. 2008. A specialized NMDA receptor function in layer 5 recurrent microcircuitry of the adult rat prefrontal cortex. PNAS 105:16791–16796. doi: 10.1073/pnas.0804318105
62. Wang M, Yang Y, Wang CJ, Gamo NJ, Jin LE, Mazer JA, Morrison JH, Wang XJ, Arnsten AF. 2013. NMDA receptors subserve persistent neuronal firing during working memory in dorsolateral prefrontal cortex. Neuron 77:736–749. doi: 10.1016/j.neuron.2012.12.032
63. Wang XJ. 1999. Synaptic basis of cortical persistent activity: the importance of NMDA receptors to working memory. Journal of Neuroscience 19:9587–9603
64. Wang XJ. 2001. Synaptic reverberation underlying mnemonic persistent activity. Trends in Neurosciences 24: 455–463. doi: 10.1016/S0166-2236(00)01868-3
65. Wang XJ. 2002. Probabilistic decision making by slow reverberation in cortical circuits. Neuron 36:955–968. doi: 10.1016/S0896-6273(02)01092-9
66. Wang XJ. 2012. Neural dynamics and circuit mechanisms of decision-making. Current Opinion in Neurobiology 22:1039–1046. doi: 10.1016/j.conb.2012.08.006
67. Wang Y, Markram H, Goodman PH, Berger TK, Ma J, Goldman-Rakic PS. 2006. Heterogeneity in the pyramidal network of the medial prefrontal cortex. Nature Neuroscience 9:534–542. doi: 10.1038/nn1670
68. Wong KF, Wang XJ. 2006. A recurrent network mechanism of time integration in perceptual decisions. Journal of Neuroscience 26:1314–1328. doi: 10.1523/JNEUROSCI.3733-05.2006
69. Yang T, Shadlen MN. 2007. Probabilistic reasoning by neurons. Nature 447:1075–1080. doi: 10.1038/ nature05852
70. Zaitsev AV, Povysheva NV, Gonzalez-Burgos G, Rotaru D, Fish KN, Krimer LS, Lewis DA. 2009. Interneuron diversity in layers 2-3 of monkey prefrontal cortex. Cerebral Cortex 19:1597–1615. doi: 10.1093/cercor/bhn198
71. Zhou X, Katsuki F, Qi XL, Constantinidis C. 2012. Neurons with inverted tuning during the delay periods of working memory tasks in the dorsal prefrontal and posterior parietal cortex. Journal of Neurophysiology 108: 31–38. doi: 10.1152/jn.01151.2011