Rule encoding in orbitofrontal cortex and striatum guides selection

Journal of Neuroscience

Volumn 36, Issue 44, 2016, Pages 11223-11237

  Sleezer, Brianna J ^a   Castagno, Meghan D ^a   Hayden, Benjamin Y ^a  

^a UNIVERSITY OF ROCHESTER   (United States)

Author keywords

Decision making; Executive control; Macaque; Orbitofrontal cortex; Single unit; Striatum

Indexed keywords

ADAPTATION; ANALYSIS OF VARIANCE; ANIMAL EXPERIMENT; ANIMAL MODEL; ARTICLE; BEHAVIOR CHANGE; CONTROLLED STUDY; CORPUS STRIATUM; DECISION MAKING; ELECTROPHYSIOLOGICAL PROCEDURES; EPISODIC MEMORY; EYE TRACKING; FEEDBACK SYSTEM; MALE; NONHUMAN; NUCLEAR MAGNETIC RESONANCE IMAGING; ORBITAL CORTEX; PERFORMANCE; PRIORITY JOURNAL; RHESUS MONKEY; ANIMAL; ATTENTION; EXECUTIVE FUNCTION; LEARNING; NERVE CELL NETWORK; PHYSIOLOGY; PREFRONTAL CORTEX;

ANIMALS; ATTENTION; CHOICE BEHAVIOR; CORPUS STRIATUM; EXECUTIVE FUNCTION; LEARNING; MACACA MULATTA; MALE; NERVE NET; PREFRONTAL CORTEX;

EID: 84994432470     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.1766-16.2016     Document Type: Article

References (83)

1. Abe H, Lee D (2011) Distributed coding of actual and hypothetical outcomes in the orbital and dorsolateral prefrontal cortex. Neuron 70: 731–741.
2. Aoki S, Liu AW, Zucca A, Zucca S, Wickens JR (2015) Role of striatal cholinergic interneurons in set-shifting in the rat. J Neurosci 35: 9424-9431.
3. Apicella P, Ljungberg T, Scarnati E, Schultz W (1991) Responses to reward in monkey dorsal and ventral striatum. Exp Brain Res 85: 491–500.
4. Atallah HE, Lopez-Paniagua D, Rudy JW, O’Reilly RC (2007) Separate neural substrates for skill learning and performance in the ventral and dorsal striatum. Nat Neurosci 10: 126-131.
5. Badre D, Kayser AS, D’Esposito M (2010) Frontal cortex and the discovery of abstract action rules. Neuron 66: 315–326.
6. Banich MT, Milham MP, Atchley RA, Cohen NJ, Webb A, Wszalek T, Kramer AF, Liang, Z.-P., Barad V, Gullett D, et al. (2000) Prefrontal regions play a predominant role in imposing an attentional “set”: evidence from fMRI. Cogn Brain Res 10: 1–9.
7. Bissonette GB, Roesch MR (2015) Rule encoding in dorsal striatum impacts action selection. Eur J Neurosci 42: 2555–2567.
8. Bissonette GB, Roesch MR (2016) Neurophysiology of rule switching in the corticostriatal circuit. Neuroscience. In press.
9. Blanchard TC, Hayden BY (2014) Neurons in dorsal anterior cingulate cor-tex signal postdecisional variables in a foraging task. J Neurosci 34: 646–655.
10. Blanchard TC, Hayden BY, Bromberg-Martin ES (2015a) Orbitofrontal cortex uses distinct codes for different choice attributes in decisions motivated by curiosity. Neuron 85: 602-614.
11. Blanchard TC, Strait CE, Hayden BY (2015b) Ramping ensemble activity in dorsal anterior cingulate neurons during persistent commitment to a decision. J Neurophysiol 114: 2439-2449.
12. Block AE, Dhanji H, Thompson-Tardif SF, Floresco SB (2007) Thalamicprefrontal cortical-ventral striatal circuitry mediates dissociable components of strategy set shifting. Cereb Cortex 17: 1625–1636.
13. Brown VJ, Tait DS (2016) Attentional set-shifting across species. Curr Top Behav Neurosci. In press.
14. Bryden DW, Roesch MR (2015) Executive control signals in orbitofrontal cortex during response inhibition. J Neurosci 35: 3903–3914.
15. Buckley MJ, Mansouri FA, Hoda H, Mahboubi M, Browning PG, Kwok SC, Phillips A, Tanaka K (2009) Dissociable components of rule-guided behavior depend on distinct medial and prefrontal regions. Science 325: 52–58.
16. Bunge SA, Kahn I, Wallis JD, Miller EK, Wagner AD (2003) Neural circuits subserving the retrieval and maintenance of abstract rules. J Neurophysiol 90: 3419-3428.
17. Bunge SA, Wallis JD (2007) Neuroscience of rule-guided behavior. Oxford: OUP.
18. Chelazzi L, Duncan J, Miller EK, Desimone R (1998) Responses of neurons in inferior temporal cortex during memory-guided visual search. J Neurophysiol 80: 2918-2940.
19. Cools R, Clark L, Robbins TW (2004) Differential responses in human striatum and prefrontal cortex to changes in object and rule relevance. J Neurosci 24: 1129-1135.
20. Dang LC, Donde A, Madison C, O’Neil JP, Jagust WJ (2012) Striatal dopamine influences the default mode network to affect shifting between object features. J Cogn Neurosci 24: 1960-1970.
21. Delgado MR (2007) Reward-related responses in the human striatum. Ann N Y Acad Sci 1104: 70–88.
22. Dias R, Robbins TW, Roberts AC (1996) Dissociation in prefrontal cortex of affective and attentional shifts. Nature 380: 69-72.
23. Diekhof EK, Falkai P, Gruber O (2011) The orbitofrontal cortex and its role in the assignment of behavioural significance. Neuropsychologia 49: 984–991.
24. Diekhof EK, Kaps L, Falkai P, Gruber O (2012) The role of the human ventral striatum and the medial orbitofrontal cortex in the representation of reward magnitude-an activation likelihood estimation meta-analysis of neuroimaging studies of passive reward expectancy and outcome processing. Neuropsychologia 50: 1252–1266.
25. Elliott R, Newman JL, Longe OA, Deakin JF (2003) Differential response patterns in the striatum and orbitofrontal cortex to financial reward in humans: a parametric functional magnetic resonance imaging study. J Neurosci 23: 303–307.
26. Floresco SB (2015) The nucleus accumbens: an interface between cognition, emotion, and action. Annu Rev Psychol 66: 25–52.
27. Floresco SB, Ghods-Sharifi S, Vexelman C, Magyar O (2006) Dissociable roles for the nucleus accumbens core and shell in regulating set shifting. J Neurosci 26: 2449-2457.
28. Floresco SB, St Onge JR, Ghods-Sharifi S, Winstanley CA (2008) Corticolimbic-striatal circuits subserving different forms of cost-benefit decision making. Cogn Affect Behav Neurosci 8: 375–389.
29. Frank MJ, Claus ED (2006) Anatomy of a decision: Striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal. Psychol Rev 113: 300-326.
30. Funahashi S (2001) Neuronal mechanisms of executive control by the prefrontal cortex. Neurosci Res 39: 147–165.
31. Fuster JM, Alexander GE (1971) Neuron activity related to short-term memory. Science 173: 652-654.
32. Goodwin SJ, Blackman RK, Sakellaridi S, Chafee MV (2012) Executive control over cognition: stronger and earlier rule-based modulation of spatial category signals in prefrontal cortex relative to parietal cortex. J Neurosci 32: 3499-3515.
33. Hayden BY, Gallant JL (2013) Working memory and decision processes in visual area v4. Front Neurosci 7: 18.
34. Hayden BY, Pearson JM, Platt ML (2011a) Neuronal basis of sequential foraging decisions in a patchy environment. Nat Neurosci 14: 933–939.
35. Hayden BY, Heilbronner SR, Pearson JM, Platt ML (2011b) Surprise signals in anterior cingulate cortex: neuronal encoding of unsigned reward prediction errors driving adjustment in behavior. J Neurosci 31: 4178–4187.
36. Hayden, B.Y., Smith, D.V., and Platt, M.L (2010) Cognitive control signals in posterior cingulate cortex. Front Hum Neurosci 4.
37. Heilbronner SR, Hayden BY (2016) Dorsal anterior cingulate cortex: a bottom-up view. Annu Rev Neurosci 39: 149-170.
38. Hernández A, Nácher V, Luna R, Zainos A, Lemus L, Alvarez M, Vázquez Y, Camarillo L, Romo R (2010) Decoding a perceptual decision process across cortex. Neuron 66: 300-314.
39. Hussein S, Johnston K, Belbeck B, Lomber SG, Everling S (2014) Functional specialization within macaque dorsolateral prefrontal cortex for the maintenance of task rules and cognitive control. J Cogn Neurosci 26: 1918–1927.
40. Kringelbach ML (2005) The human orbitofrontal cortex: linking reward to hedonic experience. Nat Rev Neurosci 6: 691–702.
41. Lui LL, Pasternak T (2011) Representation of comparison signals in cortical area MT during a delayed direction discrimination task. J Neurophysiol 106: 1260-1273.
42. Luk CH, Wallis JD (2013) Choice coding in frontal cortex during stimulusguided or action-guided decision making. J Neurosci 33: 1864-1871.
43. MacDonald AW 3rd, Cohen JD, Stenger VA, Carter CS (2000) Dissociating the role of the dorsolateral prefrontal and anterior cingulate cortex in cognitive control. Science 288: 1835–1838.
44. Machens CK, Romo R, Brody CD (2005) Flexible control of mutual inhibition: a neural model of two-interval discrimination. Science 307: 1121–1124.
45. Mansouri FA, Matsumoto K, Tanaka K (2006) Prefrontal cell activities related to monkeys’ success and failure in adapting to rule changes in a Wisconsin Card Sorting Test analog. J Neurosci 26: 2745–2756.
46. Mian MK, Sheth SA, Patel SR, Spiliopoulos K, Eskandar EN, Williams ZM (2014) Encoding of rules by neurons in the human dorsolateral prefrontal cortex. Cereb Cortex 24: 807-816.
47. Miller EK, Desimone R (1994) Parallel neuronal mechanisms for shortterm memory. Science 263: 520-522.
48. Miller EK, Wallis JD (2009) Executive function and higher-order cognition: definition and neural substrates. In: Encyclopedia of neuroscience, Vol 4 (Squire LR, ed), pp 99–104. Oxford: Academic.
49. Mirabella G, Bertini G, Samengo I, Kilavik BE, Frilli D, Della Libera C, Chelazzi L (2007) Neurons in area V4 of the macaque translate attended visual features into behaviorally relevant categories. Neuron 54: 303–318.
50. Moody SL, Wise SP, di Pellegrino G, Zipser D (1998) A model that accounts for activity in primate frontal cortex during a delayed matching-tosample task. J Neurosci 18: 399–410.
51. Moore TL, Killiany RJ, Herndon JG, Rosene DL, Moss MB (2005) A non-human primate test of abstraction and set shifting: An automated adaptation of the Wisconsin Card Sorting Test. J Neurosci Methods 146: 165–173.
52. O’Doherty JP (2014) The problem with value. Neurosci Biobehav Rev 43: 259–268.
53. O’Doherty J, Dayan P, Schultz J, Deichmann R, Friston K, Dolan RJ (2004) Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304: 452-454.
54. Ongür D, Price JL (2000) The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans. Cereb Cortex 10: 206-219.
55. Padoa-Schioppa C (2011) Neurobiology of economic choice: a good-based model. Annu Rev Neurosci 34: 333–359.
56. Pasternak T, Greenlee MW (2005) Working memory in primate sensory systems. Nat Rev Neurosci 6: 97–107.
57. Paxinos G, Huang XF, Toga AW (2000) In: The rhesus monkey brain in stereotaxic coordinates. San Diego: Academic.
58. Postle BR (2006) Working memory as an emergent property of the mind and brain. Neuroscience 139: 23–38.
59. Reverberi C, Görgen K, Haynes JD (2012) Distributed representations of rule identity and rule order in human frontal cortex and striatum. J Neurosci 32: 17420-17430.
60. Robbins TW (2007) Shifting and stopping: fronto-striatal substrates, neurochemical modulation and clinical implications. Philos Trans R Soc Lond B Biol Sci 362: 917–932.
61. Roesch MR, Taylor AR, Schoenbaum G (2006) Encoding of time-discounted rewards in orbitofrontal cortex is independent of value representation. Neuron 51: 509-520.
62. Romo R, Salinas E (2003) Flutter discrimination: neural codes, perception, memory and decision making. Nat Rev Neurosci 4: 203–218.
63. Schoenbaum G, Chiba AA, Gallagher M (1999) Neural encoding in orbitofrontal cortex and basolateral amygdala during olfactory discrimination learning. J Neurosci 19: 1876-1884.
64. Schoenbaum G, Setlow B, Ramus SJ (2003) A systems approach to orbitofrontal cortex function: recordings in rat orbitofrontal cortex reveal interactions with different learning systems. Behav Brain Res 146: 19-29.
65. Schultz W (2000) Multiple reward signals in the brain. Nat Rev Neurosci 1: 199.
66. Schultz W, Apicella P, Scarnati E, Ljungberg T (1992) Neuronal activity in monkey ventral striatum related to the expectation of reward. J Neurosci 12: 4595-4610.
67. Sleezer BJ, Hayden BY (2016) Differential contributions of ventral and dorsal striatum to early and late phases of cognitive set reconfiguration. J Cogn Neurosci. In press.
68. Stalnaker TA, Takahashi Y, Roesch MR, Schoenbaum G (2009) Neural substrates of cognitive inflexibility after chronic cocaine exposure. Neuropharmacology 56: 63–72.
69. Stalnaker TA, Cooch NK, Schoenbaum G (2015) What the orbitofrontal cortex does not do. Nat Neurosci 18: 620–627.
70. Stoet G, Snyder LH (2009) Neural correlates of executive control functions in the monkey. Trends Cogn Sci 13: 228-234.
71. Strait CE, Blanchard TC, Hayden BY (2014) Reward value comparison via mutual inhibition in ventromedial prefrontal cortex. Neuron 82: 1357-1366.
72. Strait CE, Sleezer BJ, Blanchard TC, Azab H, Castagno MD, Hayden BY (2016) Neuronal selectivity for spatial positions of offers and choices in five reward regions. J Neurophysiol 115: 1098-1111.
73. Strait CE, Sleezer BJ, Hayden BY (2015) Signatures of value comparison in ventral striatum neurons. PLo S Biol 13: e1002173.
74. Tsujimoto S, Genovesio A, Wise SP (2009) Monkey orbitofrontal cortex encodes response choices near feedback time. J Neurosci 29: 2569-2574.
75. Tsujimoto S, Genovesio A, Wise SP (2011) Comparison of strategy signals in the dorsolateral and orbital prefrontal cortex. J Neurosci 31: 4583-4592.
76. van der Plas EA, Crone EA, van den Wildenberg WP, Tranel D, Bechara A (2009) Executive control deficits in substance-dependent individuals: A comparison of alcohol, cocaine, and methamphetamine, and of men and women. J Clin Exp Neuropsychol 31: 706-719.
77. Wallis JD (2007) Orbitofrontal cortex and its contribution to decision making. Annu Rev Neurosci 30: 31–56.
78. Wallis JD, Miller EK (2003) From rule to response: neuronal processes in the premotor and prefrontal cortex. J Neurophysiol 90: 1790-1806.
79. Wallis JD, Anderson KC, Miller EK (2001) Single neurons in prefrontal cortex encode abstract rules. Nature 411: 953–956.
80. Wilson RC, Takahashi YK, Schoenbaum G, Niv Y (2014) Orbitofrontal cortex as a cognitive map of task space. Neuron 81: 267–279.
81. Woicik PA, Urban C, Alia-Klein N, Henry A, Maloney T, Telang F, Wang GJ, Volkow ND, Goldstein RZ (2011) A pattern of perseveration in cocaine addiction may reveal neurocognitive processes implicit in the Wisconsin Card Sorting Test. Neuropsychologia 49: 1660-1669.
82. Yamada M, Pita MC, Iijima T, Tsutsui K (2010) Rule-dependent anticipatory activity in prefrontal neurons. Neurosci Res 67: 162–171.
83. Yin HH (2010) The sensorimotor striatum is necessary for serial order learning. J Neurosci 30: 14719-14723.