Goal-direction and top-down control

Philosophical Transactions of the Royal Society B: Biological Sciences

Volumn 369, Issue 1655, 2014, Pages

  Buschman, Timothy J ^a   Miller, Earl K ^b  

^a PRINCETON UNIVERSITY   (United States)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Basal ganglia; Cognition; Frontal lobe; Goal direction; Learning

Indexed keywords

BEHAVIORAL RESPONSE; COGNITION; CONTROL SYSTEM; LEARNING; NEUROLOGY; TOP-DOWN CONTROL;

BASAL GANGLION; BIOLOGICAL MODEL; HUMAN; LEARNING; MOTIVATION; PHYSIOLOGY; PREFRONTAL CORTEX;

BASAL GANGLIA; GOALS; HUMANS; LEARNING; MODELS, NEUROLOGICAL; PREFRONTAL CORTEX;

EID: 84907486141     PISSN: 09628436     EISSN: 14712970     Source Type: Journal    
DOI: 10.1098/rstb.2013.0471     Document Type: Article

References (67)

1. Asaad WF, Rainer G, Miller EK. 1998 Neural activity in the primate prefrontal cortex during associative learning. Neuron 21, 1399-1407. (doi:10.1016/ S0896-6273(00)80658-3)
2. Dayan P, Abbott LF. 2005 Theoretical neuroscience: computational and mathematical modeling of neural systems. Cambridge, MA: MIT Press.
3. Hertz JA. 1991 Introduction to the theory of neural computation. Redwood City, CA: Westview Press.
4. McClelland JL, McNaughton BL, O’Reilly RC. 1995 Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. Psychol. Rev. 102, 419–457. (doi:10.1037/0033-295X.102.3.419)
5. Milner B, Corkin S, Teuber H-L. 1968 Further analysis of the hippocampal amnesic syndrome: 14-year follow-up study of HM. Neuropsychologia 6, 215-234. (doi:10.1016/0028-3932(68)90021-3)
6. Houk JC, Wise SP. 1995 Feature article: distributed modular architectures linking basal ganglia, cerebellum, cerebral cortex: their role in planning and controlling action. Cereb. Cortex 5, 95–110. (doi:10.1093/cercor/5.2.95)
7. Schultz W. 1997 Dopamine neurons and their role in reward mechanisms. Curr. Opin. Neurobiol. 7, 191-197. (doi:10.1016/S0959-4388(97)80007-4)
8. Schultz W, Apicella P, Ljungberg T. 1993 Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. J. Neurosci. 13, 900–913.
9. Goldman-Rakic PS. 1988 Topography of cognition: parallel distributed networks in primate association cortex. Annu. Rev. Neurosci. 11, 137-156. (doi:10. 1146/annurev.ne.11.030188.001033)
10. Thierry AM, Blanc G, Sobel A, Stinus L, Glowinski J. 1973 Dopaminergic terminals in the rat cortex. Science 182, 499-501. (doi:10.1126/science.182. 4111.499)
11. Lynd-Balta E, Haber SN. 1994 The organization of midbrain projections to the striatum in the primate: sensorimotor-related striatum versus ventral striatum. Neuroscience 59, 625-640. (doi:10.1016/ 0306-4522(94)90182-1)
12. Calabresi P, Maj R, Mercuri NB, Bernardi G. 1992 Coactivation of D1 and D2 dopamine receptors is required for long-term synaptic depression in the striatum. Neurosci. Lett. 142, 95-99. (doi:10.1016/ 0304-3940(92)90628-K)
13. Calabresi P, Pisani A, Centonze D, Bernardi G. 1997 Synaptic plasticity and physiological interactions between dopamine and glutamate in the striatum. Neurosci. Biobehav. Rev. 21, 519-523. (doi:10. 1016/S0149-7634(96)00029-2)
14. Kerr JND, Wickens JR. 2001 Dopamine D-1/D-5 receptor activation is required for long-term potentiation in the rat neostriatum in vitro. J. Neurophysiol. 85, 117–124.
15. Blond O, Crépel F, Otani S. 2002 Long-term potentiation in rat prefrontal slices facilitated by phased application of dopamine. Eur. J. Pharmacol. 438, 115-116. (doi:10.1016/S0014-2999(02) 01291-8)
16. Pasupathy A, Miller EK. 2005 Different time courses of learning-related activity in the prefrontal cortex and striatum. Nature 433, 873-876. (doi:10.1038/ nature03287)
17. Antzoulatos EG, Miller EK. 2011 Differences between neural activity in prefrontal cortex and striatum during learning of novel abstract categories. Neuron 71, 243–249. (doi:10.1016/j.neuron.2011.05.040)
18. Selemon LD, Goldman-Rakic PS. 1985 Longitudinal topography and interdigitation of corticostriatal projections in the rhesus monkey. J. Neurosci. 5, 776–794.
19. Brown VJ, Desimone R, Mishkin M. 1995 Responses of cells in the tail of the caudate nucleus during visual discrimination learning. J. Neurophysiol. 74, 1083–1094.
20. Divac I, Rosvold HE, Szwarcbart MK. 1967 Behavioral effects of selective ablation of the caudate nucleus. J. Comp. Physiol. Psychol. 63, 184-190. (doi:10. 1037/h0024348)
21. Goldman PS, Rosvold HE. 1972 The effects of selective caudate lesions in infant and juvenile Rhesus monkeys. Brain Res. 43, 53-66. (doi:10. 1016/0006-8993(72)90274-0)
22. Johnson A, van der Meer MA, Redish AD. 2007 Integrating hippocampus and striatum in decision-making. Curr. Opin. Neurobiol. 17, 692–697. (doi:10.1016/j.conb.2008.01.003)
23. Daw ND, Niv Y, Dayan P. 2005 Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci. 8, 1704-1711. (doi:10.1038/nn1560)
24. Yin HH, Knowlton BJ. 2006 The role of the basal ganglia in habit formation. Nat. Rev. Neurosci. 7, 464-476. (doi:10.1038/nrn1919)
25. Smittenaar P, FitzGerald THB, Romei V, Wright ND, Dolan RJ. 2013 Disruption of dorsolateral prefrontal cortex decreases model-based in favor of model-free control in humans. Neuron 80, 914-919. (doi:10. 1016/j.neuron.2013.08.009)
26. Miyachi S, Hikosaka O, Miyashita K, Kárádi Z, Rand MK. 1997 Differential roles of monkey striatum in learning of sequential hand movement. Exp. Brain Res. 115, 1–5. (doi:10.1007/PL00005669)
27. Smith KS, Graybiel AM. 2013 A dual operator view of habitual behavior reflecting cortical and striatal dynamics. Neuron 79, 361-374. (doi:10.1016/j. neuron.2013.05.038)
28. Schiffer A-M, Schubotz RI. 2011 Caudate nucleus signals for breaches of expectation in a movement observation paradigm. Front. Hum. Neurosci. 5, 38. (doi:10.3389/fnhum.2011.00038)
29. Garrido MI, Kilner JM, Stephan KE, Friston KJ. 2009 The mismatch negativity: a review of underlying mechanisms. Clin. Neurophysiol. 120, 453–463. (doi:10.1016/j.clinph.2008.11.029)
30. Bastos AM, Usrey WM, Adams RA, Mangun GR, Fries P, Friston KJ. 2012 Canonical microcircuits for predictive coding. Neuron 76, 695-711. (doi:10. 1016/j.neuron.2012.10.038)
31. Barnes TD, Kubota Y, Hu D, Jin DZ, Graybiel AM. 2005 Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories. Nature 437, 1158-1161. (doi:10.1038/nature04053)
32. Buschman TJ, Miller EK. 2010 Shifting the spotlight of attention: evidence for discrete computations in cognition. Front. Hum. Neurosci. 4, 194. (doi:10. 3389/fnhum.2010.00194)
33. Buschman TJ, Miller EK. 2009 Serial, covert shifts of attention during visual search are reflected by the frontal eye fields and correlated with population oscillations. Neuron 63, 386-396. (doi:10.1016/j. neuron.2009.06.020)
34. Shima K, Isoda M, Mushiake H, Tanji J. 2007 Categorization of behavioural sequences in the prefrontal cortex. Nature 445, 315-318. (doi:10. 1038/nature05470)
35. Amaral DG. 1986 Amygdalohippocampal and amygdalocortical projections in the primate brain. Adv. Exp. Med. Biol. 203, 3-17. (doi:10.1007/978-1-4684-7971-3_1)
36. Amaral DG, Price JL. 1984 Amygdalo-cortical projections in the monkey (Macaca fascicularis). J. Comp. Neurol. 230, 465-496. (doi:10.1002/cne. 902300402)
37. Barbas H, De Olmos J. 1990 Projections from the amygdala to basoventral and mediodorsal prefrontal regions in the rhesus monkey. J. Comp. Neurol. 300, 549-571. (doi:10.1002/cne.903000409)
38. Croxson PL et al. 2005 Quantitative investigation of connections of the prefrontal cortex in the human and macaque using probabilistic diffusion tractography. J. Neurosci. 25, 8854-8866. (doi:10. 1523/JNEUROSCI.1311-05.2005)
39. Eblen F, Graybiel AM. 1995 Highly restricted origin of prefrontal cortical inputs to striosomes in the macaque monkey. J. Neurosci. 15, 5999–6013.
40. Porrino LJ, Crane AM, Goldman-Rakic PS. 1981 Direct and indirect pathways from the amygdala to the frontal lobe in rhesus monkeys. J. Comp. Neurol. 198, 121-136. (doi:10.1002/cne.901980111)
41. Barbas H, Pandya DN. 1989 Architecture and intrinsic connections of the prefrontal cortex in the rhesus monkey. J. Comp. Neurol. 286, 353–375. (doi:10.1002/cne.902860306)
42. Pandya DN, Yeterian EH. 1990 Prefrontal cortex in relation to other cortical areas in rhesus monkey: architecture and connections. Prog. Brain Res. 85, 63-94. (doi:10.1016/S0079-6123(08)62676-X)
43. Petrides M, Pandya DN. 1999 Dorsolateral prefrontal cortex: comparative cytoarchitectonic analysis in the human and the macaque brain and corticocortical connection patterns. Eur. J. Neurosci. 11, 1011-1036. (doi:10.1046/j.1460-9568.1999.00518.x)
44. Funahashi S, Bruce CJ, Goldman-Rakic PS. 1989 Mnemonic coding of visual space in the monkey’s dorsolateral prefrontal cortex. J. Neurophysiol. 61, 331–349.
45. Fuster JM, Alexander GE. 1971 Neuron activity related to short-term memory. Science 173, 652–654. (doi:10.1126/science.173.3997.652)
46. Levy R, Friedman HR, Davachi L, Goldman-Rakic PS. 1997 Differential activation of the caudate nucleus in primates performing spatial and nonspatial working memory tasks. J. Neurosci. 17, 3870-3882.
47. Miller EK, Erickson CA, Desimone R. 1996 Neural mechanisms of visual working memory in prefrontal cortex of the macaque. J. Neurosci. 16, 5154–5167.
48. Pribram KH, Mishkin M, Enger H, Kaplan SJ. 1952 Effects on delayed-response performance of lesions of dorsolateral and ventromedial frontal cortex of baboons. J. Comp. Physiol. Psychol. 45, 565–575. (doi:10.1037/h0061240)
49. Freedman DJ, Riesenhuber M, Poggio T, Miller EK. 2001 Categorical representation of visual stimuli in the primate prefrontal cortex. Science 291, 312–316. (doi:10.1126/science.291.5502.312)
50. Nieder A, Freedman DJ, Miller EK. 2002 Representation of the quantity of visual items in the primate prefrontal cortex. Science 297, 1708–1711. (doi:10.1126/science.1072493)
51. Rainer G, Rao SC, Miller EK. 1999 Prospective coding for objects in primate prefrontal cortex. J. Neurosci. 19, 5493–5505.
52. Lee D, Seo H, Jung MW. 2012 Neural basis of reinforcement learning and decision making. Annu. Rev. Neurosci. 35, 287-308. (doi:10.1146/annurev-neuro-062111-150512)
53. Luk C-H, Wallis JD. 2013 Choice coding in frontal cortex during stimulus-guided or action-guided decision-making. J. Neurosci. 33, 1864–1871. (doi:10.1523/JNEUROSCI.4920-12.2013)
54. Bongard S, Nieder A. 2010 Basic mathematical rules are encoded by primate prefrontal cortex neurons. Proc. Natl Acad. Sci. USA 107, 2277-2282. (doi:10. 1073/pnas.0909180107)
55. Wallis JD, Anderson KC, Miller EK. 2001 Single neurons in prefrontal cortex encode abstract rules. Nature 411, 953-956. (doi:10.1038/35082081)
56. Buschman TJ, Denovellis EL, Diogo C, Bullock D, Miller EK. 2012 Synchronous oscillatory neural ensembles for rules in the prefrontal cortex. Neuron 76, 838–846. (doi:10.1016/j.neuron.2012.09.029)
57. Asaad WF, Rainer G, Miller EK. 2000 Task-specific neural activity in the primate prefrontal cortex. J. Neurophysiol. 84, 451–459.
58. Mansouri FA, Matsumoto K, Tanaka K. 2006 Prefrontal cell activities related to monkeys’ success and failure in adapting to rule changes in a Wisconsin card sorting test analog. J. Neurosci. 26, 2745–2756. (doi:10.1523/JNEUROSCI.5238-05.2006)
59. White IM, Wise SP. 1999 Rule-dependent neuronal activity in the prefrontal cortex. Exp. Brain Res. 126, 315-335. (doi:10.1007/s002210050740)
60. Rigotti M, Rubin DBD, Wang XJ, Fusi S. 2010 Internal representation of task rules by recurrent dynamics: the importance of the diversity of neural responses. Front. Comput. Neurosci. 4, 24. (doi:10. 3389/fncom.2010.00024)
61. Rigotti M, Barak O, Warden MR, Wang X-J, Daw ND, Miller EK, Fusi S. 2013 The importance of mixed selectivity in complex cognitive tasks. Nature 497, 585-590. (doi:10.1038/nature12160)
62. Stokes MG, Kusunoki M, Sigala N, Nili H, Gaffan D, Duncan J. 2013 Dynamic coding for cognitive control in prefrontal cortex. Neuron 78, 364–375. (doi:10.1016/j.neuron.2013.01.039)
63. Buschman TJ, Miller EK. 2007 Top-down versus bottom-up control of attention in the prefrontal and posterior parietal cortices. Science 315, 1860–1862. (doi:10.1126/science.1138071)
64. Moore T, Armstrong KM. 2003 Selective gating of visual signals by microstimulation of frontal cortex. Nature 421, 370-373. (doi:10.1038/nature01341)
65. Buschman TJ, Siegel M, Roy JE, Miller EK. 2011 Neural substrates of cognitive capacity limitations. Proc. Natl Acad. Sci. USA 108, 11252–11255. (doi:10.1073/pnas.1104666108)
66. Davidson TJ, Kloosterman F, Wilson MA. 2009 Hippocampal replay of extended experience. Neuron 63, 497-507. (doi:10.1016/j.neuron.2009. 07.027)
67. Kosslyn SM, Thompson WL, Klm IJ, Alpert NM. 1995 Topographical representations of mental images in primary visual cortex. Nature 378, 496–498. (doi:10.1038/378496a0)