Brain networks for exploration decisions utilizing distinct modeled information types during contextual learning

Neuron

Volumn 82, Issue 5, 2014, Pages 1171-1182

  Wang, Jane X ^a   Voss, Joel L ^a  

^a NORTHWESTERN UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE BEHAVIOR; ADULT; ARTICLE; BRAIN FUNCTION; CORRELATIONAL STUDY; DECISION MAKING; EXPLORATORY BEHAVIOR; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HIPPOCAMPUS; HUMAN; HUMAN EXPERIMENT; INFORMATION PROCESSING; LEARNING; MALE; NERVE CELL NETWORK; NERVE CONDUCTION; NERVOUS SYSTEM FUNCTION; OBJECT RELATION; PREFRONTAL CORTEX; PRIORITY JOURNAL; TASK PERFORMANCE;

ADOLESCENT; ADULT; ASSOCIATION LEARNING; BRAIN; BRAIN MAPPING; DECISION MAKING; EXPLORATORY BEHAVIOR; FEMALE; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; NERVE NET; YOUNG ADULT;

EID: 84901788221     PISSN: 08966273     EISSN: 10974199     Source Type: Journal    
DOI: 10.1016/j.neuron.2014.04.028     Document Type: Article

References (53)

1. Adcock R.A., Thangavel A., Whitfield-Gabrieli S., Knutson B., Gabrieli J.D. Reward-motivated learning: mesolimbic activation precedes memory formation. Neuron 2006, 50:507-517.
2. Alexander G.E., DeLong M.R., Strick P.L. Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annu. Rev. Neurosci. 1986, 9:357-381.
3. Badre D., Hoffman J., Cooney J.W., D'Esposito M. Hierarchical cognitive control deficits following damage to the human frontal lobe. Nat. Neurosci. 2009, 12:515-522.
4. Beard B.L., Ahumada A.J. A technique to extract relevant image features for visual tasks. Proc. SPIE 1998, 3299:79-85.
5. Boorman E.D., Behrens T.E., Woolrich M.W., Rushworth M.F. How green is the grass on the other side? Frontopolar cortex and the evidence in favor of alternative courses of action. Neuron 2009, 62:733-743.
6. Buckner R.L. The role of the hippocampus in prediction and imagination. Annu. Rev. Psychol. 2010, 61:27-48. C1-C8.
7. Buckner R.L., Carroll D.C. Self-projection and the brain. Trends Cogn. Sci. 2007, 11:49-57.
8. Buschman T.J., Denovellis E.L., Diogo C., Bullock D., Miller E.K. Synchronous oscillatory neural ensembles for rules in the prefrontal cortex. Neuron 2012, 76:838-846.
9. Chen G., Saad Z.S., Nath A.R., Beauchamp M.S., Cox R.W. FMRI group analysis combining effect estimates and their variances. Neuroimage 2012, 60:747-765.
10. Cole M.W., Reynolds J.R., Power J.D., Repovs G., Anticevic A., Braver T.S. Multi-task connectivity reveals flexible hubs for adaptive task control. Nat. Neurosci. 2013, 16:1348-1355.
11. Cox R.W. AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. Comput. Biomed. Res. 1996, 29:162-173.
12. Ding L., Gold J.I. The basal ganglia's contributions to perceptual decision making. Neuron 2013, 79:640-649.
13. Eichenbaum H., Fortin N.J. The neurobiology of memory based predictions. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2009, 364:1183-1191.
14. Fair D.A., Schlaggar B.L., Cohen A.L., Miezin F.M., Dosenbach N.U., Wenger K.K., Fox M.D., Snyder A.Z., Raichle M.E., Petersen S.E. A method for using blocked and event-related fMRI data to study "resting state" functional connectivity. Neuroimage 2007, 35:396-405.
15. Forman S.D., Cohen J.D., Fitzgerald M., Eddy W.F., Mintun M.A., Noll D.C. Improved assessment of significant activation in functional magnetic resonance imaging (fMRI): use of a cluster-size threshold. Magn. Reson. Med. 1995, 33:636-647.
16. Frank M.J., Claus E.D. Anatomy of a decision: striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal. Psychol. Rev. 2006, 113:300-326.
17. Frank M.J., Loughry B., O'Reilly R.C. Interactions between frontal cortex and basal ganglia in working memory: a computational model. Cogn. Affect. Behav. Neurosci. 2001, 1:137-160.
18. Fujisawa S., Buzsáki G. A 4Hz oscillation adaptively synchronizes prefrontal, VTA, and hippocampal activities. Neuron 2011, 72:153-165.
19. Guitart-Masip M., Barnes G.R., Horner A., Bauer M., Dolan R.J., Duzel E. Synchronization of medial temporal lobe and prefrontal rhythms in human decision making. J.Neurosci. 2013, 33:442-451.
20. Gupta R., Duff M.C., Denburg N.L., Cohen N.J., Bechara A., Tranel D. Declarative memory is critical for sustained advantageous complex decision-making. Neuropsychologia 2009, 47:1686-1693.
21. Guthrie M., Leblois A., Garenne A., Boraud T. Interaction between cognitive and motor cortico-basal ganglia loops during decision making: a computational study. J.Neurophysiol. 2013, 109:3025-3040.
22. Hannula D.E., Althoff R.R., Warren D.E., Riggs L., Cohen N.J., Ryan J.D. Worth a glance: using eye movements to investigate the cognitive neuroscience of memory. Front. Hum. Neurosci. 2010, 4:166.
23. Hansen N., Manahan-Vaughan D. Dopamine D1/D5 receptors mediate informational saliency that promotes persistent hippocampal long-term plasticity. Cereb. Cortex 2014, 24:845-858.
24. Hills T.T. Animal foraging and the evolution of goal-directed cognition. Cogn. Sci. 2006, 30:3-41.
25. Hochberg Y., Benjamini Y. More powerful procedures for multiple significance testing. Stat. Med. 1990, 9:811-818.
26. Holmes C.J., Hoge R., Collins L., Woods R., Toga A.W., Evans A.C. Enhancement of MR images using registration for signal averaging. J.Comput. Assist. Tomogr. 1998, 22:324-333.
27. Honey C.J., Sporns O., Cammoun L., Gigandet X., Thiran J.P., Meuli R., Hagmann P. Predicting human resting-state functional connectivity from structural connectivity. Proc. Natl. Acad. Sci. USA 2009, 106:2035-2040.
28. Johnson A., Redish A.D. Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point. J.Neurosci. 2007, 27:12176-12189.
29. Johnson A., Varberg Z., Benhardus J., Maahs A., Schrater P. The hippocampus and exploration: dynamically evolving behavior and neural representations. Front. Hum. Neurosci. 2012, 6:216.
30. Kahn I., Shohamy D. Intrinsic connectivity between the hippocampus, nucleus accumbens, and ventral tegmental area in humans. Hippocampus 2013, 23:187-192.
31. Kim H.F., Hikosaka O. Distinct basal ganglia circuits controlling behaviors guided by flexible and stable values. Neuron 2013, 79:1001-1010.
32. Koechlin E., Corrado G., Pietrini P., Grafman J. Dissociating the role of the medial and lateral anterior prefrontal cortex in human planning. Proc. Natl. Acad. Sci. USA 2000, 97:7651-7656.
33. Lee D., Seo H. Mechanisms of reinforcement learning and decision making in the primate dorsolateral prefrontal cortex. Ann. N Y Acad. Sci. 2007, 1104:108-122.
34. Martin J.H. Neuroanatomy: Text and Atlas 1996, Appleton & Lange, Stamford, CT. Second Edition.
35. Metcalfe J., Jacobs W.J. People's study time allocation and its relation to animal foraging. Behav. Processes 2010, 83:213-221.
36. Navawongse R., Eichenbaum H. Distinct pathways for rule-based retrieval and spatial mapping of memory representations in hippocampal neurons. J.Neurosci. 2013, 33:1002-1013.
37. Norman-Haignere S.V., McCarthy G., Chun M.M., Turk-Browne N.B. Category-selective background connectivity in ventral visual cortex. Cereb. Cortex 2012, 22:391-402.
38. O'Reilly J.X., Croxson P.L., Jbabdi S., Sallet J., Noonan M.P., Mars R.B., Browning P.G., Wilson C.R., Mitchell A.S., Miller K.L., et al. Causal effect of disconnection lesions on interhemispheric functional connectivity in rhesus monkeys. Proc. Natl. Acad. Sci. USA 2013, 110:13982-13987.
39. Packard M.G., Knowlton B.J. Learning and memory functions of the Basal Ganglia. Annu. Rev. Neurosci. 2002, 25:563-593.
40. Pennartz C.M., Berke J.D., Graybiel A.M., Ito R., Lansink C.S., van der Meer M., Redish A.D., Smith K.S., Voorn P. Corticostriatal Interactions during Learning, Memory Processing, and Decision Making. J.Neurosci. 2009, 29:12831-12838.
41. Pirolli P., Card S. Information foraging. Psychol. Rev. 1999, 106:643-675.
42. Ross R.S., Sherrill K.R., Stern C.E. The hippocampus is functionally connected to the striatum and orbitofrontal cortex during context dependent decision making. Brain Res. 2011, 1423:53-66.
43. Sadeh T., Shohamy D., Levy D.R., Reggev N., Maril A. Cooperation between the hippocampus and the striatum during episodic encoding. J.Cogn. Neurosci. 2011, 23:1597-1608.
44. Schacter D.L., Addis D.R., Hassabis D., Martin V.C., Spreng R.N., Szpunar K.K. The future of memory: remembering, imagining, and the brain. Neuron 2012, 76:677-694.
45. Shohamy D., Adcock R.A. Dopamine and adaptive memory. Trends Cogn. Sci. 2010, 14:464-472.
46. Shohamy D., Myers C.E., Grossman S., Sage J., Gluck M.A., Poldrack R.A. Cortico-striatal contributions to feedback-based learning: converging data from neuroimaging and neuropsychology. Brain 2004, 127:851-859.
47. Strange B.A., Duggins A., Penny W., Dolan R.J., Friston K.J. Information theory, novelty and hippocampal responses: unpredicted or unpredictable?. Neural Netw. 2005, 18:225-230.
48. Tolman E.C. Cognitive maps in rats and men. Psychol. Rev. 1948, 55:189-208.
49. Voss J.L., Gonsalves B.D., Federmeier K.D., Tranel D., Cohen N.J. Hippocampal brain-network coordination during volitional exploratory behavior enhances learning. Nat. Neurosci. 2011, 14:115-120.
50. Voss J.L., Warren D.E., Gonsalves B.D., Federmeier K.D., Tranel D., Cohen N.J. Spontaneous revisitation during visual exploration as a link among strategic behavior, learning, and the hippocampus. Proc. Natl. Acad. Sci. USA 2011, 108:E402-E409.
51. Wang J.X., Bartolotti J., Amaral L.A., Booth J.R. Changes in task-related functional connectivity across multiple spatial scales are related to reading performance. PLoS ONE 2013, 8:e59204.
52. Wang J.X., Cohen N.J., Voss J.L. Covert rapid action-memory simulation (CRAMS): A hypothesis of hippocampal-prefrontal interactions for adaptive behavior. Neurobiol. Learn. Mem. 2014, Published April 19, 2014. 10.1016/j.nlm.2014.04.003.
53. Yee L.T.S., Warren D.E., Voss J.L., Duff M.C., Tranel D., Cohen N.J. The hippocampus uses information just encountered to guide efficient ongoing behavior. Hippocampus 2014, 24:154-164.