Baseline frontostriatal-limbic connectivity predicts reward-based memory formation

Human Brain Mapping

Volumn 35, Issue 12, 2014, Pages 5921-5931

  Hamann, Janne M ^a,b   Dayan, Eran ^a   Hummel, Friedhelm C ^b   Cohen, Leonardo G ^a  

^a NATIONAL INSTITUTE OF NEUROLOGICAL DISORDERS AND STROKE   (United States)

^b UNIVERSITY MEDICAL CENTER HAMBURG EPPENDORF   (Germany)

Author keywords

Brain connectivity; Learning; Memory; Resting state functional magnetic resonance imaging; Reward learning; Ventral striatum

Indexed keywords

ADULT; AMYGDALOID NUCLEUS; ANTERIOR CINGULATE; ARTICLE; CEREBELLUM; CINGULATE GYRUS; CORPUS STRIATUM; DORSAL ATTENTION NETWORK; FEEDBACK SYSTEM; FEMALE; FRONTOSTRIATAL LIMBIC NETWORK; FUNCTIONAL MAGNETIC RESONANCE IMAGING; FUNCTIONAL NEUROIMAGING; HUMAN; INSULA; LIMBIC SYSTEM; LONG TERM MEMORY; MALE; MEMORY; MESENCEPHALON; MIDDLE FRONTAL GYRUS; MIDDLE TEMPORAL GYRUS; NERVE CELL NETWORK; NORMAL HUMAN; NUCLEAR MAGNETIC RESONANCE SCANNER; PARAHIPPOCAMPAL GYRUS; PREDICTION; PRIORITY JOURNAL; REWARD; RIGHT HANDEDNESS; THALAMUS; UNCUS; YOUNG ADULT; ADAPTIVE BEHAVIOR; BRAIN; BRAIN MAPPING; LEARNING; NERVE TRACT; NEUROPSYCHOLOGICAL TEST; NUCLEAR MAGNETIC RESONANCE IMAGING; PHOTOSTIMULATION; PHYSIOLOGY; PSYCHOMOTOR PERFORMANCE; REST;

BRAIN; BRAIN MAPPING; FEEDBACK, PSYCHOLOGICAL; FEMALE; HUMANS; LEARNING; MAGNETIC RESONANCE IMAGING; MALE; MEMORY; NEURAL PATHWAYS; NEUROPSYCHOLOGICAL TESTS; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; REST; REWARD; YOUNG ADULT;

EID: 84911456053     PISSN: 10659471     EISSN: 10970193     Source Type: Journal    
DOI: 10.1002/hbm.22594     Document Type: Article

References (85)

1. Abe M, Schambra H, Wassermann EM, Luckenbaugh D, Schweighofer N, Cohen LG (2011): Reward improves long-term retention of a motor memory through induction of offline memory gains. Curr Biol 21:557-562.
2. Abler B, Walter H, Erk S, Kammerer H, Spitzer M (2006): Prediction error as a linear function of reward probability is coded in human nucleus accumbens. Neuroimage 31:790-795.
3. Adcock RA, Thangavel A, Whitfield-Gabrieli S, Knutson B, Gabrieli JDE (2006): Reward-motivated learning: mesolimbic activation precedes memory formation. Neuron 50:507-517.
4. Ajemian R, D'Ausilio A, Moorman H, Bizzi E (2010): Why professional athletes need a prolonged period of warm-up and other peculiarities of human motor learning. J Mot Behav 42:381-388.
5. Albert NB, Robertson EM, Miall RC (2009): The resting human brain and motor learning. Curr Biol 19:1023-1027.
6. Bialleck KA, Schaal H-P, Kranz TA, Fell J, Elger CE, Axmacher N (2011): Ventromedial prefrontal cortex activation is associated with memory formation for predictable rewards. PLoS ONE 6:e16695.
7. Birn RM (2007): The behavioral significance of spontaneous fluctuations in brain activity. Neuron 56:8-9.
8. Biswal B, Yetkin FZ, Haughton VM, Hyde JS (1995): Functional connectivity in the motor cortex of resting human brain using echo-planar MRI. Magn Reson Med 34:537-541.
9. Bodi N, Keri S, Nagy H, Moustafa A, Myers CE, Daw N, Dibo G, Takats A, Bereczki D, Gluck MA (2009): Reward-learning and the novelty-seeking personality: a between- and within-subjects study of the effects of dopamine agonists on young Parkinson's patients. Brain 132:2385-2395.
10. Buckner RL, Krienen FM, Yeo BTT (2013): Opportunities and limitations of intrinsic functional connectivity MRI. Nat Neurosci 16:832-837.
11. Buitrago MM, Ringer T, Schulz JB, Dichgans J, Luft AR (2004): Characterization of motor skill and instrumental learning time scales in a skilled reaching task in rat. Behav Brain Res 155:249-256.
12. Canli T, Sivers H, Whitfield SL, Gotlib IH, Gabrieli JDE (2002): Amygdala response to happy faces as a function of extraversion. Science 296:2191.
13. Cauda F, Cavanna AE, D'agata F, Sacco K, Duca S, Geminiani GC (2011): Functional connectivity and coactivation of the nucleus accumbens: a combined functional connectivity and structure-based meta-analysis. J Cogn Neurosci 23:2864-2877.
14. Dayan E, Cohen LG (2011): Neuroplasticity subserving motor skill learning. Neuron 72:443-454.
15. Dayan E, Averbeck BB, Richmond BJ, Cohen LG (2014): Stochastic reinforcement benefits skill acquisition. Learn Mem 21:140-142.
16. Di Martino A, Scheres A, Margulies DS, Kelly AMC, Uddin LQ, Shehzad Z, Biswal B, Walters JR, Castellanos FX, Milham MP (2008): Functional connectivity of human striatum: a resting state FMRI study. Cereb Cortex 18:2735-2747.
17. Dimyan MA, Cohen LG (2011): Neuroplasticity in the context of motor rehabilitation after stroke. Nat Rev Neurol 7: 76-85.
18. Dolcos F, LaBar KS, Cabeza R (2004): Interaction between the amygdala and the medial temporal lobe memory system predicts better memory for emotional events. Neuron 42:855-863.
19. Doyon J, Benali H (2005): Reorganization and plasticity in the adult brain during learning of motor skills. Curr Opin Neurobiol 15:161-167.
20. Dudai Y (2004): The neurobiology of consolidations, or, how stable is the engram? Annu Rev Psychol 55:51-86.
21. Düzel E, Bunzeck N, Guitart-Masip M, Wittmann B, Schott BH, Tobler PN (2009): Functional imaging of the human dopaminergic midbrain. Trends Neurosci 32:321-328.
22. Elliott R, Friston KJ, Dolan RJ (2000): Dissociable neural responses in human reward systems. J Neurosci 20:6159-6165.
23. Elliott R, Newman JL, Longe OA, Deakin JFW (2003): Differential response patterns in the striatum and orbitofrontal cortex to financial reward in humans: A parametric functional magnetic resonance imaging study. J Neurosci 23:303-307.
24. Ericsson KA, Krampe RT, Tesch-Römer C (1993): The role of deliberate practice in the acquisition of expert performance. Psychol Rev 100:363-406.
25. Fellows LK, Farah MJ (2005): Dissociable elements of human foresight: A role for the ventromedial frontal lobes in framing the future, but not in discounting future rewards. Neuropsychologia 43:1214-1221.
26. Fields RD (2011): Imaging learning: the search for a memory trace. Neuroscientist 17:185-196.
27. Fisher RA (1915): Frequency distribution of the values of the correlation coefficient in samples from an indefinitely large population. Biometrika 10:507-521.
28. Forstmann BU, Anwander A, Schäfer A, Neumann J, Brown S, Wagenmakers E-J, Bogacz R, Turner R (2010): Cortico-striatal connections predict control over speed and accuracy in perceptual decision making. Proc Natl Acad Sci USA 107:15916-15920.
29. Fox MD, Corbetta M, Snyder AZ, Vincent JL, Raichle ME (2006): Spontaneous neuronal activity distinguishes human dorsal and ventral attention systems. Proc Natl Acad Sci USA 103:10046-10051.
30. Frankland PW, Bontempi B (2005): The organization of recent and remote memories. Nat Rev Neurosci 6:119-130.
31. Friedman DP, Aggleton JP, Saunders RC (2002): Comparison of hippocampal, amygdala, and perirhinal projections to the nucleus accumbens: Combined anterograde and retrograde tracing study in the Macaque brain. J Comp Neurol 450:345-365.
32. Friston KJ, Holmes AP, Worsley KJ, Poline JP, Frith CD, Frackowiak RSJ (1994): Statistical parametric maps in functional imaging: A general linear approach. Hum Brain Mapp 2:189-210.
33. Fudge JL, Kunishio K, Walsh P, Richard C, Haber SN (2002): Amygdaloid projections to ventromedial striatal subterritories in the primate. Neuroscience 110:257-275.
34. Gaffan D, Murray EA (1990): Amygdalar interaction with the mediodorsal nucleus of the thalamus and the ventromedial prefrontal cortex in stimulus-reward associative learning in the monkey. J Neurosci 10:3479-3493.
35. Gold JM, Waltz JA, Prentice KJ, Morris SE, Heerey EA (2008): Reward processing in schizophrenia: A deficit in the representation of value. Schizophr Bull 34:835-847.
36. Greicius MD, Supekar K, Menon V, Dougherty RF (2009): Resting-state functional connectivity reflects structural connectivity in the default mode network. Cereb Cortex 19:72-78.
37. Haber S, Knutson B (2010): The reward circuit: linking primate anatomy and human imaging. Neuropsychopharmacol 35:4-26.
38. Haber SN, Kunishio K, Mizobuchi M, Lynd-Balta E (1995): The orbital and medial prefrontal circuit through the primate basal ganglia. J Neurosci 15:4851-4867.
39. Hosp JA, Pekanovic A, Rioult-Pedotti MS, Luft AR (2011): Dopaminergic projections from midbrain to primary motor cortex mediate motor skill learning. J Neurosci 31:2481-2487.
40. Hyman SE, Malenka RC, Nestler EJ (2006): Neural mechanisms of addiction: The role of reward-related learning and memory. Annu Rev Neurosci 29:565-598.
41. Johansen-Berg H, Gutman DA, Behrens TEJ, Matthews PM, Rushworth MFS, Katz E, Lozano AM, Mayberg HS (2008): Anatomical connectivity of the subgenual cingulate region targeted with deep brain stimulation for treatment-resistant depression. Cereb Cortex 18:1374-1383.
42. Knutson B, Adams CM, Fong GW, Hommer D (2001): Anticipation of increasing monetary reward selectively recruits nucleus accumbens. J Neurosci 21:RC159.
43. Krakauer JW (2006): Motor learning: Its relevance to stroke recovery and neurorehabilitation. Curr Opin Neurol 19:84-90.
44. Kuhl BA, Shah AT, DuBrow S, Wagner AD (2010): Resistance to forgetting associated with hippocampus-mediated reactivation during new learning. Nat Neurosci 13:501-506.
45. Kumar P, Waiter G, Ahearn T, Milders M, Reid I, Steele JD (2008): Abnormal temporal difference reward-learning signals in major depression. Brain 131:2084-2093.
46. Lehéricy S, Ducros M, Van de Moortele P-F, Francois C, Thivard L, Poupon C, Swindale N, Ugurbil K, Kim D-S(2004): Diffusion tensor fiber tracking shows distinct corticostriatal circuits in humans. Ann Neurol 55:522-529.
47. Liu X, Powell DK, Wang H, Gold BT, Corbly CR, Joseph JE (2007): Functional dissociation in frontal and striatal areas for processing of positive and negative reward information. J Neurosci 27:4587-4597.
48. Liu X, Hairston J, Schrier M, Fan J (2011): Common and distinct networks underlying reward valence and processing stages: A meta-analysis of functional neuroimaging studies. Neurosci Biobehav Rev 35:1219-1236.
49. Malhotra PA, Soto D, Li K, Russell C (2013): Reward modulates spatial neglect. J Neurol Neurosurg Psychiatr 84:366-369.
50. McGinty VB, Lardeux S, Taha SA, Kim JJ, Nicola SM (2013): Invigoration of reward seeking by cue and proximity encoding in the nucleus accumbens. Neuron 78:910-922.
51. Meindl T, Teipel S, Elmouden R, Mueller S, Koch W, Dietrich O, Coates U, Reiser M, Glaser C (2010): Test-retest reproducibility of the default-mode network in healthy individuals. Hum Brain Mapp 31:237-246.
52. Neto LL, Oliveira E, Correia F, Ferreira AG (2008): The human nucleus accumbens: where is it? A stereotactic, anatomical and magnetic resonance imaging study. Neuromodulation 11:13-22.
53. Pernet CR, Wilcox R, Rousselet GA (2012): Robust correlation analyses: False positive and power validation using a new open source matlab toolbox. Front Psychol 3:606.
54. Peterson DA, Elliott C, Song DD, Makeig S, Sejnowski TJ, Poizner H (2009): Probabilistic reversal learning is impaired in Parkinson's disease. Neuroscience 163:1092-1101.
55. Popescu AT, Popa D, Paré D (2009): Coherent gamma oscillations couple the amygdala and striatum during learning. Nat Neurosci 12:801-807.
56. Pulvermüller F, Neininger B, Elbert T, Mohr B, Rockstroh B, Koebbel P, Taub E (2001): Constraint-induced therapy of chronic aphasia after stroke. Stroke 32:1621-1626.
57. Reis J, Schambra HM, Cohen LG, Buch ER, Fritsch B, Zarahn E, Celnik PA, Krakauer JW (2009): Noninvasive cortical stimulation enhances motor skill acquisition over multiple days through an effect on consolidation. Proc Natl Acad Sci USA 106:1590-1595.
58. Rochat L, Van der Linden M, Renaud O, Epiney J-B, Michel P, Sztajzel R, Spierer L, Annoni J-M(2013): Poor reward sensitivity and apathy after stroke: implication of basal ganglia. Neurology 81:1674-1680.
59. Rodriguez PF, Aron AR, Poldrack RA (2006): Ventral-striatal/nucleus-accumbens sensitivity to prediction errors during classification learning. Hum Brain Mapp 27:306-313.
60. Schambra HM, Abe M, Luckenbaugh DA, Reis J, Krakauer JW, Cohen LG (2011): Probing for hemispheric specialization for motor skill learning: a transcranial direct current stimulation study. J Neurophysiol 106:652-661.
61. Schmidt RA, Lee TD (2011): Motor Control and Learning, 5th ed. Human Kinetics Publishers, Champaign, IL.
62. Schott BH, Minuzzi L, Krebs RM, Elmenhorst D, Lang M, Winz OH, Seidenbecher CI, Coenen HH, Heinze H-J, Zilles K, Düzel E, Bauer A (2008): Mesolimbic functional magnetic resonance imaging activations during reward anticipation correlate with reward-related ventral striatal dopamine release. J Neurosci 28:14311-14319.
63. Sepulcre J, Liu H, Talukdar T, Martincorena I, Yeo BTT, Buckner RL (2010): The organization of local and distant functional connectivity in the human brain. PLoS Comput Biol 6:e1000808.
64. Sescousse G, Caldú X, Segura B, Dreher J-C(2013): Processing of primary and secondary rewards: a quantitative meta-analysis and review of human functional neuroimaging studies. Neurosci Biobehav Rev 37:681-696.
65. Shohamy D, Adcock RA (2010): Dopamine and adaptive memory. Trends Cogn Sci (Regul Ed) 14:464-472.
66. Simons JS, Spiers HJ (2003): Prefrontal and medial temporal lobe interactions in long-term memory. Nat Rev Neurosci 4:637-648.
67. Strauss GP, Frank MJ, Waltz JA, Kasanova Z (2011): Deficits in positive reinforcement learning and uncertainty-driven exploration are associated with distinct aspects of negative symptoms in schizophrenia. Biol Psychiatry 69:424-431.
68. Talairach J, Tournoux P (1988): Co-planar stereotaxic atlas of the human brain. Thieme Medical Publishers, New York, NY.
69. Thomas Yeo BT, Krienen FM, Sepulcre J, Sabuncu MR, Lashkari D, Hollinshead M, Roffman JL, Smoller JW, Zollei L, Polimeni JR, Fischl B, Liu H, Buckner RL (2011): The organization of the human cerebral cortex estimated by intrinsic functional connectivity. J Neurophysiol 106:1125-1165.
70. Tomasi D, Volkow ND (2012): Resting functional connectivity of language networks: characterization and reproducibility. Mol Psychiatry 17:841-854.
71. Tomassini V, Jbabdi S, Kincses ZT, Bosnell R, Douaud G, Pozzilli C, Matthews PM, Johansen-Berg H (2011): Structural and functional bases for individual differences in motor learning. Hum Brain Mapp 32:494-508.
72. Vahdat S, Darainy M, Milner TE, Ostry DJ (2011): Functionally specific changes in resting-state sensorimotor networks after motor learning. J Neurosci 31:16907-16915.
73. van den Heuvel MP, Hulshoff Pol HE (2010): Exploring the brain network: a review on resting-state fMRI functional connectivity. Eur Neuropsychopharmacol 20:519-534.
74. Van Dijk KRA, Hedden T, Venkataraman A, Evans KC, Lazar SW, Buckner RL (2010): Intrinsic functional connectivity as a tool for human connectomics: theory, properties, and optimization. J Neurophysiol 103:297-321.
75. Vickery TJ, Chun MM, Lee D (2011): Ubiquity and specificity of reinforcement signals throughout the human brain. Neuron 72:166-177.
76. Volkow ND, Fowler JS, Wang GJ, Baler R, Telang F (2009): Imaging dopamine's role in drug abuse and addiction. Neuropharmacology 56 Suppl 1:3-8.
77. Vrieze E, Pizzagalli DA, Demyttenaere K, Hompes T (2012): Reduced Reward Learning Predicts Outcome in Major Depressive Disorder. Biol Psychiatry 73:639-645.
78. Wächter T, Lungu OV, Liu T, Willingham DT, Ashe J (2009): Differential effect of reward and punishment on procedural learning. J Neurosci 29:436-443.
79. Wang L, Zang Y, He Y, Liang M, Zhang X, Tian L, Wu T, Jiang T, Li K (2006): Changes in hippocampal connectivity in the early stages of Alzheimer's disease: Evidence from resting state fMRI. Neuroimage 31:496-504.
80. Wickens JR, Reynolds JN, Hyland BI (2003): Neural mechanisms of reward-related motor learning. Curr Opin Neurobiol 13:685-690.
81. Wilcox R (2004): Inferences Based on a Skipped Correlation Coefficient. J Appl Statistics 31:131-143.
82. Wilcox RR (1994): The percentage bend correlation coefficient. Psychometrika 59:601-616.
83. Williams ZM, Bush G, Rauch SL, Cosgrove GR, Eskandar EN (2004): Human anterior cingulate neurons and the integration of monetary reward with motor responses. Nat Neurosci 7:1370-1375.
84. Wittmann BC, Schott BH, Guderian S, Frey JU, Heinze H-J, Düzel E (2005): Reward-related FMRI activation of dopaminergic midbrain is associated with enhanced hippocampus-dependent long-term memory formation. Neuron 45:459-467.
85. Zimerman M, Nitsch M, Giraux P, Gerloff C, Cohen LG, Hummel FC (2013): Neuroenhancement of the aging brain: restoring skill acquisition in old subjects. Ann Neurol 73:10-15.