An Upside to Reward Sensitivity: The Hippocampus Supports Enhanced Reinforcement Learning in Adolescence

Neuron

Volumn 92, Issue 1, 2016, Pages 93-99

  Davidow, Juliet Y ^a,e   Foerde, Karin ^b,c   Galván, Adriana ^d   Shohamy, Daphna ^e  

^a HARVARD UNIVERSITY   (United States)

^b NewYork Presbyterian Hospital   (United States)

^c NEW YORK STATE PSYCHIATRIC INSTITUTE   (United States)

^d UNIVERSITY OF CALIFORNIA   (United States)

^e Och Spine at New York Presbyterian Hospitals   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADOLESCENT; ARTICLE; BOLD SIGNAL; CONTROLLED STUDY; EPISODIC MEMORY; FUNCTIONAL CONNECTIVITY; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HIPPOCAMPUS; HUMAN; PREDICTION; PREDICTION ERROR; PRIORITY JOURNAL; PUTAMEN; REINFORCEMENT; REWARD; REWARD SENSITIVITY; ADOLESCENT BEHAVIOR; ADULT; CORPUS STRIATUM; FUNCTIONAL NEUROIMAGING; LEARNING; NERVE TRACT; NUCLEAR MAGNETIC RESONANCE IMAGING; PHYSIOLOGY; YOUNG ADULT;

ADOLESCENT; ADOLESCENT BEHAVIOR; ADULT; CORPUS STRIATUM; FUNCTIONAL NEUROIMAGING; HIPPOCAMPUS; HUMANS; LEARNING; MAGNETIC RESONANCE IMAGING; MEMORY, EPISODIC; NEURAL PATHWAYS; REINFORCEMENT (PSYCHOLOGY); REWARD; YOUNG ADULT;

EID: 84992700427     PISSN: 08966273     EISSN: 10974199     Source Type: Journal    
DOI: 10.1016/j.neuron.2016.08.031     Document Type: Article

References (46)

1. Adcock, R.A., Thangavel, A., Whitfield-Gabrieli, S., Knutson, B., Gabrieli, J.D.E., Reward-motivated learning: mesolimbic activation precedes memory formation. Neuron 50 (2006), 507–517.
2. Akaike, H., A new look at the statistical model identification. IEEE Trans. Automat. Contr. 19 (1974), 716–723.
3. Andersen, S.L., Rutstein, M., Benzo, J.M., Hostetter, J.C., Teicher, M.H., Sex differences in dopamine receptor overproduction and elimination. Neuroreport 8 (1997), 1495–1498.
4. Bartra, O., McGuire, J.T., Kable, J.W., The valuation system: a coordinate-based meta-analysis of BOLD fMRI experiments examining neural correlates of subjective value. Neuroimage 76 (2013), 412–427.
5. Brenhouse, H.C., Andersen, S.L., Developmental trajectories during adolescence in males and females: a cross-species understanding of underlying brain changes. Neurosci. Biobehav. Rev. 35 (2011), 1687–1703.
6. Brenhouse, H.C., Sonntag, K.C., Andersen, S.L., Transient D1 dopamine receptor expression on prefrontal cortex projection neurons: relationship to enhanced motivational salience of drug cues in adolescence. J. Neurosci. 28 (2008), 2375–2382.
7. Bunzeck, N., Dayan, P., Dolan, R.J., Duzel, E., A common mechanism for adaptive scaling of reward and novelty. Hum. Brain Mapp. 31 (2010), 1380–1394.
8. Casey, B.J., Beyond simple models of self-control to circuit-based accounts of adolescent behavior. Annu. Rev. Psychol. 66 (2015), 295–319.
9. Casey, B.J., Glatt, C.E., Lee, F.S., Treating the developing versus developed brain: translating preclinical mouse and human studies. Neuron 86 (2015), 1358–1368.
10. Christakou, A., Gershman, S.J., Niv, Y., Simmons, A., Brammer, M., Rubia, K., Neural and psychological maturation of decision-making in adolescence and young adulthood. J. Cogn. Neurosci. 25 (2013), 1807–1823.
11. Clithero, J.A., Rangel, A., Informatic parcellation of the network involved in the computation of subjective value. Soc. Cogn. Affect. Neurosci. 9 (2014), 1289–1302.
12. Cohen, J.R., Asarnow, R.F., Sabb, F.W., Bilder, R.M., Bookheimer, S.Y., Knowlton, B.J., Poldrack, R.A., A unique adolescent response to reward prediction errors. Nat. Neurosci. 13 (2010), 669–671.
13. Daugherty, A.M., Bender, A.R., Raz, N., Ofen, N., Age differences in hippocampal subfield volumes from childhood to late adulthood. Hippocampus 26 (2016), 220–228.
14. Davachi, L., Item, context and relational episodic encoding in humans. Curr. Opin. Neurobiol. 16 (2006), 693–700.
15. Daw, N.D., Trial-by-trial data analysis using computational models. Delgado, M.R., Phelps, E.A., Robbins, T.W., (eds.) Decision Making, Affect, and Learning: Attention and Performance XXIII, 2011, Oxford University Press.
16. Daw, N.D., Niv, Y., Dayan, P., Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci. 8 (2005), 1704–1711.
17. Daw, N.D., Gershman, S.J., Seymour, B., Dayan, P., Dolan, R.J., Model-based influences on humans’ choices and striatal prediction errors. Neuron 69 (2011), 1204–1215.
18. DeMaster, D., Pathman, T., Lee, J.K., Ghetti, S., Structural development of the hippocampus and episodic memory: developmental differences along the anterior/posterior axis. Cereb. Cortex 24 (2014), 3036–3045.
19. Ernst, M., Romeo, R.D., Andersen, S.L., Neurobiology of the development of motivated behaviors in adolescence: a window into a neural systems model. Pharmacol. Biochem. Behav. 93 (2009), 199–211.
20. Gabrieli, J.D.E., Cognitive neuroscience of human memory. Annu. Rev. Psychol. 49 (1998), 87–115.
21. Galván, A., The teenage brain: sensitivity to rewards. Curr. Dir. Psychol. Sci. 22 (2013), 88–93.
22. Galván, A., Hare, T.A., Parra, C.E., Penn, J., Voss, H., Glover, G., Casey, B.J., Earlier development of the accumbens relative to orbitofrontal cortex might underlie risk-taking behavior in adolescents. J. Neurosci. 26 (2006), 6885–6892.
23. Ghetti, S., DeMaster, D.M., Yonelinas, A.P., Bunge, S.A., Developmental differences in medial temporal lobe function during memory encoding. J. Neurosci. 30 (2010), 9548–9556.
24. Haber, S.N., Knutson, B., The reward circuit: linking primate anatomy and human imaging. Neuropsychopharmacology 35 (2010), 4–26.
25. Han, S., Huettel, S.A., Raposo, A., Adcock, R.A., Dobbins, I.G., Functional significance of striatal responses during episodic decisions: recovery or goal attainment?. J. Neurosci. 30 (2010), 4767–4775.
26. Haque, S., Hasking, P.A., Life scripts for emotionally charged autobiographical memories: a cultural explanation of the reminiscence bump. Memory 18 (2010), 712–729.
27. Hare, T.A., O'Doherty, J., Camerer, C.F., Schultz, W., Rangel, A., Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors. J. Neurosci. 28 (2008), 5623–5630.
28. Kahn, I., Shohamy, D., Intrinsic connectivity between the hippocampus, nucleus accumbens, and ventral tegmental area in humans. Hippocampus 23 (2013), 187–192.
29. Lee, J.K., Ekstrom, A.D., Ghetti, S., Volume of hippocampal subfields and episodic memory in childhood and adolescence. Neuroimage 94 (2014), 162–171.
30. Lloyd, M.E., Doydum, A.O., Newcombe, N.S., Memory binding in early childhood: evidence for a retrieval deficit. Child Dev. 80 (2009), 1321–1328.
31. O'Doherty, J.P., Dayan, P., Friston, K., Critchley, H., Dolan, R.J., Temporal difference models and reward-related learning in the human brain. Neuron 38 (2003), 329–337.
32. Ofen, N., Kao, Y.-C., Sokol-Hessner, P., Kim, H., Whitfield-Gabrieli, S., Gabrieli, J.D.E., Development of the declarative memory system in the human brain. Nat. Neurosci. 10 (2007), 1198–1205.
33. Ofen, N., Chai, X.J., Schuil, K.D.I., Whitfield-Gabrieli, S., Gabrieli, J.D.E., The development of brain systems associated with successful memory retrieval of scenes. J. Neurosci. 32 (2012), 10012–10020.
34. Padmanabhan, A., Luna, B., Developmental imaging genetics: linking dopamine function to adolescent behavior. Brain Cogn. 89 (2014), 27–38.
35. Poldrack, R.A., Packard, M.G., Competition among multiple memory systems: converging evidence from animal and human brain studies. Neuropsychologia 41 (2003), 245–251.
36. Poldrack, R.A., Clark, J., Paré-Blagoev, E.J., Shohamy, D., Creso Moyano, J., Myers, C., Gluck, M.A., Interactive memory systems in the human brain. Nature 414 (2001), 546–550.
37. Rubin, D.C., Berntsen, D., Life scripts help to maintain autobiographical memories of highly positive, but not highly negative, events. Mem. Cognit. 31 (2003), 1–14.
38. Shohamy, D., Myers, C.E., Grossman, S., Sage, J., Gluck, M.A., Poldrack, R.A., Cortico-striatal contributions to feedback-based learning: converging data from neuroimaging and neuropsychology. Brain 127 (2004), 851–859.
39. Somerville, L.H., Casey, B.J., Developmental neurobiology of cognitive control and motivational systems. Curr. Opin. Neurobiol. 20 (2010), 236–241.
40. Spear, L.P., The adolescent brain and age-related behavioral manifestations. Neurosci. Biobehav. Rev. 24 (2000), 417–463.
41. Squire, L.R., Stark, C.E.L., Clark, R.E., The medial temporal lobe. Annu. Rev. Neurosci. 27 (2004), 279–306.
42. Thomsen, D.K., Pillemer, D.B., Ivcevic, Z., Life story chapters, specific memories and the reminiscence bump. Memory 19 (2011), 267–279.
43. van den Bos, W., Cohen, M.X., Kahnt, T., Crone, E.A., Striatum-medial prefrontal cortex connectivity predicts developmental changes in reinforcement learning. Cereb. Cortex 22 (2012), 1247–1255.
44. van Duijvenvoorde, A.C.K., Op de Macks, Z.A., Overgaauw, S., Gunther Moor, B., Dahl, R.E., Crone, E.A., A cross-sectional and longitudinal analysis of reward-related brain activation: effects of age, pubertal stage, and reward sensitivity. Brain Cogn. 89 (2014), 3–14.
45. Wimmer, G.E., Shohamy, D., Preference by association: how memory mechanisms in the hippocampus bias decisions. Science 338 (2012), 270–273.
46. Wimmer, G.E., Braun, E.K., Daw, N.D., Shohamy, D., Episodic memory encoding interferes with reward learning and decreases striatal prediction errors. J. Neurosci. 34 (2014), 14901–14912.