The computational nature of memory modification

eLife

Volumn 6, Issue , 2017, Pages

  Gershman, Samuel J ^a   Monfils, Marie H ^b   Norman, Kenneth A ^c   Niv, Yael ^c  

^a HARVARD UNIVERSITY   (United States)

^b UNIVERSITY OF TEXAS AT AUSTIN   (United States)

^c PRINCETON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CONDITIONED REFLEX; EXPERIMENTAL MODEL; MEMORY; SIMULATION; STATE DEPENDENT LEARNING; ANIMAL; BIOLOGICAL MODEL; COMPUTER SIMULATION; HUMAN; LEARNING;

ANIMALS; COMPUTER SIMULATION; HUMANS; LEARNING; MEMORY; MODELS, NEUROLOGICAL;

EID: 85018499436     PISSN: None     EISSN: 2050084X     Source Type: Journal    
DOI: 10.7554/eLife.23763     Document Type: Article

References (194)

1. Aggleton JP, Sanderson DJ, Pearce JM. 2007. Structural learning and the Hippocampus. Hippocampus 17:723– 734. doi: 10.1002/hipo.20323, PMID: 17598160
2. Agren T, Engman J, Frick A, Björkstrand J, Larsson EM, Furmark T, Fredrikson M. 2012. Disruption of reconsolidation erases a fear memory trace in the human amygdala. Science 337:1550–1552. doi: 10.1126/science.1223006, PMID: 22997340
3. Aimone JB, Wiles J, Gage FH. 2006. Potential role for adult neurogenesis in the encoding of time in new memories. Nature Neuroscience 9:723–727. doi: 10.1038/nn1707, PMID: 16732202
4. Alberini CM. 2007. Reconsolidation: the samsara of memory consolidation. Debates in Neuroscience 1:17–24. doi: 10.1007/s11559-007-9000-z
5. Aldous D. 1985. Exchangeability and related topics. In: École D’Été De Probabilités De Saint-Flour XIII. Berlin: Springer. p. 1–198.
6. Amaral OB, Osan R, Roesler R, Tort AB. 2008. A synaptic reinforcement-based model for transient amnesia following disruptions of memory consolidation and reconsolidation. Hippocampus 18:584–601. doi: 10.1002/hipo.20420, PMID: 18306305
7. Anderson JR. 1990. The adaptive character of Thought. In: Lawrence Erlbaum.
8. Anderson JR. 1991. The adaptive nature of human categorization. Psychological Review 98:409–429. doi: 10.1037/0033-295X.98.3.409
9. Auber A, Tedesco V, Jones CE, Monfils MH, Chiamulera C. 2013. Post-retrieval extinction as reconsolidation interference: methodological issues or boundary conditions? Psychopharmacology 226:631–647. doi: 10.1007/s00213-013-3004-1, PMID: 23404065
10. Auchter A, Cormack LK, Niv Y, Gonzalez-Lima F, Monfils MH. 2017. Reconsolidation-Extinction interactions in fear memory attenuation: the role of Inter-Trial interval variability. Frontiers in Behavioral Neuroscience 11:2. doi: 10.3389/fnbeh.2017.00002, PMID: 28174526
11. Baker KD, McNally GP, Richardson R. 2013. Memory retrieval before or after extinction reduces recovery of fear in adolescent rats. Learning & Memory 20:467–473. doi: 10.1101/lm.031989.113, PMID: 23950194
12. Baldi E, Lorenzini CA, Bucherelli C. 2004. Footshock intensity and generalization in contextual and auditory-cued fear conditioning in the rat. Neurobiology of Learning and Memory 81:162–166. doi: 10.1016/j.nlm.2004.02.004, PMID: 15082017
13. Becker S. 2005. A computational principle for hippocampal learning and neurogenesis. Hippocampus 15:722– 738. doi: 10.1002/hipo.20095, PMID: 15986407
14. Biedenkapp JC, Rudy JW. 2004. Context memories and reactivation: constraints on the reconsolidation hypothesis. Behavioral Neuroscience 118:956–964. doi: 10.1037/0735-7044.118.5.956, PMID: 15506878
15. Bishop CM. 2006. Pattern Recognition and Machine Learning. Springer.
16. Bissière S, Humeau Y, Lüthi A. 2003. Dopamine gates LTP induction in lateral amygdala by suppressing feedforward inhibition. Nature Neuroscience 6:587–592. doi: 10.1038/nn1058, PMID: 12740581
17. Blair HT, Schafe GE, Bauer EP, Rodrigues SM, LeDoux JE. 2001. Synaptic plasticity in the lateral amygdala: a cellular hypothesis of fear conditioning. Learning & Memory 8:229–242. doi: 10.1101/lm.30901, PMID: 1158406 9
18. Blei DM, Frazier PI. 2011. Distance dependent chinese restaurant processes. Journal of Machine Learning Research 12:2461–2488.
19. Bouton ME, Bolles RC. 1979a. Contextual control of the extinction of conditioned fear. Learning and Motivation 10:445–466. doi: 10.1016/0023-9690(79)90057-2
20. Bouton ME, Bolles RC. 1979b. Role of conditioned contextual stimuli in reinstatement of extinguished fear. Journal of Experimental Psychology: Animal Behavior Processes 5:368–378. doi: 10.1037/0097-7403.5.4.368, PMID: 528893
21. Bouton ME, Brooks DC. 1993. Time and context effects on performance in a pavlovian discrimination reversal. Journal of Experimental Psychology. Animal Behavior Processes 19:165–179. doi: 10.1037/0097-7403.19.2.165
22. Bouton ME. 1993. Context, time, and memory retrieval in the interference paradigms of pavlovian learning. Psychological Bulletin 114:80–99. doi: 10.1037/0033-2909.114.1.80, PMID: 8346330
23. Bouton ME. 2004. Context and behavioral processes in extinction. Learning & Memory 11:485–494. doi: 10. 1101/lm.78804, PMID: 15466298
24. Brooks AM, Berns GS. 2013. Aversive stimuli and loss in the mesocorticolimbic dopamine system. Trends in Cognitive Sciences 17:281–286. doi: 10.1016/j.tics.2013.04.001, PMID: 23623264
25. Brooks DC, Bouton ME. 1993. A retrieval cue for extinction attenuates spontaneous recovery. Journal of Experimental Psychology: Animal Behavior Processes 19:77–89. doi: 10.1037/0097-7403.19.1.77, PMID: 841821 8
26. Brown GD, Neath I, Chater N. 2007. A temporal ratio model of memory. Psychological Review 114:539–576. doi: 10.1037/0033-295X.114.3.539, PMID: 17638496
27. Capaldi EJ. 1994. The sequential view: from rapidly fading stimulus traces to the organization of memory and the abstract concept of number. Psychonomic Bulletin & Review 1:156–181. doi: 10.3758/BF03200771, PMID: 24203468
28. Censor N, Dimyan MA, Cohen LG. 2010. Modification of existing human motor memories is enabled by primary cortical processing during memory reactivation. Current Biology 20:1545–1549. doi: 10.1016/j.cub.2010.07.047, PMID: 20817532
29. Chan JC, LaPaglia JA. 2013. Impairing existing declarative memory in humans by disrupting reconsolidation. PNAS 110:9309–9313. doi: 10.1073/pnas.1218472110, PMID: 23690586
30. Chan JC, Thomas AK, Bulevich JB. 2009. Recalling a witnessed event increases eyewitness suggestibility: the reversed testing effect. Psychological Science 20:66–73. doi: 10.1111/j.1467-9280.2008.02245.x, PMID: 19037 905
31. Chan WY, Leung HT, Westbrook RF, McNally GP. 2010. Effects of recent exposure to a conditioned stimulus on extinction of pavlovian fear conditioning. Learning & Memory 17:512–521. doi: 10.1101/lm.1912510, PMID: 20 884753
32. Chater N, Vitányi P. 2003. Simplicity: a unifying principle in cognitive science? Trends in Cognitive Sciences 7:19– 22. doi: 10.1016/S1364-6613(02)00005-0, PMID: 12517354
33. Clem RL, Huganir RL. 2010. Calcium-permeable AMPA receptor dynamics mediate fear memory erasure. Science 330:1108–1112. doi: 10.1126/science.1195298, PMID: 21030604
34. Clopath C, Ziegler L, Vasilaki E, Büsing L, Gerstner W. 2008. Tag-trigger-consolidation: a model of early and late long-term-potentiation and depression. PLoS Computational Biology 4:e1000248. doi: 10.1371/journal.pcbi.1000248, PMID: 19112486
35. Cohen JY, Haesler S, Vong L, Lowell BB, Uchida N. 2012. Neuron-type-specific signals for reward and punishment in the ventral tegmental area. Nature 482:85–88. doi: 10.1038/nature10754, PMID: 22258508
36. Collins AG, Frank MJ. 2013. Cognitive control over learning: creating, clustering, and generalizing task-set structure. Psychological Review 120:190–229. doi: 10.1037/a0030852, PMID: 23356780
37. Costanzi M, Cannas S, Saraulli D, Rossi-Arnaud C, Cestari V. 2011. Extinction after retrieval: effects on the associative and nonassociative components of remote contextual fear memory. Learning & Memory 18:508–518. doi: 10.1101/lm.2175811, PMID: 21764847
38. Courville AC, Daw ND, Touretzky DS. 2006. Bayesian theories of conditioning in a changing world. Trends in Cognitive Sciences 10:294–300. doi: 10.1016/j.tics.2006.05.004, PMID: 16793323
39. Courville AC. 2006. A Latent Cause Theory of Classical Conditioning. Pittsburgh, USA: Carnegie Mellon University.
40. Debiec J, Diaz-Mataix L, Bush DE, Doyère V, LeDoux JE. 2013. The selectivity of aversive memory reconsolidation and extinction processes depends on the initial encoding of the pavlovian association. Learning & Memory 20:695–699. doi: 10.1101/lm.031609.113, PMID: 24255099
41. Debiec J, LeDoux JE, Nader K. 2002. Cellular and systems reconsolidation in the Hippocampus. Neuron 36:527– 538. doi: 10.1016/S0896-6273(02)01001-2, PMID: 12408854
42. Delamater AR. 2004. Experimental extinction in pavlovian conditioning: behavioural and neuroscience perspectives. The Quarterly Journal of Experimental Psychology: Section B 57:97–132. doi: 10.1080/02724990344000097, PMID: 15204112
43. Dempster A, Laird N, Rubin D. 1977. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society. Series B 39:1–38. doi: 10.2307/2984875
44. Deneve S. 2008. Bayesian spiking neurons II: learning. Neural Computation 20:118–145. doi: 10.1162/neco.2008.20.1.118, PMID: 18045003
45. Devenport L, Hill T, Wilson M, Ogden E. 1997. Tracking and averaging in variable environments: a transition rule. Journal of Experimental Psychology. Animal Behavior Processes 23:450–460. doi: 10.1037/0097-7403.23.4.450
46. Doyère V, Debiec J, Monfils MH, Schafe GE, LeDoux JE. 2007. Synapse-specific reconsolidation of distinct fear memories in the lateral amygdala. Nature Neuroscience 10:414–416. doi: 10.1038/nn1871, PMID: 17351634
47. Dudai Y. 2012. The restless Engram: consolidations never end. Annual Review of Neuroscience 35:227–247. doi: 10.1146/annurev-neuro-062111-150500, PMID: 22443508
48. Dunsmoor JE, Niv Y, Daw N, Phelps EA. 2015. Rethinking extinction. Neuron 88:47–63. doi: 10.1016/j.neuron.2015.09.028, PMID: 26447572
49. Duvarci S, Nader K. 2004. Characterization of fear memory reconsolidation. Journal of Neuroscience 24:9269– 9275. doi: 10.1523/JNEUROSCI.2971-04.2004, PMID: 15496662
50. Ecker UK, Brown GD, Lewandowsky S. 2015. Memory without consolidation: temporal distinctiveness explains retroactive interference. Cognitive Science 39:1570–1593. doi: 10.1111/cogs.12214, PMID: 25556982
51. Eisenberg M, Kobilo T, Berman DE, Dudai Y. 2003. Stability of retrieved memory: inverse correlation with trace dominance. Science 301:1102–1104. doi: 10.1126/science.1086881, PMID: 12934010
52. Estes WK. 1950. Toward a statistical theory of learning. Psychological Review 57:94–107. doi: 10.1037/h0058559
53. Estes WK. 1955. Statistical theory of spontaneous recovery and regression. Psychological Review 62:145–154. doi: 10.1037/h0048509, PMID: 14371893
54. Eysenck HJ. 1968. A theory of the incubation of anxiety-fear responses. Behaviour Research and Therapy 6:309– 321. doi: 10.1016/0005-7967(68)90064-8, PMID: 5734549
55. Flavell CR, Barber DJ, Lee JL. 2011. Behavioural memory reconsolidation of food and fear memories. Nature Communications 2:504. doi: 10.1038/ncomms1515, PMID: 22009036
56. Forcato C, Burgos VL, Argibay PF, Molina VA, Pedreira ME, Maldonado H. 2007. Reconsolidation of declarative memory in humans. Learning & Memory 14:295–303. doi: 10.1101/lm.486107, PMID: 17522018
57. Forcato C, Rodríguez ML, Pedreira ME, Maldonado H. 2010. Reconsolidation in humans opens up declarative memory to the entrance of new information. Neurobiology of Learning and Memory 93:77–84. doi: 10.1016/j. nlm.2009.08.006, PMID: 19703575
58. Frankland PW, Ding HK, Takahashi E, Suzuki A, Kida S, Silva AJ. 2006. Stability of recent and remote contextual fear memory. Learning & Memory 13:451–457. doi: 10.1101/lm.183406, PMID: 16882861
59. Friston K. 2005. A theory of cortical responses. Philosophical Transactions of the Royal Society B: Biological Sciences 360:815–836. doi: 10.1098/rstb.2005.1622, PMID: 15937014
60. Fuchs RA, Bell GH, Ramirez DR, Eaddy JL, Su ZI. 2009. Basolateral amygdala involvement in memory reconsolidation processes that facilitate drug context-induced cocaine seeking. European Journal of Neuroscience 30:889–900. doi: 10.1111/j.1460-9568.2009.06888.x, PMID: 19712099
61. Fuhs MC, Touretzky DS. 2007. Context learning in the rodent Hippocampus. Neural Computation 19:3173–3215. doi: 10.1162/neco.2007.19.12.3173, PMID: 17970649
62. Fusi S, Drew PJ, Abbott LF. 2005. Cascade models of synaptically stored memories. Neuron 45:599–611. doi: 10. 1016/j.neuron.2005.02.001, PMID: 15721245
63. Gallistel CR. 2012. Extinction from a rationalist perspective. Behavioural Processes 90:66–80. doi: 10.1016/j. beproc.2012.02.008, PMID: 22391153
64. Gershman S. 2017. Memory modification model code. GitHub. 899950a914875a1d6a25669d35d401ff51acc172. https://github.com/sjgershm/memory-modification
65. Gershman SJ, Blei DM, Niv Y. 2010. Context, learning, and extinction. Psychological Review 117:197–209. doi: 10.1037/a0017808, PMID: 20063968
66. Gershman SJ, Blei DM. 2012. A tutorial on bayesian nonparametric models. Journal of Mathematical Psychology 56:1–12. doi: 10.1016/j.jmp.2011.08.004
67. Gershman SJ, Hartley CA. 2015. Individual differences in learning predict the return of fear. Learning & Behavior 43:243–250. doi: 10.3758/s13420-015-0176-z, PMID: 26100524
68. Gershman SJ, Jones CE, Norman KA, Monfils MH, Niv Y. 2013a. Gradual extinction prevents the return of fear: implications for the discovery of state. Frontiers in Behavioral Neuroscience 7:164. doi: 10.3389/fnbeh.2013.00164, PMID: 24302899
69. Gershman SJ, Niv Y. 2010. Learning latent structure: carving nature at its joints. Current Opinion in Neurobiology 20:251–256. doi: 10.1016/j.conb.2010.02.008, PMID: 20227271
70. Gershman SJ, Niv Y. 2012. Exploring a latent cause theory of classical conditioning. Learning & Behavior 40:255– 268. doi: 10.3758/s13420-012-0080-8, PMID: 22927000
71. Gershman SJ, Niv Y. 2013. Perceptual estimation obeys Occam’s razor. Frontiers in Psychology 4:623. doi: 10.3389/fpsyg.2013.00623, PMID: 24137136
72. Gershman SJ, Norman KA, Niv Y. 2015. Discovering latent causes in reinforcement learning. Current Opinion in Behavioral Sciences 5:43–50. doi: 10.1016/j.cobeha.2015.07.007
73. Gershman SJ, Radulescu A, Norman KA, Niv Y. 2014. Statistical computations underlying the dynamics of memory updating. PLoS Computational Biology 10:e1003939. doi: 10.1371/journal.pcbi.1003939, PMID: 25375 816
74. Gershman SJ, Schapiro AC, Hupbach A, Norman KA. 2013c. Neural context reinstatement predicts memory misattribution. Journal of Neuroscience 33:8590–8595. doi: 10.1523/JNEUROSCI.0096-13.2013, PMID: 2367 8104
75. Gershman SJ. 2014. The penumbra of learning: a statistical theory of synaptic tagging and capture. Network 25: 97–115. doi: 10.3109/0954898X.2013.862749, PMID: 24679103
76. Gisquet-Verrier P, Alexinsky T. 1990. Facilitative effect of a pretest exposure to the CS: analysis and implications for the memory trace. Animal Learning & Behavior 18:323–331. doi: 10.3758/BF03205292
77. Gisquet-Verrier P, Lynch JF, Cutolo P, Toledano D, Ulmen A, Jasnow AM, Riccio DC. 2015. Integration of New Information with active memory Accounts for Retrograde Amnesia: a Challenge to the consolidation/ Reconsolidation hypothesis? Journal of Neuroscience 35:11623–11633. doi: 10.1523/JNEUROSCI.1386-15. 2015, PMID: 26290239
78. Glimcher PW. 2011. Understanding dopamine and reinforcement learning: the dopamine reward prediction error hypothesis. PNAS 108 Suppl 3:15647–15654. doi: 10.1073/pnas.1014269108, PMID: 21389268
79. Gluck MA, Myers CE. 1993. Hippocampal mediation of stimulus representation: a computational theory. Hippocampus 3:491–516. doi: 10.1002/hipo.450030410, PMID: 8269040
80. Gold PE, King RA. 1974. Retrograde amnesia: storage failure versus retrieval failure. Psychological Review 81: 465–469. doi: 10.1037/h0036949, PMID: 4474675
81. Goldwater S, Griffiths TL, Johnson M. 2009. A bayesian framework for word segmentation: exploring the effects of context. Cognition 112:21–54. doi: 10.1016/j.cognition.2009.03.008, PMID: 19409539
82. Gräff J, Joseph NF, Horn ME, Samiei A, Meng J, Seo J, Rei D, Bero AW, Phan TX, Wagner F, Holson E, Xu J, Sun J, Neve RL, Mach RH, Haggarty SJ, Tsai LH. 2014. Epigenetic priming of memory updating during reconsolidation to attenuate remote fear memories. Cell 156:261–276. doi: 10.1016/j.cell.2013.12.020, PMID: 24439381
83. Hardwicke TE, Taqi M, Shanks DR. 2016. Postretrieval new learning does not reliably induce human memory updating via reconsolidation. PNAS 113:5206–5211. doi: 10.1073/pnas.1601440113, PMID: 27114514
84. Hernandez PJ, Kelley AE. 2004. Long-term memory for instrumental responses does not undergo protein synthesis-dependent reconsolidation upon retrieval. Learning & Memory 11:748–754. doi: 10.1101/lm.84904, PMID: 15537740
85. Hinderliter CF, Webster T, Riccio DC. 1975. Amnesia induced by hypothermia as a function of treatment-test interval and recooling in rats. Animal Learning & Behavior 3:257–263. doi: 10.3758/BF03213441
86. Honey RC, Good M. 1993. Selective hippocampal lesions abolish the contextual specificity of latent inhibition and conditioning. Behavioral Neuroscience 107:23–33. doi: 10.1037/0735-7044.107.1.23, PMID: 8447955
87. Howard MW, Eichenbaum H. 2013. The Hippocampus, time, and memory across scales. Journal of Experimental Psychology: General 142:1211–1230. doi: 10.1037/a0033621, PMID: 23915126
88. Howard MW, Fotedar MS, Datey AV, Hasselmo ME. 2005. The temporal context model in spatial navigation and relational learning: toward a common explanation of medial temporal lobe function across domains. Psychological Review 112:75–116. doi: 10.1037/0033-295X.112.1.75, PMID: 15631589
89. Howard MW, Kahana MJ. 2002. A distributed representation of temporal context. Journal of Mathematical Psychology 46:269–299. doi: 10.1006/jmps.2001.1388
90. Howard MW. 2014. Mathematical learning theory through time. Journal of Mathematical Psychology 59:18–29. doi: 10.1016/j.jmp.2013.09.003
91. Hupbach A, Gomez R, Hardt O, Nadel L. 2007. Reconsolidation of episodic memories: a subtle reminder triggers integration of new information. Learning & Memory 14:47–53. doi: 10.1101/lm.365707, PMID: 17202429
92. Hupbach A, Gomez R, Nadel L. 2009. Episodic memory reconsolidation: updating or source confusion? Memory 17:502–510. doi: 10.1080/09658210902882399, PMID: 19468955
93. Ishii D, Matsuzawa D, Matsuda S, Tomizawa H, Sutoh C, Shimizu E. 2015. An isolated retrieval trial before extinction session does not prevent the return of fear. Behavioural Brain Research 287:139–145. doi: 10.1016/j. bbr.2015.03.052, PMID: 25827926
94. Jarome TJ, Kwapis JL, Werner CT, Parsons RG, Gafford GM, Helmstetter FJ. 2012. The timing of multiple retrieval events can alter GluR1 phosphorylation and the requirement for protein synthesis in fear memory reconsolidation. Learning & Memory 19:300–306. doi: 10.1101/lm.024901.111, PMID: 22723052
95. Jones CE, Monfils MH. 2016. Post-retrieval extinction in adolescence prevents return of juvenile fear. Learning & Memory 23:567–575. doi: 10.1101/lm.043281.116, PMID: 27634147
96. Jones CE, Ringuet S, Monfils MH. 2013. Learned together, extinguished apart: reducing fear to complex stimuli. Learning & Memory 20:674–685. doi: 10.1101/lm.031740.113, PMID: 24241750
97. Kakade S, Dayan P. 2002. Acquisition and extinction in autoshaping. Psychological Review 109:533–544. doi: 10.1037/0033-295X.109.3.533, PMID: 12088244
98. Karpicke JD, Roediger HL. 2008. The critical importance of retrieval for learning. Science 319:966–968. doi: 10. 1126/science.1152408, PMID: 18276894
99. Kindt M, Soeter M. 2013. Reconsolidation in a human fear conditioning study: a test of extinction as updating mechanism. Biological Psychology 92:43–50. doi: 10.1016/j.biopsycho.2011.09.016, PMID: 21986472
100. Kredlow MA, Unger LD, Otto MW. 2016. Harnessing reconsolidation to weaken fear and appetitive memories: a meta-analysis of post-retrieval extinction effects. Psychological Bulletin 142:314–336. doi: 10.1037/bul0000034, PMID: 26689086
101. Kruschke JK. 2008. Bayesian approaches to associative learning: from passive to active learning. Learning & Behavior 36:210–226. doi: 10.3758/LB.36.3.210, PMID: 18683466
102. Lattal KM, Abel T. 2004. Behavioral impairments caused by injections of the protein synthesis inhibitor anisomycin after contextual retrieval reverse with time. PNAS 101:4667–4672. doi: 10.1073/pnas.0306546101, PMID: 15070775
103. Lee HJ, Haberman RP, Roquet RF, Monfils MH. 2015. Extinction and retrieval + extinction of conditioned fear differentially activate medial prefrontal cortex and amygdala in rats. Frontiers in Behavioral Neuroscience 9: 369. doi: 10.3389/fnbeh.2015.00369, PMID: 26834596
104. Lee JL, Gardner RJ, Butler VJ, Everitt BJ. 2009. D-cycloserine potentiates the reconsolidation of cocaine-associated memories. Learning & Memory 16:82–85. doi: 10.1101/lm.1186609, PMID: 19144966
105. Lee JL, Milton AL, Everitt BJ. 2006a. Reconsolidation and extinction of conditioned fear: inhibition and potentiation. Journal of Neuroscience 26:10051–10056. doi: 10.1523/JNEUROSCI.2466-06.2006, PMID: 17005 868
106. Lee JL, Milton AL, Everitt BJ. 2006b. Cue-induced cocaine seeking and relapse are reduced by disruption of drug memory reconsolidation. Journal of Neuroscience 26:5881–5887. doi: 10.1523/JNEUROSCI.0323-06.2006, PMID: 16738229
107. Lee SH, Choi JH, Lee N, Lee HR, Kim JI, Yu NK, Choi SL, Lee SH, Kim H, Kaang BK. 2008. Synaptic protein degradation underlies destabilization of retrieved fear memory. Science 319:1253–1256. doi: 10.1126/science.1150541, PMID: 18258863
108. Levy WB, Hocking AB, Wu X. 2005. Interpreting hippocampal function as recoding and forecasting. Neural Networks 18:1242–1264. doi: 10.1016/j.neunet.2005.08.005, PMID: 16269237
109. Lewis DJ, Miller RR, Misanin JR. 1968a. Control of retrograde amnesia. Journal of Comparative and Physiological Psychology 66:48–52. doi: 10.1037/h0025963
110. Lewis DJ, Miller RR, Misanin JR. 1969. Selective amnesia in rats produced by electroconvulsive shock. Journal of Comparative and Physiological Psychology 69:136–140. doi: 10.1037/h0027932
111. Lewis DJ, Misanin JR, Miller RR. 1968b. Recovery of memory following amnesia. Nature 220:704–705. doi: 10.1038/220704a0, PMID: 5693930
112. Lewis DJ. 1979. Psychobiology of active and inactive memory. Psychological Bulletin 86:1054–1083. doi: 10.1037/0033-2909.86.5.1054, PMID: 386401
113. Lisman JE, Grace AA. 2005. The hippocampal-VTA loop: controlling the entry of information into long-term memory. Neuron 46:703–713. doi: 10.1016/j.neuron.2005.05.002, PMID: 15924857
114. Ma X, Zhang JJ, Yu LC. 2012. Post-retrieval extinction training enhances or hinders the extinction of morphine-induced conditioned place preference in rats dependent on the retrieval-extinction interval. Psychopharmacology 221:19–26. doi: 10.1007/s00213-011-2545-4, PMID: 22048130
115. McGaugh JL. 1966. Time-dependent processes in memory storage. Science 153:1351–1358. doi: 10.1126/science.153.3742.1351, PMID: 5917768
116. McGaugh JL. 2000. Memory–a century of consolidation. Science 287:248–251. doi: 10.1126/science.287.5451.248, PMID: 10634773
117. McNally GP, Johansen JP, Blair HT. 2011. Placing prediction into the fear circuit. Trends in Neurosciences 34: 283–292. doi: 10.1016/j.tins.2011.03.005, PMID: 21549434
118. McNaughton BL, Morris RGM. 1987. Hippocampal synaptic enhancement and information storage within a distributed memory system. Trends in Neurosciences 10:408–415. doi: 10.1016/0166-2236(87)90011-7
119. Mikhael JG, Bogacz R. 2016. Learning reward uncertainty in the basal ganglia. PLOS Computational Biology 12: e1005062. doi: 10.1371/journal.pcbi.1005062, PMID: 27589489
120. Milekic MH, Alberini CM. 2002. Temporally graded requirement for protein synthesis following memory reactivation. Neuron 36:521–525. doi: 10.1016/S0896-6273(02)00976-5, PMID: 12408853
121. Millan EZ, Milligan-Saville J, McNally GP. 2013. Memory retrieval, extinction, and reinstatement of alcohol seeking. Neurobiology of Learning and Memory 101:26–32. doi: 10.1016/j.nlm.2012.12.010, PMID: 23305621
122. Miller RR, Laborda MA. 2011. Preventing recovery from extinction and relapse. Current Directions in Psychological Science 20:325–329. doi: 10.1177/0963721411418466
123. Miller RR, Matzel LD. 2006. Retrieval failure versus memory loss in experimental amnesia: definitions and processes. Learning & Memory 13:491–497. doi: 10.1101/lm.241006, PMID: 17015845
124. Miller RR, Springer AD. 1972. Induced recovery of memory in rats following electroconvulsive shock. Physiology & Behavior 8:645–651. doi: 10.1016/0031-9384(72)90089-3, PMID: 5064524
125. Miller RR, Springer AD. 1973. Amnesia, consolidation, and retrieval. Psychological Review 80:69–79. doi: 10.1037/h0033897, PMID: 4347561
126. Miller RR, Springer AD. 1974. Implications of recovery from experimental amnesia. Psychological Review 81:470– 473. doi: 10.1037/h0036951, PMID: 4474676
127. Miller RR. 1970. Effects of environmental complexity on amnesia induced by electroconvulsive shock in rats. Journal of Comparative and Physiological Psychology 71:267–275. doi: 10.1037/h0029126, PMID: 5465206
128. Millin PM, Moody EW, Riccio DC. 2001. Interpretations of retrograde amnesia: old problems redux. Nature Reviews Neuroscience 2:68–70. doi: 10.1038/35049075, PMID: 11253361
129. Milton AL, Lee JL, Butler VJ, Gardner R, Everitt BJ. 2008. Intra-amygdala and systemic antagonism of NMDA receptors prevents the reconsolidation of drug-associated memory and impairs subsequently both novel and previously acquired drug-seeking behaviors. Journal of Neuroscience 28:8230–8237. doi: 10.1523/JNEUROSCI.1723-08.2008, PMID: 18701685
130. Mirenowicz J, Schultz W. 1996. Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature 379:449–451. doi: 10.1038/379449a0, PMID: 8559249
131. Misanin JR, Miller RR, Lewis DJ. 1968. Retrograde amnesia produced by electroconvulsive shock after reactivation of a consolidated memory trace. Science 160:554–555. doi: 10.1126/science.160.3827.554, PMID: 5689415
132. Monfils MH, Cowansage KK, Klann E, LeDoux JE. 2009. Extinction-reconsolidation boundaries: key to persistent attenuation of fear memories. Science 324:951–955. doi: 10.1126/science.1167975, PMID: 19342552
133. Nader K, Hardt O. 2009. A single standard for memory: the case for reconsolidation. Nature Reviews Neuroscience 10:224–234. doi: 10.1038/nrn2590, PMID: 19229241
134. Nader K, Schafe GE, Le Doux JE. 2000. Fear memories require protein synthesis in the amygdala for reconsolidation after retrieval. Nature 406:722–726. doi: 10.1038/35021052, PMID: 10963596
135. Neal RM, Hinton GE. 1998. A view of the EM algorithm that justifies incremental, sparse, and other variants. In: Learning in Graphical Models. p. 355–368.
136. Nessler B, Pfeiffer M, Buesing L, Maass W. 2013. Bayesian computation emerges in generic cortical microcircuits through spike-timing-dependent plasticity. PLoS Computational Biology 9:e1003037. doi: 10.1371/journal.pcbi.1003037, PMID: 23633941
137. Niibori Y, Yu TS, Epp JR, Akers KG, Josselyn SA, Frankland PW. 2012. Suppression of adult neurogenesis impairs population coding of similar contexts in hippocampal CA3 region. Nature Communications 3:1253. doi: 10.1038/ncomms2261, PMID: 23212382
138. Olshavsky ME, Jones CE, Lee HJ, Monfils MH. 2013a. Appetitive behavioral traits and stimulus intensity influence maintenance of conditioned fear. Frontiers in Behavioral Neuroscience 7:179. doi: 10.3389/fnbeh.2013.00179, PMID: 24348354
139. Olshavsky ME, Song BJ, Powell DJ, Jones CE, Monfils MH, Lee HJ. 2013b. Updating appetitive memory during reconsolidation window: critical role of cue-directed behavior and amygdala central nucleus. Frontiers in Behavioral Neuroscience 7:186. doi: 10.3389/fnbeh.2013.00186, PMID: 24367304
140. Osan R, Tort AB, Amaral OB. 2011. A mismatch-based model for memory reconsolidation and extinction in attractor networks. PLoS One 6:e23113. doi: 10.1371/journal.pone.0023113, PMID: 21826231
141. Oyarzún JP, Lopez-Barroso D, Fuentemilla L, Cucurell D, Pedraza C, Rodriguez-Fornells A, de Diego-Balaguer R. 2012. Updating fearful memories with extinction training during reconsolidation: a human study using auditory aversive stimuli. PLoS One 7:e38849. doi: 10.1371/journal.pone.0038849, PMID: 22768048
142. Pavlov IP. 1927. Conditioned Reflexes. Oxford University Press.
143. Pearce JM, Bouton ME. 2001. Theories of associative learning in animals. Annual Review of Psychology 52:111–139. doi: 10.1146/annurev.psych.52.1.111, PMID: 11148301
144. Pedreira ME, Maldonado H. 2003. Protein synthesis subserves reconsolidation or extinction depending on reminder duration. Neuron 38:863–869. doi: 10.1016/S0896-6273(03)00352-0, PMID: 12818173
145. Pezze MA, Feldon J. 2004. Mesolimbic dopaminergic pathways in fear conditioning. Progress in Neurobiology 74:301–320. doi: 10.1016/j.pneurobio.2004.09.004, PMID: 15582224
146. Ponnusamy R, Zhuravka I, Poulos AM, Shobe J, Merjanian M, Huang J, Wolvek D, O’Neill PK, Fanselow MS. 2016. Retrieval and reconsolidation accounts of fear extinction. Frontiers in Behavioral Neuroscience 10:89. doi: 10.3389/fnbeh.2016.00089, PMID: 27242459
147. Power AE, Berlau DJ, McGaugh JL, Steward O. 2006. Anisomycin infused into the Hippocampus fails to block "reconsolidation" but impairs extinction: the role of re-exposure duration. Learning & Memory 13:27–34. doi: 10.1101/lm.91206, PMID: 16452651
148. Przybyslawski J, Sara SJ. 1997. Reconsolidation of memory after its reactivation. Behavioural Brain Research 84: 241–246. doi: 10.1016/S0166-4328(96)00153-2, PMID: 9079788
149. Quartermain D, McEwen BS, Azmitia EC. 1972. Recovery of memory following amnesia in the rat and mouse. Journal of Comparative and Physiological Psychology 79:360–370. doi: 10.1037/h0032810, PMID: 5066260
150. Quirk GJ. 2002. Memory for extinction of conditioned fear is long-lasting and persists following spontaneous recovery. Learning & Memory 9:402–407. doi: 10.1101/lm.49602, PMID: 12464700
151. Rangel LM, Alexander AS, Aimone JB, Wiles J, Gage FH, Chiba AA, Quinn LK. 2014. Temporally selective contextual encoding in the dentate gyrus of the Hippocampus. Nature Communications 5:3181. doi: 10.1038/ncomms4181, PMID: 24518986
152. Rao-Ruiz P, Rotaru DC, van der Loo RJ, Mansvelder HD, Stiedl O, Smit AB, Spijker S. 2011. Retrieval-specific endocytosis of GluA2-AMPARs underlies adaptive reconsolidation of contextual fear. Nature Neuroscience 14: 1302–1308. doi: 10.1038/nn.2907, PMID: 21909089
153. Redish AD, Jensen S, Johnson A, Kurth-Nelson Z. 2007. Reconciling reinforcement learning models with behavioral extinction and renewal: implications for addiction, relapse, and problem gambling. Psychological Review 114:784–805. doi: 10.1037/0033-295X.114.3.784, PMID: 17638506
154. Reichelt AC, Exton-McGuinness MT, Lee JL. 2013. Ventral tegmental dopamine dysregulation prevents appetitive memory destabilization. Journal of Neuroscience 33:14205–14210. doi: 10.1523/JNEUROSCI.1614-13.2013, PMID: 23986254
155. Rescorla RA, Heth CD. 1975. Reinstatement of fear to an extinguished conditioned stimulus. Journal of Experimental Psychology: Animal Behavior Processes 1:88–96. doi: 10.1037/0097-7403.1.1.88, PMID: 1151290
156. Rescorla RA, Wagner AR. 1972. A theory of of pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement. In: Black AH, Prokasy WF (Eds). Classical Conditioning II: Current Research and Theory. p. 64–99.
157. Rescorla RA. 2004. Spontaneous recovery. Learning & Memory 11:501–509. doi: 10.1101/lm.77504, PMID: 15466300
158. Riccio DC, Millin PM, Bogart AR. 2006. Reconsolidation: a brief history, a retrieval view, and some recent issues. Learning & Memory 13:536–544. doi: 10.1101/lm.290706, PMID: 17015851
159. Roediger HL, Butler AC. 2011. The critical role of retrieval practice in long-term retention. Trends in Cognitive Sciences 15:20–27. doi: 10.1016/j.tics.2010.09.003, PMID: 20951630
160. Rohrbaugh M, Riccio DC, Arthur A. 1972. Paradoxical enhancement of conditioned suppression. Behaviour Research and Therapy 10:125–130. doi: 10.1016/S0005-7967(72)80005-6, PMID: 5030258
161. Rohrbaugh M, Riccio DC. 1970. Paradoxical enhancement of learned fear. Journal of Abnormal Psychology 75: 210–216. doi: 10.1037/h0028974, PMID: 5422519
162. Routtenberg A, Rekart JL. 2005. Post-translational protein modification as the substrate for long-lasting memory. Trends in Neurosciences 28:12–19. doi: 10.1016/j.tins.2004.11.006, PMID: 15626492
163. Rudy JW, Biedenkapp JC, Moineau J, Bolding K. 2006. Anisomycin and the reconsolidation hypothesis. Learning & Memory 13:1–3. doi: 10.1101/lm.157806, PMID: 16452648
164. Rumpel S, LeDoux J, Zador A, Malinow R. 2005. Postsynaptic receptor trafficking underlying a form of associative learning. Science 308:83–88. doi: 10.1126/science.1103944, PMID: 15746389
165. Sanborn AN, Griffiths TL, Navarro DJ. 2010. Rational approximations to rational models: alternative algorithms for category learning. Psychological Review 117:1144–1167. doi: 10.1037/a0020511, PMID: 21038975
166. Sartor GC, Aston-Jones G. 2014. Post-retrieval extinction attenuates cocaine memories. Neuropsychopharmacology 39:1059–1065. doi: 10.1038/npp.2013.323, PMID: 24257156
167. Schafe GE, LeDoux JE. 2000. Memory consolidation of auditory pavlovian fear conditioning requires protein synthesis and protein kinase A in the amygdala. Journal of Neuroscience 20:RC96. PMID: 10974093
168. Schiller D, Kanen JW, LeDoux JE, Monfils MH, Phelps EA. 2013. Extinction during reconsolidation of threat memory diminishes prefrontal cortex involvement. PNAS 110:20040–20045. doi: 10.1073/pnas.1320322110, PMID: 24277809
169. Schiller D, Monfils MH, Raio CM, Johnson DC, Ledoux JE, Phelps EA. 2010. Preventing the return of fear in humans using reconsolidation update mechanisms. Nature 463:49–53. doi: 10.1038/nature08637, PMID: 20010606
170. Sederberg PB, Gershman SJ, Polyn SM, Norman KA. 2011. Human memory reconsolidation can be explained using the temporal context model. Psychonomic Bulletin & Review 18:455–468. doi: 10.3758/s13423-011-0086-9, PMID: 21512839
171. Sederberg PB, Howard MW, Kahana MJ. 2008. A context-based theory of recency and contiguity in free recall. Psychological Review 115:893–912. doi: 10.1037/a0013396, PMID: 18954208
172. Shors TJ, Anderson ML, Curlik DM, Nokia MS. 2012. Use it or lose it: how neurogenesis keeps the brain fit for learning. Behavioural Brain Research 227:450–458. doi: 10.1016/j.bbr.2011.04.023, PMID: 21536076
173. Socher R, Gershman S, Sederberg P, Norman K, Perotte AJ, Blei DM. 2009. A Bayesian analysis of dynamics in free recall. In: Williams CK, Culotta A, Bengio Y, Schuurmans D, Lafferty JD (Eds). Advances in Neural Information Processing Systems. 22 p. 1714–1722.
174. Soeter M, Kindt M. 2011. Disrupting reconsolidation: pharmacological and behavioral manipulations. Learning & Memory 18:357–366. doi: 10.1101/lm.2148511, PMID: 21576515
175. Soto FA, Gershman SJ, Niv Y. 2014. Explaining compound generalization in associative and causal learning through rational principles of dimensional generalization. Psychological Review 121:526–558. doi: 10.1037/a0037018, PMID: 25090430
176. Spear NE. 1973. Retrieval of memory in animals. Psychological Review 80:163–194. doi: 10.1037/h0034326
177. Steinfurth EC, Kanen JW, Raio CM, Clem RL, Huganir RL, Phelps EA. 2014. Young and old pavlovian fear memories can be modified with extinction training during reconsolidation in humans. Learning & Memory 21: 338–341. doi: 10.1101/lm.033589.113, PMID: 24934333
178. Sutton RS, Barto AG. 1998. Reinforcement Learning: An Introduction. Cambridge University Press.
179. Suzuki A, Josselyn SA, Frankland PW, Masushige S, Silva AJ, Kida S. 2004. Memory reconsolidation and extinction have distinct temporal and biochemical signatures. Journal of Neuroscience 24:4787–4795. doi: 10.1523/JNEUROSCI.5491-03.2004, PMID: 15152039
180. Tedesco V, Roquet RF, DeMis J, Chiamulera C, Monfils MH. 2014. Extinction, applied after retrieval of auditory fear memory, selectively increases zinc-finger protein 268 and phosphorylated ribosomal protein S6 expression in prefrontal cortex and lateral amygdala. Neurobiology of Learning and Memory 115:78–85. doi: 10.1016/j.nlm.2014.08.015, PMID: 25196703
181. Tronson NC, Taylor JR. 2007. Molecular mechanisms of memory reconsolidation. Nature Reviews Neuroscience 8:262–275. doi: 10.1038/nrn2090, PMID: 17342174
182. Tronson NC, Wiseman SL, Olausson P, Taylor JR. 2006. Bidirectional behavioral plasticity of memory reconsolidation depends on amygdalar protein kinase A. Nature Neuroscience 9:167–169. doi: 10.1038/nn1628, PMID: 16415868
183. Tulving E, Thomson DM. 1973. Encoding specificity and retrieval processes in episodic memory. Psychological Review 80:352–373. doi: 10.1037/h0020071
184. Wagner AR, Rudy JW, Whitlow JW. 1973. Rehearsal in animal conditioning. Journal of Experimental Psychology 97:407–426. doi: 10.1037/h0034136, PMID: 4705247
185. Walker MP, Brakefield T, Hobson JA, Stickgold R. 2003. Dissociable stages of human memory consolidation and reconsolidation. Nature 425:616–620. doi: 10.1038/nature01930, PMID: 14534587
186. Wang L, Dunson DB. 2011. Fast bayesian inference in Dirichlet process Mixture models. Journal of Computational and Graphical Statistics 20:196–216. doi: 10.1198/jcgs.2010.07081, PMID: 24187479
187. Wang SH, de Oliveira Alvares L, Nader K. 2009. Cellular and systems mechanisms of memory strength as a constraint on auditory fear reconsolidation. Nature Neuroscience 12:905–912. doi: 10.1038/nn.2350, PMID: 1 9543280
188. Widrow B, Hoff ME. 1960. Adaptive switching circuits. In: 1960 WESCON Convention Record Part IV. p. 96–104.
189. Winters BD, Tucci MC, DaCosta-Furtado M. 2009. Older and stronger object memories are selectively destabilized by reactivation in the presence of new information. Learning & Memory 16:545–553. doi: 10.1101/lm.1509909, PMID: 19713353
190. Wixted JT, Ebbesen EB. 1991. On the form of forgetting. Psychological Science 2:409–415. doi: 10.1111/j.1467-9280.1991.tb00175.x
191. Wixted JT. 2004. The psychology and neuroscience of forgetting. Annual Review of Psychology 55:235–269. doi: 10.1146/annurev.psych.55.090902.141555, PMID: 14744216
192. Xue YX, Luo YX, Wu P, Shi HS, Xue LF, Chen C, Zhu WL, Ding ZB, Bao YP, Shi J, Epstein DH, Shaham Y, Lu L. 2012. A memory retrieval-extinction procedure to prevent drug craving and relapse. Science 336:241–245. doi: 10.1126/science.1215070, PMID: 22499948
193. Zhu X, Ghahramani Z, Lafferty J. 2005. Time-sensitive Dirichlet process mixture models. In: Technical Report, CMU-CALD-05-104. Carnegie Mellon University.
194. Ziegler L, Zenke F, Kastner DB, Gerstner W. 2015. Synaptic consolidation: from synapses to behavioral modeling. Journal of Neuroscience 35:1319–1334. doi: 10.1523/JNEUROSCI.3989-14.2015, PMID: 25609644