A Bayesian context fear learning algorithm/automaton

Frontiers in Behavioral Neuroscience

Volumn 9, Issue MAY, 2015, Pages

  Krasne, Franklin B ^a   Cushman, Jesse D ^a   Fanselow, Michael S ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Amygdala; Bayesian; Computational neuroscience; Context; Fear conditioning; Hippocampus; Model

Indexed keywords

ALGORITHM; AMYGDALOID NUCLEUS; ARTICLE; AUTOMATION; AVERSION; BAYESIAN LEARNING; BRAIN FUNCTION; DENTATE GYRUS; ENTORHINAL CORTEX; FEAR; HIPPOCAMPAL CA1 REGION; HIPPOCAMPAL CA3 REGION; HIPPOCAMPUS; HUMAN; MEMBRANE POTENTIAL; MEMORY CONSOLIDATION; NERVE CELL MEMBRANE STEADY POTENTIAL; NERVE CELL PLASTICITY; RECALL; SYMPATHETIC INNERVATION; WORKING MEMORY;

EID: 84930667207     PISSN: 16625153     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnbeh.2015.00112     Document Type: Article

References (79)

1. Bast, T., Zhang, W. N., and Feldon, J. (2003). Dorsal hippocampus and classical fear conditioning to tone and context in rats: effects of local NMDA-receptor blockade and stimulation. Hippocampus 13, 657-675. doi: 10.1002/hipo.10115
2. Blair, H. T., Schafe, G. E., Bauer, E. P., Rodrigues, S. M., and LeDoux, J. E. (2001). Synaptic plasticity in the lateral amygdala: a cellular hypothesis of fear conditioning. Learn. Mem. 8, 229-242. doi: 10.1101/lm.30901
3. Blanchard, R. J., Fukunaga, K. K., and Blanchard, D. C. (1976). Environmental control of defensive reactions to footshock. Bull. Psychon. Soc. 8, 129-130. doi: 10.3758/BF03335103
4. Boatman, J. A., and Kim, J. J. (2006). A thalamo-cortico-amygdala pathway mediates auditory fear conditioning in the intact brain. Eur. J. Neurosci. 24, 894-900. doi: 10.1111/j.1460-9568.2006.04965.x
5. Bortolotto, Z. A., Lauri, S., Issaac, J. T., and Collingridge, G. L. (2003). Kainate receptors and induction of mossy fibre long-term potentiation. Philos. Trans. R. Soc. Lond. B Biol. Sci. 358, 657-666. doi: 10.1098/rstb.2002.1216
6. Calandreau, L., Desmedt, A., Decorte, L., and Jaffard, R. (2005). A different recruitment of the lateral and basolateral amygdala promotes contextual or elemental conditioned association in Pavlovian fear conditioning. Learn. Mem. 12, 383-388. doi: 10.1101/lm.92305
7. Contractor, A., Rogers, C., Marion, C., Henkerneyer, M., Swanson, G. T., and Heinemann, S. F. (2002). Trans-synaptic Eph receptor sinaling in hippocampal mossy fiber LTP. Science 296, 1864-1869. doi: 10.1126/science.1069081
8. Cowansage, K. K., Shuman, T., Dillingham, B. C., Chang, A., Golshani, P., and Mayford, M. (2014). Direct reactivation of a coherent neocortical memory of context. Neuron 84, 432-441. doi: 10.1016/j.neuron.2014.09.022
9. Deng, W., Mayford, M., and Gage, F. H. (2013). Selection of distinct populations of dentate granule cells in response to inputs as a mechanism for pattern separation in mice. Elife 2:e00312. doi: 10.7554/eLife.00312
10. Fanselow, M. S. (1982). The post-shock activity burst. Anim. Learn. Behav. 10, 448-454. doi: 10.3758/BF03212284
11. Fanselow, M. S. (1986). Associative vs. topographical accounts of the immediate shock freezing deficit in rats: implications for the response selection rules governing species specific defensive reactions. Learn. Motiv. 17, 16-39. doi: 10.1016/0023-9690(86)90018-4
12. Fanselow, M. S. (1990). Factors governing one-trial conextual conditioning. Anim. Learn. Behav. 18, 264-270. doi: 10.3758/BF03205285
13. Fanselow, M. S. (2000). Contextual fear, gestalt memories, and the hippocampus.Behav. BrainRes. 110,73-81. doi: 10.1016/S0166-4328(99)00186-2
14. Fanselow, M. S., and Dong, H. W. (2010). Are the dorsal and ventral hippocampus functionally distinct structures? Neuron 65, 7-19. doi: 10.1016/j.neuron.2009.11.031
15. Fanselow, M. S., and LeDoux, J. E. (1999). Why we think plasticity underlying Pavlovian fear conditioning occurs in the basolateral amygdala. Neuron 23, 229-232. doi: 10.1016/S0896-6273(00)80775-8
16. Favero, M., Massella, O., Cangiano, A., and Buffelli, M. (2009). On the mechanism of action of muscle fibre activity in synapse competition and elimination at the mammalian neuromuscular junction. Eur. J. Neurosci. 29, 2327-2334. doi: 10.1111/j.1460-9568.2009.06779.x
17. Frey, U., Hartmann, S., and Matthies, H. (1989). Domperidone, an inhibitor of the D2-receptor, blocks a late phase of an electrically induced long-term potentiation in the CA1-region in rats. Biomed. Biochim. Acta 48, 473-476.
18. Gallistel, C. R. (2009). The importance of proving the null. Psychol. Rev. 116, 439-453. doi: 10.1037/a0015251
19. Gardner-Medwin, A. R. (1976). The recall of events through the learning of associations between their parts. Proc. R. Soc. Lond. B. 194, 375-402. doi: 10.1098/rspb.1976.0084
20. Hasselmo, M. E. (2006). The role of acetycholing in learning and memory. Curr. Opin. Neurobiol. 16, 710-715. doi: 10.1016/j.conb.2006.09.002
21. Hasselmo, M. E., and Sarter, M. (2010). Modes and models of forebrain cholinergicneuromodulation of cognition. Neuropsychopharmacology 36, 52-73. doi: 10.1038/npp.2010.104
22. Hasselmo, M. E., Schnell, E., and Barkai, E. (1995). Dynamics oflearning and recall atexcitatory recurrent synapses and cholinergic modulation in rat hippocampal region CA3. J. Neurosci. 15, 5249-5262.
23. Hawkins, R. D. (2013). Possible contributions of a novel form of synaptic plasticity in Aplysia to reward, memory, and their dysfunctions in mammalian brain. Learn. Mem. 20, 580-591. doi: 10.1101/lm.031237.113
24. Huerta, P. T., and Lisman, J. E. (1995). Bidirectional synaptic plasticityinduced by a single burst during cholinergic theta oscillation in CA1 in vitro. Neuron 15, 1053-1063. doi: 10.1016/0896-6273(95)90094-2
25. Jin, J., and Maren, S. (2015). Fear renewal preferentially activates ventral hippocampal neurons projecting to both amygdala and prefrontal cortex in rats. Sci. Rep. 5:8388. doi: 10.1038/srep08388
26. Johansen, J. P., Diaz-Mataix, L., Hamanaka, H., Ozawa, T., Ycu, E., Koivumaa, J., et al. (2014). Hebbian and neuromodulatory mechanisms interact to trigger associative memory formation. Proc. Natl. Acad. Sci. U.S.A. 111, E5584-E5592. doi: 10.1073/pnas.1421304111
27. Kano, M., and Hashimoto, K. (2009). Synapse elimination in the central nervous system. Curr. Opin. Neurobiol. 19, 154-161. doi: 10.1016/j.conb.2009.05.002
28. Kass, R. E., and Rafter, A. E. (1995). Bayes factors. J. Am. Stat. Assoc. 90, 773-795. doi: 10.1080/01621459.1995.10476572
29. Kenney, J. W., and Gould, T. J. (2008). Modulation of hippocampus-dependent learning and synapticplasticity by nicotine. Mol. Neurobiol. 38, 101-121. doi: 10.1007/s12035-008-8037-9
30. Kesner, R. P., and Rolls, E. T. (2015). A computational theory of hippocampal function, and tests of the theory: new developments. Neurosci. Biobehav. Rev. 48, 92-147. doi: 10.1016/j.neubiorev.2014.11.009
31. Ketz, N., Morkonda, S. G., and O’Reilly, R. C. (2013). Theta coordinated error- driven learning in the hippocampus. PLOS Comput. Biol. 9:e1003067. doi: 10.1371/journal.pcbi.1003067
32. Kheirbek, M. A., Drew, L. J., Burghardt, N. S., Costantini, D. O., Tannenholz, L., Ahmari, S. E., et al. (2013). Differential control of learning and anxiety along the dorsoventral axis of the dentate gyrus. Neuron 77, 955-968. doi: 10.1016/j.neuron.2012.12.038
33. Kiernan, M., and Cranney, J. (1992). Immediate-startle stimulus presentation fails to condition freezing responses to contextual cues. Behav. Neurosci. 106, 121-124. doi: 10.1037/0735-7044.106.1.121
34. Kiernan, M. J., and Westbrook, R. F. (1993). Effects of exposure to a to-be- shocked environment upon the rat's freezing respons: evidence for facilitation, latent inhibition, and perceptual learning. Q. J. Exp. Psychol. 46, 271-288. doi: 10.1080/14640749308401089
35. Krasne, F. B., Fanselow, M. S., and Zelikowsky, M. (2011). Design of a neurally plausible model of fear learning. Front. Behav. Neurosci. 5:41. doi: 10.3389/fnbeh.2011.00041
36. Landeira-Fernandez, J., Decola, J. P., Kim, J. J., and Fanselow, M. S. (2006). Immediate shock deficit in fear conditioning: effects of shock manipulations. Behav. Neurosci. 120,873-879.doi: 10.1037/0735-7044.120.4.873
37. LeDoux, J. E., Cicchetti, P., Xagoraris, A., and Romanski, L. M. (1990). The lateral amygdaloid nucleus: sensory interface of the amygdala in fear conditioning. J. Neurosci. 10, 1062-1069.
38. LeDoux, J. E., and Clugnet, M. C. (1990). Synaptic plasticity in fear conditioning circuits: induction of LTP in thelateral nucleus of the amygdala by stimulation of the medial geniculate body. J. Neurosci. 10, 2818-2824.
39. Lester, L. S. and Fanselow, M. S. (1986). Naloxone's enhancement of freezing: Modulation of perceived intensity or memory processes? Physiol. Psychol. 14, 5-10.
40. Leutgeb, J. K., Leutgeb, S., Moser, M. B., and Moser, E. I. (2007). Pattern separation in the dentate gyrus and CA3 of the hippocampus. Science 315, 961-966. doi: 10.1126/science.1135801
41. Lisman, J., Grace, A. A., and Duzel, E. A. (2011). neoHebbian framework for episodic memory; role of dopamine-dependent late LTP. Trends Neurosci. 34, 536-547. doi: 10.1016/j.tins.2011.07.006
42. Liu, X., Ramirez, S., Pang, P. T., Puryear, C. B., Govindarajan, A., and Deisseroth, K. S. (2012). Optogenetic stimulation of a hippocampal engram activates fear memory recall. Nature 484, 381-385. doi: 10.1038/nature11028
43. Lovinger, D. M. (2010). Neurotransmitter roles in synaptic modulation, plasticity and learning in the dorsal striatum. Neuropharmacology 58, 951-961. doi: 10.1016/j.neuropharm.2010.01.008
44. Maren, S., and Fanselow, M. S. (1995). Synaptic plasticity in the basolateral amygdala induced by hippocampal formation stimulation in vivo. J. Neurosci. 15,7548-7564.
45. Maren, S., and Holt, W. G. (2004). Hippocampus and Pavlovian fear conditioning in rats: muscimol infusions into the ventral, but not dorsal, hippocampus impair the acquisition of conditional freezing to an auditory conditional stimulus. Behav. Neurosci. 118, 97-110. doi: 10.1037/0735-7044.118.1.97
46. Markram, H., and Segal, M. (1990). Acetylcholine potentiates responses to N- methyI-D-aspartate in the rat hippocampus. Neurosci. Lett. 113, 62-65. doi: 10.1016/0304-3940(90)90495-U
47. Marr, D. (1971). Simple memory: a theory for archicortex. Philosophical transactions of the royal society of london. Ser. B Biol. Sci. 262, 23-81. doi: 10.1098/rstb.1971.0078
48. Matus-Amat, P., Higgins, E. A., Barrientos, R. M., and Rudy, J. W. (2004). The role of the dorsal hippocampus in the acquisition and retrieval of context memory representations. J. Neurosci. 24, 2431-2439. doi: 10.1523/JNEUROSCI.1598-03.2004
49. McClelland, J. L., McNaughton, B. L., and O'Reilly, R. C. (1995). Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. Psychol. Rev. 102,419-457. doi: 10.1037/0033-295X.102.3.419
50. McHugh, T. J., Jones, M. W., Quinn, J. J., Balthasar, N., Coppari, R., Elmquist, J. K., et al. (2007). Dentate gyrus NMDA receptors mediate rapid pattern separation in the hippocampal network. Science 2007, 94-99. doi: 10.1126/science.1140263
51. McNaughton, B. L., and Morris, R. G. M. (1987). Hippocampal synaptic enhancement and information storage within a distributed memory system. TrendsNeurosci. 10,408-415.doi: 10.1016/0166-2236(87)90011-7
52. Myers, C. E., and Scharfman, H. E. (2011). Pattern separation in the dentate gyrus: a role for the CA3 backprojection. Hippocampus 21, 1190-1215. doi: 10.1002/hipo.20828
53. Nakashiba, T., Cushman, J. D., Pelkey, K. A., Renaudineau, S., Buhl, D. L., McHugh, T. J., et al. (2012). Young dentate granule cells mediate pattern separation, whereas old granule cells facilitate pattern completion. Cell 149, 201. doi: 10.1016/j.cell.2012.01.046
54. Neunuebel, J. P., and Knierim, J. J. (2014). CA3 retrieves coherent representations from degraded input: direct evidence for CA3 pattern completion and dentate gyrus pattern separation. Neuron 81, 416-427. doi: 10.1016/j.neuron.2013.11.017
55. Onishi, B. K., and Xavier, G. F. (2010). Contextual, but not auditory, fear conditioning is disrupted by neurotoxic selective lesion of the basal nucleus of amygdala in rats. Neurobiol. Learn. Mem. 93, 165-174. doi: 10.1016/j.nlm.2009.09.007
56. O'Reilly, R. C., and McClelland, J. L. (1994). Hippocampal conjunctive encoding, storage, and recall: avoiding a trade-off. Hippocampus 4, 661-682. doi: 10.1002/hipo.450040605
57. O'Reilly, R. C., and Rudy, J. W. (2001). Conjunctive representations in learning and memory: principles of cortical and hippocampal function. Psychol. Rev. 108, 311-345. doi: 10.1037/0033-295X.108.2.311
58. Parsons, T. C., and Otto, T. (2008). Temporary inactivation of dorsal hippocampus attenuates explicitly nonspatial, unimodal, contextual fear conditioning. Neurobiol. Learn. Mem. 90, 261-268. doi: 10.1016/j.nlm.2008.03.007
59. Reid, C. A., Dixon, D. B., Takahashi, M., Bliss, T. V. P., and Fine, A. (2004). Optical quantal analysis indicates that long-term potentiation at single hippocampal mossy fiber synapses is expressed through increased release probability, recruitment of new release sites, and activation of silent synapses. J. Neurosci. 24, 3618-3626. doi: 10.1523/JNEUR0SCI.3567-03.2004
60. Romanski, L. M., and LeDoux, J. E. (1992). Equipotentiality of thalamo- amygdala and thalamo-cortico-amygdala circuits in auditoryfear conditioning. J. Neurosci. 12,4501-4509.
61. Rudy, J. W. (2009). Context representations, context functions, and the parahippocampal-hippocampal system. Learn. Mem. 16, 573-585. doi: 10.1101/lm.1494409
62. Rudy, J. W., Barrientos, R. M., and O'Reilly, R. C. (2002). Hippocampal formation supports conditioning to memory of a context. Behav. Neurosci. 116, 530-538. doi: 10.1037/0735-7044.116.4.530
63. Rudy, J. W., and O'Reilly, R. C. (1999). Contextual fear conditioning, conjunctive representations, pattern completion, and the hippocampus. Behav. Neurosci. 113,867-880.doi: 10.1037/0735-7044.113.5.867
64. Rudy, J. W., and O'Reilly, R. C. (2001). Conjunctive representations, the hippocampus, and contextual fear conditioning. Cogn. Affect. Behav. Neurosci. 1, 66-82. doi: 10.3758/CABN.1.1.66
65. Scharfman, H. E. (2007). The CA3 “Backprojection” to the dentate gyrus. Prog. BrainRes. 163,627-637.doi: 10.1016/S0079-6123(07)63034-9
66. Schenberg, E. E., and Oliveira, M. G. (2008). Effects of pre or posttraining dorsal hippocampus D-AP5 injection on fear conditioning to tone, background, and foreground context. Hippocampus 18, 1089-1093. doi: 10.1002/hipo.20475
67. Schon, K., Newmark, R. E., Ross, R. S., and Stern, C. E. (2015). Aworking memory buffer in parahippocampal regions: evidence from a load effect during the delay period. Cereb. Cortex bhv013. doi: 10.1093/cercor/bhv013. [Epub ahead of print].
68. Skaggs, W. E., and McNaughton, B. L. (1992). Computational approaches to hippocampal function. Curr. Opin. Neurobiol. 2, 209-211. doi: 10.1016/0959-4388(92)90014-C
69. Stote, D. L., and Fanselow, M. S. (2004). NMDA receptor modulation of incidental learning in Pavlovian context conditioning. Behav. Neurosci. 118,253-257. doi: 10.1037/0735-7044.118.1.253
70. Suzuki, W. A., Miller, E. K., and Desimone, R. (1997). Object and place memoryin the macaque entorhinal cortex. J. Neurophysiol. 78, 1062-1081.
71. Tanaka, K. Z., Pevzner, A., Hamidi, A. B., Nakazawa, Y., Graham, J., and Wiltgen, B. J. (2014). Cortical representations are reinstated by the hippocampus during memory retrieval. Neuron 84, 347-354. doi: 10.1016/j.neuron.2014.09.037
72. Thomas, M. J., Moody, T. D., Makhinson, M., and O'Dell, T. J. (1996). Activity- dependent beta-adrenergic modulation of low frequency stimulation induced LTP in the hippocampal CA1 region. Neuron 17, 475-482. doi: 10.1016/S0896-6273(00)80179-8
73. Treves, A. (1995). Quantitative estimate of the information relayed by the Schaffer collaterals. J. Comput. Neurosci. 2, 259-272. doi: 10.1007/BF00961437
74. Treves, A., and Rolls, E. T. (1992). Computational constraints suggest the need for two distinct input systems to the hippocampal CA3 network. Hippocampus 2, 200. doi: 10.1002/hipo.450020209
75. Treves, A., and Rolls, E. T. (1994). Computational analysis of the role of the hippocampus in memory. Hippocampus 4, 374-391. doi: 10.1002/hipo.450040319
76. Treves, A., Tashiro, A., Witter, M. P., and Moser, E. I. (2008). What is the mammalian dentate gyrus good for? Neuroscience 154, 1155-1172. doi: 10.1016/j.neuroscience.2008.04.073
77. Wiltgen, B. J., Sanders, M. J., Anagonstaras, S. G., Sage, J. R., and Fanselow, M. S. (2006). Context fear learning in the absenceofthe hippocampus. J. Neurosci. 26, 5484-5491. doi: 10.1523/JNEUROSCI.2685-05.2006
78. Young, B. J., Otto, T., Fox, G. D., and Eichenbaum, H. (1997). Memory representation within the parahippocampal region. J. Neurosci. 17, 5183-5195.
79. Young, S. L., Bohenek, D. L., and Fanselow, M. S. (1994). NMDA processes mediate anterograde amnesia of contextual fear conditioning induced by hippocampal damage: immunization against amnesia by context preexposure. Behav. Neurosci. 108, 19-29. doi: 10.1037/0735-7044.108.1.19