Learning and prospective recall of noisy spike pattern episodes

Frontiers in Computational Neuroscience

Volumn , Issue JUN, 2013, Pages

  Dockendorf, Karl ^a   Srinivasa, Narayan ^a  

^a Hughes Aircraft Co   (United States)

Author keywords

Hippocampus; Learning; Memory; Pattern completion; Preplay; Prospection; Recall; Replay; Sequences; Spiking neural network; STDP

Indexed keywords

HIPPOCAMPUS; LEARNING; PATTERN COMPLETION; PREPLAY; PROSPECTION; RECALL; REPLAY; SEQUENCES; SPIKING NEURAL NETWORKS; STDP;

BRAIN; DATA STORAGE EQUIPMENT; NEURONS; VECTOR SPACES;

NEURAL NETWORKS;

ARTICLE; BRAIN FUNCTION; CELL ACTIVITY; ELECTROENCEPHALOGRAM; HIPPOCAMPUS; HOMEOSTASIS; HUMAN; LEARNING; NERVE CELL NETWORK; NERVE CELL PLASTICITY; NERVOUS SYSTEM PARAMETERS; NOISE; RECALL; SPIKE TIMING DEPENDENT PLASTICITY; SPIKE WAVE;

EID: 84878778067     PISSN: 16625188     EISSN: None     Source Type: Journal    
DOI: 10.3389/fncom.2013.00080     Document Type: Article

References (65)

1. Adams, J. and Dudek, S. (2005). Late-phase long-term potentiation: getting to the nucleus. Nature Reviews Neuroscience, 6(9):737-743.
2. Andersen, P. (2007). The Hippocampus book. Oxford University Press, USA.
3. Arthur, J. V. (2006). Learning in silicon: A neuromorphic model of the hippocampus. PhD thesis, University of Pennsylvania.
4. Babadi, B. and Abbott, L. (2010). Intrinsic stability of temporally shifted spike-timing dependent plasticity. PLoS Computational Biology, 6(11):e1000961.
5. Berthouze, L. (2000). An episodic memory model using spiking neurons. In, 2000 IEEE International Conference on Systems, Man, and Cybernetics, volume 1, pages 86-91.
6. Bragin, A., Engel, J., Wilson, C. L., Fried, I. and Buzsaki, G. (1999). High-frequency oscillations in human brain. Hippocampus, 9(2), 137-142.
7. Buhry, L., Azizi, A. H., and Cheng, S. (2011). Reactivation, Replay and Preplay: How it Might All Fit Together. Neural Plasticity, Vol. 2011, Article ID 203462, doi:10.1155/2011/203462.
8. Buonomano, D. (2005). A learning rule for the emergence of stable dynamics and timing in recurrent networks. Journal of Neurophysiology, 94(4):2275-2283.
9. Buzsaki, G. (2006). Rhythms of the Brain. Oxford University Press.
10. Buzsaki, G., Horvat, Z., Urioste, R., Hetke, J., and Wise, K. (1992). High-frequency network oscillation in the hippocampus, Science, 256(5059), 1025-1027.
11. Caporale, N. and Dan, Y. (2008). Spike timing-dependent plasticity: a Hebbian learning rule. Annu. Rev. Neurosci., 31:25-46.
12. De Almeida, L., Idiart, M., and Lisman, J. (2007). Memory retrieval time and memory capacity of the CA3 network: role of gamma frequency oscillations. Learning & Memory, 14(11):795-806.
13. Deeg, K. (2009). Synapse-specific homeostatic mechanisms in the hippocampus. Journal of Neurophysiology, 101(2):503-506.
14. Diba, K. and Buzsaki, G. (2007). Forward and reverse hippocampal place-cell sequences during ripples. Nature Neuroscience, 10(10):1241.
15. Dragoi, G. and S. Tonegawa, S. (2010). Preplay of future place cell sequences by hippocampal cellular assemblies. Nature, 469, 397-401.
16. Euston, D., Tatsuno, M., and McNaughton, B. (2007). Fast-forward playback of recent memory sequences in prefrontal cortex during sleep. Science, 318(5853):1147-1150.
17. Foster, D. and Wilson, M. (2006). Reverse replay of behavioral sequences in hippocampal place cells during the awake state. Nature, 440(7084):680-683.
18. Gupta, A. S., van der Meer, M. A. A., Touretzky, D. S., and Redish, A. D. (2010). Hippocampal replay is not a simple function of experience, Neuron, 65(5), 695-705.
19. Gerstner, W. and Kistler, W. (2002). Spiking neuron models: Single neurons, populations, plasticity. Cambridge Univ Press.
20. Gold, A. and Kesner, R. (2005). The role of the ca3 subregion of the dorsal hippocampus in spatial pattern completion in the rat. Hippocampus, 15(6):808-814.
21. Graves, A., Liwicki, M., Ferna ndez, S., Bertolami, R., Bunke, H., and Schmidhuber, J. (2009). A novel connectionist system for unconstrained handwriting recognition. IEEE Trans. On Pattern Analysis and Machine Intelligence, 31(5):855-868.
22. Hasselmo, M., Schnell, E., and Barkai, E. (1995). Dynamics of learning and recall at excitatory recurrent synapses and cholinergic modulation in rat hippocampal region ca3. The Journal of Neuroscience, 15(7):5249-5262.
23. Hopfield, J. et al. (1995). Pattern recognition computation using action potential timing for stimulus representation. Nature, 376(6535):33-36.
24. Itskov, V., Curto, C., Pastalkova, E., and Buzsa ki, G. (2011). Cell assembly sequences arising from spike threshold adaptation keep track of time in the hippocampus. The Journal of Neuroscience, 31(8):2828-2834.
25. Izhikevich, E. (2003). Simple model of spiking neurons. Neural Networks, IEEE Transactions on Neural Networks, 14(6):1569-1572.
26. Izhikevich, E. (2007a). Dynamical systems in neuroscience: the geometry of excitability and bursting. The MIT Press.
27. Izhikevich, E. (2007b). Solving the distal reward problem through linkage of STDP and dopamine signaling. Cerebral Cortex, 17(10):2443-2452.
28. Izhikevich, E. (2010). Hybrid spiking models. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 368(1930):5061.
29. Ka li, S. and Dayan, P. (2000). The involvement of recurrent connections in area CA3 in establishing the properties of place fields: a model. The Journal of Neuroscience, 20(19):7463-7477.
30. Kesner, R. (2007). Behavioral functions of the CA3 subregion of the hippocampus. Learning & Memory, 14(11):771-781.
31. Kobayashi, K. and Poo, M. (2004). Spike train timing-dependent associative modification of hippocampal CA3 recurrent synapses by mossy fibers. Neuron, 41(3):445-454.
32. Leutgeb, J., Leutgeb, S., Moser, M., and Moser, E. (2007). Pattern separation in the dentate gyrus and ca3 of the hippocampus. Science, 315(5814):961.
33. Li, X., Ouyang, G., Usami, A., Ikegaya, Y., and Sik, A. (2010). Scale-free topology of the CA3 hippocampal network: a novel method to analyze functional neuronal assemblies. Biophysical journal, 98(9):1733-1741.
34. Lisman, J. and Redish, A. (2009). Prediction, sequences and the hippocampus. Philosophical Transactions of the Royal Society B: Biological Sciences, 364(1521):1193-1201.
35. Lisman, J., Talamini, L., and Raffone, A. (2005). Recall of memory sequences by interaction of the dentate and CA3: a revised model of the phase precession. Neural networks, 18(9):1191-1201.
36. Louie, K., and Wilson, M. A. (2001). Temporally structured replay of awake hippocampal ensemble activity during rapid eye movement sleep, Neuron, vol. 29(1), 145-156, 2001.
37. Malinow, R. and Malenka, R. C. (2002). AMPA receptor trafficking and synaptic plasticity. Annual Reviews in Neuroscience, 25:103-126.
38. Markram, H., Gerstner, W., and Sjostrom, P. (2012). Spike-timing-dependent plasticity: a comprehensive overview. Frontiers in Synaptic Neuroscience, 4.
39. Maurer, A. and McNaughton, B. (2007). Network and intrinsic cellular mechanisms underlying theta phase precession of hippocampal neurons. Trends in Neurosciences, 30(7), 325-333.
40. Nolan, C., Wyeth, G., Milford, M., and Wiles, J. (2011). The race to learn: spike timing and STDP can coordinate learning and recall in CA3. Hippocampus, 21(6), 647-660.
41. O'Brien, M. and Srinivasa, N. (2013). A spiking neural model for stable reinforcement of synapses based on multiple distal rewards. Neural Computation, 25, 123-156.
42. O'Keefe, J. and Recce, M. (1993). Phase relationship between hippocampal place units and the EEG theta rhythm. Hippocampus, 3(3), 317-330.
43. O'Neill, J., Senior, T. J., Allen, K., Huxter, J. R. and Csicsvari, J. (2008). Reactivation of experience-dependent cell assembly patterns in the hippocampus. Nature Neuroscience, 11(2), 209-215.
44. Pastalkova, E., Itskov, V., Amarasingham, A., and Buzsaki, G. (2008). Internally generated cell assembly sequences in the rat hippocampus. Science 321, 1322-1327.
45. Pavlides, C. and Winson, J. (1989). Influences of hippocampal place cell firing in the awake state on the activity of these cells during subsequent sleep episodes. Journal of Neuroscience, 9(8), 2907-2918.
46. Penley, S.C., Hinman, J.R., Sabolek, H.R., Escabi, M.A., Markus, E.J., and Chrobak, J.J. (2012). Theta and gamma coherence across the septotemporal axis during distinct behavioral states. Hippocampus 22, 1164-1175.
47. Penttonen, M., Kamondi, A., Acsady, L., and Buzsaki, G. (1998). Gamma frequency oscillation in the hippocampus of the rat: intracellular analysis in vivo. Eur. J. Neurosci. 10, 718-728.
48. Pfister, J. P. and Gerstner, W. (2006). Triplets of spikes in a model of spike timing-dependent plasticity. J Neuroscience, 26(38), 9673-9682.
49. Rasch, R. and Born, J. (2007). Maintaining memories by reactivation. Current Opinion in Neurobiology, 17(6), 698-703.
50. Rao, R. P. and Sejnowski, T. J. (2001). Predictive learning of temporal sequences in recurrent neocortical circuits. Novartis Found Symp, 239:208-229; discussion 229-40.
51. Renart, A., Song, P., and Wang, X. (2003). Robust spatial working memory through homeostatic synaptic scaling in heterogeneous cortical networks. Neuron, 38(3):473-485.
52. Rolls, E. (1990). Functions of neuronal networks in the hippocampus and of back projections in the cerebral cortex in memory. Brain Organization and Memory: Cells, Systems, and Circuits, pages 184-210.
53. Roweis, S. and Saul, L. (2000). Nonlinear dimensionality reduction by locally linear embedding. Science, 290(5500):2323-2326.
54. Sanchez, J., Mareci, T., Norman, W., Principe, J., Ditto, W., and Carney, P. (2006). Evolving into epilepsy: Multiscale electrophysiological analysis and imaging in an animal model. Experimental Neurology, 198(1), 31-47.
55. Skaggs, W.E., McNaughton, B.L., Wilson, M.A., and Barnes, C.A. (1996). Theta phase precession in hippocampal neuronal populations and the compression of temporal sequences. Hippocampus 6, 149-172.
56. Song, S., Miller, K. D., and Abbott, L. F. (2000). Competitive Hebbian learning through spike-timing-dependent synaptic plasticity. Nat Neurosci, 3(1097-6256):919-926.
57. Srinivasa, N., and Jiang, Q. (2013). Stable learning of functional maps using a self-organizing spiking neural networks with continuous synaptic plasticity. Front. Comput. Neurosci. 7:10. doi: 10.3389/fncom.2013.00010.
58. Treves, A. and Rolls, E. (1992). Computational constraints suggest the need for two distinct input systems to the hippocampal CA3 network. Hippocampus, 2(2):189-199.
59. Turrigiano, G. (2011). Too many cooks? intrinsic and synaptic homeostatic mechanisms in cortical circuit refinement. Annual Review of Neuroscience, 34:89-103.
60. Turrigiano, G. and Nelson, S. (2004a). Homeostatic plasticity in the developing nervous system. Nature Reviews Neuroscience, 5(2):97-107.
61. Van Rossum, M., Bi, G., and Turrigiano, G. (2000). Stable Hebbian learning from spike timing-dependent plasticity. The Journal of Neuroscience, 20(23):8812.
62. Wagenaar, D. A., Pine, J., and Potter, S. M. (2006). An extremely rich repertoire of bursting patterns during the development of cortical cultures. BMC Neuroscience, 7(11).
63. Wilson, M. A. and McNaughton, B. L. (1994). Reactivation of hippocampal ensemble memories during sleep. Science, 265(5172), 676-679.
64. Yassa, M. and Stark, C. (2011). Pattern separation in the hippocampus. Trends in Neurosciences, 34(10), 515-525.
65. Zhang, H., Lin, S.C., and Nicolelis, M.A. (2011). A distinctive subpopulation of medial septal slow-firing neurons promote hippocampal activation and theta oscillations. J. Neurophysiol. 106, 2749-2763.