Storage of phase-coded patterns via STDP in fully-connected and sparse network: A study of the network capacity

Frontiers in Synaptic Neuroscience

Volumn , Issue AUG, 2010, Pages 1-12

  Scarpetta, Silvia ^a,b   de Candia, Antonio ^b,c,d   Giacco, Ferdinando ^a,b  

^a UNIVERSITY OF SALERNO   (Italy)

^b INFN SEZIONE DI NAPOLI   (Italy)

^c UNIVERSITY OF NAPLES FEDERICO II   (Italy)

^d CNR SPIN   (Italy)

Author keywords

Associative memory; Phase coding; Replay; STDP; Storage capacity

Indexed keywords

ARTICLE; ASSOCIATIVE MEMORY; BRAIN NERVE CELL; LEARNING; NERVE CELL NETWORK; NERVE CELL PLASTICITY; OSCILLATION; POSTSYNAPTIC POTENTIAL; PRESYNAPTIC POTENTIAL; SPIKE TIME DEPENDENT PLASTICITY;

EID: 80052989624     PISSN: None     EISSN: 16633563     Source Type: Journal    
DOI: 10.3389/fnsyn.2010.00032     Document Type: Article

References (74)

1. Abarbanel, H., Huerta, R., and Rabinovich, M. I. (2002) Dynamical model of longterm synaptic plasticity. Proc. Natl. Acad. Sci. 99, 10132-10137.
2. Achacoso, T. B., and Yamamoto, W. S. (1991). AY's Neuroanatomy of C. elegans for Computation. Boca Raton: CRC Press.
3. Barabái, A. L., and Albert, R. (1999). Emergence of scaling in random networks. Science 286, 509-512.
4. Bi, G. Q., and Poo, M. M. (1998). Precise spike timing determines the direction and extent of synaptic modifications in cultured hippocampal neurons. J. Neurosci. 18, 10464-10472.
5. Bi, G. Q., and Poo, M. M. (2001). Synaptic modification by correlated activity: Hebb's postulate revisited. Ann. Rev. Neurosci. 24, 139-166.
6. Borisyuk, R. M., and Hoppensteadt, F. C. (1999). Oscillatory models of the hippocampus: a study of spatio-temporal patterns of neural activity. Biol. Cybern. 81, 359-371.
7. Bullmore, E., and Sporns, O. (2009). Complex brain networks: graph theoretical analysis of structural and functional systems. Nat. Rev. Neurosci. 10, 186-198.
8. Buzsaki, G., and Draguhn, A. (2004). Neuronal oscillations in cortical networks. Science 304, 1926-1929.
9. David, R. E., Masami, T., and McNaughton, B. L. (2007). Sequences in prefrontal cortex during sleep fast-forward playback of recent memory. Science 318, 1147-1150.
10. Davidson, T. J., Kloosterman, F., and Wilson, M. A. (2009). Hippocampal replay of extended experience. Neuron 63, 497-507.
11. de Arcangelis, L., and Herrmann, H. J. (2010). Learning as a phenomenon occurring in a critical state. PNAS 107, 3977-3981.
12. Debanne, D., Gahwiler, B. H., and Thompson, S. M. (1998). Long-term synaptic plasticity between pairs of individual CA3 pyramidal cells in rat hippocampal slice cultures. J. Physiol. 507, 237-247.
13. Diba, K., and Buzsaki, G. (2007). Forward and reverse hippocampal placecell sequences during ripples. Nat. Neurosci. 10, 1241-1242.
14. Drew, P. J., and Abbott, L. F. (2006). Extending the effects of spike-timingdependent plasticity to behavioral timescales. Proc. Natl. Acad. Sci. 103, 8876-8881.
15. Eguüzuz, V. M., Chialvo, D. R., Cecchi, G. A., Baliki, M., and Apkarian, A. V. (2005). Scale-free brain functional networks. Phys. Rev. Lett. 94, 018102.
16. Düzel, E., Penny, W. D., and Burgess, N. (2010). Brain oscillations and memory. Curr. Opin. Neurobiol. 20, 143-149.
17. Feldman, D. E. (2000). Timing-based LTP and LTD and vertical inputs to layer II/III pyramidal cells in rat barrel cortex. Neuron 27, 45-56.
18. Florian, R. V., and Muresan, R. C. (2006). Phase precession and recession with STDP and anti-STDP. Lect. Notes Comp. Sci. 4131, 718-727.
19. Foster, D. J., and Wilson, M. A. (2006). Reverse replay of behavioral sequences in hippocampal place cells during the awake state. Nature 440, 680-683.
20. Fries, N. (2005). A mechanism for cognitive dynamics: neuronal communication through neuronal coherence. Trend Cogn. Sci. 9, 474-480.
21. Fries, N., Nikolić, D., and Singer, W. (2007). The gamma cycle. Trends Neurosci. 30, 309-316.
22. Froemke, R. C., and Dan, Y. (2002). Spiketiming-dependent synaptic modification induced by natural spike trains. Nature 416, 433-438.
23. Gelperin, A. (2006). Olfactory computations and network oscillation. J. Neurosci. 26, 1663-1668.
24. Gerstner, W., and Kistler, W. (2002). Spiking Neuron Models: Single Neurons, Populations, Plasticity. New York, NY: Cambridge University Press.
25. Gerstner, W., Kempter, R., van Hemmen, L., and Wagner, H. (1996). A neuronal learning rule for sub-millisecond temporal coding. Nature 383, 76-78.
26. Gerstner, W., Ritz, R., and van Hemmen, J. L. (1993). Why spikes? Hebbian learning and retrieval of time-resolved excitation patterns. Biol. Cybern. 69, 503-515.
27. Hasselmo, M. E. (1993). Acetylcholine and learning in a cortical associative memory. Neural Comput. 5, 32-44.
28. Hasselmo, M. E. (1999). Neuromodulation: acetylcholine and memory consolidation. Trends Cogn. Sci. 3, 351.
29. Hasselmo, M. E. (2008). Temporally structured replay of neural activity in a model of entorhinal cortex, hippocampus and postsubiculum. Eur. J. Neurosci. 28, 1301-1315.
30. Hellwig, B. (2000). A quantitative analysis of the local connectivity between pyramidal neurons in layers 2/3 of the rat visual cortex. Biol. Cybern. 82, 111-121.
31. Huhn, Z., Orbán, G., Érdi, P., and Lengyel, M. (2005) Theta oscillation-coupled dendritic spiking integrates inputs on a long time scale. Hippocampus 15, 950-962.
32. Huxter, J., Burgess, N., and O'Keefe, J. (2003). Independent rate and temporalcoding in hippocampal pyramidal cells. Nature 425, 828-832.
33. Jin, D. Z. (2002). Fast convergence of spike sequences to periodic patterns in recurrent networks. Phys. Rev. Lett. 89, 208102.
34. Kayser, C., Montemurro, M. A., Logothetis, N. K., and Panzeri, S. (2009). Spikephase coding boosts and stabilizes information carried by spatial and temporal spike patterns. Neuron 61, 597-608.
35. Kempter, R., Gerstner, W., and van Hemmen, L. (1999). Hebbian learning and spiking neurons. Phys. Rev. E 59, 4498-4514.
36. König, P., Engel, A. K., Roelfsema, P. R., and Singer, W. (1995). How precise is neuronal synchronization? Neural Comput. 7, 469-485.
37. Latham, P. E., and Lengyel, M. (2008). Phase coding: spikes get a boost from local fields. Curr. Biol. 18, R349-R351.
38. Laurent, G. (2002). Olfactory network dynamics and the coding of multidimensional signals. Nat. Rev. Neurosci. 3, 884-895.
39. Lee, A. K., and Wilson, M. A. (2002). Memory of sequential experience in the hippocampus during slow wave sleep. Neuron 36, 1183-1194.
40. Leibold, C., Gundlfinger, A., Schmidt, R., Thurley, K., Schmitz, D., and Kempter, R. (2008). Temporal compression mediated by short-term synaptic plasticity. Proc. Natl. Acad. Sci. U.S.A. 105, 11, 4417-4422.
41. Lengyel, M., and Dayan, P. (2007). "Uncertainty, phase and oscillatory hippocampal recall," in Advances in Neural Information Processing Systems 19 eds D. Schölkopf et al. (Cambridge, MA: MIT Press), 833-840.
42. Lengyel, M., Huhn, Z., and Érdi, P. (2005a). Computational theories on the function of theta oscillations. Biol. Cybern. 92, 393-408.
43. Lengyel, M., Kwag, J., Paulsen, O., and Dayan, P. (2005b). Matching storage and recall: hippocampal spike timing-dependent plasticity and phase response curves. Nat. Neurosci. 8, 1677-1683.
44. Magee, J. C., and Johnston, D. (1997). A synaptically controlled associativesignal for Hebbian plasticity in hippocampal neurons. Science 275, 209-212.
45. Markram, H., Lubke, J., Frotscher, M., and Sakmann, B. (1997). Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science, 275, 213-215.
46. Masquelier, T., Guyonneau, R., and Thorpe, S. J. (2009). Competitive STDP-based spike pattern learning. Neural Comput. 21, 1259-1276.
47. Mehta, M. R., Lee, A. K., and Wilson, M. A. (2002). Role of experience and oscillations in transforming a rate code into a temporal code. Nature 417, 741-746.
48. Memmesheimer, R.-M., and Timme, M. (2006a). Designing the dynamics of spiking neural networks. Phys. Rev. Lett. 97, 188101.
49. Memmesheimer, R.-M., and Timme, M. (2006b). Designing complex networks. Physica D 224, 182-201.
50. O'Keefe, J., and Recce, M. L. (1993). Phase relationship between hippocampal place units and the EEG theta rhythm. Hippocampus 3, 317-330.
51. Pajevic, S., and Plenz, D. (2009). Efficient network reconstruction from dynamical cascades identifies small-world topology of neuronal avalanches. PLoS Comput. Biol. 5, e1000271. doi:10.1371/journal.pcbi.1000271.
52. Pellegrini, G. L., de Arcangelis, L., Herrmann, H. J., and Perrone-Capano, C. (2007) Activity-dependent neural network model on scale-free networks Phys. Rev. E. 76, 016107.
53. Rao, R. P., and Sejnowski, T. J. (2001). Spike-timing-dependent Hebbian plasticity as temporal difference learning. Neural Comput. 13, 2221-2237.
54. Scarpetta, S., and Marinaro, M. (2005). A learning rule for place fields in a cortical model: theta phase precession as a network effect. Hippocampus 15, 979-989.
55. Scarpetta, S., Yoshioka, M., and Marinaro, M. (2008). Encoding and replay of dynamic attractors with multiple frequencies. Lect. Notes Comp. Sci. 5286, 38-61.
56. Scarpetta, S., Zhaoping, L., and Hertz, J. (2001). "Spike-timing-dependent learning for oscillatory networks, in NIPS, Vol. 13, eds T. Leen, T. Dietterich and V. Tresp (Cambridge, MA: MIT Press), 152-165.
57. Scarpetta, S., Zhaoping, L., and Hertz, J. (2002a). Hebbian imprinting and retrieval in oscillatory neural networks. Neural Comput. 14, 2371-2396.
58. Scarpetta, S., Zhaoping, L., and Hertz, J. (2002b). "Learning in an oscillatory cortical model," in Scaling and Disordered Systems, eds F. Family, M. Daoud, H. Herrmann and E. H. Stanley (Singapore: World Scientific Publishing), 292.
59. Siegel, M., Warden, M. R., and Miller, E. K. (2009). Phase-dependent neuronal coding of objects in short-term memory. PNAS 106, 21341-21346.
60. Singer, W. (1999). Neuronal synchrony: a versatile code for the definition of relations. Neuron 24, 49-65.
61. Sjostrom, P. J., Turrigiano, G., and Nelson, S. B. (2001). Rate, timing, and cooperativity jointly determine cortical synaptic plasticity. Neuron 32, 1149-1164.
62. Song, S., Miller, K. D., and Abbott, L. F. (2000). Competitive Hebbian learning through spike-timing-dependent synaptic plasticity. Nat. Neurosci. 3, 919-926.
63. Sporns, O., Chialvo, D., Kaiser, M., and Hilgetag, C. C. (2004). Organization, development and function of complex brain networks. Trends Cogn. Sci. 8, 418-425.
64. Sporns, O., and Zwi, J. D. (2004). The small world of the cerebral cortex. Neuroinformatics 2, 145-162.
65. Thurley, K., Leibold, C., Gundlfinger, A., Schmitz, D., and Kempter, R. (2008). Phase precession through synaptic facilitation. Neural Comput. 20, 1285-1324.
66. Treves, A. (1990). Graded-response neurons and information encodings in autoassociative memories. Phys. Rev. A 42, 2418.
67. Watts, D. J., and Strogatz, S. H. (1998). Collective dynamics of "small-world" networks. Nature 393, 440-442.
68. White, J. G., Southgate, E., Thomson, J. N., and Brenner, S. (1986). The structure of the nervous system of the nematode Caenorhabditis elegans. Philos. Trans. R. Soc. Lond. B Biol. Sci. 314, 1-340.
69. Wills, T., Lever, C., Cacucci, F., Burgess, N., and O'Keefe, J. (2005). Attractor dynamics in the hippocampal representation of the local environment. Science 308, 873-876.
70. Wittenberg, G. M., and Wang, S.-H. (2006). Malleability of spiketiming-dependent plasticity at the CA3-CA1 synapse. J. Neurosci. 26, 6610-6617.
71. Wu, Z., and Yamaguchi, Y. (2010). Independence of the unimodal tuning of firing rate from theta phase precession in hippocampal place cells. Biol. Cybern. 102, 95-107.
72. Yoshioka, M. (2009). Learning of spatiotemporal patterns in ising-spin neural networks: analysis of storage capacity by path integral methods. Phys. Rev. Lett. 102, 158102.
73. Yoshioka, M., Scarpetta, S., and Marinaro, M. (2007). Spatiotemporal learning in analog neural networks using spiketiming-dependent synaptic plasticity. Phys. Rev. E 75, 051917.
74. Yu, S., Huang, D., Singer, W., and Nikolić, D. (2008). A small world of neuronal synchrony. Cerebral Cortex 18, 2891-2901.