Nearly extensive sequential memory lifetime achieved by coupled nonlinear neurons

Neural Computation

Volumn 24, Issue 10, 2012, Pages 2678-2699

  Toyoizumi, Taro ^a  

^a RIKEN BRAIN SCIENCE INSTITUTE   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; COMPUTER SIMULATION; HUMAN; MEMORY; NONLINEAR SYSTEM; PHYSIOLOGY;

COMPUTER SIMULATION; HUMANS; MEMORY; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER); NONLINEAR DYNAMICS;

EID: 84872686301     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/NECO_a_00324     Document Type: Article

References (47)

1. Abeles, M. (1982). Local cortical circuits: An electrophysiological study. Berlin: Springer.
2. Abeles, M. (1991). Corticonics. Cambridge: Cambridge University Press.
3. Aertsen, A., Diesmann, M., & Gewaltig, M.-O. (1996). Propagation of synchronous spiking activity in feedforward neural networks. Journal of Physiology-Paris, 90(3-4), 243-247.
4. Baddeley, A. (2000). The episodic buffer: A new component of working memory? Trends in Cognitive Sciences, 4(11),417-423.
5. Baeg, E. H., Kim, Y. B., Huh, K., Mook-Jung, I., Kim, H. T., & Jung, M.W. (2003). Dynamics of population code for working memory in the prefrontal cortex. Neuron, 40(1), 177-188.
6. Bertschinger, N., & Natschl, T. (2004). Real-time computation at the edge of chaos in recurrent neural networks. Neural Computation, 1436, 1413-1436.
7. Bick, C., & Rabinovich, M. I. (2009).Dynamical origin of the effective storage capacity in the brain working memory. Physical Review Letters, 102(21): 218101.
8. Bienenstock, E. (1995). Amodel of neocortex. Network: Computation in Neural Systems, 6(2), 179-224.
9. Büsing, L., Schrauwen, B., & Legenstein, R. (2010). Connectivity, dynamics, and memory in reservoir computing with binary and analog neurons. Neural Computation, 22(5), 1272-1311.
10. Camperi, M., & Wang, X.-J. (1998). A model of visuospatial working memory in prefrontal cortex: Recurrent network and cellular bistability. Journal of Computational Neuroscience, 5(4), 383-405.
11. Dayan, P., & Abbott, L. F. (2001). Theoretical neuroscience. Cambridge, MA: MIT Press.
12. de Fockert, J. W., Rees, G., Frith, C. D., & Lavie, N. (2001). The role of working memory in visual selective attention. Science, 291(5509), 1803-1806.
13. Diesmann, M., Gewaltig, M.-O., & Aertsen, A. (1999). Stable propagation of synchronous spiking in cortical neural networks. Nature, 402(6761), 529-533.
14. Fuster, J. M. (1973). Unit activity in prefrontal cortex during delayed-response performance: Neuronal correlates of transient memory. Journal of Neurophysiology, 36(1), 61-78.
15. Ganguli, S., Huh, D.,& Sompolinsky, H. (2008).Memory traces in dynamical systems. Proceedings of the National Academy of Sciences, 105(48), 18970-18975.
16. Ganguli, S., & Sompolinsky, H. (2010). Short-term memory in neuronal networks through dynamical compressed sensing. In J. Lafferty, C. Williams, J. Shawe-Taylor, R. Zemel, & A. Culotta (Eds.), Advances in neural information processing systems, 23 (pp. 667-675). Red Hook, NY: Curran.
17. Goldman, M. S. (2009).Memorywithout feedback in a neural network. Neuron, 61(4), 621-634.
18. Goldman, M. S., Levine, J. H., Major, G., Tank, D. W., & Seung, H. S. (2003). Robust persistent neural activity in a model integrator with multiple hysteretic dendrites per neuron. Cerebral Cortex, 13(11), 1185-1195.
19. Goldman-Rakic, P. S. (1995). Cellular basis of working memory. Neuron, 14(3), 477-485.
20. Hahnloser, R.H.R., Kozhevnikov, A. A., & Fee, M. S. (2002). An ultra-sparse code underlies the generation of neural sequences in a songbird. Nature, 797(1989),796-797.
21. Herrmann, M., Hertz, J. A., & Prügel-Bennett, A. (1995). Analysis of synfire chains. Network: Computation in Neural Systems, 6(3), 403-414.
22. Hopfield, J. J. (1982). Neural networks and physical systemswith emergent collective computational abilities. Proceedings of the National Academy of Sciences of the United States of America, 79(8), 2554-2558.
23. Ikegaya, Y., Aaron, G., Cossart, R., Aronov, D., Lampl, I., Ferster, D., & Yuste, R. (2004). Synfire chains and cortical songs: Temporal modules of cortical activity. Science, 304(5670), 559-564.
24. Jaeger, H., & Haas, H. (2004). Harnessing nonlinearity: Predicting chaotic systems and saving energy in wireless communication. Science, 304(5667), 78-80.
25. Ji, D., & Wilson, M. A. (2007). Coordinated memory replay in the visual cortex and hippocampus during sleep. Nature Neuroscience, 10(1), 100-107.
26. Jin, D. Z., Ramazanoglu, F. M., & Seung, H. S. (2007). Intrinsic bursting enhances the robustness of a neural network model of sequence generation by avian brain area HVC. Journal of Computational Neuroscience, 23, 283-289.
27. Kleinfeld, D. (1986). Sequential state generation by model neural networks. Proceedings of the National Academy of Sciences of the United States of America, 83, 9469-9473.
28. Koulakov, A. A. (2001). Properties of synaptic transmission and the global stability of delayed activity states. Network: Computation in Neural Systems, 12, 47-74.
29. Kumar, A., Rotter, S., & Aertsen, A. (2008). Conditions for propagating synchronous spiking and asynchronous firing rates in a cortical network model. Journal of Neuroscience, 28(20), 5268-5280.
30. Lazar, A., Pipa, G., & Triesch, J. (2009). SORN: A self-organizing recurrent neural network. Frontiers in Computational Neuroscience, 3(23). doi:10.3389/neuro.10.023.2009.
31. Lim, S., & Goldman, M. S. (2011). Noise tolerance of attractor and feedforward memory models. Neural Computation, 24(2), 332-390.
32. Lisman, J. E., Fellous, J.-M.,& Wang, X.-J. (1998).Arole forNMDA-receptor channels in working memory. Nature Neuroscience, 1(4), 273-275.
33. Long, M. A., Jin, D. Z., & Fee, M. S. (2010). Support for a synaptic chain model of neuronal sequence generation. Nature, 468(7322), 394-399.
34. Maass, W., Natschläger, T., & Markram, H. (2002). Real-time computing without stable states: A new framework for neural computation based on perturbations. Neural Computation, 14(11), 2531-2560.
35. Münte, T. F., Schiltz, K., & Kutas, M. (1998). When temporal terms belie conceptual order. Nature, 395(6697), 71-72.
36. Orlov, T., Yakovlev, V., Hochstein, S., & Zohary, E. (2000). Macaque monkeys categorize images by their ordinal number. Nature, 404(6773), 77-80.
37. Pastalkova, E., Itskov, V., Amarasingham, A., & Buzsáki, G. (2008). Internally generated cell assembly sequences in the rat hippocampus. Science, 321(5894), 1322-1327.
38. Risken, H. (1996). The Fokker-Planck equation (3rd ed.). Berlin: Springer-Verlag.
39. Seliger, P., Tsimring, L. S., & Rabinovich, M. I. (2003). Dynamics-based sequential memory:Winnerless competition of patterns. Physical Review E, 67(1), 1-4.
40. Sompolinsky, H., & Kanter, I. (1986). Temporal association in asymmetric neural network. Physical Review Letters, 57(22), 2861-2864.
41. Sussillo, D., & Abbott, L. F. (2009). Article generating coherent patterns of activity from chaotic neural networks. Neuron, 63(4), 544-557.
42. Takahashi, N., Sasaki, T., Matsumoto, W., Matsuki, N., & Ikegaya, Y. (2010). Circuit topology for synchronizing neurons in spontaneously active networks. Proceedings of the National Academy of Sciences of the United States of America, 107(22), 10244-10249.
43. Tetzlaff, T., Geisel, T., & Diesmann, M. (2002). The ground state of cortical feedforward networks. Neurocomputing, 44, 673-678.
44. Toyoizumi, T., & Abbott, L. F. (2011). Beyond the edge of chaos: Amplification and temporal integration by recurrent networks in the chaotic regime. Physical Review E, 84: 051908.
45. van Rossum, M. C.W., Turrigiano, G. G., & Nelson, S. B. (2002). Fast propagation of firing rates through layered networks of noisy neurons. Journal of Neuroscience, 22(5), 1956-1966.
46. Vogels, T., & Abbott, L. F. (2005). Signal propagation and logic gating in networks of integrate-and-fire neurons. Journal of Neuroscience, 25(46), 10786-10795.
47. White, O. L., Lee, D. D.,& Sompolinsky, H. (2004). Short-termmemory in orthogonal neural networks. Physical Review Letters, 92(14), 148102.