Latent attractors: A general paradigm for context-dependent neural computation

Studies in Computational Intelligence

Volumn 35, Issue , 2006, Pages 135-169

  Doboli, Simona ^a   Minai, Ali A ^b  

^a HOFSTRA UNIVERSITY   (United States)

^b University of Cincinnati   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 33750968805     PISSN: 1860949X     EISSN: None     Source Type: Book Series    
DOI: 10.1007/978-3-540-36122-0_6     Document Type: Article

References (84)

1. S. Amari and K. Maginu. Statistical neurodynamics of associative memory. Neural Networks, 1:63-73, 1988.
2. D.J. Amit. Modeling brain function: The world of attractor neural networks. Cambridge University Press, 1989.
3. A. Babloyantz and A. Desthexhe. Low-dimensional chaos in an instance of epilepsy. Proceedings of the National Academy of Sciences USA, 83:3513-3517, 1986.
4. Y. Bengio, P. Simard, and P. Frasconi. Learning long-term dependencies with gradient descent is difficult. IEEE Transactions on Neural Networks, Vol. 5, No. 2:157-166, 1994.
5. M. Botvinick and D.C. Plaut. Doing without schema hierarchies: A recurrent connectionist approach to normal and impaired routine sequential action. Psychological Review, 111:395-429, 2004.
6. N. Burgess. Neuronal computations underlying the firing of place cells and their role in navigation. Hippocampus, 6:749-762, 1996.
7. S.B. Carroll. Endless forms: The evolution of gene regulation and morphological diversity. Cell, 101:577-580, 2000.
8. C. Cortes, A. Krogh, and J.A Hertz. Hierarchical associative memories. Journal of Physics A, 20:4449-4455, 1987.
9. S. Doboli and A.A Minai. Progressive attractor selection in latent attractor networks. In Proceedings of IJCNN'01, Washington, D.C., USA, 2001.
10. S. Doboli and A.A Minai. Latent attractor selection in the presence of irrelevant stimuli. In Proceedings of the 2002 World Congress on Computational Intelligence, Hawaii, USA, 2002.
11. S. Doboli and A.A Minai. Latent attractor selection for variable length episodic context stimuli with distractors. In Proceedings of IJCNN'2003, Portland, OR, USA, 2003.
12. S. Doboli and A.A Minai. Network capacity analysis for latent attractor computation. Network: Computation in Neural Systems, 14:273-302, 2003.
13. S. Doboli and A.A Minai. Using latent attractors to discern temporal order. In Proceedings of IJCNN'04, Budapest, Hungary, 2004.
14. S. Doboli, A.A. Minai, and P.J. Best. A comparison of context-dependent hippocampal place codes in 1-layer and 2-layer recurrent neural networks. In Proceedings of the 1999 Computational Neuroscience Conference (CNS'99), 1999.
15. S. Doboli, A.A. Minai, and P.J. Best. Generating smooth context-dependent representations. In Proceedings of IJCNN'99, Washington D.C., 1999.
16. S. Doboli, A.A. Minai, and P.J. Best. A latent attractors model of context selection in the dentate gyrus-hilus system. Neurocomputing, 26-27:671-676, 1999.
17. S. Doboli, A.A. Minai, and P.J. Best. Latent attractors: A model for context-dependence place representations in the hippocampus. Neural Computation, 12(5):1009-1043, 2000.
18. D.R.C. Dominguez. Information capacity of a hierarchical neural network. Physical Review E, 58:4811-4815, 1998.
19. V.S. Dostenko. Hierarchical model of memory. Physica A, 140:410-415, 1986.
20. J. Duncan. An adaptive coding model pf neural function in prefrontal cortex. Nature Reviews, 1:59-65, 2000.
21. G.M. Edelman. Neural Darwinism: The theory of neuronal group selection. Basic Books, 1987.
22. J.L. Elman. Finding structure in time. Cognitive Science, 14:179-211, 1990.
23. P. Frasconi and M. Gori. Computational capabilities of local-feedback recurrent networks acting as finite-state machines. IEEE Transactions on Neural Networks, Vol. 7, No. 6:1521-1525, 1996.
24. P. Frasconi, M. Gori, and G. Soda. Local feedback multilayered metworks. Neural Computation, 4:120-130, 1992.
25. W.J. Freeman. Tutorial on neurobuiology: From single neurons to brain chaos. International Journal of Bifurcation and Chaos, 2:451-482, 1992.
26. J.J. Gibson. The ecological approach to visual perception. Houghton Mifflin, 1979.
27. C.L. Giles, C.B. Miller, D. Chen, H.H. Chen, G.Z. Sun, and Y.C. Lee. Learning and extracting finite state automata with second-order recurrent neural networks. Neural Computation, 4:393-405, 1992.
28. H. Haken, J.A.S. Kelso, and H. Bunz. A theoretical model of phase transition in human hand movement. Biological Cybernetics, 51:347-356, 1985.
29. Z.-S. Han, E.H. Buhl, Z. Lörinczi, and P. Somogyi. A high degree of spatial selectivity in the axonal and dendritic domains of physiologically identified local-circuit neurons in the dentate gyrus of the rat hippocampus. European Journal of Neuroscience, 5:395-410, 1993.
30. M.E. Hasselmo, E. Schnell, and E. Barkai. Dynamics of learning and recall at excitatory recurrent synapses and cholinergic modulation in hippocampal region CA3. Journal of Neuroscience, 15:5249-5262, 1995.
31. S. Hochreiter and J. Schmidhuber. Long short-term memory. Neural Computation, 9(8):1735-1780, 1997.
32. J.J. Hopfield. Neural networks and physical systems with emergent collective computational abilities. Proceedings of the National Academy of Sciences USA, 79:2554-2558, 1982.
33. J.J. Hopfield. Neurons with graded response have collective computationasl properties like those of two-state neurons. Proceedings of the National Academy of Sciences USA, 81:3088-3092, 1984.
34. M.B. Jackson and H.E. Scharfman. Positive feedback from hilar mossy cells to granule cells in the dentate gyrus revealed by voltage-sensitive dye and microelectrode recording. Journal of Neurophysiology, 76:601-616, 1996.
35. M.I. Jordan. Attractor dynamics and parallelism in a connectionist sequential machine. In Proc. 8th Conference of the Cognitive Science Society, pages 531-546. Lawrence Elbaum, 1986.
36. S.A. Kauffman. The Origins of Order. Oxford University Press, 1993.
37. J.A.S. Kelso. Dynamic patterns: The self-organization of brain and behavior. MIT Press, 1995.
38. B. Kosko. Bidirectional associative memories. IEEE Transactions on Systems, Man, and Cybernetics, 18:49-60, 1988.
39. R. Kozma and W.J. Freeman. Chaotic resonance - methods and applications for robust classification of noisy and variable patterns. International Journal of Bifurcation and Chaos, 11:1607-1629, 2001.
40. W.B. Levy. A computational approach to hippocampal function. In R.D. Hawkins and G.H. Bower, editors, Computational Models of Learning in Simple Neural Systems, pages 243-305. Academic Press, San Diego, CA, 1989.
41. W.B. Levy. A sequence predicting CA3 is a flexible associator that learns and uses context to solve hippocampal-like tasks. Hippocampus, 6:579-591, 1996.
42. W.B. Levy and X. Wu. The relationship of local context cues to sequence length memory capacity. Network, 7:371-384, 1996.
43. W.E. Lillo, D.C. Miller, S. Hui, and S.H. Zak. Synthesis of brain-state-in-a-box (bsb) based associative memories. IEEE Transactions on Neural Networks, 5:730-737, 1994.
44. J.E. Lisman. Relating hippocampal circuitry to function: The role of reciprocal dentate-CA3 interaction in the recall of sequences. Neuron, 22:233-242, 1999.
45. E.J. Markus, Y.-L. Qin, B. Leonard, W.E. Skaggs, B.L. McNaughton, and C.A. Barnes. Interactions between location and task affect the spatial and directional firing of hippocampal neurons. Journal of Neuroscience, 15:7079-7094, 1995.
46. D. Marr. Simple memory: A theory for archicortex. Philosophical Transactions of the Royal Society of London B, 262:23-81, 1971.
47. M. R. Mehta. Cooperative ltp can map memory sequences on dendritic branches. Trends in Neurosciences, 27(2):69-72, 2004.
48. E.K. Miller. The prefrontal cortex and cognitive control. Nature Reviews, 2:820-829, 2001.
49. A.A. Minai, G.L. Barrows, and W.B. Levy. Disambiguation of pattern sequences with recurrent networks. In Proceedings of the 1994 World Congress on Neural Networks, San Diego, CA, volume IV, pages 176-180, 1994.
50. A.A. Minai and P.J. Best. Encoding spatial context: A hypothesis on the function of the dentate gyrus-hilus system. In Proceedings of the 1998 International Joint Conference on Neural Networks, Anchorage, AK, pages 587-592, 1998.
51. E.I. Moser. Altered inhibition of dentate granule cells during spatial learning in an exploration task. Journal of Neuroscience, 16:1247-1259, 1996.
52. M.C. Mozer. A focused backpropagation algorithm for temporal pattern recognition. Complex Systems, 3:349-381, 1989.
53. M.C. Mozer. Induction of multiscale temporal structure. Advances in Neural Information Processing Systems 4, pages 275-282, 1992.
54. D. O'Kane and D. Sherrington. A feature retrieving attractor neural network. Journal of Physics A, 26:2333-2342, 1993.
55. D. O'Kane and A. Treves. Short- and long-range connections in autoassociative memory. Journal of Physics A, 25:5055-5069, 1992.
56. J. O'Keefe and L. Nadel. The Hippocampus as a Cognitive Map. Clarendon Press, Oxford, UK, 1978.
57. R.C O'Reilly and M.J. Frank. Making working memory work: A computational model of learning in the prefrontal cortex and basal ganglia. Neural Computation, 18(2):283-328, 2005.
58. B.A. Pearlmutter. Learning state space trajectories in recurrent neural networks. Neural Computation, 1:263-269, 1989.
59. M.A. Pires Idiart and A. Theumann. Retrieval properties of neural networks with hierarchical clustering. Journal of Physics A, 24:L649-L658, 1991.
60. G.J. Quirk, R.U. Muller, and J.L. Kubie. The firing of hippocampal place cells in the dark depends on the rat's recent experience. Journal of Neuroscience, 10:2008-2017, 1990.
61. A.D. Redish. Beyond the Cognitive Map: Contributions to a Computational Neuroscience Theory of Rodent Navigation. PhD thesis, Carnegie-Mellon University, 1997.
62. A.D. Redish and D.S. Touretzky. Cognitive maps beyond the hippocampus. Hippocampus, 7:15-35, 1997.
63. M. Reiss and J.G. Taylor. Storing temporal sequences. Neural Networks, 4:773-787, 1991.
64. M.A. Riley and M.T. Turvey. Variability and determinism in motor behavior. Journal of Motor Behavior, 34:99-125, 2002.
65. E.T. Rolls. The representation and storage of information in neuronal networks in the primate cerebral cortex and hippocampus. In R. Durbin, C. Miall, and G. Mitchison, editors, The Computing Neuron, pages 125-159. Addison-Wesley, Reading, MA, 1989.
66. A. Rotenberg and R.U. Muller. Variable place-cell coupling to a continuously viewed stimulus: Evidence that the hippocampus acts as a perceptual system. Philosophical Transactions of the Royal Society of London B, 352:1505-1513, 1997.
67. N.P. Rougier, D.C. Noelle, T.S. Braver, J.D. Cohen, and R.C. O'Reilly. Prefrontal cortex and flexible cognitive control: Rules without symbols. Proceedings of the National Academy of Sciences USA, 102:7338-7343, 2005.
68. N.P. Rougier and R.C. O'Reilly. Learning representations in a gated prefrontal cortex model of dynamic task switching. Cognitive Science, 26:503-520, 2002.
69. A. Samsonovich and B.L. McNaughton. Path integration and cognitive mapping in a continuous attractor neural network model. Journal of Neuroscience, 17:5900-5920, 1997.
70. J. Schmidhuber. Learning to control fast-weight memories: An alternative to dynamic recurrent networks. Neural Computation, 4:131-139, 1992.
71. D. Servan-Schreiber, A. Cleereman, and J.L. McClelland. Learning sequential structure in simple recurrent networks. Advances in Neural Information Processing Systems 1, pages 643-652, 1989.
72. I. Shmulevich, E.R. Dougherty, and W. Zhang. From boolean to probabilistic boolean networks as models of genetic regularoty networks. Proceedings of the IEEE, 90:1778-1792, 2002.
73. W.E. Skaggs and B.L. McNaughton. Replay of neuronal firing sequences in rat hippocampus during sleep following spatial experience. Science, 271:1870-1873, 1996.
74. B modulation improves sequence disambiguation in computational models of hippocampal region CA3. Hippocampus, 8:171-193, 1998.
75. H. Sompolinsky and I. Kanter. Temporal association in asymmetric neural networks. Physical Review Letters, 57:2861-2864, 1986.
76. M.T. Turvey. Coordination. American Psychologist, 45:938-953, 1990.
77. G.C. Van Orden, J.G. Holden, and M.T. Turvey. Self-organization of cognitive performance. Journal of Experimental Psychology: General, 132:331-350, 2003.
78. D.L. Wang and B. Yuwono. Anticipation-based temporal pattern generation. IEEE Transactions on Systems, Man, and Cybernetics, 25:615-628, 1995.
79. D.L. Wang and B. Yuwono. Incremental learning of complex temporal patterns. IEEE Transactions on Neural Networks, 7:1465-1481, 1996.
80. L. Wang. Multi-associative neural networks and their applications to learning and retrieving complex spatio-temporal sequences. IEEE Transactions on Systems, Man, and Cybernetics - Part B: Cybernetics, 29:73-82, 1999.
81. R.J. Williams and D. Zipser. A learning algorithm for continually running fully recurrent neural networks. Neural Computation, 1:270-280, 1989.
82. D. Willshaw, O.P. Buneman, and H.C. Longuet-Higgins. Non-holographic associative memory. Nature, 222:960-962, 1969.
83. L. Wolpert, R. Beddington, J. Brockes, T. Jessell, P. Lawrence, and E. Meyerowitz. Principles of Development. Oxford University Press, 1998.
84. M.J. Zaki. Sequence mining in categorical domains: Algorithms and applications. In R. Sun and C.L. Giles, editors, Sequence Learning: Paradigms, Algorithms, and Applications, pages 162-187. Springer-Verlag, Berlin, 2000.