Isotropic sequence order learning

Neural Computation

Volumn 15, Issue 4, 2003, Pages 831-864

  Porr, Bernd ^a   Wörgötter, Florentin ^a  

^a UNIVERSITY OF STIRLING   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; AVOIDANCE BEHAVIOR; FEEDBACK SYSTEM; MOTONEURON; PHYSIOLOGY; REFLEX; ROBOTICS; SENSORY NERVE CELL; SIGNAL PROCESSING;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; AVOIDANCE LEARNING; FEEDBACK; MOTOR NEURONS; NEURAL NETWORKS (COMPUTER); NEURONS, AFFERENT; REFLEX; ROBOTICS; SIGNAL PROCESSING, COMPUTER-ASSISTED;

EID: 0037686661     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/08997660360581921     Document Type: Article

References (55)

1. Abbott, L., & Blum, K. (1996). Functional significance of long-term potentiation for sequence learning and prediction. Cereb. Cortex, 6, 406-416.
2. Abbott, L., & Nelson, S. B. (2000). Synaptic plasticity: Taming the beast. Nature Neuroscience (Suppl.) 3, 1178-1179.
3. Ashby, W. R. (1956). An introduction to cybernetics. London: Methuen.
4. Bi, G.-q., & Poo, M.-m. (1998). Synaptic modifications in cultured hippocampal neurons: Dependence on spike timing, synaptic strengh, and postsynaptic cell type. J. Neurosci., 18(24), 10464-10472.
5. Bozic, S. M. (1994). Digital and Kalman filtering: An introduction to discrete-time filtering and optimum linear estimation. London: E. Arnold.
6. Brooks, R. A. (1989). How to build complete creatures rather than isolated cognitive simulators. In K. VanLehn (Ed.), Architectures for intelligence (pp. 225-239). Hillsdale, NJ: Erlbaum.
7. Brooks, R. A. (1997). Intelligence without representation. In H. John (Ed.), Mind design II (pp. 395-420). Cambridge, MA: MIT Press.
8. Dayan, P. (2002). Matters temporal. Trends in Cognitive Sciences, 6(3), 105-106.
9. Dayan, P., & Abbott, L. F. (2001). Theoretical neuroscience. Cambridge, MA: MIT Press.
10. Dayan, P., Kakade, S., & Montague, P. R. (2000). Learning and selective attention. Nature Neuroscience (Suppl.) 3, 1218-1223.
11. Dayan, P., & Sejnowski, T. (1994). TD(λ) converges with probability 1. Mach. Learn., 14(3), 295-301.
12. Doya, K. (2000). Reinforcement learning in continuous time and space. Neural Networks, 12(1), 219-245.
13. Fu, Y.-X., Djupsund, K., Gao, H., Hayden, B., Shen, K., & Dan, Y. (2002). Temporal specificity in the cortical plasticity of visual space representation. Science, 296, 1999-2003.
14. Gerstner, W., Kempter, R., van Hemmen, L., & Wagner, H. (1996). A neural learning rule for submilisecond temporal coding. Nature, 383, 76-78.
15. Gerstner, W., Kreiter, A. K., Markram, H., & Herz, A. V. (1997). Neural codes: Firing rates and beyond. Proc. Natl. Acad. Sci. USA, 94, 12740-12741.
16. Grossberg, S. (1995). A spectral network model of pitch perception. J. Acoust. Soc. Am., 98(2), 862-879.
17. Grossberg, S., & Merrill, J. (1996). The hippocampus and cerebellum in adaptively timed learning, recognition and movement. J. Cogn. Neurosci., 8, 257-277.
18. Grossberg, S., & Schmajuk, N. (1989). Neural dynamics of adaptive timing and temporal discrimination during associative learning. Neural Networks, 2, 79-102.
19. Guo-Quing, B., & Poo, M.-M. (1998). Synaptic modifications in cultured hippocampus neurons. J. Neurosci., 18(24), 10464-10472.
20. Haruno, M., Wolpert, D. M., & Kawato, M. (2001). Mosaic model for sensorimotor learning and control. Neural Comp., 13, 2201-2220.
21. 2 receptors in the rat nucleus accumbens are involved in guidance of the instrumental behaviour by stimuli predicting reward magnitude. J. Neurosci., 20(16), 6282-6288.
22. Hebb, D. O. (1949). The organization of behavior: A neuropsychological study. New York: Wiley-Interscience.
23. Kandel, E., Abrams, T., Bernier, L., Carew, T., Hawkins, R., & Schwartz, J. (1983). Classical conditioning and sensitization share aspects of the same molecular cascade in Aplysia. Cold Spring Harb. Symp. Quant. Biol., 48(2), 821-830.
24. Kistler, W. M., & van Hemmen, J. L. (2000). Modeling synaptic plasticity in conjunction with the timing of pre- and postsynaptic action potentials. Neural Comp., 12, 385-405.
25. Klopf, A. H. (1986). A drive-reinforcement model of single neuron function. In J. S. Denker (Ed.), Neural networks for computing: AIP conference proceedings (Vol. 151). New York: American Institute of Physics.
26. Klopf, A. H. (1988). A neuronal model of classical conditioning. Psychobiol., 16(2), 85-123.
27. Kosco, B. (1986). Differential Hebbian learning. In J. S. Denker (Ed.), Neural networks for computing: AIP conference proceedings (Vol. 151). New York: American Institute of Physics.
28. Levy, W. B., & Minai, A. A. (1993). Sequence learning in a single trial. In Proceedings of the 1993 INNS World Congress on Neural Networks II (pp. 505-508). Hillside, NJ: Erlbaum.
29. Markram, H., Lübke, J., Frotscher, M., & Sakman, B. (1997). Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science, 275, 213-215.
30. Maturana, H., & Varela, F. J. (1980). Autopoiesis and cognition: The realization of the living. Dordrecht: Reidel.
31. McGillem, C. D., & Cooper, G. R. (1984). Continuous and discrete signal and system analysis. New York: CBS Publishing.
32. Miller, K. D. (1996). Receptive fields and maps in the visual cortex: Models of ocular dominance and orientation columns. In E. Donnay, J. van Hemmen, & K. Schulten (Eds.), Models of neural networks III (pp. 55-78). New York: Springer-Verlag.
33. Montague, P. R., Dayan, P., & Sejnowski, T. J. (1993). Foraging in an uncertain environment using predictive hebbian learning. In J. D. Cowan, G. Tesauro, & J. Alspector (Eds.), Advances in neural information processing systems, 6 (pp. 598-605). San Mateo, CA: Morgan Kaufmann.
34. Oja, E. (1982). A simplified neuron model as a principal component analyzer. J. Math. Biol., 15(3), 267-273.
35. Palm, W. J. (2000). Modeling, analysis and control of dynamic systems. New York: Wiley.
36. Rao, R. P., & Sejnowski, T. J. (2001). Spike-timing-dependent Hebbian plasticity as temporal difference learning. Neural Comp., 13, 2221-2237.
37. Roberts, P. D. (1999). Temporally asymmetric learning rules: I. Differential Hebbian learning. J. Comput. Neurosci., 7(3), 235-246.
38. Saudargiene, A., Porr, B., & Wörgötter, F. (2003). Biophysical evaluation of a linear model for temporal sequence learning: ISO-Learning revisited. Manuscript in preparation.
39. Schultz, W., Dayan, P., & Montague, P. R. (1997). A neural substrate of prediction and reward. Science, 275, 1593-1599.
40. Schultz, W., & Suri, R. E. (2001). Temporal difference model reproduces anticipatory neural activity. Neural Comp., 13(4), 841-862.
41. Shepherd, G. M. (Ed.). (1990). The synaptic organisation of the brain. New York: Oxford University Press.
42. Song, S., & Abbott, L. (2001). Column and map development and cortical remapping through spike-timing dependent plasticity. Neuron, 32, 339-350.
43. Song, S., Miller, K. D., & Abbott, L. F. (2000). Competitive Hebbian learning through spike-timing-dependent synaptic plasticity. Nature Neuroscience, 3, 919-926.
44. Stewart, J. L. (1960). Fundamentals of signal theory. New York: McGraw-Hill.
45. Sutton, R. (1988). Learning to predict by method of temporal differences. Machine Learning, 3(1), 9-44.
46. Sutton, R., & Barto, A. (1981). Towards a modern theory of adaptive networks: Expectation and prediction. Psychol. Review, 88, 135-170.
47. Sutton, R., & Barto, A. (1988). Simulation of anticipatory responses in classical conditioning by a neuron-like adaptive element. Behav. Brain. Res., 4(3), 221-235.
48. Traub, R. D. (1999). Fast oscillations in cortical circuits. Cambridge, MA: MIT Press.
49. Verschure, P. F., & Pfeifer, R. (1992). Categorization, representations, and the dynamics of system-environment interaction: A case study in autonomous systems. In H. Roitblat, J. Meyer, & S. Wilson (Eds.), Proceedings of the Second International Conference on Simulation of Adaptive Behaviour (pp. 210-217). Cambridge, MA: MIT Press.
50. Verschure, P., & Voegtlin, T. (1998). A bottom-up approach towards the aquisition, retention, and expression of sequential representations: Distributed adaptive control III. Neural Networks, 11, 1531-1549.
51. von Foerster, H. (1960). On self-organizing systems and their environments. In M. Yovits & S. Cameron (Eds.), Self-organizing systems (pp. 31-50). New York: Pergamon Press.
52. Widrow, G., & Hoff, M. (1960). Adaptive switching circuits. IRE WESCON Convention Record, 4, 96-104.
53. Wolpert, D. M., & Ghahramani, Z. (2000). Computational principles of movement neuroscience. Nature Neuroscience (Suppl.), 3, 1212-1217.
54. Xie, X., & Seung, S. (2000). Spike-based learning rules and stabilization of persistent neural activity. In S. A. Solla, T. K. Leen, & K.-R. Müller (Eds.), Advances in neural information processing systems, 12 (pp. 199-208). Cambridge, MA: MIT Press.
55. Zhang, L. I., Tao, H. W., Holt, C. E., Harris, W. A., & Poo, M.-M. (1998). A critical window for cooperation and competition among developing retinotectal synapses. Nature, 395, 37-44.