A taxonomy for spatiotemporal connectionist networks revisited: The unsupervised case

Neural Computation

Volumn 15, Issue 6, 2003, Pages 1255-1320

  Barreto, Guilherme de A ^a   Araújo, Aluizio F R ^a   Kremer, Stefan C ^b  

^a UNIVERSITY OF SÃO PAULO   (Brazil)

^b UNIVERSITY OF GUELPH   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

BIOLOGICAL MODEL; CLASSIFICATION; NERVE CELL; NERVE TRACT; REVIEW;

CLASSIFICATION; MODELS, NEUROLOGICAL; NEURAL PATHWAYS; NEURONS;

EID: 0037928080     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/089976603321780281     Document Type: Review

References (176)

1. Abbott, L. F., & Song, S. (1999). Temporally asymmetric Hebbian learning, spike timing and neuronal response variability. In M. S. Kearns, S. A. Solla, & D. A. Cohn (Eds.), Advances in neural information processing systems, 2 (pp. 69-75). Cambridge, MA: MIT Press.
2. Adair, K. L., & Argo, P. (1997). Classification of behavior using unsupervised temporal neural networks. In Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics (SMC'98) (pp. 2584-2589).
3. Amari, S. (1972). Learning patterns and pattern sequences by self-organizing nets of threshold elements. IEEE Transactions on Computers, 0-21(11), 1197-1206.
4. Amari, S., & Cichocki, A. (1998). Adaptive blind signal processing - Neural network approaches. Proceedings of the IEEE, 86(10), 2026-2048.
5. Anderson, J. A. (1983). Cognitive and psychological computation with neural models. IEEE Transactions on Systems, Man, and Cybernetics, 13, 799-815.
6. Anderson, T. W. (1984). Estimating linear statistical relationships. Annals of Statistics, 122(1), 1-45.
7. Araújo, A. F. R., & Barreto, G. A. (2002a). Context in temporal sequence processing: A self-organizing approach and its application to robotics. IEEE Transactions on Neural Networks, 13(1), 45-57.
8. Araújo, A. F. R., & Barreto, G. A. (2002b). A self-organizing context-based approach to the tracking of multiple robot trajectories. Applied Intelligence, 17(1), 99-116.
9. Ballard, D. H., Salgian, G., Rao, R. P. N., & McCallum, R. A. (1998). On the role of time in brain computation. In L. Harris & M. Jenkin (Eds.), Vision and action (pp. 82-119). Cambridge: Cambridge University Press.
10. Barlow, H. (1961). The coding of sensory messages. In W. Thorpe & O. Zangwill (Eds.), Current problems in animal behaviour (pp. 331-360). Cambridge: Cambridge University Press.
11. Barlow, H. (1989). Unsupervised learning. Neural Computation, 1, 295-311.
12. Barreto, G. A., & Araújo, A. F. R. (2001a). Time in self-organizing maps: An overview of models. International Journal of Computer Research, 10(2), 139-179.
13. Barreto, G. A., & Araújo, A. F. R. (2001b). A self-organizing NARX network and its application to prediction of chaotic time series. In Proceedings of the IEEE-INNS International Joint Conference on Neural Networks (IJCNN'01) (Vol. 3, pp. 2144-2149). Washington, DC.
14. Barreto, G. A., & Araújo, A. F. R. (2002). Nonlinear modeling of dynamic systems with the self-organizing map. In J. R. Dorronsoro (Ed.), Lecture notes on computer science (Vol. 2415, pp. 975-980). New York: Springer-Verlag.
15. Bartlett, M. S. (2001). Face image analysis by unsupervised learning. Boston: Kluwer.
16. Bartlett, M. S., & Sejnowski, T. J. (1998). Learning viewpoint-invariant face representations from visual experience in an artractor network. Network: Computation in Neural Systems, 9, 399-417.
17. Barto, A. G., Sutton, R. S., & Anderson, C. W. (1983). Neuronlike elements that can solve difficult learning control problems. IEEE Transactions on Systems, Man, and Cybernetics, 13, 835-846.
18. Becker, S., & Plumbey, M. (1996). Unsupervised neural network learning procedures for feature extraction and classification. Applied Intelligence, 6(3), 185-203.
19. Bell, A. J., & Sejnowski, T. J. (1995). An information-maximization approach to blind separation and blind deconvolution. Neural Computation, 7(6), 1129-1159.
20. Bellini, S. (1994). Bussgang techniques for blind deconvolution and equalization. In S. Haykin (Ed.), Blind deconvolution (pp. 8-59). Englewood Cliffs, NJ: Prentice Hall.
21. Bishop, C. M., Hinton, G. E., & Strachan, I. G. D. (1997). GTM through time. In Proceedings IEE 5th International Conference on Artificial Neural Networks (pp. 111-116). Cambridge, UK.
22. Bishop, C. M., Svensen, M., & Williams, C. K. I. (1998). GTM: The generative topographic mapping. Neural Computation, 10(1), 215-234.
23. Blumestein, C., Brücner, B., Mecke, R., Wesarg, T., & Schauer, C. (1996). Using a modified Hypermap for analyzing moving scenes. In S. Amari, L. Yu, W. Chan, I. King, & K. S. Lenng (Eds.), Progress in neural information processing (pp. 428-431). New York: Springer-Verlag.
24. Bradski, C. A., Carpenter, G., & Grossberg, S. (1992). Working memory networks for learning temporal order with application to three-dimensional visual object recognition. Neural Computation, 4(2), 279-286.
25. Bradski, C. A., Carpenter, G., & Grossberg, S. (1994). STORE working memory networks for storage and recall of arbitrary temporal sequences. Biological Cybernetics, 71, 469-480.
26. Brücner, B., Franz, M., & Richter, A. (1992). A modified hypermap architecture for classification of biological signals. In I. Aleksander & J. Taylor (Eds.), Artificial neural networks (Vol. 2, pp. 1167-1170). Amsterdam: North-Holland.
27. Brücner, B., Wesarg, T., & Blumestein, C. (1995). Improvements of the modified hypermap architecture for speech recognition. In Proceedings of the IEEE International Conference on Neural Networks (ICNN'95) (Vol. 5, pp. 2891-2895). Perth, Australia.
28. Buhmann, J., & Schulten, K. (1987). Noise-driven temporal association in neural networks. Europhysics Letters, 4, 1205-1209.
29. Carpenter, G. A., Grossberg, S., & Rosen, D. B. (1991). Fuzzy ART: Fast stable learning and categorization of analog patterns by an adaptive resonance system. Neural Networks, 4, 759-771.
30. Carpinteiro, O. A. S. (1999). A hierarchical self-organizing map model for sequence recognition. Neural Processing Letters, 9(3), 209-220.
31. Chappell, G. J., & Taylor, J. G. (1993). The temporal Kohonen map. Neural Networks, 6(3), 441-445.
32. Choi, S., & Cichocki, A. (1997). Blind signal deconvolution by spatio-temporal decorrelation and demixing. In J. Principe, L. Gile, N. Morgan, & E. Wilson (Eds.), Neural networks for signal processing (Vol. 7, pp. 426-435). New York: IEEE Press.
33. Chon, T.-S., Park, Y.-S., & Park, J. H. (2000). Determining temporal pattern of community dynamics by using unsupervised learning algorithms. Ecological Modelling, 132, 151-166.
34. Chudý, L., & Farkas, I. (1998). Prediction of chaotic time series using dynamic cell structures and local linear models. Neural Network World, 8(5), 481-489.
35. Cohen, M. A., & Grossberg, S. (1983). Absolute stability of global pattern formation and parallel memory storage by competitive neural networks. IEEE Transactions on Systems, Man, and Cybernetics, 13, 815-826.
36. Cohen, M. A., & Grossberg, S. (1987). Masking fields: A massively parallel neural architecture for learning, recognizing, and predicting multiple groupings of patterned data. Applied Optics, 26, 1866-1891.
37. Dayan, P., Hinton, G. E., Neal, R. M., & Zemel, R. S. (1995). The Helmholtz machine. Neural Computation, 7(5), 889-904.
38. Dayan, P., & Zemel, R. (1995). Competition and multiple cause models. Neural Computation, 7(3), 565-579.
39. Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm. Proceedings of the Royal Statistical Society, B-39, 1-38.
40. Dobrzewski, B., Ruwisch, D., & Bode, M. (1997). Wave propagation in self-organizing feature maps as a means for the representation of temporal sequences. In Proceedings of the International Conference on Artificial Neural Networks (ICANN'97) (pp. 661-666). Lausanne, Switzerland.
41. Dorffner, G. (1996). Neural networks for time series processing. Neural Network World, 6(4), 447-468.
42. Douglas, S. C., & Kung, S.-Y. (2000). Gradient adaptive algorithms for contrast-based blind deconvolution. Journal of VLSI Signal Processing, 26(1), 47-60.
43. Duda, R. O., & Hart, P. E. (1973). Pattern classification and scene analysis. New York: Wiley.
44. Elman, J. L. (1990). Finding structure in time. Cognitive Science, 14, 179-211.
45. Euliano, N. R., Kulzer, P., & Principe, J. C. (1997). A self-organizing temporal pattern recognizer with application to robot landmark recognition. In F. L. Silva, L. B. Almeida, & J. C. Principe (Eds.), Spatiotemporal models in biological and artificial systems (pp. 41-48). Amsterdam: IOS Press.
46. Euliano, N. R., & Principe, J. C. (1995). Spatiotemporal self-organizing feature maps. In Proceedings of the International Joint Conference on Neural Networks (IJCNN'96) (Vol. 4, pp. 1900-1905). Washington, DC.
47. Euliano, N. R., & Principe, J. C. (1999). A spatiotemporal memory based on SOMs with activity diffusion. In E. Oja & S. Kaski (Eds.), Kohonen maps (pp. 41-48). Amsterdam: Elsevier Science.
48. Fancourt, C. L., & Principe, J. C. (1997). Competitive principal component analysis for locally stationary time series. IEEE Transactions on Signal Processing, 46(11), 3068-3082.
49. Farkas, I., & Miikkulainen, R. (1999). Modeling the self-organization of directional selectivity in the primary visual cortex. In Proceedings of the 9th International Conference on Artificial Neural Networks (ICANN'99) (pp. 251-256). Edinburgh, Scotland.
50. Field, D. J. (1994). What is the goal of sensory coding? Neural Computation, 6, 559-601.
51. Földiák, P. (1990). Forming sparse representations by local anti-Hebbian learning. Biological Cybernetics, 64, 165-170.
52. Földiák, P. (1991). Learning invariance from transformation sequences. Neural Computation, 3, 194-200.
53. Gers, F., Eck, D., & Schmidhuber, J. (2001). Applying LSTM to time series predictable through time-window approaches. In G. Dorffner, H. Bischof, & K. Hornik (Eds.), Proceedings of International Conference on Artificial Neural Networks (ICANN'01) (Vol. LNCS 2130, pp. 669-676). New York: Springer-Verlag.
54. Gerstner, W., Ritz, R., & van Hemmen, J. L. (1993). Why spikes? Hebbian learning and retrieval of time-resolved excitation patterns. Biological Cybernetics, 69, 503-515.
55. Girolami, M., & Fyfe, C. (1996). A temporal model of linear anti-Hebbian learning. Neural Processing Letters, 4(3), 139-148.
56. Girolami, M., & Fyfe, C. (1997). An extended exploratory projection pursuit network with linear and nonlinear anti-Hebbian lateral connections applied to the cocktail party problem. Neural Networks, 10(9), 1607-1618.
57. Golden, R. M. (1996). Mathematical methods for neural network analysis and design. Cambridge, MA: MIT Press.
58. Grossberg, S. (1969). Some networks that can learn, remember, and reproduce any number of complicated space-time patterns, I. Journal of Mathematics and Mechanics, 19, 53-91.
59. Grossberg, S. (1987). Competitive learning: From interactive activation to adaptive resonance. Cognitive Science, 11, 23-63.
60. Grossberg, S., & Carpenter, G. (1988). The ART of adaptive pattern recognition by a self-organizing neural network. Computer, 21, 77-88.
61. Grossberg, S., & Carpenter, G. (1991). Pattern recognition by self-organizing neural networks. Cambridge, MA: MIT Press.
62. Gullapalli, V. (1990). A stochastic reinforcement learning algorithm for learning real valued functions. Neural Networks, 3(6), 671-692.
63. Hagiwara, M. (1994). Time-delay ART for spatio-temporal patterns. Neurocomputing, 6(5), 513-521.
64. Harpur, G. F. (1997). Low entropy coding with unsupervised neural networks. Unpublished doctoral dissertation, Queen's College, University of Cambridge.
65. Hastie, T., & Stuetzle, W. (1989). Principal curves. Journal of the American Statistical Association, 84(406), 502-516.
66. Haykin, S. (1994). Neural networks: A comprehensive foundation. New York: Macmillan/IEEE Press.
67. Healy, M. J., Caudell, T. P., & Smith, S. D. (1993). A neural architecture for pattern sequence verification through inference. IEEE Transactions on Neural Networks, 4, 9-20.
68. Hebb, D. O. (1949). The organization of behavior. New York: Wiley.
69. Hertz, J., Krogh, A., & Palmer, R. G. (1991). Introduction to the theory of neural computation. Redwood City, CA: Addison-Wesley.
70. Herz, A. V. M. (1995). Spatiotemporal association in neural networks. In M. A. Arbib (Ed.), The handbook of brain theory and neural networks (pp. 902-905). Cambridge, MA: MIT Press.
71. Herz, A., Sulzer, B., Kühn, R., & van Hemmen, J. L. (1989). Hebbian learning reconsidered: Representation of static and dynamic objects in associative neural nets. Biological Cybernetics, 60, 457-467.
72. Hinton, G. E., & Sejnowski, T. J. (1986). Learning and relearning in Boltzmann machines. In D. E. Rumelhart, J. L. McClelland, & the PDF Research Group (Eds.), Parallel distributed processing: Explorations in the microstructure of cognition (Vol. 1, pp. 282-317). Cambridge, MA: MIT Press.
73. Hinton, G., & Sejnowski, T. (1999). Unsupervised learning: Foundations of neural computation. Cambridge, MA: MIT Press.
74. Hochreiter, S. (1998). The vanishing gradient problem during learning recurrent neural nets and problem solutions. International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 6(2), 107-116.
75. Hochreiter, S., & Mozer, M. C. (2001). Beyond maximum likelihood and density estimation: A sample-based criterion for unsupervised learning of complex models. In T. K. Leen, T. Dietterich, & V. Tresp (Eds.), Advances in neural information processing systems (Vol. 13, pp. 535-541). Cambridge, MA: MIT Press.
76. Hochreiter, J., & Schmidhuber, J. (1997). Long short-term memory. Neural Computation, 9(8), 1735-1780.
77. Hodgkin, A. L., & Huxley, A. F. (1952). A quantitative description of membrane current and its application to conduction and excitation in nerve. Journal of Physiology, 117, 500-544.
78. Holmström, L., Koistinen, P., Laaksonen, J., & Oja, E. (1997). Neural and statistical classifiers - taxonomy and two case studies. IEEE Transactions on Neural Networks, 8(1), 5-17.
79. Hopcroft, J., & Ullman, J. (1979). Introduction to automata theory, languages, and computation. Reading, MA: Addison-Wesley.
80. Hopfield, J. J. (1984). Neural networks with graded response have collective computational properties like those of two-state neurons. Proceedings of the National Academy of Sciences of the USA, 81, 3088-3092.
81. Horio, K., & Yamakawa, T. (2001). Feedback self-organizing map and its application to spatio-temporal pattern classification. International Journal of Computational Intelligence and Applications, 1(1), 1-18.
82. Huber, P. J. (1985). Projection pursuit. Annals of Statistics, 23(2), 435-475.
83. Hunt, K. J., Sbarbaro, D., Zbikowski, R., & Gawthrop, P. J. (1992). Neural networks for control systems - A survey. Automatica, 28(6), 1083-1112.
84. Hyvärinen, A. (1999). Survey on independent component analysis. Neural Computing Surveys, 2, 94-128.
85. Hyvärinen, A., Karhunen, J., & Oja, E. (2001). Independent component analysis. New York: Wiley.
86. Hyvärinen, A., & Oja, E. (1998). Independent component analysis by general non-linear Hebbian-like learning rules. Signal Processing, 64(3), 301-313.
87. James, D. L., & Miikkulainen, R. (1995). SARDNET: A self-organizing feature map for sequences. In J. D. Cowan, G. Tesauro, & J. Alspector (Eds.), Advances in neural information processing systems (Vol. 7, pp. 577-584). Cambridge, MA: MIT Press.
88. Jutten, C., & Hérault, J. (1991). Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architectures. Signal Processing, 24(1), 1-10.
89. Kangas, J. (1990). Time-delayed self-organizing maps. In Proceedings of the IEEE-INNS International Joint Conference on Neural Networks, (IJCNN'90) (pp. 331-336).
90. Kangas, J. (1991). Phoneme recognition using time-dependent versions of self-organizing maps. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, (ICASSP'91) (pp. 101-104).
91. Kaski, S., Kangas, J., & Kohonen, T. (1998). Bibliography of self-organizing map (SOM) papers: 1981-1997. Neural Computing Surveys, 1, 102-350.
92. Kempter, R., Gerstner, W., & van Hemmen, J. L. (1999). Hebbian learning and spiking neurons. Physical Review E, 59, 4498-4514.
93. Khalil, H. (1996). Nonlinear systems. Englewood Cliffs, NJ: Prentice Hall.
94. Klapper-Rybicka, M., Schraudolph, N. N., & Schmidhuber, J. (2001). Unsupervised learning in LSTM recurrent neural networks. In G. Dorffner, H. Bischof, & K. Hornik (Eds.), Proceedings of the International Conference on Artificial Neural Networks (ICANN'01) (Vol. LNCS 2130, pp. 684-691). New York: Springer-Verlag.
95. Klopf, A. H. (1988). A neuronal model of classical conditioning. Psychobiology, 16, 85-125.
96. Kohonen, T. (1991). The hypermap architecture. In T. Kohonen, K. Mäkisara, O. Simula, & J. Kangas (Eds.), Artificial neural Nnetworks (Vol. 1, pp. 1357-1360). Amsterdam: North-Holland.
97. Kohonen, T. (1996). Emergence of invariant-feature detectors in the adaptive-subspace self-organizing map. Biological Cybernetics, 75, 281-291.
98. Kohonen, T. (1997). Self-organizing Maps (2nd ed.). New York: Springer-Verlag.
99. Kohonen, T., Kaski, S., & Lappalainen, H. (1997). Self-organized formation of various invariant-feature filters in the adaptive-subspace SOM. Neural Computation, 9(6), 1321-1344.
100. Kolen, J. F., & Kremer, S. C. (2001). A field guide to dynamical recurrent networks. New York: IEEE Press.
101. Kopecz, K. (1995). Unsupervised learning of sequences on maps of lateral connectivity. In Proceedings of the International Conference on Artificial Neural Networks (ICANN'95) (pp. 431-436). Paris.
102. Koskela, T., Varsta, M., Heikkonen, J., & Kaski, S. (1998). Time series prediction using recurrent SOM with local linear models. International Journal of Knowledge-Based Intelligent Engineering Systems, 2(1), 60-68.
103. Kosko, B. (1988). Bidirectional associative memories. IEEE Transactions on Systems, Man, and Cybernetics, 18, 49-60.
104. Kremer, S. C. (1995). On the computational power of Elman-style recurrent networks. IEEE Transactions on Neural Networks, 6(4), 1000-1004.
105. Kremer, S. C. (2001). Spatio-temporal connectionist networks: A taxonomy and review. Neural Computation, 13(2), 249-306.
106. Lakany, H. M., & Hayes, G. M. (1997). Object localisation in 2D images using a temporal Kohonen network. In Proceedings of the Workshop on Self-Organizing Maps (WSOM'97) (pp. 148-151). Espoo, Finland.
107. Lambrinos, D., & Scheier, C. (1995). Unsupervised classification of sensory-motor states in a real world artifact using a temporal Kohonen map. In Proceedings of the International Conference on Artificial Neural Networks (ICANN'95) (Vol. 2, pp. 467-472). Paris.
108. Lampinen, J., & Oja, E. (1989). Self-organizing maps for spatial and temporal AR models. In Proceedings of the 6th Scandinavian Conference on Image Analysis, (SCIA'89) (pp. 120-127). Helsinki, Finland.
109. Lawley, D. N., & Maxwell, A. E. (1971). Factor analysis as a statistical method. London: Butterworth.
110. Lee, T.-W., Bell, A. J., & Lambert, R. H. (1997). Blind separation of delayed and convolved sources. In M. C. Mozer, M. I. Jordan, & T. Petsche (Eds.), Advances in neural information processing systems, 9 (pp. 758-764). Cambridge, MA: MIT Press.
111. Lendasse, A., Lee, J., Wertz, V., & Verleysen, M. (2002). Forecasting electricity consumption using nonlinear projection and self-organizing maps. Neurocomputing, 48, 299-311.
112. Lewicki, M. S., & Sejnowski, T. J. (2000). Learning overcomplete representations. Neural Computation, 12, 337-365.
113. Lin, T., Hörne, B., Tino, P., & Giles, C. (1996). Learning long-term dependencies in NARX recurrent neural networks. IEEE Transactions on Neural Networks, 7(6), 1329-1338.
114. Maass, W. (1997a). Fast sigmoidal networks via spiking neurons. Neural Computation, 9, 279-304.
115. Maass, W. (1997b). On the relevance of time in neural computation and learning. In M. Li & A. Maruoka (Eds.), Proceedings of the 8th International Conference on Algorithmic Learning Theory (Vol. 1316, pp. 364-384). New York: Springer-Verlag.
116. Marr, D. (1982). Vision. San Francisco: Freeman.
117. Martinetz, T. M., Berkovich, S. G., & Schulten, K. J. (1993). "Neural-gas" network for vector quantization and its application to time-series prediction. IEEE Transactions on Neural Networks, 4(4), 558-569.
118. Mayberry, M. R. I., & Miikkulainen, R. (1999). SARDSRN: A neural network shift-reduce parser. In Proceedings of the 16th International Joint Conference on Artificial Intelligence (IJCAI-99). Stockholm, Sweden.
119. Mealy, G. H. (1955). A method for synthesizing sequential circuits. Bell System Technical Journal, 34(5), 1045-1079.
120. Meinicke, P. (2000). Unsupervised learning in a generalized regression framework. Unpublished doctoral dissertation, University of Bielefeld, Bielefeld, Germany.
121. Montague, P. R., & Sejnowski, T. J. (1994). The predictive brain: Temporal coincidence and temporal order in synaptic learning mechanisms. Learning and Memory, 1, 1-33.
122. Moore, E. F. (1956). Gedanken experiments on sequential machines. In C. E. Shannon & J. McCarthy (Eds.), Automata studies (pp. 129-153). Princeton, NJ: Princeton University Press.
123. Mozayyani, N., Alanou, V., Dreyfus, J. F., & Vaucher, G. (1995). A spatiotemporal data-coding applied to Kohonen maps. In Proceedings of the International Conference on Artificial Neural Networks (ICANN'95) (Vol. 2, pp. 75-79). Paris.
124. Mozer, M. C. (1993). Neural net architectures for temporal sequence processing. In A. Weigend & N. Gershenfeld (Eds.), Predicting the future and understanding the past (pp. 243-264). Redwood City, CA: Addison-Wesley.
125. Neal, R. M., & Dayan, P. (1997). Factor analysis using delta-rule wake-sleep learning. Neural Computation, 9(8), 1781-1803.
126. Oja, E. (1989). Neural networks, principal components, and subspaces. International Journal of Neural Systems, 1, 61-68.
127. Oja, E. (2002). Unsupervised learning in neural computation. Theoretical Computer Science, 287, 187-207.
128. Pearlmutter, B. (1995). Gradient calculations for dynamic recurrent neural networks. IEEE Transactions on Neural Networks, 6(5), 1212-1228.
129. Plamondon, R., & Privitera, C. M. (1995). A neural model for generating and learning a rapid movement sequence. Biological Cybernetics, 74(2), 117-130.
130. Principe, J. C., & Wang, L. (1995). Non-linear time series modeling with self-organizing feature maps. In Proceedings of the IEEE Workshop on Neural Networks for Signal Processing (NNSP'95) (pp. 11-20). Cambridge, MA.
131. Principe, J. C., Wang, C., & Wu, H.-C. (1996). Temporal decorrelation using teacher forcing anti-Hebbian learning and its application in adaptive blind source separation. In Proc. IEEE Workshop on Neural Networks for Signal Processing (Vol. 6, pp. 413-422). Kyoto, Japan.
132. Quoy, M., & Daucé, E. (2000). Visual and motor learning using a chaotic recurrent neural network: Application to the control of a mobile robot. In Proceedings of the ICSC Symposium on Neural Computation (NC'2000) (pp. 577-582). Berlin, Germany.
133. Rao, R. P. N., & Sejnowski, T. J. (2000). Predictive sequence learning in recurrent neocortical circuits. In S. A. Solla, T. K. Leen, & K.-R. Miller (Eds.), Advances in neural information processing systems, 12 (pp. 164-170). Cambridge, MA: MIT Press.
134. Roweis, S., & Ghahramani, Z. (1999). A unifying review of linear gaussian models. Neural Computation, 11(2), 305-345.
135. Ruf, B., & Schmitt, M. (1997). Learning temporally encoded patterns in networks of spiking neurons. Neural Processing Letters, 5(1), 9-18.
136. Ruf, B., & Schmitt, M. (1998). Self-organization of spiking neurons using action potential timing. IEEE Transactions on Neural Networks, 9(3), 575-578.
137. Rumelhart, D. E., & McClelland, J. L. (1986). Parallel distributed processing: Explorations in the microstructure of cognition (Vol. 1). Cambridge, MA: MIT Press.
138. Rumelhart, D. E., & Zipser, D. (1986). Feature discovery by competitive learning. In D. E. Rumelhart & J. L. McClelland (Eds.), Parallel distributed processing: Explorations in the microstructure of cognition (Vol.1, pp. 151-193). Cambridge, MA: MIT Press.
139. Sakoe, H., & Chiba, S. (1978). Dynamic programming algorithm optimization for spoken word recognition. IEEE Transactions on Acoustics, Speech, and Signal Processing, 26(1), 43-49.
140. Sanger, T. D. (1989). Optimal unsupervised learning in a single layer linear feedforward network. Neural Networks, 2, 459-473.
141. Schmidhuber, J. (1992). Learning complex, extended sequences using the principle of history compression. Neural Computation, 4(2), 234-242.
142. Schmidhuber, J., Eldracher, M., & Foltin, B. (1996). Semilinear predictability minimization produces well-known feature detectors. Neural Computation, 8, 773-786.
143. Schölkopf, B., & Mallot, H. A. (1995). View-based cognitive mapping and path planning. Adaptive Behavior, 3, 311-348.
144. Schölkopf, B., Smola, A., & Müller, K.-R. (1998). Nonlinear component analysis as a kernel eigenvalue problem. Neural Computation, 10(5), 1299-1319.
145. Schraudolph, N. N., & Sejnowski, T. J. (1993). Unsupervised discrimination of clustered data via optimization of binary information gain. In S. J. Hanson, J. D. Cowan, & C. L. Giles (Eds.), Advances in neural information processing systems, 5 (pp. 499-506). San Mateo, CA: Morgan Kaufmann.
146. Seibert, M. C., & Waxman, A. M. (1990). Learning aspect graph representations from view sequences. In D. S. Touretzky (Ed.), Advances in neural information processing systems, 2 (pp. 258-265). San Mateo, CA: Morgan Kaufmann.
147. Sejnowski, T. (1977). Strong covariance with nonlinearly interacting neurons. Journal of Mathematical Biology, 4, 303-321.
148. Shigematsu, Y., & Matsumoto, G. (2000). Temporal learning rule and dynamic neural network model. Applied Mathematics and Computation, 111(2-3), 209-218.
149. Sjöberg, J., Zhang, Q., Ljung, L., Benveniste, A., Deylon, B., Glorennec, P.-Y., Hjalmarsson, H., & Juditsky, A. (1995). Nonlinear black-box modeling in system identification: A unified overview. Automatica, 31(12), 1691-1724.
150. Smola, A. J., Mika, S., Schölkopf, B., & Williamson, R. C. (2001). Regularized principal manifolds. Journal of Machine Learning Research, 1, 179-209.
151. rffrt Somervuo, P., & Kohonen, T. (1999). Self-organizing maps and learning vector quantization for feature sequences. Neural Processing Letters, 10, 151-159.
152. Sompolinsky, H., & Kanter, I. (1986). Temporal association in asymmetric neural networks. Physics Review Letters, 57, 2861-2864.
153. Song, S., Miller, K., & Abbott, L. (2000). Competitive Hebbian learning through spiketime-dependent synaptic plasticity. Nature Neuroscience, 3, 919-926.
154. Srinivasa, N., & Ahuja, N. (1999). A topological and temporal correlator network for spatiotemporal pattern learning, recognition, and recall. IEEE Transactions on Neural Networks, 10(2), 356-371.
155. Stacey, D. A., Dara, R., & Kremer, S. C. (2000). The Guelph cluster class (GCC) system - a SOM/BP hybrid network that uses unclassified data to improve classification performance. In Artificial Neural Networks in Engineering (ANNIE'2000) (pp. 179-184).
156. Stone, J. (1996). Learning perceptually salient visual parameters using spatiotemporal smoothness constraints. Neural Computation, 8(7), 1463-1492.
157. Stone, J., & Bray, A. (1995). A learning rule for extracting spatio-temporal invariances. Network: Computation in Neural Systems, 6(3), 429-436.
158. Sutton, R. S., & Barto, A. G. (1981). Toward a modern theory of adaptive networks: Expectation and prediction. Psychological Review, 88(2), 135-170.
159. Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning: An introduction. Cambridge, MA: MIT Press.
160. Taylor, J. G. (1995). Self-organization in the time domain. In M. A. Arbib (Ed.), The handbook of brain theory and neural networks (pp. 843-846). Cambridge, MA: MIT Press.
161. Tesauro, G. (1986). Simple neural models of classical conditioning. Biological Cybernetics, 55, 187-200.
162. Vesanto, J. (1997). Using the SOM and local models in time-series prediction. In Proceedings of the Workshop on Self-Organizing Maps, (WSOM'97) (pp. 209-214). Espoo, Finland.
163. Viola, P. A., Schraudolph, N. N., & Sejnowski, T. J. (1996). Empirical entropy manipulation for real-world problems. In D. S. Touretzky, M. C. Mozer, & M. E. Hasselmo (Eds.), Advances in neural information processing systems, 8 (pp. 851-857). Cambridge, MA: MIT Press.
164. Voegtlin, T. (2000). Context quantization and contextual self-organizing maps. In Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks (IJCNN'00) (Vol. 6, pp. 20-25). Como, Italy.
165. Wallis, G. (1996). Using spatio-temporal correlations to learn invariant object recognition. Neural Networks, 9(9), 1513-1519.
166. Wallis, G. (1998). Spatio-temporal influences in object recognition. Network Computation in Neural Systems, 9, 265-278.
167. Wallis, G., & Baddeley, R. (1997). Optimal unsupervised learning in invariant object recognition. Neural Computation, 9(4), 959-970.
168. Walter, J., Ritter, H., & Schulten, K. (1990). Non-linear prediction with self-organizing maps. In Proceedings of the International Joint Conference on Neural Networks (IJCNN'90) (pp. 587-592). San Diego, CA.
169. Wang, D. L., & Arbib, M. A. (1990). Complex temporal sequence learning based on short-term memory. IEEE Proceedings, 78, 1536-1543.
170. Wang, D. L., & Arbib, M. A. (1993). Timing and chunking in processing temporal order. IEEE Transactions on Systems, Man, and Cybernetics, 23(4), 993-1009.
171. Wang, D. L., & Yuwono, B. (1996). Incremental learning of complex temporal patterns. IEEE Transactions on Neural Networks, 7(6), 1465-1481.
172. Wu, H.-C., & Principe, J. C. (1999). Generalized anti-Hebbian learning for source separation. In Proceedings of the IEEE International Conference on Acoustic, Speech, and Signal Processing (ICASSP'99) (Vol. 2, pp. 1073-1076). Phoenix, AZ.
173. Xu, L. (2000). Temporal BYY learning for state space approach, hidden Markov model, and blind source separation. IEEE Transactions on Signal Processing, 48(7), 2132-2144.
174. Xu, L. (2001). BYY harmony learning, independent state space, and generalized APT financial analyses. IEEE Transactions on Neural Networks, 12(4), 822-849.
175. Zemel, R. S. (1993). A minimum description length framework for unsupervised learning. Unpublished doctoral dissertation, University of Toronto.
176. Zhao, Y., & Atkeson, C. G. (1996). Implementing projection pursuit learning. IEEE Transactions on Neural Networks, 7(2), 362-373.