Learning and Retrieving Spatio-Temporal Sequences with Any Static Associative Neural Network

IEEE Transactions on Circuits and Systems II: Analog and Digital Signal Processing

Volumn 45, Issue 6, 1998, Pages 729-738

  Wang, Lipo ^a  

^a DEAKIN UNIVERSITY   (Australia)

Author keywords

Autoassociative; Heteroassociative; Neural network; Noise; Spatio temporal sequence

Indexed keywords

ASSOCIATIVE STORAGE; COMMUNICATION CHANNELS (INFORMATION THEORY); COMPUTATIONAL METHODS; FEEDBACK; KNOWLEDGE ACQUISITION; LEARNING SYSTEMS; PARALLEL PROCESSING SYSTEMS;

ASSOCIATIVE NEURAL NETWORKS (ANN); SPATIO-TEMPORAL SEQUENCES;

NEURAL NETWORKS;

EID: 0032099287     PISSN: 10577130     EISSN: None     Source Type: Journal    
DOI: 10.1109/82.686692     Document Type: Article

References (42)

1. G. Bradski, G. A. Carpenter, and S. Grossberg, "Working memories for learning temporal order with application to three-dimensional visual object recognition," Neural Comput., vol. 4, pp. 270-286, 1992.
2. "STORE working memory networks for storage and recall of arbitrary temporal sequences," Biol. Cybern., vol. 71, no. 6, pp. 469-480, 1994.
3. G. Bradski and S. Grossberg, "Fast-learning VIEWNET architectures for recognizing three-dimensional objects from multiple two-dimensional views," Neural Networks, vol. 8, nos. 7/8, pp. 1053-1080, 1996.
4. J. Buhmann and K. Schulten, "Noise-driven temporal association in neural networks," Europhys. Lett., vol. 4, pp. 1205-1209, 1987.
5. G. A. Carpenter and S. Grossberg, "Neural dynamics of category learning and recognition: Attention, memory consolidation, and amnesia," in Brain Structure, Learning, and Memory, J. Davis, R. Newburgh, and E. Wegman, Eds., AAAS Symp. Series, 1986, pp. 233-290.
6. G. A. Carpenter, S. Grossberg, and J. H. Reynolds, "ARTMAP: Supervised real-time learning and classification of nonstationary data by a self-organizing neural network," Neural Networks, vol. 4, no. 5, pp. 565-588, 1991.
7. T.-D. Chiueh and H.-K. Tsai, "Multivalued associative memories based on recurrent networks," IEEE Trans. Neural Networks, vol. 4, pp. 364-366, Mar. 1993.
8. A. C. C. Coolen and Th. W. Ruijgrok, "Image evolution in Hopfield networks," Phys. Rev. A, vol. 38, pp. 4253-4255, 1988.
9. S. Dehaene, J. P. Changeux, and J. P. Nadal, "Neural networks that learn temporal sequences by selection," Proc. Nat. Acad. Sci. USA, vol. 84, pp. 2727-2731, 1987.
10. K. Doya and S. Yoshizawa, "Adaptive neural oscillator using continuous-time back-propagation learning," Neural Networks, vol. 2, pp. 375-385, 1989.
11. K. Fukushima, "A model of associative memory in the brain," Kybernetik, vol. 12, pp. 58-63, 1973.
12. S. Grossberg, The Adaptive Brain, II: Vision, Speech, Language, and Motor Control. Amsterdam, The Netherlands: Elsevier/North-Holland, 1987.
13. I. Guyon, L. Personnaz, J. P. Nadal, and G. Dreyfus, "Storage and retrieval of complex sequences in neural networks," Phys. Rev. A, vol. 38, pp. 6365-6372, 1988.
14. M. J. Healy, T. P. Caudell, and S. D. G. Smith, "A neural architecture for pattern sequence verification through inferencing," IEEE Trans. Neural Networks, vol. 4, pp. 9-20, Jan. 1993.
15. D. O. Hebb, The Organization of Behavior. New York: Wiley, 1949, p. 44.
16. R. Hecht-Nielsen, Neurocomputing. Reading, MA: Addison-Wesley, 1990.
17. J. J. Hopfield, "Neural networks and physical systems with emergent collective computational abilities," Proc. Nat. Acad. Sci. USA, vol. 79, pp. 2554-2558, Apr. 1982.
18. "Neurons with graded response have collective computational properties like those of two-state neurons," Proc. Nat. Acad. Sci. USA, vol. 81, pp. 3088-3092, May 1984.
19. D. Kleinfeld, "Sequential state generation by model neural networks," Proc. Nat. Acad. Sci. USA, vol. 83, pp. 9469-9473, 1986.
20. B. Kosko, "Bidirectional associative memories," IEEE Trans. Syst., Man, Cybern., vol. 18, pp. 49-60, Jan./Feb. 1988.
21. R. P. Lippmann, "Review of neural networks for speech recognition," Neural Comput., vol. 1, pp. 1-38, 1989.
22. W. S. McCulloch and W. H. Pitts, "A logical calculus of ideas immanent in nervous activity," Bull. Math. Biophys., vol. 5, pp. 115-133, 1943.
23. A. Nigrin, Neural Networks for Pattern Recognition. Cambridge, MA: MIT Press, 1993.
24. H. Nishimori, T. Nakamura, and M. Shiino, "Retrieval of spatiotemporal sequence in asynchronous neural network," Phys. Rev. A, vol. 41, pp. 3346-3354, 1990.
25. P. Peretto and J. J. Niez, "Collective properties of neural networks," in Disordered Systems and Biological Organization, E. Bienenstock et al., Eds. Berlin, Germany: Springer-Verlag, 1986, pp. 171-185.
26. D. E. Rumelhart, J. L. McClelland, and the PDP Research Group, Parallel Distributed Processing. Cambridge MA: MIT Press, 1986.
27. H. Sompolinsky and I. Kanter, "Temporal association in asymmetric neural networks," Phys. Rev. Lett., vol. 57, pp. 2861-2864, 1986.
28. D. W. Tank and J. J. Hopfield, "Neural computation by concentrating information in time," Proc. Nat. Acad. Sci. USA, vol. 84, pp. 1896-1900, 1987.
29. G. L. Tarr, S. K. Rogers, M. Kabrisky, M. E. Oxley, and K. L. Priddy, "Effective neural network modeling in C," in Artificial Neural Networks, T. Kohonen, K. Mäkisara, O. Simula, and J. Kangas, Eds. Amsterdam, The Netherlands: North-Holland/Elsevier Science, 1991, pp. 1497-1500.
30. A. C. Tsoi and A. D. Back, "Locally recurrent globally feedforward networks: A critical review of architectures," IEEE Trans. Neural Networks, vol. 5, pp. 229-239, Mar. 1994.
31. K. P. Unnikrishnan, J. J. Hopfield, and D. W. Tank, "Connecteddigit speaker-dependent speech recognition using a neural network with time-delayed connections," IEEE Trans. Signal Processing, vol. 39, pp. 698-713, 1991.
32. A. Waibel, T. Hanazawa, G. Hinton, and K. Shikano, "Phoneme recognition using time-delay neural networks," IEEE Trans. Acoust., Speech, Signal Processing, vol. 37, pp. 328-339, 1989.
33. D. L. Wang and M. A. Arbib, "Complex temporal sequence learning based on short-term memory," Proc. IEEE, vol. 78, pp. 1536-1543, Sept. 1990.
34. "Timing and chunking in processing temporal order," IEEE Trans. Syst., Man, Cybern., vol. 23, pp. 993-1009, July/Aug. 1993.
35. D. L. Wang and B. Yuwono, "Anticipation-based temporal pattern generation," IEEE Trans. Syst., Man, Cybern., vol. 25, pp. 615-628, Apr. 1995.
36. L. Wang, "Oscillatory and chaotic dynamics in neural networks under varying operating conditions," IEEE Trans. Neural Networks, vol. 7, pp. 1382-1388, Nov. 1996.
37. "Suppressing chaos with hysteresis in a higher-order neural network," IEEE Trans. Circuits Syst. II, vol. 43, pp. 845-846, Dec. 1996.
38. L. Wang and D. L. Alkon, Eds., Artificial Neural Networks: Oscillations, Chaos, and Sequence Processing. Los Alamitos, CA: IEEE Comput. Soc. Press, 1993.
39. "An artificial neural network system for temporal-spatial sequence processing," Pattern Recognit., vol. 28, no. 8, pp. 1267-1276, 1995.
40. L. Wang, E. E. Pichler, and J. Ross, "Oscillations and chaos in neural networks: An exactly solvable model," Proc. Nat. Acad. Sci. USA, vol. 87, pp. 9467-9471, Dec. 1990.
41. L. Wang and J. Ross, "Chaos, multiplicity, crisis, and synchronicity in higher order neural networks," Phys. Rev. A, vol. 44, pp. R2259-R2262, Aug. 1991.
42. L. Wu and F. Fallside, "On the design of connectionist vector quantizers," Comput. Speech Lang., vol. 5, pp. 207-229, 1991.