An associative memory for the on-line recognition and prediction of temporal sequences

Proceedings of the International Joint Conference on Neural Networks

Volumn 2, Issue , 2005, Pages 1223-1228

  Bose, J ^a   Furber, S B ^a   Shapiro, J L ^a  

^a UNIVERSITY OF MANCHESTER   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER SIMULATION; DATA STORAGE EQUIPMENT; LEARNING SYSTEMS; MATHEMATICAL MODELS; NEURAL NETWORKS; NUMERICAL ANALYSIS;

ASSOCIATIVE MEMORY; NUMERICAL SIMULATIONS; ON-LINE RECOGNITION; ON-LINE TEMPORAL SEQUENCE LEARNING;

ONLINE SYSTEMS;

EID: 33745953745     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2005.1556028     Document Type: Conference Paper

References (26)

1. S. Haykin. Neural Networks: a Comprehensive Foundation (2nd Ed). Prentice Hall, 1999.
2. S. Furber, J. Cumpstey, W. Bainbridge, and S. Temple, "Sparse distributed mem. using N-of-M codes," Neural Networks, vol. 10, 2004.
3. R. Sun and C. G. (Eds.), Sequence Learning. Springer-Verlag, 2000.
4. S. Hochreiter and J. Schmidhuber, "Long short-term memory," Neural Comp., vol. 9, 1997.
5. J. L. Elman, "Finding structure in time," Cog. Sci., vol. 14, 1990.
6. I. G. et al. "Storage and retrieval of complex sequences in neural networks," Physical Review, vol. 38, 1988.
7. R. Sutton and A. Barto. Reinforcement Learning. MIT Press, Cambridge, MA, 1997.
8. F. Worgotter and B. Porr, "Temporal sequence learning, prediction and control - a review of different models and their relation to biological mechanisms," Neural Comp., vol. 17, 2005.
9. L. E. Baum, "An inequality and associated maximization technique in statistical estimation for probabilistic functions of a Markov process," Inequalities, vol. 3, 1972.
10. M. Strickert, B. Hammer, and S. Blohm, "Unsupervised recursive sequence processing," Neurocomputing, vol. 63, 2005.
11. B. Ans, Y. Cotton, J. C. Gilhodes, and J. Velay, "A neural network model for temporal sequence learning and motor programming," Neural Nets, vol. 7, no. 9, 1994.
12. A. Baddeley, Working Memory. Oxford University Press, 1986.
13. N. J. Fortin, K. L. Agster, and H. B. Eichenbaum, "Critical role of the hippocampus in memory for sequences of events," Nature Neuroscience, vol. 5, 2002.
14. N. Burgess and G. J. Hitch, "Memory for serial order: A network model of the phonological loop and its timing," Psychological Review, vol. 106, 1999.
15. T. Troyer and A. Doupe, "An associational model of birdsong sensorimotor learning: efference copy and the learning of song syllables," Journal of Neurophysiology, vol. 84, 2000.
16. M. C. Mozer., "Neural network music composition by prediction: Exploring the benefits of psychoacoustic constraints and multiscale processing," Connection Science, vol. 6, 1994.
17. W. Cathy, M. Berry, S. Shivakumar, and J. McLarty, "Neural networks for full-scale protein sequence classification: Sequence encoding with singular value decomposition," Machine Learning, vol. 21, 1995.
18. M. C. Mozer., Neural network architectures for temporal sequence processing, in Predicting the future and understanding the past. Addison Wesley, 1993.
19. T. A. Plate, "Holographic reduced representations," IEEE Trans.on NN, vol. 6, 1995.
20. B. Hammer and P. Tino, "Recurrent neural nets with small weights implement definite memory machines," Neural Comp., vol. 15, 2003.
21. P. Tino and G. Dorffner, "Building predictive models from fractal representation of symbolic sequences," NIPS, vol. 12, 2000.
22. S. Thorpe, A. Delorme, and R. VanRullen, "Spike based strategies for rapid processing," Neural Nets, vol. 14, no. 6, 2001.
23. P. Kanerva, Sparse Distributed Memory. MIT Press, 1988.
24. T. Kohonen, "Correlation matrix memories," IEEE Transactions on Computers, vol. 21, 1972.
25. K. J. Lang and G. E. Hinton, "The development of the time delay neural network architecture for speech recognition," Tech. Rep. 88152, Carnegie Mellon University, 1988.
26. M. I. Jordan, "Serial order: a parallel distributed processing approach," Tech. Rep. 86044, Institute for Cog. Sci., UCSD, 1986.