Self-refreshing memory in artificial neural networks: Learning temporal sequences without catastrophic forgetting

Connection Science

Volumn 16, Issue 2, 2004, Pages 71-99

  Ans, Bernard ^a   Rousset, Stéphane ^a   French, Robert M ^b   Musca, Serban ^a  

^a UNIV GRENOBLE ALPES   (France)

^b UNIVERSITY OF LIÈGE   (Belgium)

Author keywords

Artificial neural networks; Catastrophic forgetting; Self refreshing memory; Temporal sequence learning

Indexed keywords

CATASTROPHIC FORGETTING; REAL WORLD; SELF-REFRESHING MEMORY; TEMPORAL SEQUENCE LEARNING;

BEHAVIORAL RESEARCH; COGNITIVE SYSTEMS; COMPUTER SIMULATION; DATA STORAGE EQUIPMENT; HUMAN ENGINEERING; LEARNING SYSTEMS; PSYCHOLOGY COMPUTING;

NEURAL NETWORKS;

EID: 4544253956     PISSN: 09540091     EISSN: None     Source Type: Journal    
DOI: 10.1080/09540090412331271199     Document Type: Article

References (60)

1. Altmann, G. T. M., 2002, Learning and development in neural networks - the importance of prior experience. Cognition, 85: 43-50.
2. Altmann, G. T. M., and Dienes, Z., 1999, Rule learning by seven-month-old infants and neural networks. Science, 284: 875.
3. Ans, B., 1990, Neuromimetic model for storage and recall of temporal sequences. CR Académie des Sciences Paris, Life Sciences, 311: 7-12.
4. Ans, B., Carbonnel, S., and Valdois, S., 1998, A connectionist multiple-trace memory model for polysyllabic word reading. Psychological Review, 105: 678-723.
5. Ans, B., Coiton, Y. Gilhodes, J. C., and Velay, J. L., 1994, A neural network model for temporal sequence learning and motor programming. Neural Networks, 7: 1461-1476.
6. Ans, B., and Roussel, S., 1997, Avoiding catastrophic forgetting by coupling two reverberating neural networks. CR Académie des Sciences Paris, Life Sciences, 320: 989-997.
7. Ans, B., and Roussel, S., 2000, Neural networks with a self-refreshing memory: knowledge transfer in sequential learning tasks without catastrophic forgetting. Connection Science, 12: 1-19.
8. Ans, B. Roussel, S. French, R. M., and Musca, S., 2002, Preventing catastrophic interference in multiple-sequence learning using coupled reverberating Elman networks. In Proceedings of the 24th Annual Conference of the Cognitive Science Society (Hillsdale NJ: Lawrence Erlbaum), pp. 71-76.
9. Baddeley, A. D., and Hitch, G., 1974, Working memory. In G. A. Bower (ed.) Recent Advances in Learning and Motivation, Vol. 8 (New York: Academic Press).
10. Barnes, J., and Underwood, B., 1959, 'Fate' of first-list associations in transfer theory. Journal of Experimental Psychology, 58: 97-105.
11. Botvinick, M., and Plaut, D. C., 2004, Doing without schema hierarchies: a recurrent connectionist approach to normal and impaired routine sequential action. Psychological Review, 111: 395-429.
12. Carpenter, G. A., and Grossberg, S., 1988, The ART of adaptive pattern recognition by a self-organizing neural network. Computer, 21: 77-88.
13. Cleeremans, A., 1993, Mechanisms of Implicit Learning: Connectionist Models of Sequence Processing (Cambridge MA: MIT Press).
14. Cleeremans, A., and Destrebecqz, A., 1997, Incremental sequence learning. In Proceedings of the 19th Annual Conference of the Cognitive Science Society (Hillsdale NJ: Lawrence Erlbaum), pp. 119-124.
15. Cohen, A. Ivry, R., and Keele, S. W., 1990, Attention and structure in sequence learning. Journal of Experimental Psychology: Learning, Memory, and Cognition, 16: 17-30.
16. Destrebecqz, A., and Cleeremans, A., 2001, Can sequence learning be implicit? New evidence with the process dissociation procedure. Psychonomic Bulletin and Review, 8: 343-350.
17. Dienes, Z. Altmann, G. T. M., and Gao, S. J., 1999, Mapping across domains without feedback: a neural network model of transfer of implicit knowledge. Cognitive Science, 23: 53-82.
18. Elman, J. L., 1990, Finding structure in time. Cognitive Science, 14: 179-211.
19. French, R. M., 1992, Semi-distributed representations and catastrophic forgetting in connectionist networks. Connection Science, 4: 365-377.
20. French, R. M., 1994, Dynamically constraining connectionist networks to produce distributed, orthogonal representations to reduce catastrophic interference. In Proceedings of the 16th Annual Conference of the Cognitive Science Society (Hillsdale NJ: Lawrence Erlbaum), pp. 335-340.
21. French, R. M., 1997, Pseudo-recurrent connectionist networks: an approach to the 'sensitivity-stability' dilemma. Connection Science, 9: 353-379.
22. French, R. M., 1999, Catastrophic forgetting in connectionist networks. Trends in Cognitive Sciences, 3: 128-135.
23. French, R. M. Ans, B., and Rousset, S., 2001, Pseudopatterns and dual-network memory models: advantages and shortcomings. In R. French and J. Sougné (eds) Connectionist Models of Learning, Development and Evolution (London: Springer), pp. 1-10.
24. Grossberg, S., 1987, Competitive learning: from interactive activation to adaptive resonance. Cognitive Science, 11: 23-63.
25. Hanson, S. J., and Negishi, M., 2002, On the emergence of rules in neural networks. Neural Computation, 14: 2245-2268.
26. Hebb, D. O., 1949, The Organization of Behavior (New York: Wiley).
27. Hetherington, P., and Seidenberg, M., 1989, Is there 'catastrophic interference' in connectionist networks? In Proceedings of the 11th Annual Conference of the Cognitive Science Society (Hillsdale NJ: Lawrence Erlbaum), pp. 26-33.
28. Hinton, G. E., 1989a, Connectionist learning procedures. Artificial Intelligence, 40: 185-234.
29. Hinton, G. E., 1989b, Deterministic Boltzmann learning performs steepest descent in weight-space. Neural Computation, 1: 143-150.
30. Hintzman, D. L., 1986, 'Schema abstraction' in a multiple-trace memory model. Psychological Review, 93:411-428.
31. Jordan, M. I., 1986, Serial Order: A Parallel Distributed Processing Approach. Technical Report ICS-8604, University of California at San Diego, CA.
32. Kanerva, P., 1988, Sparse Distributed Memory (Cambridge MA: MIT Press).
33. Kortge, C. A., 1990, Episodic memory in connectionist networks. In Proceedings of the 12th Annual Conference of the Cognitive Science Society (Hillsdale NJ: Lawrence Erlbaum), pp. 764-771.
34. Kruschke, J. K., 1992, ALCOVE: an exemplar-based connectionist model of category learning. Psychological Review, 99: 22-44.
35. Kruschke, J. K., 1993, Human category learning: implications for backpropagation models. Connection Science, 5: 3-36.
36. Lewandowsky, S., 1991, Gradual unlearning and catastrophic interference: a comparison of distributed architectures. In W. E. Hockley and S. Lewandowsky (eds) Relating Theory and Data: Essays on Human Memory in Honor of Bennet B. Murdoch (Hillsdale NJ: Lawrence Erlbaum), pp. 445-476.
37. Lewandowsky, S., 1994, On the relation between catastrophic interference and generalization in connectionist networks. Journal of Biological Systems, 2: 307-333.
38. Lewandowsky, S., and Li, S. C., 1995, Catastrophic interference in neural networks. Causes, solutions, and data. In F. N. Dempster and C. Brainerd (eds) New Perspectives on Interference and Inhibition in Cognition (New York: Academic Press), pp. 329-361.
39. Maquet, P. Laureys, S. Peigneux, P. Fuchs, S. Petiau, C. Phillips, C. Aerts, J. Del Fiore, G., Degueldre, C. Meulemans, T. Luxen, A. Franck, G. Van Der Linden, M., Smith, C., and Cleeremans, A., 2000, Experience-dependent changes in cerebral activation during human REM sleep. Nature Neuroscience, 3: 831-836.
40. Maskara, A., and Noetzel, A., 1992, Forced simple recurrent neural network and grammatical inference. In Proceedings of the 14th Annual Conference of the Cognitive Science Society (Hillsdale NJ: Lawrence Erlbaum), pp. 420-425.
41. Maskara, A., and Noetzel, A., 1993, Sequence learning with recurrent neural networks. Connection Science, 5: 139-152.
42. McClelland, J. L. McNaughton, B. L., and O'Reilly, R. C., 1995, Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. Psychological Review, 102: 419-457.
43. McCloskey, M., and Cohen, N. J., 1989, Catastrophic interference in connectionist networks: the sequential learning problem. In G. H. Bower (ed.) The Psychology of Learning and Motivation, Vol. 24 (New York: Academic Press), pp. 109-165.
44. McRae, K., and Hetherington, P. A., 1993, Catastrophic interference is eliminated in pretrained networks. In Proceedings of the 15th Annual Conference of the Cognitive Science Society (Hillsdale NJ: Lawrence Erlbaum), pp. 723-728.
45. Murre, J. M. J., 1992, The effects of pattern presentation on interference in backpropagation networks. In Proceedings of the 14th Annual Conference of the Cognitive Science Society (Hillsdale NJ: Lawrence Erlbaum), pp. 54-59.
46. O'Reilly, R. C., 1996, Biologically plausible error-driven learning using local activation differences: the generalized recirculation algorithm. Neural Computation, 8: 895-938.
47. Page, M., 2000, Connectionist modelling in psychology: a localist manifesto. Behavioral and Brain Sciences, 23: 443-467.
48. Peterson, C., and Andersen, J., 1987, A mean field theory learning algorithm for neural networks. Complex Systems, 1: 995-1019.
49. Plaut, D. C. McClelland, J. L. Seidenberg, M. S., and Patterson, K., 1996, Understanding normal and impaired word reading: computational principles in quasi-regular domains. Psychological Review, 103:56-115.
50. Ratcliff, R., 1990, Connectionist models of recognition memory: constraints imposed by learning and forgetting functions. Psychological Review, 97: 285-308.
51. Reber, A. S., 1967, Implicit learning of artificial grammars. Journal of Verbal Learning and Verbal Behaviour, 6: 855-863.
52. Reed, J., and Johnson, P., 1994, Assessing implicit learning with indirect tests: determining what is learned about sequence structure. Journal of Experimental Psychology: Learning, Memory, and Cognition, 20: 585-594.
53. Reiss, M., and Taylor, J. G., 1991, Storing temporal sequences. Neural Networks, 4: 773-787.
54. Robins, A. V., 1995, Catastrophic forgetting, rehearsal and pseudorehearsal. Connection Science, 7: 123-146.
55. Robins, A. V., 1996, Consolidation in neural networks and in the sleeping brain. Connection Science, 8: 259-275.
56. Robins, A. V., and McCallum, S., 1998, Catastrophic forgetting and the pseudorehearsal solution in Hopfield-type networks. Connection Science, 10: 121-135.
57. Robins, A. V., and McCallum, S., 1999, The consolidation of learning during sleep: comparing the pseudorehearsal and unlearning accounts. Neural Networks, 12: 1191-1206.
58. Shanks, D. R., and Johnstone, T., 1999, Evaluating the relationship between explicit and implicit knowledge in a sequential reaction time task. Journal of Experimental Psychology: Learning, Memory, and Cognition, 25: 1435-1451.
59. Sharkey, N. E., and Sharkey, A. J. C. 1995, An analysis of catastrophic interference. Connection Science, 7: 301-329.
60. Xie, X., and Seung, H. S., 2003, Equivalence of backpropagation and contrastive Hebbian learning in a layered network. Neural Computation, 15: 441-454.