Retroactive interference in neural networks and in humans: The effect of pattern-based learning

Connection Science

Volumn 13, Issue 3, 2001, Pages 257-275

  Mirman, Daniel ^a   Spivey, Michael ^b  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b NONE

Author keywords

Catastrophic interference; Memory; Mixture of experts; Neural networks

Indexed keywords

RETROACTIVE INTERFERENCES;

ERRORS; EXPERT SYSTEMS; LEARNING ALGORITHMS; LEARNING SYSTEMS;

NEURAL NETWORKS;

EID: 0035545046     PISSN: 09540091     EISSN: None     Source Type: Journal    
DOI: 10.1080/09540090110091830     Document Type: Article

References (31)

1. Ans, B., and Rousset, S., 2000, Neural networks with a self-refreshing memory: knowledge transfer in sequential learning tasks without catastrophic forgetting. Connection Science. 12 (1): 1-19.
2. Barnes, J. M., and Underwood, B. J., 1959, Fate of first-list associations in transfer theory. Journal of Experimental Psychology 58: 97-105.
3. Cohen, J. D., MacWhinney, B., Flatt, M., and Provost, J., 1993, PsyScope: a new graphic interactive environment for designing psychology experiments. Behavioral Research Methods, Instruments, and Computers, 25 (2): 257-271.
4. Deutsch, D., and Feroe, J., 1981, The internal representation of pitch sequences in tonal music. Psychological Review, 88 (6:)503-522.
5. Erickson, and Kruschke, J. K. 1998, Rules and examplars in category learning. Journal of Experimental Psychology: General, 127 (2): 107-140.
6. French, R. M., 1992, Semi-distributed representations and catastrophic forgetting in connectionist networks. Connection Science, 4: 365-377.
7. French, R. M., 1997, Pseudo-recurrent connectionist networks: an approach to the 'sensitivity-stability' dilemma. Connection Science, 9 (4): 353-379.
8. French, R. M., 1999. Catastrophic forgetting in connectionist networks. Trends in Cognitive Sciences, 3 (4): 128-135.
9. French, R. M., and Ferrara, A., 1999, Modeling time perception in rats: evidence for catastrophic interference in animal learning. In Proceedings of the 21st Annual Conference of the Cognitive Sciences Society (Hillsdale NJ: L. Erlbaum), pp. 173-178.
10. Glaze, J. A., 1928, The association value of non-sense syllables. Journal of Genetic Psychology, 35: 255-269.
11. Hampshire, J. B., and Waibel, A., 1992, The meta-pi network: building distributed knowledge representations for robust multisource pattern recognition. IEEE Transactions on Pattern Analysts and Machine Intelligence. 14: (7): 751-769.
12. Hintzman, D. L., 1984, MINERVA 2: a simulation model of human memory. Behavior Research Methods, Instruments, and Computers, 16 (2): 96-101.
13. Jacobs, R. A., Jordan, M. I., and Barto, A. G., 1991, Task decomposition through competition in a modular connectionist architecture: the what and where vision tasks. Cognitive Science, 15: 219-250.
14. Jones, M. R., 1974, Cognitive representations of serial patterns. In B. Kantrowitz (ed.) Human Information Processing: Tutorials in Performance and Cognition (Hillsdale NJ: Erlbaum), pp. 187-229.
15. Jordan, M. I., and Jacobs, R. A. 1994, Hierarchical mixtures of experts and the EM algorithm. Neural Computation, 6: 181-214.
16. Kruschke, J. K. 1992, ALCOVE: an exemplar-based model of category learning. Psychological Review, 99 (1): 22-44.
17. McClelland, J. L., McNaughton, B. L., and O'Reilly, R. C.. 1995, Why there are complimentary learning systems in the hippocampus and neocortex: insights from successes and failures of connectionist models of learning and memory. Psychological Review, 102 (3): 419-457.
18. McCloskey, M., and Cohen, N. J., 1989, Catastrophic interference in connectionist networks: the sequential learning problem. In H. G. Bower (ed.) The Psychology of Learning and Motivation, Vol. 24 (New York: Academic Press), pp. 109-165.
19. McRae, K., and Hetherington, P. A., 1993, Catastrophic interference is eliminated in pretrained networks. In Proceedings of the 15th Annual Conference Sciences Society (Hillsdale NJ: L. Erlbaum), pp. 723-728.
20. Miller, G. A., 1956, The magical number seven, plus or minus two: some limits on our capacity for processing information. Psychological Review, 63 (2): 81-97.
21. Mishkin, M., Ungerleider, L. G., and Macko, K. A., 1983, Object vision and spatial vision: two cortical pathways. Trends In Neurosciences, 6: 414-417.
22. Poggio, T., and Girosi, F., 1990, Regularization algorithms for learning that are equivalent to multilayer networks. Science, 247: 978-982.
23. Ratcliff, R., 1990, Connectionist models of recognition and memory: constraints imposed by learning and forgetting functions. Psychological Review, 97 (2): 285-308.
24. Restle, F., and Brown, E. R., 1970, Serial pattern learning. Journal of Experimental Psychology. 83: 120-125.
25. Robins, A., 1995, Catastrophic forgetting, rehearsal and pseudorehearsal. Connection Science, 7 (2): 123-146.
26. Rumelhart, D. E., Hinton, G. E., and Williams, R. J., 1986, Learning internal representations by error propagating. In D. E. Rumelhart and J. L. McClelland (eds) Parallel Distributed Processing: Explorations Microstructure of Cognition: Vol. 1. Foundations (Cambridge MA: MIT Press). pp. 318-362.
27. Seidenberg, M. S., and McClelland, J. L., 1989, A distributed developmental model of word recognition and naming. Psychological Review, 96 (4): 523-568.
28. Shadmehr, R., and Brashers-Krug, T., 1997, Functional stages in the formation of human long-term motor rnemory. The Journal of Neuroscience, 17 (1): 409-419.
29. Sharkey, N. E., and Sharkey, A. J. C., 1995, An analysis of catastrophic interference. Connection Science, 7 (3-4): 301-329.
30. Shepard, R. N., 1987, Toward a universal law of generalization for psychological science. Science. 237: 1317-1323.
31. Simon, H. A., and Kotovsky, K., 1963, Human acquisition of concepts for sequential patterns. Psychological Review, 70: 534-546.