Evolving improved incremental learning schemes for neural network systems

2005 IEEE Congress on Evolutionary Computation, IEEE CEC 2005. Proceedings

Volumn 3, Issue , 2005, Pages 2002-2009

  Seipone, Tebogo ^a   Bullinaria, John A ^a  

^a UNIVERSITY OF BIRMINGHAM   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL METHODS; COMPUTER SIMULATION; INFORMATION ANALYSIS; LEARNING SYSTEMS;

INCREMENTAL LEARNING; NEURAL NETWORK SYSTEMS;

NEURAL NETWORKS;

EID: 27144484400     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. Bishop, C.M. (1995). Neural Networks for Pattern Recognition. Oxford, UK: Oxford University Press.
2. Blake, C.L. & Merz, C.J. (1998). UCI Repository of machine learning databases. University of California, Irvine, Dept. of Information and Computer Science. http://www.ics.uci.edu/~mlearn/MLRepository.html.
3. Bullinaria, J.A. (2003). Evolving Efficient Learning Algorithms for Binary Mappings. Neural Networks, 16, 793-800.
4. Engelbrecht, A.P. & Brits, R. (2001). A Clustering Approach to Incremental Learning for Feedforward Neural Networks. Proceedings of the International Joint Conference in Neural Networks, 3, 2019-2024
5. Frean, M. & Robins, A. (1999). Catastrophic Forgetting in Simple Neural Networks: An Analysis of the Pseudorehearsal Solution. Network: Computation in Neural Systems, 10, 227-236.
6. French, R.M. (2003). Catastrophic Interference in Connectionist Networks. In: L. Nadel (Ed), Encyclopedia of Cognitive Science, 1, 431-435.
7. Giraud-Carrier, C. (2000). A Note on the Utility of Incremental Learning. AI Communications, 13, 215-223.
8. Hinton, G.E. & Plaut, D.C. (1987). Using Fast Weights to Deblur Old Memories. Proceedings of the Ninth Annual Conference of the Cognitive Science Society. NJ:Erlbaum. 177-186.
9. McCloskey, M. & Cohen, N.J. (1989). Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem. The Psychology of Learning and Motivation, 24, 109-165.
10. Polikar, R., Byorick, J., Krause, S., Marino, A., & Moreton, M. (2002). Learn++: A Classifier Independent Incremental Learning Algorithm for Supervised Neural Networks. Proceedings of the 2002 International Joint Conference on Neural Networks. 2, 1742-1747.
11. Polikar, R., Udpa, L., Udpa, S.S., & Honavar, V. (2001). Learn++: An Incremental Learning Algorithm for Multi-Layer Perceptron Networks. IEEE Transactions on Systems, Man, and Cybernetics. 31, 497-508.
12. Ratcliff, R. (1990). Connectionist Models of Recognition and Memory: Constraints Imposed by Learning and Forgetting Functions. Psychological Review, 97, 205-308.
13. Robins, A. (1995). Catastrophic Forgetting, Rehearsal and Pseudorehearsal. Connection Science, 7, 123-146.
14. Seipone, T. & Bullinaria, J.A. (2005). The Evolution of Minimal Catastrophic Forgetting in Neural Systems. Proceedings of the Twenty-Seventh Annual Conference of the Cognitive Science Society. Mahwah, NJ: LEA.
15. Yao, X. (1999). Evolving Artificial Neural Networks. Proceedings of the IEEE, 87, 1423-1447.