On the accuracy of mapping by neural networks trained by backpropagation with forgetting

Neurocomputing

Volumn 13, Issue 2-4, 1996, Pages 295-311

  Kozma, R ^a   Sakuma, M ^a   Yokoyama, Y ^a   Kitamura, M ^a  

^a TOHOKU UNIVERSITY   (Japan)

Author keywords

accuracy of mapping; anomaly detection; forgetting of connection weights; structural learning

Indexed keywords

ALGORITHMS; BACKPROPAGATION; ERRORS; KNOWLEDGE ACQUISITION; LEARNING SYSTEMS; PROBABILITY;

ACCURACY OF MAPPING; ANOMALY DETECTION; FORGETTING OF CONNECTION WEIGHTS; STRUCTURAL LEARNING;

NEURAL NETWORKS;

ARTIFICIAL NEURAL NETWORK; CONFERENCE PAPER; LEARNING; PRIORITY JOURNAL;

EID: 0030271244     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/0925-2312(95)00094-1     Document Type: Conference Paper

References (25)

1. [1] E.B. Bartlett, Dynamic node architecture learning: An information theoretic approach, Neural Networks 7(1) (1994) 129-140.
2. [2] J.C. Bezdek, What is computational intelligence?, in: J.M. Zurada, R.J. Marks II and C.J. Robinson, eds., Computational Intelligence-Imitating Life (IEEE Press, New York, NY, 1994) 1-12.
3. [3] Y. Le Cun, J.S. Denker and S.A. Solla, Optimal brain damage, in: D.S. Toureczky, ed., Advances in Neural Information Processing Systems 2 (Morgan Kaufmann, 1990) 598-605.
4. [4] D.B. Fogel, An information criterion for optimal neural network selection, IEEE Trans. Neural Networks 2(5) (1991) 490-497.
5. [5] J.D. Hamilton, Time Series Analysis (Princeton Univ. Press, Princeton, NJ, 1993)
6. [6] M. Ishikawa, A new approach to problem solving by modular structured networks, Proc. 2nd Int. Conf. on Fuzzy Logic and Neural Networks, Iizuka '92 (1992) 855-858.
7. [7] M. Ishikawa, Structural learning in neural networks, Proc. 3rd Int. Conf. on Fuzzy Logic, Neural Nets and Soft Computing, Iizuka'94 (1994) 37-44.
8. [8] M. Ishikawa, Learning of modular structured networks, Artificial Intelligence (1995).
9. [9] A.K. Jain and J. Mao, Neural networks and pattern recognition, in: J.M. Zurada, R.J. Marks II and C.J. Robinson, eds., Computational Intelligence - Imitating Life (IEEE Press, New York, NY, 1994) 194-212.
10. [10] G.M. Jenkins D.G. Watts, Spectral Analysis and Its Applications (Holden Day, San Francisco, 1968).
11. [11] F. Kanaya and S. Miyake, Bayes statistical behavior and valid generalization of pattern classifying neural networks, IEEE Trans. Neural Networks 2(4) (1991) 471-475.
12. [12] E.D. Kamin, A simple procedure for pruning back-propagation trained neural nets, IEEE Trans. Neural Networks 1(2) (1990) 239-242.
13. [13] R. Kozma, H. van Dam and J.E. Hoogenboom, Identification of flow patterns by neutron noise analysis, Nuclear Technology 100 (1992) 97-110.
14. [14] R. Kozma, M. Kitamura, M. Sakuma and Y. Yokoyama, Anomaly detection by neural network models and statistical time series analysis, Proc. IEEE WCCI Int. Conf. on Neural Networks, ICCN'94 Vol.5 (1994) 3207-3210.
15. [15] R. Kozma, M. Sakuma, S. Sato and M. Kitamura, Evaluating the consistency between input uncertainty and learning accuracy in neural networks, Proc. 3rd Int. Conf. on Fuzzy Logic, neural nets and Soft Computing, Iizuka'94 (1994) 69-70.
16. [16] M.T. Musawi, K.H. Chan, D.M. Hummels and K. Kalantri, On the generalization ability of neural network classifiers, IEEE Trans. Patt. Anal. Mach. Intell. 16(6) (1994) 659-663.
17. [17] K.L. Priddy, S.K. Rogers, D.W. Ruck, G.L. Tarr and M. Kabrisky, Bayesian selection of important features for feed-forward neural networks, Neurocomputing 5(2-3) (1993) 91-103.
18. [18] R. Reed, Pruning algorithms-a survey, IEEE Trans. Neural Networks 4(5) (1993) 740-747.
19. [19] D.W. Ruck, S.K. Rogers, M. Kabrisky, M.E. Oxley and B.W. Suter, The multilayer perceptron as an approximation to a Bayes optimal discriminant function, IEEE Trans. Neural Networks 1(4) (1990) 296-298.
20. [20] Rumelhart, D.E., G.E. Hinton and R.J. Williams, Learning internal representations by error propagation, in: D. Rumelhart and F. McClelland, eds., Parallel Distributed Processing, Vol. 1, (M.I.T. Press, Cambridge, MA, 1986) 319-362.
21. [21] A. Sankar, and R.J. Mammone, Growing and pruning neural tree networks, IEEE Trans. Comput. 42(3) (1993) 291-299.
22. [22] D.F. Specht, Probabilistic neutral networks, Neural Networks 3(1) (1990) 109-118.
23. [23] P.J. Werbos, Backpropagation through time: what it does and how to do it, Proc. IEEE 78(10) (1990) 1550-1560.
24. [24] P.J. Werbos, T. McAvoy and T. Su, Neural networks, system identification, and control in the chemical process industries, in: D.A. White and D.A. Sofge, eds., Handbook of Intelligent Control (Van Nostrand Reinhold, New York, 1993) 325-338.
25. [25] S. Yasui, Convergence suppression and divergence facilitation for pruning multi-output backpropagation networks, Proc. 3rd Int. Conf. on Fuzzy Logic, Neural Nets and Soft Computing, Iizuka'94 (1994) 137-139.