Efficient learning of NN-MLP based on individual evolutionary algorithm

Neurocomputing

Volumn 13, Issue 2-4, 1996, Pages 201-215

  Zhao, Qiangfu ^a   Higuchi, Tatsuo ^a  

^a TOHOKU UNIVERSITY   (Japan)

Author keywords

individual evolutionary algorithm; multilayer perceptron; nearest neighbor classifier; neural network learning; supervised organization

Indexed keywords

COMPUTATION THEORY; COMPUTER SIMULATION; GENETIC ALGORITHMS; LEARNING ALGORITHMS; LEARNING SYSTEMS;

INDIVIDUAL EVOLUTIONARY ALGORITHM; NEAREST NEIGHBOR BASED MULTILAYER PERCEPTRON; NEAREST NEIGHBOR CLASSIFIER; NEURAL NETWORK LEARNING; SUPERVISED ORGANIZATION;

NEURAL NETWORKS;

ALGORITHM; ARTIFICIAL NEURAL NETWORK; CONFERENCE PAPER; LEARNING; PRIORITY JOURNAL;

EID: 0030271252     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/0925-2312(95)00088-7     Document Type: Conference Paper

References (39)

1. [1] D.E. Rumelhart and J.L. McClelland, Parallel Distributed Processing 1 (MIT Press, Cambridge, MA, 1986).
2. [2] S.E. Fahlman and C. Lebiere, The Cascade-Correlation Learning Architecture, Advances in Neural Information Processing Systems 2, D.S. Touretzky (ed.), (Morgan Kaufmann Publishers, Los Altos CA, 1990) 524-532.
3. [3] T.S.Chang and K.A.S. Abdel-Ghaffar, A universal neural net with guaranteed convergence to zero system error, IEEE Trans. on Signal Processing 40 (12) (1992) 3022-3031.
4. [4] I.K. Sethi, Entropy nets: from decision trees to neural networks, Proc. IEEE 78 (10) (1990) 1605-1613.
5. [5] H. Guo and S.B. Gelfand, Classification trees with neural network feature extraction, IEEE Trans. on Neural Networks 3 (6) (1992) 923-933.
6. [6] R.P. Brent, Fast training algorithms for multilayer neural nets, IEEE Trans. on Neural Networks 2 (3) (1991) 346-354.
7. [7] T. Poggio and F. Girosi, Networks for approximation and learning, Proc. IEEE 78 (9) (1990) 1481-1497.
8. [8] S.Chen, C.F.N. Cowan and P.M. Grant, Orthogonal least squares learning algorithm for radial basis function networks, IEEE Trans. on Neural Networks 2 (2) (1991) 302-309.
9. [9] J. Sietsma and R.J.F. Dow, Creating artificial neural networks that generalize, Neural Networks 4 (1991) 67-79.
10. [10] K. Kameyama and Y. Kosugi, Neural network pruning by fusing hidden layer units, IEICE Trans. E74 (12) (1991) 4198-4204.
11. [11] Y. Matsunaga, Y. Nakade, O. Yamakawa and K. Murase, A back-propagation algorithm with automatic reduction of association units in multi-layered neural network, IEICE Trans. J74-D-II (8) (1991) 1118-1121.
12. [12] T. Oshino, J. Ojima and S. Yamamoto, Method for gradually reducing a number of hidden units on back propagation learning algorithm, IEICE Trans. J-76-D-II (7) (1993) 1414-1424.
13. [13] M. Ishikawa and H. Uchida, A structural learning of neural networks based on entropy criterion, Proc. Int. Joint Conf. on Neural Networks (China, Beijing, 1992) II375-II380.
14. [14] Q.F. Zhao and T. Higuchi, A study on the determination of MLP structures, Proc. IEICE Karuizawa Workshop (Japan, Karuizawa, 1994) 121-126.
15. [15] T.M. Cover and P.E. Hart, Nearest neighbor pattern classification, IEEE Trans. on Information Theory 13 (1) (1967) 21-27.
16. [16] Q.F. Zhao, Neural network realization of the nearest neighbor methods, Technical Report of IEICE, NC93-65 (1993) 83-87.
17. [17] O.J. Murphy, Nearest neighbor pattern classification perceptrons, Proc. IEEE 78 (10) (1990) 1595-1598.
18. [18] N.K. Bose and A.K. Garga, Neural network design using Voronoi diagrams, IEEE Trans. on Neural Networks 4 (5) (1993) 778-787.
19. [19] D.L. Reilly, L.N. Cooper and C. Elbaum, A neural model for category learning, Biol. Cybern 45 (1982) 35-41.
20. [20] Y. Okamoto, Neural network model for real time adaptation to rapidly changing environment, IEICE Trans. J73-D-II (8) (1990) 1186-1191.
21. [21] T. Kohonen, Self-organized formation of topologically correct feature maps, Biolog. Cybern. 43 (1982) 59-69.
22. [22] T. Kohonen, The self-organizing map, Proc. IEEE 78 (9) (1990) 1464-1480.
23. [23] J.A. Kangas, T. Kohonen and J.T. Laaksonen, Variants of self-organizing maps, IEEE Trans. on Neural Networks 1 (1) (1990) 93-99.
24. [24] B. Kosko, Unsupervised learning in noise, IEEE Trans. on Neural Networks 1 (1) (1990) 44-57.
25. [25] B. Kosko, Stochastic competitive learning, IEEE Trans. on Neural Networks 2 (5) (1991) 522-529.
26. [26] G.A. Carpenter and S. Grossberg, ART 2: self-organization of stable category recognition codes for analog input patterns, Applied Optics 26 (23) (1987) 4919-4930.
27. [27] G.A. Carpenter and S. Grossberg, The ART of adaptive pattern recognition by a self-organizing neural network, IEEE Computer 21 (3) (1988) 77-88.
28. [28] S. Geva and J. Sitte, Adaptive nearest neighbor pattern classification, IEEE Trans. on Neural Networks 2 (2) (1991) 318-322.
29. [29] Y. Linde, A. Buzo and R.M. Gray, An algorithm for vector quantizer design, IEEE Trans. on Communication 28 (1) (1980) 84-95.
30. [30] P.E. Hart, The condensed nearest neighbor rule, IEEE Trans. on Information Theory 14 (5) (1968) 515-516.
31. [31] G.W. Gates, The reduced nearest neighbor rule, IEEE Trans. on Information Theory 18 (5) (1972) 431-433.
32. [32] K. Fukunaga and J.M. Mantock, Nonparametric data reduction, IEEE Trans. on Pattern Analysis and Machine Intelligence 6 (1) (1984) 115-118.
33. [33] K. Fukunaga and R.R. Kayes, The reduced Parzen classifier, IEEE Trans. on Pattern Analysis and Machine Intelligence 11 (4) (1989) 423-425.
34. [34] C.L. Chang, Finding prototypes for nearest neighbor classifiers, IEEE Trans. on Computers 23 (11) (1974) 1179-1184.
35. [35] Q.B. Xie, C.A. Laszlo and R.K. Ward, Vector quantization technique for nonparametric classifier design, IEEE Trans. on Pattern Analysis and Machine Intelligence 15 (12) (1993) 1326-1330.
36. [36] Q.F. Zhao and T. Higuchi, Efficient learning of nearest neighbor multilayer perceptrons, Proc. international Conference on Fuzzy Logic, Neural Nets and Soft Computing (Japan, Iizuka, 1994) 77-78.
37. [37] Q.F. Zhao and T. Higuchi, Supervised organization of nearest neighbor MLP, Proc. International Conference on Neural Information Processing (Korea, Seoul, 1994) 1398-1403.
38. [38] X. Yao, Evolutionary artificial neural networks. Int. J. Neural Systems 4 (3) (1993) 203-222.
39. [39] D.B. Fogel, An introduction to simulated evolutionary optimization, IEEE Trans. on Neural Networks 5 (1) (1994) 3-14.