Tuning of the structure and parameters of a neural network using an improved genetic algorithm

IEEE Transactions on Neural Networks

Volumn 14, Issue 1, 2003, Pages 79-88

  Leung, Frank H F ^a   Lam, H K ^a   Ling, S H ^a   Tam, Peter K S ^a  

^a HONG KONG POLYTECHNIC UNIVERSITY   (Hong Kong)

Author keywords

Genetic algorithm (GA); Neural networks; Parameter learning; Structure learning

Indexed keywords

BACKPROPAGATION; COMPUTER SIMULATION; GENETIC ALGORITHMS; PROBABILITY;

PARAMETER LEARNING;

NEURAL NETWORKS;

EID: 0037276988     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2002.804317     Document Type: Article

References (37)

1. J. H. Holland, Adaptation in Natural and Artificial Systems. Ann Arbor, MI: Univ. Michigan Press, 1975.
2. D. T. Pham and D. Karaboga, Intelligent Optimization Techniques, Genetic Algorithms, Tabu Search, Simulated Annealing and Neural Networks. New York: Springer-Verlag, 2000.
3. Y. Hanaki, T. Hashiyama, and S. Okuma, "Accelerated evolutionary computation using fitness estimation," in Proc. IEEE Int. Conf. Syst., Man, Cybern., vol. 1, 1999, pp. 643-648.
4. K.A. De Jong, "An analysis of the behavior of a class of genetic adaptive systems," Ph.D. dissertation, Univ. Michigan, Ann Arbor, MI, 1975.
5. Z. Michalewicz, Genetic Algorithm + Data Structures = Evolution Programs, 2nd extended ed. New York: Springer-Verlag, 1994.
6. G.X. Yao and Y. Liu, "Evolutionary programming made faster," IEEE Trans. Evol. Comput., vol. 3, pp. 82-102, July 1999.
7. M. Li, K. Mechrotra, C. Mohan, and S. Ranka, "Sunspot numbers forecasting using neural network," in Proc. 5th IEEE Int. Symp. Intell. Contr., 1990, pp. 524-528.
8. T. J. Cholewo and J. M. Zurada, "Sequential network construction for time series prediction," in Proc. Int. Conf. Neural Networks, vol. 4, 1997, pp. 2034-2038.
9. B. D. Liu, C. Y. Chen, and J. Y. Tsao, "Design of adaptive fuzzy logic controller based on linguistic-hedge concepts and genetic algorithms," IEEE Trans. Syst., Man, Cybern. B, vol. 31, pp. 32-53, Feb. 2001.
10. Y. S. Zhou and L. Y. Lai, "Optimal design for fuzzy controllers by genetic algorithms," IEEE Trans. Ind. Applicat., vol. 36, pp. 93-97, Jan. 2000.
11. C. F. Juang, J. Y. Lin, and C. T. Lin, "Genetic reinforcement learning through symbiotic evolution for fuzzy controller design," IEEE Trans. Syst., Man. Cybern. B, vol. 30, pp. 290-302, Apr. 2000.
12. H. Juidette and H. Youlal, "Fuzzy dynamic path planning using genetic algorithms," Electron. Lett., vol. 36, no. 4, pp. 374-376, Feb. 2000.
13. R. Caponetto, L. Fortuna, G. Nunnari, L. Occhipinti, and M. G. Xibilia, "Soft computing for greenhouse climate control," IEEE Trans. Fuzzy Syst., vol. 8, pp. 753-760, Dec. 2000.
14. M. Setnes and H. Roubos, "GA-fuzzy modeling and classification: Complexity and performance," IEEE Trans. Fuzzy Syst., vol. 8, pp. 509-522, Oct. 2000.
15. K. Belarbi and F. Titel, "Genetic algorithm for the design of a class of fuzzy controllers: An alternative approach," IEEE Trans. Fuzzy Systems, vol. 8, pp. 398-405, Aug. 2000.
16. M. Brown and C. Harris, Neural Fuzzy Adaptive Modeling and Control. Englewood Cliffs, NJ: Prentice-Hall, 1994.
17. S. Amin and J. L. Fernandez-Villacanas, "Dynamic local search," in Proc. 2nd Int. Conf. Genetic Algorithms in Engineering Systems: Innovations and Applications, 1997, pp. 129-132.
18. X. Yao, "Evolving artificial networks," Proc. IEEE, vol. 87, pp. 1423-1447, July 1999.
19. X. Yao and Y. Liu, "A new evolutionary system for evolving artificial neural networks," IEEE Trans. Neural Networks, vol. 8, pp. 694-713, May 1997.
20. F. J. Lin, C. H. Lin, and P. H. Shen, "Self-constructing fuzzy neural network speed controller for permanent-magnet synchronous motor drive," IEEE Trans. Fuzzy Syst., vol. 9, pp. 751-759, Oct. 2001.
21. Y. Hirose, K. Yamashita, and S. Hijiya, "Back-propagation algorithm which varies the number of hidden units," Neural Networks, vol. 4, no. 1, pp. 61-66, 1991.
22. A. Roy, L. S. Kim, and S. Mukhopadhyay, "A polynomial time algorithm for the construction and training of a class of multiplayer perceptions," Neural Networks, vol. 6, no. 4, pp. 535-545, 1993.
23. N. K. Treadold and T. D. Gedeon, "Exploring constructive cascade networks," IEEE Trans. Neural Networks, vol. 10, pp. 1335-1350, Nov. 1999.
24. C. C. Teng and B. W. Wah, "Automated learning for reducing the configuration of a feedforward neural network," IEEE Trans. Neural Networks, vol. 7, pp. 1072-1085, Sept. 1996.
25. Y. Q. Chen, D. W. Thomás, and M. S. Nixon, "Generating-shrinking algorithm for learning arbitrary classification," Neural Networks, vol. 7, no. 9, pp. 1477-1489, 1994.
26. M. C. Moze and P. Smolensky, "Using relevance to reduce network size automatically," Connect. Sci., vol. 1, no. 1, pp 3-16, 1989.
27. H. K. Lam, S. H. Ling, F. H. F. Leung, and P. K. S. Tam, "Tuning of the structure and parameters of neural network using an improved genetic algorithm," in Proc. 27th Annu. Conf. IEEE Ind. Electron. Soc., Denver, CO, Nov. 2001, pp. 25-30.
28. G. P. Miller, P. M. Todd, and S. U. Hegde, "Designing neural networks using genetic algorithms," in Proc. 3rd Int. Conf. Genetic Algorithms Applications, 1989, pp. 379-384.
29. N. Weymaere and J. Martens, "On the initialization and optimization of multiplayer perceptrons," IEEE Trans. Neural Networks, vol. 5, pp. 738-751, Sept. 1994.
30. S. S. Haykin, Neural Networks: A Comprehensive Foundation, 2nd ed. Upper Saddle River, NJ: Prentice-Hall, 1999.
31. X. Wang and M. Elbuluk, "Neural network control of induction machines using genetic algorithm training," in Conf. Record 31st IAS Annual Meeting, vol. 3, 1996, pp. 1733-1740.
32. L. Davis, Handbook of Genetic Algorithms. New York: Van Nostrand Reinhold, 1991.
33. M. Srinivas and L. M. Patnaik, "Genetic algorithms: A survey," IEEE Computer, vol. 27, pp. 17-27, June 1994.
34. J. D. Schaffer, D. Whitley, and L. J. Eshelman, "Combinations of genetic algorithms and neural networks: A survey of the state of the art," in Proc. Int. Workshop Combinations Genetic Algorithms Neural Networks, 1992, pp. 1-37.
35. S. Bornholdt and D. Graudenz, "General asymmetric neural networks and structure design by genetic algorithms: A learning rule for temporal patterns," in Proc. Int. Conf. Syst., Man, Cybern., vol. 2, 1993, pp. 595-600.
36. V. Maniezzo, "Genetic evolution of the topology and weight distribution of neural networks," IEEE Trans. Neural Networks, vol. 5, pp. 39-53, Jan. 1994.
37. P. J. Angeline, G. M. Saunders, and J. B. Pollack, "An evolutionary algorithm that constructs recurrent neural networks," IEEE Trans. Neural Networks, vol. 5, pp. 54-65, Jan. 1994.