Mutation-based genetic neural network

IEEE Transactions on Neural Networks

Volumn 16, Issue 3, 2005, Pages 587-600

  Palmes, Paulito P ^a   Hayasaka, Taichi ^b   Usui, Shiro ^a  

^a RIKEN BRAIN SCIENCE INSTITUTE   (Japan)

^b TOYOTA NATIONAL COLLEGE OF TECHNOLOGY   (Japan)

Author keywords

Artificial neural networks (ANNs); Evolutionary algorithm (EA); Evolutionary programming (EP); Evolutionary strategies (ESs); Genetic algorithm (GA); Hybrid algorithm (HA)

Indexed keywords

COMPUTATIONAL METHODS; ENCODING (SYMBOLS); EVOLUTIONARY ALGORITHMS; GENETIC ALGORITHMS; MATHEMATICAL TRANSFORMATIONS; MATRIX ALGEBRA; STATISTICAL METHODS; VECTORS;

EVOLUTIONARY STRATEGIES (ESS); GLOBAL SEARCHING CAPABILITIES; HYBRID ALGORITHM (HA); MUTATION BASED GENETIC NEURAL NETWORK (MGNN);

NEURAL NETWORKS;

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; BIOLOGICAL MODEL; BREAST TUMOR; COMPUTER SIMULATION; EVALUATION; HUMAN; MATHEMATICAL COMPUTING; METHODOLOGY; MUTATION; SIGNAL PROCESSING; STATISTICAL MODEL; STATISTICS;

ALGORITHMS; BREAST NEOPLASMS; COMPUTER SIMULATION; HUMANS; LINEAR MODELS; MODELS, GENETIC; MUTATION; NEURAL NETWORKS (COMPUTER); NUMERICAL ANALYSIS, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; SIGNAL PROCESSING, COMPUTER-ASSISTED; STOCHASTIC PROCESSES;

EID: 19344362899     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2005.844858     Document Type: Article

References (68)

1. J. H. Holland, Adaptation in Natural and Artificial Systems. Ann Arbor, MI: Univ. Michigan Press, 1975.
2. L. Fogel, A. Owens, and M. Waish, Eds., Artificial Intelligence Through Simulated Evolution. New York: Wiley, 1966.
3. D. Goldberg, Genetic Algorithms in Search, Optimization, and Machine Learning. Reading, MA: Addison-Wesley, 1989.
4. J. Koza, Genetic Programming. Cambridge MA: MIT Press, 1992.
5. S. Grossberg, Ed., Neural Networks and Natural Intelligence. Cambridge, MA: MIT Press, 1988.
6. D. Rumelhart and J. McClelland, Eds., Parallel Distributed Processing: Explorations in Microstructure of Cognition. Cambridge, MA: MIT Press, 1986.
7. J. M. Zurada, Ed., Introduction to Neural Systems. St. Paul, MN: West, 1992.
8. P. J. Angeline, G. M. Saunders, and J. B. Poliack, "An evolutionary algorithm that constructs recurrent neural networks," IEEE Trans. Neural Netw., vol. 5, no. 1, pp. 54-64, Jan. 1994.
9. N. Nikolaev and H. Iba, "Learning polynomial feedforward neural networks by genetic programming and backpropagation," IEEE Trans. Neural Netw., vol. 14, no. 2, pp. 337-350, Mar. 2003.
10. F. Leung, H. Lam, S. Ling, and P. Tam, "Tuning of the structure and parameters of a neural network using an improved genetic algorithm," IEEE Trans. Neural Netw., vol. 14, no. 1, pp. 79-88, Jan. 2003.
11. J. T. Alander. (1995) An indexed bibliography of genetic algorithms and neural networks. Univ. Baasa, Dept. Information Technol. and Production Economics. [Online] Available: ftp://ftp.uwasa.fi/cs_report941/ gaNNbib.ps.Z
12. R. K. Belew, J. McInerney, and N. N. Schraudolph, "Evolving networks: using the genetic algorithm with connectionist learning," in Artificial Life II, C. G. Langton, C. Taylor, J. D. Farmer, and S. Rasmussen, Eds. Reading, MA: Addison-Wesley, 1992, pp. 511-547.
13. P. J. B. Hancock, "Coding strategies for genetic algorithms and neural nets," Ph.D. dissertation, Dept. Comput. Sci. Math., Univ. Stirling, 1992.
14. S. A. Harp and T. Samad, "Optimizing neural networks with genetic algorithms," in Proc. Amer. Power Conf., vol. 54, 1992, pp. 1138-1143.
15. M. Potter, "A genetic cascade-correlation learning algorithm," in Proce. COGANN'92 Int. Workshop Combinations of Genetic Algorithms and Neural Networks, 1992, pp. 123-133.
16. P. Robbins, A. Soper, and K. Rennolls, "Use of genetic algorithms for optimal topology determination in back propagation neural networks," in Proc. Int. Conf. Artificial Neural Networks and Genetic Algorithms, 1993, pp. 726-730.
17. J. D. Schaffer, D. Whitley, and L. J. Eshelman, "Combinations of genetic algorithms and neural networks: A survey of the state of the art," in Proc. Conf. Combinations of Genetic Algorithms and Neural Networks, 1992, pp. 1-37.
18. W. Schiffmann, M. Joost, and R. Werner, "Application of genetic algorithms to the construction of topologies for multilayer perceptrons," in Proc. Int. Conf. Artificial Neural Networks and Genetic Algorithms, 1993, pp. 675-682.
19. D. WhitleY and C. Bogart, "The evolution of connectivity: Pruning neural networks using genetic algorithms," in Proc. Int. Joint Conf. Neural Networks, 1990, pp 134-137.
20. P. Wilke, "Simulation of neural network and genetic algorithms in a distributed computing environment using neurograph," in Proc. World Congr. Neural Networks, 1993, pp. I269-I272.
21. V. Manniezzo, "Searching among search spaces: Hastening the genetic evolution of feed-forward neural networks," in Proc. Int. Joint Conf. Neural Networks and Genetic Algorithms, 1993, pp. 635-642.
22. P. Kohn, "Combining genetic algorithms and neural networks," M.S. thesis, Dept. Comput. Sci., Univ. Tenessee, Knoxville, TN, 1994.
23. E. Keedwell, A. Narayanan, and D. Savic, "Using genetic algorithms to extract rules from trained neural networks," in Proc. Genetic Evolutionary Computation Conf., vol. 1, W. Banzhaf, J. Daida, A. Eiben, M. Garzon, V. Honavar, M. Jakiela, and R. Smith, Eds., Jul. 13-17, 1999, p. 793.
24. J. Bishop, M. Bushnell, A. Usher, and S. Westland, "Genetic optimization of neural network architectures for color recipe prediction," in Proc. Int. Conf. Artificial Neural Networks Genetic Algorithms, 1993, pp. 719-725.
25. P. de la Brassinne, "Genetic algorithms and learning of neural networks," Bulletin Scientifique de l'Association des Ingenieurs Electriciens sortis de l'Institut Electrotechnique Montefiore, vol. 106, no. 1, pp. 41-58, 1993.
26. H. Braun and J. Weisbrod, "Evolving neural feedforward networks," in Proc. Int. Conf. Artificial Neural Networks Genetic Algorithms, 1993, pp. 25-32.
27. V. Petridis, S. Kazarlis, and A. Papaikonomou, "A genetic algorithm for training recurrent neural networks," in Proc Int. Joint Conf. Neural Networks, Nagoya, Japan, 1993 pp. 2706-2709.
28. W. Philipsen and L. Cluitmans, "Using a genetic algorithm to tune potts neural networks," in Artificial Neural Networks and Genetic Algorithms, R. Albrecht, C. Reeves, and N. Steele, Eds. New York: Springer-Verlag, 1993, pp. 650-657.
29. D. Montana and L. Davis, "Training feedforward neural networks using genetic algorithms," in Proc. 11th Int. Joint Conf. Artificial Intelligence, 1989, pp. 762-767.
30. R. Mitchell, J. Bishop, and W. Low, "Using a genetic algorithm to find the rules of a neural network," in Artificial Neural Networks and Genetic Algorithms, R. Albrecht, C. Reeves, and N. Steele, Eds. New York: Springer-Verlag, 1993, pp. 664-669.
31. M. Kouchi, H. Inayoshi, and T. Hoshino, "Optimization of neural-net structure by genetic algorithm with diploidy and geographical isolation model," J. Jap. Soc. Artif. Intell., vol. 7, no. 3, pp. 509-517, May 1992.
32. D. B. Fogel, "Using evolutionary programming to create neural networks that are capable of playing tic-tac-toe," in Proc. Amer. Power Conf., 1993, pp. 875-879.
33. D. B. Fogel and L. J. Fogel, "Method and apparatus for training a neural network using evolutionary programming," Patent 5 214 746, May 25, 1993.
34. D. Chakraborty and N. Pal, "A novel scheme for multilayered perceptrons to realize proper generalization and incremental learning," IEEE Trans. Neural Netw., vol. 14, no. 1, pp. 1-14, Jan. 2003.
35. S.-C. Ng, C.-C. Cheun, and S.-H. Leung, "Magnified gradient function with deterministic weight modification in adaptive learning," IEEE Trans. Neural Netw., vol. 15, no. 6, pp, 1411-1423, Nov. 2004.
36. J. Schmidhuber, "Accelerated learning in back-propagation nets," in Connectionism in Perspective. Amsterdam, The Netherlands: Elsevier, 1989, pp. 439-445.
37. P. A. Castillo, V. Rivas, J. J. Merelo, A. Prieto, and G. Romero, "G-prop II: Global optimization of multilayer perceptrons using GAs," in Proc. Congr. Evolutionary Computation, vol. 3, P. J. Angeline, Z. Michalewicz, M. Schoenauer, X. Yao, and A. Zalzala, Eds., 1999, pp. 2022-2028.
38. S. E. Fahlman and C. Lebiere, "The cascade-correlation learning architecture," in Advances in Neural Information Processing Systems Denver 1989, D. S. Touretzky, Ed. San Mateo, CA: Morgan Kaufmann, 1990, vol. 2, pp. 524-532.
39. R. Setiono and H. Liu, "Improving backpropagation learning with feature selection," Applied Intelligence, vol. 6, no. 2, pp. 129-139, 1996.
40. X. Yao, "Evolving artificial neural networks," Proc. IEEE, vol. 87, no. 9, pp. 1423-1447, Sep. 1999.
41. D. B. Fogel, "Phenotypes, genotypes, and operators in evolutionary computation," in Proc. 1995 IEEE Int. Conf. Evolutionary Computation, Piscataway, NJ, 1995, pp. 193-198.
42. S. Lawrence, C. L. Giles, and A. C. Tsoi, "Lessons in neural network training: Overfitting may be harder than expected," in Proc. 14th Nat. Conf. Artificial Intelligence (AAAI'97), Menlo Park, CA, 1997, pp. 540-545.
43. M. Gori and A. Tesi, "On the problem of local minima in backpropagation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 14, no. 1, pp. 76-86, Jan. 1992.
44. P. J. B. Hancock, "Genetic algorithms and permutation problems: A comparison of recombination operators for neural net structure specification," in Proc. COGANN Workshop, Baltimore, MD, 1992, pp. 108-122.
45. X. Yao and Y. Liu, "A new evolutionary system for evolving artificial neural networks," IEEE Trans. Neural Netw., vol. 8, no 3, pp. 694-713, May 1997.
46. I. Rechenberg, Evolutionsstrategie. Berlin, Germany: Friedrich Frommann Springer-Verlag, 1994.
47. Y. Davidor, "Foundations of genetic algorithms," in Epistasis Variance: A Viewpoint on GA-Hardness. San Marteo, CA: Morgan Kaufmann, 1991, pp. 23-35.
48. S. A. Kaufmann, Lectures in the Science of Complexity. Reading, MA: Addison-Wesley, 1989, vol. 1, pp. 567-618.
49. J. R. McDonnell and D. Waagen, "Neural network structure design by evolutionary programming," in Proc. 2nd Annu. Conf. Evolutionary Programming, D. B. Fogel and W. Atmar, Eds., La Jolla, CA, 1993, pp. 79-89.
50. J. R. McDonnell and D. Waagen, "Evolving neural network connectivity," in Proc. Amer. Power Conf., 1993, pp. 863-868.
51. J. R. McDonnell and D. Waagen, "Evolving neural network architecture," Proc. SPIE-Int. Soc. Opt. Eng., vol. 1766, pp. 690-701, 1992.
52. S. Kirkpatrick, C. Gelatt, and M. Vecchi, "Optimization by simulated annealing," Science, vol. 220, pp. 671-680, 1983.
53. X. Yao and Y. Liu, "Making use of populations information in evolutionary artificial networks," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 28, no. 3, pp. 417-425, Jun. 1998.
54. M. Islam, X. Yao, and K. Murase, "A constructive algorithm for training, cooperative neural network ensembles," IEEE Trans. Neural Netw., vol. 14, no. 4, pp. 820-834, Jul. 2003.
55. N. Garcia-Pedrajas, C. Hervas-Martinez, and J. Munoz-Perez, "Covnet: A cooperative coevolutionary model for evolving artificial neural networks," IEEE Trans. Neural Netw., vol. 14, no. 3, pp. 575-596, May 2003.
56. H.-P. Schwefel, Evolution and Optimum Seeking. New York: Wiley, 1995.
57. I. Rechenberg, Evolutionsstrategie: Optimierung Technischer Systeme nach Prinzipien der biologischen Evolution. Stuttgart, Germany: Frommann-Holzboog Verlag, 1973.
58. D. Fogel, Evolutionary Computation. Toward a New Philosophy of Machine Intelligence. Piscataway, NJ: IEEE Press, 1995.
59. H. Schwefel, "Deep insight from simple models of evolution," BioSystems, vol. 64, pp. 189-198, 2002.
60. C. Igel and M. Kreutz, "Operator adaptation in evolutionary computation and its application to structure optimization of neural networks," Neurocomput., vol. 55, no. 1-2, pp. 347-361, Sep. 2003.
61. I. D. Falco, A. D. Ciopa, and E. Tarantino, "Mutation-based genetic algorithm: Performance evaluation," Appl. Soft Comput., vol. 1, pp. 285-299, 2002.
62. L. Prechelt, "Proben1 - a set of neural network benchmark problems and benchmarking," Fakultat fur Informatik, Univ. Karlsruhe, Karlsruhe, Germany, Tech. Rep., Sep. 1994.
63. P. M. Murphy and D. W. Aha, "UCI repository of machine learning databases," Dept. Inf. Comput. Sci., Univ. California, Irvine, CA, 1994.
64. M. Riedmiller and H. Braun, "A direct adaptive method for faster backpropagation learning: The RPROP algorithm," in Proc. IEEE Conf. Neural Networks, San Francisco, CA, Apr. 1993, pp. 586-591.
65. D. H. Wolpert and W. G. Macready, "No free lunch theorems for optimization" IEEE Trans. Evol. Comput., vol. 1, no. 1, pp. 67-82, Feb-1997.
66. G. Ochoa, I. Harvey, and H. Buxton, "On recombination and optimal mutation rates," in Proc. Genetic and Evolutionary Computation Conf., vol. 1, Orlando, FL, 1999, pp. 488-495.
67. P. J. Angeline, "Adaptive and self-adaptive evolutionary computations," in Computational Intelligence: A Dynamic Systems Perspective, M. Palaniswami and Y. Attikiouzel, Eds. Piscataway, NJ: IEEE Press, 1995, pp. 152-163.
68. R. Hinterding, Z. Michalewicz and A. E. Eiben. (1997) Adaptation in evolutionary computation: A survey. Proc. IEEE Conf. Evolutionary Computation, World Congr. Computational Intelligence. [Online], pp. 65-69.