Evolving neural networks for strategic decision-making problems

Neural Networks

Volumn 22, Issue 3, 2009, Pages 326-337

  Kohl, Nate ^a   Miikkulainen, Risto ^a  

^a University of Texas at Austin   (United States)

Author keywords

Cascade correlation; Fracture; NEAT; Neuroevolution; RBF networks

Indexed keywords

BENCHMARK DOMAINS; CASCADE CORRELATION; COLLISION WARNINGS; EVOLVING NEURAL NETWORKS; FUNCTION VARIATIONS; LOW-LEVEL CONTROLS; NEAT; NEUROEVOLUTION; POLE BALANCING; RBF NETWORKS; RECEPTIVE FIELDS; STRATEGIC DECISIONS; VEHICLE CONTROLS;

CONTROL SYSTEM SYNTHESIS; DECISION MAKING; FRACTURE; RADIAL BASIS FUNCTION NETWORKS;

NEURAL NETWORKS;

ALGORITHM; ARCHITECTURE; ARTICLE; CONCEPT ANALYSIS; DECISION MAKING; EVOLUTION; HUMAN; LEARNING; NERVE CELL; NERVE CELL NETWORK; PRIORITY JOURNAL; QUALITY CONTROL; RECEPTIVE FIELD; REINFORCEMENT; TASK PERFORMANCE;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; DECISION MAKING, COMPUTER-ASSISTED; EVOLUTION; NERVE NET; NEURAL NETWORKS (COMPUTER); NEURONS; SYSTEMS THEORY; TASK PERFORMANCE AND ANALYSIS;

EID: 67349180191     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neunet.2009.03.001     Document Type: Article

References (77)

1. Angeline P.J. Evolving basis functions with dynamic receptive fields. IEEE international conference on systems, man, and cybernetics Vol. 5 (1997) 4109-4114
2. Angeline P.J., Saunders G.M., and Pollack J.B. An evolutionary algorithm that constructs recurrent neural networks. IEEE Transactions on Neural Networks 5 (1993) 54-65
3. Asada, M., Noda, S., & Hosoda, K. (1995). Non-physical intervention in robot learning based on LFE method. In Proceedings of machine learning conference workshop on learning from examples vs. programming by demonstration (pp. 25-31)
4. Barron A., Rissanen J., and Yu B. The minimum description length principle in coding and modeling. IEEE Transactions on Information Theory 44 6 (1998) 2743-2760
5. Bengio, Y. (2007). Learning deep architectures for ai. Tech. rep. 1312. Dept. IRO, Universite de Montreal
6. Billings S.A., and Zheng G.L. Radial basis function network configuration using genetic algorithms. Neural Networks 8 (1995) 877-890
7. Bochner S. Lectures on Fourier integrals with an author's supplement on monotonic functions. Stieltjes integrals and harmonic analysis (1959), Princeton University Press
8. Bull, L., & O'Hara, T. (2002). Accuracy-based neuro and neuro-fuzzy classifier systems. In Proceedings of the genetic and evolutionary computation conference (pp. 905-911)
9. Butz, M. V. (2005). Kernel-based, ellipsoidal conditions in the real-valued xcs classifier system. In Proceedings of the 2005 conference on genetic and evolutionary computation (pp. 1835-1842)
10. Butz, M. V., & Herbort, O. (2008). Context-dependent predictions and cognitive arm control with xcsf. In Proceedings of the 2008 conference on genetic and evolutionary computation
11. Chaitin G. A theory of program size formally identical to information theory. Journal of the ACM 22 (1975) 329-340
12. Chaiyaratana N., and Zalzala A.M.S. Evolving hybrid rbf-mlp networks using combinedgenetic/unsupervised/supervised learning. UKACC international conference on control Vol. 1 (1998) 330-335
13. Ghosh J., and Nag A. An overview of radial basis function networks. Studies in fuzziness and soft computing: Radial basis function networks 2: New advances in design (2001) 1-36
14. Goldberg, D. E., & Richardson, J. (1987). Genetic algorithms with sharing for multimodal function optimization. In Proceedings of the second international conference on genetic algorithms (pp. 148-154)
15. Gomez, F., & Miikkulainen, R. (1999). Solving non-Markovian control tasks with neuroevolution. In Proceedings of the 16th international joint conference on artificial intelligence
16. Gomez, F., Schmidhuber, J., & Miikkulainen, R. (2006). Efficient non-linear control through neuroevolution. In Proceedings of the European conference on machine learning
17. Gonzalez J., Rojas I., Ortega J., Pomares H., Fernandez F., and Diaz A. Multiobjective evolutionary optimization of the size, shape, and position parameters of radial basis function networks for function approximation. IEEE Transactions on Neural Networks 14 (2003) 1478-1495
18. Gruau F., Whitley D., and Pyeatt L. A comparison between cellular encoding and direct encoding for genetic neural networks. In: Koza J.R., Goldberg D.E., Fogel D.B., and Riolo R.L. (Eds). Genetic programming 1996: Proceedings of the first annual conference (1996), MIT Press 81-89
19. Guillen, A., Pomares, H., Gonzalez, J., Rojas, I., Herrera, L. J., & Prieto, A. (2007). Parallel multi-objective memetic RBFNNS design and feature selection for function approximation problems 4507/2007. pp. 341-350
20. Guillen, A., Rojas, I., Gonzalez, J., Pomares, H., Herrera, L. J., & Paechter, B. (2006). Improving the performance of multi-objective genetic algorithm for function approximation through parallel islands specialisation 4304/2006. pp. 1127-1132
21. Guo L., Huang D.-S., and Zhao W. Combining genetic optimisation with hybrid learning algorithm for radial basis function neural networks. Electronics Letters 39 (2003) 1600-1601
22. Gutmann H. A radial basis function method for global optimization. Journal of Global Optimization 19 (2001) 201-227
23. Hinton G.E., and Salakhutdinov R.R. Reducing the dimensionality of data with neural networks. Science 313 5786 (2006) 504-507
24. Ho T., and Basu M. Complexity measures of supervised classification problems. IEEE Transactions on Pattern Analysis and Machine Intelligence 24 3 (2002) 289-300
25. Hornik K.M., Stinchcombe M., and White H. Multilayer feedforward networks are universal approximators. Neural Networks (1989) 359-366
26. Howard, D., Bull, L., & Lanzi, P.-L. (2008). Self-adaptive constructivism in neural XCS and XCSF. In Proceedings of the 2008 genetic and evolutionary computation conference
27. Jiang N., Zhao Z., and Ren L. Design of structural modular neural networks with genetic algorithms. Advances in Software Engineering 34 (2003) 17-24
28. Kamke, E. (1956). Das lebesgue-stieltjes integral
29. Kohl, N., Stanley, K., Miikkulainen, R., Samples, M., & Sherony, R. (2006). Evolving a real-world vehicle warning system. In Proceedings of the genetic and evolutionary computation conference 2006 (pp. 1681-1688)
30. Kolmogorov A. Three approaches to the quantitative definition of information. Problems of Information Transmission 1 (1965) 4-7
31. Kozma R., and Freeman W. The kiv model of intentional dynamics and decision making. Neural Networks (2009)
32. Kretchmar, R., & Anderson, C. (1997). Comparison of CMACS and radial basis functions for local function approximators in reinforcement learning. In Proceedings of the International Conference on neural networks
33. Lanzi, P. L., Loiacono, D., Wilson, S. W., & Goldberg, D. E. (2005). XCS with computed prediction for the learning of boolean functions. In Proceedings of the IEEE congress on evolutionary computation conference
34. Lanzi, P. L., Loiacono, D., Wilson, S. W., & Goldberg, D. E. (2006). Classifier prediction based on tile coding. In Proceedings of the genetic and evolutionary computation conference (pp. 1497-1504)
35. Lawrence, S., Tsoi, A., & Back, A. (1996). Function approximation with neural networks and local methods: Bias, variance and smoothness. In Australian conference on neural networks (pp. 16-21)
36. LeCun Y., and Bengio Y. Scaling learning algorithms towards ai. Large-scale kernel machines (2007)
37. Leonov A.S. On the total variation for functions of several variables and a multidimensional analog of Helly's selection principle. Mathematical Notes 63 1 (1998) 61-71
38. Levine D. Brain pathways for cognitive-emotional decision making in the human animal. Neural Networks (2009)
39. Li, J., & Duckett, T. (2005). Q-learning with a growing RBF network for behavior learning in mobile robotics. In Proceedings of the Sixth IASTED international conference on robotics and applications
40. Li, J., Martinez-Maron, T., Lilienthal, A., & Duckett, T. (2006). Q-ran: A constructive reinforcement learning approach for robot behavior learning. In Proceedings of IEEE/RSJ international conference on intelligent robot and system
41. Li M., and Vitanyi P. An introduction to Kolmogorov complexity and its applications (1993), Springer-Verlag
42. Maciejowskia J.M. Model discrimination using an algorithmic information criterion. Automatica 15 (1979) 579-593
43. Maillard E., and Gueriot D. RBF neural network, basis functions and genetic algorithm. International Conference on neural networks Vol. 4 (1997)
44. Mitchell T. Machine learning (1997), McGraw Hill
45. Moody J., and Darken C.J. Fast learning in networks of locally tuned processing units. Neural Computation 1 (1989) 281-294
46. Moriarty D.E., and Miikkulainen R. Efficient reinforcement learning through symbiotic evolution. Machine Learning 22 (1996) 11-32
47. Park J., and Sandberg I.W. Universal approximation using radial-basis-function networks. Neural Computation 3 (1991) 246-257
48. Perlovsky L. Language and cognition. Neural Networks (2009)
49. Peterson T., and Sun R. An rbf network alternative for a hybrid architecture. IEEE International Joint Conference on neural networks Vol. 1 (1998) 768-773
50. Platt J. A resource-allocating network for function interpolation. Neural Computation 3 2 (1991) 213-225
51. Potter M.A., and Jong K.A.D. Cooperative coevolution: An architecture for evolving coadapted subcomponents. Evolutionary Computation 8 1 (2000) 1-29
52. Radcliffe N.J. Genetic set recombination and its application to neural network topology optimization. Neural Computing and Applications 1 1 (1993) 67-90
53. Reisinger, J., Bahceci, E., Karpov, I., & Miikkulainen, R. (2007). Coevolving strategies for general game playing. In Proceedings of the IEEE symposium on computational intelligence and games
54. Rosca, J. P. (1997). Hierarchical learning with procedural abstraction mechanisms. Ph.D. thesis. Rochester, NY 14627, USA. citeseer.ist.psu.edu/rosca97hierarchical.html
55. Saravanan N., and Fogel D.B. Evolving neural control systems. IEEE Expert (1995) 23-27
56. Sarimveis H., Alexandridis A., Mazarakis S., and Bafas G. A new algorithm for developing dynamic radial basis function neural network models based on genetic algorithms. Computers and Chemical Engineering 28 (2004) 209-217
57. Shilov, G. E., & Gurevich, B. L. (1967). Integral, measure, derivative
58. Stanley, K., Kohl, N., Sherony, R., & Miikkulainen, R. (2005). Neuroevolution of an automobile crash warning system. In Proceedings of the genetic and evolutionary computation conference 2005 (pp. 1977-1984)
59. Stanley K.O., Bryant B.D., and Miikkulainen R. Real-time neuroevolution in the NERO video game. IEEE Transactions on Evolutionary Computation 9 6 (2005) 653-668
60. Stanley K.O., and Miikkulainen R. Evolving neural networks through augmenting topologies. Evolutionary Computation 10 2 (2002)
61. Stanley K.O., and Miikkulainen R. Competitive coevolution through evolutionary complexification. Journal of Artificial Intelligence Research 21 (2004) 63-100
62. Stanley, K.O., & Miikkulainen, R. (2004b). Evolving a roving eye for go. In Proceedings of the genetic and evolutionary computation conference
63. Stone P., Kuhlmann G., Taylor M.E., and Liu Y. Keepaway soccer: From machine learning testbed to benchmark. In: Noda I., Jacoff A., Bredenfeld A., and Takahashi Y. (Eds). RoboCup-2005: Robot soccer world cup IX Vol. 4020 (2006), Springer Verlag, Berlin 93-105
64. Sutton R.S. Generalization in reinforcement learning: Successful examples using sparse coarse coding. Advances in neural information processing systems 8 (1996) 1038-1044
65. Taylor, M., Whiteson, S., & Stone, P. (2006). Comparing evolutionary and temporal difference methods for reinforcement learning. In Proceedings of the genetic and evolutionary computation conference (pp. 1321-28)
66. Tulai, A. F., & Oppacher, F. (2002). Combining competitive and cooperative coevolution for training cascade neural networks. In Proceedings of the genetic and evolutionary computation conference (pp. 618-625)
67. Vapnik V., and Chervonenkis A. On the uniform convergence of relative frequencies of events to their probabilities. Theory of Probability and its Applications 16 (1971) 264-280
68. Vitushkin, A. G. (1955). On multidimensional variations
69. Wedge D., Ingram D., McLean D., Mingham C., and Bandar Z. Neural network architectures and wave overtopping. Proc. Inst. Civil Engineering 2005: Maritime engineering Vol. 158 (2005) 123-133 MA3
70. Wedge D., Ingram D., McLean D., Mingham C., and Bandar Z. On global-local artificial neural networks for function approximation. IEEE Transactions on Neural Networks 17 4 (2006) 942-952
71. Whitehead B., and Choate T. Cooperative-competitive genetic evolution of radial basis functioncenters and widths for time series prediction. IEEE Transactions on Neural Networks 7 (1996) 869-880
72. Whiteson S., Kohl N., Miikkulainen R., and Stone P. Evolving keepaway soccer players through task decomposition. Machine Learning 59 (2005) 5-30
73. Whitley D., Dominic S., Das R., and Anderson C.W. Genetic reinforcement learning for neurocontrol problems. Machine Learning 13 (1993) 259-284
74. Wieland, A. (1991). Evolving neural network controllers for unstable systems. In Proceedings of the International Joint Conference on neural networks (pp. 667-673)
75. Wilson S.W. Classifiers that approximate functions. Natural Computing 1 (2002) 211-234
76. Wilson, S. W. (2008). Classifier conditions using gene expression programming. Tech. rep. 2008001. Illinois Genetic Algorithms Laboratory, University of Illinois at Urbana-Champaign
77. Yao X. Evolving artificial neural networks. Proceedings of the IEEE 87 9 (1999) 1423-1447