Evolution and development of neural controllers for locomotion, gradient-following, and obstacle-avoidance in artificial insects

IEEE Transactions on Neural Networks

Volumn 9, Issue 5, 1998, Pages 796-812

  Kodjabachian, Jérôme ^a   Meyer, Jean Arcady ^a  

^a ECOLE NORMALE SUPÉRIEURE   (France)

Author keywords

Animals; Genetic programming; Leaky integrators; Recurrent neural networks; SGOCE paradigm

Indexed keywords

ALGORITHMS; COLLISION AVOIDANCE; CONSTRAINT THEORY; CONTROL EQUIPMENT; GENETIC ALGORITHMS; INSECT CONTROL; MATHEMATICAL MODELS;

GENETIC PROGRAMMING;

NEURAL NETWORKS;

EID: 0032165064     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/72.712153     Document Type: Article

References (60)

1. W. B. Dress, "Darwinian optimization of synthetic neural systems," in Proc. IEEE 1st Int. Conf. Neural Networks. San Diego, CA: SOS, 1987.
2. A. Guha, S. Harp, and T. Samad, "Genetic synthesis of neural networks," Honeywell Corporate Syst. Development Division, Tech. Rep. CSDD-88-I4852-CC-1, 1988.
3. D. Whitley, "Applying genetic algorithms to neural net learning," Dept. Comput. Sci., Colorado State Univ., Tech. Rep. CS-88-128, 1988.
4. R. K. Belew, J. McInerney, and N. N. Schraudolph, "Evolving networks: Using the genetic algorithm with connectionist learning," CSE, Univ. California San Diego, Tech. Rep. CS90-174, June 1990.
5. G. F. Miller, P. M. Todd, and S. U. Hedge, "Designing neural networks using genetic algorithms," in Proc. 3rd Int. Conf. Genetic Algorithms, 1989.
6. J. Schaffer, D. Whitley, and L. Eschelman, "Combinations of genetic algorithms and neural networks: A survey of the state of the art," in Combinations of Genetic Algorithms and Neural Networks, D. Whitley and J. Schaffer, Eds. Los Alamitos, CA: IEEE Comput. Soc. Press, 1992.
7. I. Kuscu and C. Thorton, "Design of artificial neural networks using genetic algorithms: Review and prospect," Univ. Sussex, Brighton, U.K., Cognitive Sci. Res. Paper 319, 1994.
8. K. Balakrishnan and V. Honavar, "Evolutionary design of neural architectures - Preliminary taxonomy and guide to literature," Artificial Intell. Group, Iowa State Univ., Ames, Tech. Rep. CS TR#95-01, 1995.
9. J. Branke, "Evolutionary algorithms for neural network design and training," in Proc. 1st Nordic Wkshp. Genetic Algorithms Applicat., T. Talander, Ed., 1995.
10. T. Gomi and A. Griffith, "Evolutionary Robotics - An overview," in Proc. IEEE 3rd Int. Conf. Evolutionary Comput., 1996.
11. J. Kodjabachian and J.-A. Meyer, "Evolution and development of control architectures in animals," Robot. Autonomous Syst., vol. 16, pp. 161-182, Dec. 1995.
12. M. Matarić and D. Cliff, "Challenges in evolving controllers for physical robots," Robot. Autonomous Syst., vol. 19, pp. 67-83, 1996.
13. J. Kodjabachian and J.-A. Meyer, "Evolution and development of modular control architectures for 1-d locomotion in six-legged animals," Connection Scil., to be published.
14. J.-A. Meyer, "The animal approach to cognitive science," in Comparative Approaches to Cognitive Science, H. Roitblat and J.-A. Meyer, Eds. Cambridge, MA: MIT Press, 1995.
15. _, "Artificial life and the animal approach to artificial intelligence," in Artificial Intelligence, M. Boden, Ed. New York: Academic, 1996.
16. R. Beer, Intelligence as Adaptive Behavior: An Experiment in Computational Neuroethology. San Diego, CA: Academic, 1990.
17. R. Beer and J. Gallagher, "Evolving dynamical neural networks for adaptive behavior," Adaptive Behavior, vol. 1, no. 1, pp. 91-122, 1992.
18. T. Gomi and K. Ide, "Emergence of gaits of a legged robot by collaboration through evolution, "in Proc. Int. Symp. Artificial Life and Robot., 1997.
19. N. Jakobi, "Running across the reality gap: Octopod locomotion evolved in a Minimal Simulation," in EvoRobot'98: Proc. 1st European Wkshp. Evolutionary Robot., P. Husbands and J.-A. Meyer, Eds., 1998.
20. F. Gruau, "Synthèse de réseaux de neurones par codage cellulaire et algorithmes génétiques," Thèse d'université, ENS Lyon, Université Lyon I, Jan. 1994.
21. _, "Automatic definition of modular neural networks," Adaptive Behavior, vol. 3, no. 2, pp. 151-184, 1994.
22. _, "Artificial cellular development in optimization and compilation," in Evolvable Hardware '95, E. Sanchez and Tomassini, Eds. New York: Springer-Verlag, Lecture Notes in Comput. Sci., 1996.
23. R. Hecht-Nielsen, Ed., Neurocomputing. Reading, MA: Addison Wesley, 1990.
24. J. Hertz, A. Krogh, and R. Palmer, Introduction to the Theory of Neural Computation. Reading, MA: Addison-Wesley, 1991.
25. J. Koza, Genetic Programming: On the Programming of Computers by Means of Natural Selection. Cambridge, MA: MIT Press, 1992.
26. _, Genetic Programming II: Automatic Discovery of Reusable Subprograms. Cambridge, MA: MIT Press, 1994.
27. D. E. Goldberg, Genetic Algorithms in Search, Optimization and Machine Learning. Reading, MA: Addison-Wesley, 1989.
28. I. Segev, "Simple neuron models: Oversimple, complex, and reduced," Trends in Neurosci., vol. 15, no. 11, pp. 414-421, 1992.
29. W. Softky and C. Koch, "Single-cell models," in The Handbook of Brain Theory and Neural Networks, M. Arbib, Ed. Cambridge, MA: MIT Press, 1995.
30. J. L. McClelland and D. E. Rumelhart, Eds., Parallel Distributed Processing, vol. 1. Cambridge, MA: MIT Press, 1986.
31. D. E. Rumelhart and J. L. McClelland, Eds., Parallel Distributed Processing, vol. 2. Cambridge, MA: MIT Press, 1986.
32. D. Cliff, I. Harvey, and P. Husbands, "Explorations in evolutionary robotics," Adaptive Behavior, vol. 2, no. 1, pp. 73-110, 1993.
33. D. Cliff and G. F. Miller, "Coevolution of pursuit and evasion ii: Simulation methods and results," in From Animals to Animats 4. Proc. 4th Int. Conf. Simulation of Adaptive Behavior, P. Maes, M. J. Mataric, J.-A. Meyer, J. B. Pollack, and S. W. Wilson, Eds. Cambridge, MA: MIT Press., 1996.
34. W. T. Miller III, R. S. Sutton, and P. J. Werbos, Eds., Neural Networks for Control. Cambridge, MA: MIT Press, 1991.
35. K. Warwick, G. Irwin, and K. Hunt, Eds., Neural networks for control and systems. London, U.K., Peter Peregrinus, 1992.
36. R. D. Beer, "On the dynamics of small continuous-time recurrent neural networks," Adaptive Behavior, vol. 3, no. 4, pp. 469-510, 1995.
37. B. A. Pearlmutter, "Gradient calculations for dynamic recurrent neural networks: A survey," IEEE Trans. Neural Networks, vol. 6, pp. 1212-1228, Sept 1995.
38. G. Spencer, "Automatic generation of programs for crawling and walking," in Advances in Genetic Programming, K. E. K., Jr., Ed. Cambridge, MA: MIT Press, 1994, pp. 335-353.
39. J. Kodjabachian, "Simulating the dynamics of a six-legged animal," AnimatLab, ENS, Paris, Tech. Rep., 1996.
40. E. R. Kandel, J. H. Schwartz, and T. M. Jessell, "Principles of neural science," in Muscles, Effectors of the Motor Systems, 3rd ed. Englewood Cliffs, NJ: Prentice-Hall, 1991, ch. 36.
41. H. de Garis, "Genetic programming: GenNets, artificial nervous systems, artificial embryos," Ph.D. dissertation, Université Libre de Bruxelles, Belgium, 1991.
42. M. A. Lewis, A. H. Fagg, and A. Solidum, "Genetic programming approach to the construction of a neural network for control of a walking robot," in IEEE Int. Conf. Robot. Automat., Nice, France, 1992, pp. 2618-2623.
43. R. A. Brooks, "A robot that walk: Emergent behavior form a carefully evolved network," Neural Comput., vol. 1, no. 2, pp. 253-262, 1989.
44. A. Wieland, "Evolving neural network controllers for unstable systems," in Proc. Int. Joint Conf. Neural Networks, 1991.
45. I. Harvey, P. Husbands, and D. Cliff, "Seeing the light: Artificial evolution, real vision," in From Animals to Animats 3: Proc. 3rd Int. Conf. Simulation of Adaptive Behavior, D. Cliff, P. Husbands, J.-A. Meyer, and S. W. Wilson, Eds. Cambridge, MA: MIT Press, 1994, pp. 392-401.
46. N. Saravan and D. Fogel, "Evolving neural control systems," IEEE Expert, vol. 10, pp. 23-27, 1995.
47. F. Gomez and R. Mikkulainen, "Incremental evolution of complex general behavior," Adaptive Behavior, vol. 5, pp. 317-342, 1997.
48. R. Dawkins, The Blind Watchmaker. Essex, U.K.: Longman, 1986.
49. J.-A. Meyer, "From natural to artificial life: Biomimetic mechanisms in animat design," Robot. Autonomous Syst., vol. 22, pp. 3-21, 1997.
50. K. Sims, "Evolving 3-D morphology and behavior by competition," in Proc. 4th Int. Wkshp. Artificial Life, R. A. Brooks and P. Maes, Eds. Cambridge, MA: MIT Press, 1994.
51. F. Dellaert and R. D. Beer, "A developmental model for the evolution of complete autonomous agents," in From Animals to Animats 4: Proc. 4th Int. Conf. Simulation of Adaptive Behavior, P. Maes, M. J. Mataric, J.-A. Meyer, J. B. Pollack, and S. W. Wilson, Eds. Cambridge, MA: MIT Press, 1996.
52. W. D. Hillis, "Coevolving parasites improve simulated evolution as an optimization procedure," in Artificial Life II, C. G. Langton, C. Taylor, J. D. Farmer, and S. Rasmussen, Eds. Reading, MA: Addison-Wesley, 1992, pp. 313-324.
53. J. Paredis, "Coevolutionary computation," Artificial Life, vol. 2, no. 4, pp. 355-376, 1995.
54. H. Juillé and J. B. Pollack, "Dynamics of coevolutionary learning," in From Animals to Animats 4: Proc. 4th Int. Conf. Simulation of Adaptive Behavior, P. Maes, M. J. Mataric, J.-A. Meyer, J. B. Pollack, and S. W. Wilson, Eds. Cambridge, MA: MIT Press, 1996, pp. 526-534.
55. C. D. Rosin and R. K. Belew, "New methods for competitive coevolution," Evolutionary Computation, vol. 5, pp. 1-29, 1997.
56. C. W. Reynolds, "Evolution of corridor following behavior in a noisy world," in From Animals to Animats 3: Proc. 3rd Int. Conf. Simulation of Adaptive Behavior, D. Cliff, P. Husbands, J.-A. Meyer, and S. W. Wilson, Eds. Cambridge, MA: MIT Press, 1994, pp. 402-410.
57. W.-P. Lee, J. Hallam, and H. H. Lund, "A hybrid GA/GP approach for coevolving controllers and robot bodies to achieve fitness-specified tasks," in Proc. 3d IEEE Int. Conf. Evolutionary Comput., 1996.
58. W.-P. Lee, J. Hallam, and H. H. Lund, "Applying genetic programming to evolve behavior primitives and arbitrators for mobile robots," in Proc. 4th IEEE Int. Conf. Evolutionary Comput., 1997, to be published.
59. L. B. Booker, "Classifier systems that learn internal world models," Machine Learning, vol. 3, pp. 161-192, 1988.
60. C. R. Gallistel, The Organization of Action: A New Synthesis. Hillsdale, NJ: Laurence Erlbaum, 1980.