Evolving Controllers for Real Robots: A Survey of the Literature

Adaptive Behavior

Volumn 11, Issue 3, 2003, Pages 179-203

  Walker, Joanne ^a,b,c   Garrett, Simon ^a,b,d   Wilson, Myra ^a,b,e,f  

^a UNIVERSITY OF WALES   (United Kingdom)

^b ABERYSTWYTH UNIVERSITY   (United Kingdom)

^c Intelligent Robotics Group   (United Kingdom)

^d UNIVERSITY OF BRISTOL   (United Kingdom)

^e UNIVERSITY OF ABERDEEN   (United Kingdom)

^f UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

Evolutionary robotics; Lifelong adaptation by evolution; Physical robots; Simulation; Training

Indexed keywords

EID: 1642489044     PISSN: 10597123     EISSN: None     Source Type: Journal    
DOI: 10.1177/1059712303113003     Document Type: Review

References (90)

1. Arkin, R. C. (1989). Motor schema-based mobile robot navigation. International Journal of Robotics Research, 8(4) 9-12.
2. Back, T. and Schwefel, H.-P. (1993). An overview of evolutionary algorithms for parameter optimization. Evolutionary Computation, 1(1) 1-23.
3. Bajcsy, R. (1988). Active perception. Proceedings of the IEEE, 76(8) 996-1005.
4. Banzhaf, W., Nordin, P., & Olmer, M. (1997). Generating adaptive behavior using function regression within genetic programming and a real robot. In 2nd International Conference on Genetic Programming, (pp. 35-43) San Francisco: Morgan Kaufmann.
5. Bongard, J. (2002). Evolving modular genetic regulatory networks. In Proceedings of The IEEE 2002 Congress on Evolutionary Computation (CEC2002), (pp. 1872-1877). IEEE Press.
6. Booker, L., Goldberg, D., & Holland, J. (1989). Classifier systems and genetic algorithms. Artificial Intelligence, 40, 235-282.
7. Braitenberg, V. (1994). Vehicles: Experiments in Synthetic Psychology. MIT Press, Cambridge, Massachusetts.
8. Brooks, R. (1986). Achieving artificial intelligence through building robots. A.I. Memo 899, Massachusetts Institute of Technology Artificial Intelligence Lab.
9. Brooks, R. (1992). Artificial life and real robots. In European Conference on Artificial Life, (pp. 3-10).
10. Bruner, J. S. (1964). The course of cognititve growth. American Psychologist, 19, 1-15.
11. Colombetti, M. & Dorigo, M. (1992). Learning to control an autonomous robot by distributed genetic algorithms. In From Animals to Animals 2, Proceedings of the 2nd International Conference on the Simulation of Adaptive Behavior SAB-92, (pp. 305-312).
12. Dorigo, M. (1995). ALECSYS and the AutonoMouse: Learning to control a real robot by distributed classifier systems. Machine Learning, 19(3) 209-240.
13. Ficici, S., Watson, R., & Pollack, J. (1999). Embodied evolution: a response to challenges in evolutionary robotics. In 8th European Workshop on Learning Robots, (pp. 14-22).
14. Floreano, D. & Mondada, F. (1994). Automatic creation of autonomous agent: Genetic evolution of a neural-network driven robot. In Proceedings of 3rd International Conference on Simulation of Adaptive Behavior, (SAB-94), (pp. 421-430).
15. Floreano, D. & Mondada, F. (1996a). Evolution of plastic neurocontrollers for situated agents. In From Animals to Animals 4, Proceedings of the 4th International Conference on the Simulation of Adaptive Behavior (SAB-96).
16. Floreano, D. & Mondada, F. (1996b). Evolution on homing navigation in a real mobile robot. IEEE Transactions on Systems, Man and Cybernetics (pp. 396-407).
17. Floreano, D., Nolfi, S., & Mondada, F. (1998). Competitive coevolutionary robotics: from theory to practice. In From Animals to Animats 5, Proceedings of the 5th International Conference on the Simulation of Adaptive Behavior SAB'98, Cambridge, MA: MIT Press.
18. Floreano, D., Nolfi, S., & Mondada, F. (2001). Co-evolution and ontogenetic change in competing robots. In M., Patel, V., Hanover, and K., Balakrishnan (Eds.) Advances in the Evolutionary Synthesis of Intelligent Agents, Cambridge, MA: MIT Press.
19. Floreano, D. & Urzelai, J. (2000a). Evolutionary on-line self-organisation of autonomous robots. In Proceedings of the 5th International Conference on Artificial Life and Robotics.
20. Floreano, D. & Urzelai, J. (2000b). Evolutionary robots with on-line self-organisation and behavioral fitness. Neural Networks, 13, 431-443.
21. Floreano, D. & Urzelai, J. (2001). Evolution of plastic control networks. Autonomous Robots, 11, 311-317.
22. Fogel, L., Owens, A., & Walsh, M. (1966). Artificial Intelligence through Simulated Evolution. New York, Wiely.
23. Gallagher, J., Beer, R., Espenschied, K., & Quinn, R. (1994). Application of evolved locomotion controllers to a hexapod robot. Robotics and Autonomous Systems, 19, 95-103.
24. Goldberg, D. E. (1989). Genetic Algorithms in Search Optimization and Machine Learning. Reading, MA: Addison Wesley.
25. Grefenstette, J. & Ramsey, C. (1992). An approach to anytime learning. In Proceedings of the 9th International Machine Learning Conference (pp. 189-195) Amsterdam: Elsevier.
26. Grefenstette, J., Ramsey, C., & Schultz, A. (1990). Learning sequential decision rules using simulation models and competition. Machine Learning, 5(4) 35-81.
27. Grefenstette, J. & Schultz, A. (1994). An evolutionary approach to learning in robots. In Machine Learning Workshop on robot learning, New Brunswick, NJ.
28. Harvey, I. (1997). Artificial evolution and real robots. Artificial Life and Robotics, 1, 35-38.
29. Holland, J. (1975). Adaptation in Natural and Artificial Systems. Ann Arbor, MI: University of Michigan Press.
30. Holland, J. (1993). Adaptation in Natural and Artificial Systems, an Introductory Analysis with Applications to Biology, Control and Artificial Intelligence. Cambridge, MA: MIT Press.
31. Hornby, G., Fujita, M., Takamura, S., Yamamoto, T., & Hanagata, O. (1999). Autonomous evolution of gaits with the Sony quadruped robot. In Proceedings of the 1999 Genetic and Evolutionary Computation Conference (GECCO'99), (pp. 129-304).
32. Hornby, G., Lipson, H., & Pollack, J. (2001). Evolution of generative design systems for modular physical robots. In IEEE International Conference on Robotics and Automation. Piscataway, NJ: IEEE Press.
33. Hornby, G. & Pollack, J. (2001). Evolving {L}-systems to generate virtual creatures. Computers and Graphics, 25(6) 1041-1048.
34. Hornby, G., Takamura, S., Yokono, J., Hanagata, O., Yamamoto, T., & Fujita, M. (2000). Evolving robust gaits with AIBO. In IEEE International Conference on Robotics and Automation, (pp. 3040-3045).
35. Jakobi, N. (1994). Evolving sensorimotor control architectures in simulation for a real robot. Master's thesis, University of Sussex.
36. Jakobi, N., Husbands, P., & Harvey, I. (1995). Noise and the reality gap: The use of simulation in evolutionary robotics. In Advances in Artificial Life: Proceedings of the 3rd International Conference on Artificial Life, (pp. 704-720) Berlin: Springer-Verlag.
37. Kato, T. & Floreano, D. (2001). An evolutionary active-vision system. In Proceedings of the Congress on Evolutionary Computation (CEC'01) (pp. 107-114). Piscataway, NJ: IEEE Press.
38. Keymeulen, D., Iwata, M., Kuniyoshi, Y., & Higuchi, T. (1998a). Comparison between an off-line model-free and an on-line model-based evolution applied to a robotics navigation system using evolvable hardware. In Artificial Life VI: Proceedings of the Sixth International Conference on Artificial Life, (pp. 199-209).
39. Keymeulen, D., Iwata, M., Kuniyoshi, Y., & Higuchi, T. (1998b). Online evolution for a self-adapting robotic naviagation system using evolvable hardware. Artificial Life, 4, 359-393.
40. Koza, J. (1991). Evolution and co-evolution of computer programs to control independently acting agents. In From Animals to Animats. Proceedings of the 1st International Conference on Simulation of Adaptive Behavior, (SAB'91), (pp. 366-375). Cambridge, MA: MIT Press.
41. Koza, J. (1992). Genetic Programming. Cambridge, MA, MIT Press.
42. Lewis, M., Fagg, A., & Solidum, A. (1992). Genetic programming approach to the construction of a neural network for control of a walking robot. In IEEE International Conference on Robotics and Automation, (pp. 2618-2623). Piscataway, NJ: IEEE Press.
43. Marocco, D. & Floreano, D. (2002). Active vision and feature selection in evolutionary behavioural systems. In From Animals to Animats: Proceedings of the seventh international conference on the simulation of adaptive behviour (SAB'02), (pp. 247-255).
44. Mataric, M. & Cliff, D. (1996). Challenges for evolving controllers for physical robots. Robotics and Autonomous Systems, 19(1) 67-83.
45. Matellan, V., Fernandez, C., & Molina, J. (1998). Genetic learning of fuzzy reactive controllers. Robotics and Autonomous Systems, 25, 33-41.
46. Matellan, V., Molina, J., Sanz, J., & Fernandez, C. (1995). Learning fuzzy reactive behaviours in autonomous robots. In 4th European Workshop on Learning Robots (pp. 45-56). Karlsruhe, Germany.
47. Mautner, C. & Belew, R. (1999). Evolving robot morphology and control. In Proceeding of the Artificial Life and Robotics Conference (AROB-99).
48. Miglino, O., Lund, H., & Nolfi, S. (1995). Evolving mobile robots in simulated and real environments. Artificial Life, 2, 417-434.
49. Mitchell, M. (1998). An Introduction to Genetic Algorithms. MIT Press.
50. Mondada, F. & Floreano, D. (1995). Evolution of neural control structures: some experiments on mobile robots. Robotics and Autonomous Systems, 10, 221-249.
51. Mondada, F., Franzi, E., & Ienne, P. (1993). Mobile robot miniaturisation: a tool for investigation in control algorithms. In Experimental Robotics 3: Proceedings of the 3rd International Symposium on Experimental Robotics (pp. 501-513). Berlin: Springer-Verlag.
52. Moody, J. & Darken, C. (1988). Learning with localised receptive fields. In Proceedings of the 1988 Connectionist Models Summer School, (pp. 13-43). San Francisco: Morgan Kaufmann.
53. Nehmzow, U. (2002). Physically embedded genetic algorithm learning in multi-robot scenarios: The PEGA algorithm. In 2nd International Workshop on Epigenetic Robotics: Modelling Cognitive Development in Robotic Systems.
54. Nolfi, S. & Floreano, F. (1998). How co-evolution can enhance the adaptive power of aritificial evolution: implications for evolutionary robotics. In Proceedings of EvoRobot'98, (pp. 2-8). Berlin: Springer-Verlag.
55. Nolfi, S. & Floreano, F. (2000). Evolutionary Robotics, the Biology, Intelligence and Technology of Self-Organizing Machines. Cambridge, MA: MIT Press.
56. Nolfi, S. and Marocco, D. (2000). Evolving visually-guided robots able to discriminate between different landmarks. In From Animals to Animats 6. Proceedings of the sixth International Conference on Simulation of Adaptive Behavior (SAB'00), (pp. 413-419). Cambridge, MA: MIT Press.
57. Nolfi, S., Miglino, O., & Parisi, D. (1994). Phenotypic plasticity in evolving neural networks. In Proceedings of the International Conference from Perception to Action, (pp. 14-57). Los Alamitos, CA: IEEE Computer Society Press.
58. Nordin, P. & Banzhaf, W. (1995). Genetic programming controlling a miniature robot. In Working notes of the AAAI-95 Fall Symposium Series, Symposium on Genetic Programming, (pp. 61-67). Cambridge, MA: AAAI.
59. Nordin, P. & Banzhaf, W. (1997). Real time control of a Khepera robot using genetic programming. Cybernetics and Control, 26(3) 53-61.
60. Nordin, P., Banzhaf, W., & Brameier, M. (1998). Evolution of a world model for a miniature robot using genetic programming. Robotics and Autonomous Systems, 25, 10-16.
61. Olmer, M., Nordin, P., & Banzhaf, W. (1996). Evolving real-time behavioral modules for a robot with GP. In Proceedings of the 6th International Symposium on Robotics and Manufacturing (pp. 67-80). New York: ASME Press.
62. Ostergaard, E. & Lund, H. (2003). Co-evolving complex robot behavior. In ICES'03, The 5th International Conference on Evolvable Systems: From Biology to Hardware. Berlin: Springer.
63. Parker, G. (1998). Generating arachnid gaits with cyclic genetic algorithms. In Genetic programming 1998: Proceedings of the 3rd Annual Conference (pp. 57-83). San Francisco: Morgan Kaufmann.
64. Parker, G. (2000a). Co-evolving model parameters for anytime learning in evolutionary robotics. Robotics and Autonomous Systems, 33, 13-30.
65. Parker, G. (2000b). Evolving leg cycles to produce hexapod gaits. In The world Automation Congress WAC 2000, (pp. 250-255). Albuquerque: TSI Enterprises.
66. Parker, G. (2003a). Learning adaptive leg cycles using fitness biasing. In 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'03). Piscataway, NJ: IEEE Press.
67. Parker, G. (2003b). Learning adaptive leg cycles using fitness biasing. In 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'03). Piscataway, NJ: IEEE Press.
68. Parker, G. and Blumenthal, H. J. (2002). Punctuated anytime learning for evolving a team. In World Automation Congress WAC'02. Albuquerque: TSI Enterprises.
69. Parker., G. and LaRochelle, K. (2000). Punctuated anytime learning for evolutionary robotics. In The world Automation Congress WAC'00, (pp. 268-273).
70. Parker, G. and Mills, J. (1999). Adaptive hexapod gait control using anytime learning with fitness biasing. In Proceedings of the Genetic and Evolutionary Computation Conference GECCO'99 (pp. 519-524). San Francisco: Morgan Kaufmann.
71. Parker, G. & Rawlins, G. (1996). Cyclic genetic algorithms for the locomotion of hexapod robots. In Proceedings of the World Automation Congress (WAC '96), Robotic and Manufacturing Systems, 3, 617-622.
72. Ramsey, C. and Grefenstette, J. (1993). Case-based initialization of genetic algorithms. In Genetic Algorithms: Proceedings of the Fifth International Conference (ICGA'93). San Francisco: Morgan Kaufmann.
73. Rechenberg, I. (1965). Cybernetic solution path of an experimental problem. Royal Aircraft Establishment Translation Toms, Trans 1122 B.F., Ministry of Aviation, Royal Aircraft Establishment, Franborough, Hants.
74. Rechenberg, I. (1973). Evolutionstrategies: Optimierung Technischer Systeme nach Prinzipien der Biologischen Evolution. Frommann-Holzboog, Stuttgart.
75. Reynolds, C. (1994). Competition, co-evolution and the game of tag. In Proceedings of the 4th Workshop on Artificial Life. Cambridge, MA: MIT Press.
76. Salomon, R. (1996). Increasing adaptivity through evolution strategies. In From Animals to Animals 4: Proceedings of the 4th International Conference on the Simulation of Adaptive Behavior (SAB'96), (pp. 411-420).
77. Salomon, R. (1997). The evolution of different neuronal control structures for autonomous agents. Robotics and Autonomous Systems. Special issue: Robot Learning: the New Wave, 647, 1-15. Cambridge, MA: MIT Press.
78. Schultz, A. & Grefenstette, J. (1992). Using a genetic algorithm to learn behaviours for autonomous vehicles. In Proceedings of the AIAA Guidance, Navigation and Control Conference, (pp. 739-749).
79. Schwefel, H.-P. (1977). Numerische Optimierung von Computer-Modellen mittles der Evolutionsstrategie. Basel: Birkhauser.
80. Sims, K. (1994). Evolving virtual creatures. In Computer Graphics, Annual Conference Series, (pp. 1-2). New York: ACM Press.
81. Spears, W., Jong, K. D., Back, T., Fogel, D., & de Garis, H. (1993). An overview of evolutionary computation. In Proceedings of the 1993 Conference on Machine Learning, (pp. 442-459). Berlin: Springer-Verlag.
82. Thompson, A. (1995). Evolving electronic controllers that exploit hardware resources. In Advances in Artificial Life: Proceedings of the 3rd International Conference on Artificial Life, (pp. 640-656). Berlin: Springer-Verlag.
83. Urzelai, J. & Floreano, D. (2000a). Evolutionary robotics: coping with environmental change. In Proceedings of the genetic and evolutionary computation conference GECCO'00, (pp. 941-948). San Francisco: Morgan Kaufmann.
84. Urzelai, J. & Floreano, D. (2000b). Evolutionary robots with fast adaptive behavior in new environments. In Proceedings of the 3rd International Conference on Evolvable Systems: from Biology to Hardware, (pp. 24-51). Berlin: Springer-Verlag.
85. Walker, J. (2003). Experiments in evolutionary robotics: investigating the importance of training and lifelong adaptation by evolution. PhD thesis, University of Wales.
86. Walker, J. & Wilson, M. (2002). How useful is lifelong evolution for robotics? In From Animals to Animals: Proceedings of the seventh international conference on simulation of Adaptive Behavior (SAB'02), (pp. 347-348). Piscataway, NJ: IEEE Press.
87. Watson, R., Ficici, S., & Pollack, J. (1999). Embodied evolution: Embodying an evolutionary algorithm in a population of robots. In 1999 Congress on Evolutionary Computation, (pp. 335-342). Piscataway, NJ: IEEE Press.
88. Watson, R., Ficici, S., & Pollack, J. (2000). Embodied evolution: distributing an evolutionary algorithm in a population of robots. Technical Report CS-00-208, Department of Computer Science, Volen National Center for Complex Systems, Brandeis University, USA.
89. Wilson, M. (2000). Preston: A system for the evaluation of behaviour sequences. In Demmiris, J. and Birk, A., editors, Interdisciplinary Approaches to Robot Learning, Would Scientific 24(9) 185-208. Singapore: World Scientific.
90. Wilson, M., King, C., & Hunt, J. (1997). Evolving hierarchical robot behaviours. Robotics and Autonomous Systems. Special Issue on Robot Learning: The New Wave, 22(3-4) 215-230.