The balance between initial training and lifelong adaptation in evolving robot controllers

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 36, Issue 2, 2006, Pages 423-432

  Walker, Joanne H ^a   Garrett, Simon M ^a   Wilson, Myra S ^a  

^a ABERYSTWYTH UNIVERSITY   (United Kingdom)

Author keywords

Evolution strategy; Evolutionary robotics; Genetic algorithm; Lifelong adaptation; Training

Indexed keywords

COMPUTER SIMULATION; CONTROL EQUIPMENT; EVOLUTIONARY ALGORITHMS; GENETIC ALGORITHMS; INTELLIGENT ROBOTS; ROBOT PROGRAMMING; ROBOTICS;

EVOLUTION STRATEGY; EVOLUTIONARY ROBOTICS; EVOLVING ROBOT CONTROLLERS; LIFELONG ADAPTATION; TRAINING PHASE EVOLUTION (TPE);

MOBILE ROBOTS;

ADAPTATION; ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; BIOMIMETICS; CYBERNETICS; EVOLUTION; FEEDBACK SYSTEM; METHODOLOGY; MOTION; ROBOTICS;

ADAPTATION, PHYSIOLOGICAL; ALGORITHMS; ARTIFICIAL INTELLIGENCE; BIOMIMETICS; CYBERNETICS; EVOLUTION; FEEDBACK; MOTION; ROBOTICS;

EID: 33645011449     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2005.859082     Document Type: Article

References (37)

1. N. Roy, W. Burgard, D. Fox, and S. Thrun, "Coastal navigation - mobile robot navigation with uncertainty in dynamic environments," in Proc. IEEE Conf. Robotics and Automation (ICRA), 1999.
2. A. Foka and P. Trahanias, "Predictive control of robot velocity to avoid obstacles in dynamic environments," in Proc. 2003 IEEE/RSJ Int. Conf. Intelligent Robots and Systems (IROS), 2003.
3. M. Jun, A. Chaudhry, and R. D'Andrea, "The navigation of autonomous vehicles in uncertain dynamic environments: A case study," in Proc. IEEE Conf. Decision and Control, 2002.
4. H. A. A. Shamli and S. Areibi, "Genetic algorithms for dynamic path planning," in Canadian Conf. Electrical and Computer Engineering (CCECE 2004), 2004, pp. 677-680.
5. D. B. Fogel, Evolutionary Computation - Toward a New Philosophy of Machine Intelligence. New York: IEEE Press, 1995.
6. G. Hornby, S. Takamura, J. Yokono, O. Hanagata, T. Yamamoto, and M. Fujita, "Evolving robust gaits with AIBO," in Proc. IEEE Int. Conf. Robotics and Automation (ICRA), 2000, pp. 3040-3045.
7. P. Nordin and W. Banzhaf, "Genetic programming controlling a miniature robot," in Working Notes of the AAAI-95 Fall Symposium Series, Symp. on Genetic Programming, 1995, pp. 61-67.
8. G. Parker, "Co-evolving model parameters for anytime learning in evolutionary robotics," Robot. and Auton. Syst., vol. 33, pp. 13-30, 2000.
9. S. Garrett and J. Walker, "Combining evolutionary and 'non'-evolutionary methods in tracking dynamic global optima," in Proc. Genetic and Evolutionary Computation Conf. (GECCO 2002), 2002, pp. 359-366.
10. D. Dasgupta and D. McGregor, "Nonstationary function optimization using the structured genetic algorithm," in Proc. Parallel Problem Solving From Nature (PPSN-92), 1992, pp. 145-154.
11. H. Cobb, "An Investigation Into the Use of Hypermutation as an Adaptive Operator in Genetic Algorithms Having Continuous, Time Dependent Non-Stationary Environments,", NRL Memorandum Report 6760 (NCARAI report AIC-90-001), 1990.
12. J. Walker, S. Garrett, and M. S. Wilson, "Evolving controllers for real robots: A survey of the literature," Adaptive Behav., vol. 11, no. 3, pp. 179-203, 2003.
13. J. Walker, "Experiments in Evolutionary Robotics: Investigating the Importance of Training and Lifelong Adaptation by Evolution," Ph.D. dissertation, Dept. Comput. Sci., Univ. of Wales, Aberystwyth, 2003.
14. J. Walker and M. S. Wilson, "Lifelong evolution for adaptive robots," in Proc. Int. Conf. Intelligent Robots and Systems (IROS), 2002, pp. 984-989.
15. I. Harvey, "The SAGA cross: The mechanics of recombination for species with variable length geneotypes," in Parallel Problem Solving From Nature 2 (PPSN), 1992, pp. 271-282.
16. T. Taylor, "Creativity in evolution: Individuals, interactions and environments," in Creative Evolutionary Systems, P. Bentley and D. Corne, Eds. New York: Morgan Kaufman, 2001, ch. 1.
17. R. Brooks, "A robust layered control system for a mobile robot," IEEE J. Robot. Autom., vol. RA-2, no. 1, pp. 14-23, 1986.
18. J. Grefenstette, C. Ramsey, and A. Shultz, "Learning sequential decision rules using simulation models and competition," Mach. Learn., vol. 5, no. 4, pp. 35-81, 1990.
19. N. Jakobi, P. Husbands, and I. Harvey, "Noise and the reality gap: The use of simulation in evolutionary robotics," in Advances in Artificial Life: Proc. 3rd Int. Conf. Artificial Life (ICRA), 1995, pp. 704-720.
20. J. Gallagher, R. Beer, K. Espenschied, and R. Quinn, "Application of evolved locomotion controllers to a hexapod robot," Robot. Auton. Syst., vol. 19, pp. 95-103, 1994.
21. M. Mataric and D. Cliff, "Challenges for evolving controllers for physical robots," Robot. Auton. Syst., vol. 19, no. 1, pp. 67-83, 1996.
22. F. Mondada and D. Floreano, "Evolution of neural control structures: Some experiments on mobile robots," Robot. Auton. Syst., vol. 10, pp. 221-249, 1995.
23. D. Marocco and D. Floreano, "Active vision and feature selection in evolutionary behavioral systems," in From Animals to Animals: Proc. 7th Int. Conf. Simulation of Adaptive Behviour SAB-02, 2002, pp. 247-255.
24. V. Zykov, J. Bongard, and H. Lipson, "Evolving dynamic gaits on a physical robot," in Proc. Genetic and Evolutionary Computation Conf. (GECCO), Late Breaking Papers, 2004.
25. R. Salomon, "Increasing adaptivity through evolution strategies," in From Animals to Animals 4: Proc. 4th Int. Conf. Simulation of Adaptive Behavior (SAB-96), 1996, pp. 411-420.
26. S. Nolfi, D. Floreano, O. Miglino, and F. Mondada, "How to evolve autonomous robots: Different approaches in evolutionary robotics," in Proc. Artificial Life IV, 1994, pp. 19-97.
27. M. Wilson, C. King, and J. Hunt, "Evolving hierarchical robot behaviors," Robot. Auton. Syst. (Special Issue on Robot Learning: The New Wave), vol. 22, no. 3-4, pp. 215-230, Dec. 1997.
28. R. Watson, S. Ficici, and J. Pollack, "Embodied evolution: Embodying an evolutionary algorithm in a population of robots," in 1999 Congr. Evolutionary Computation (CEC), 1999, pp. 335-342.
29. U. Nehmzow, "Physically embedded genetic algorithm learning in multi-robot scenarios: The PEGA algorithm," in Proc. 2nd Int. Workshop on Epigenetic Robotics: Modeling Cognitive Development in Robotic Systems, 2002.
30. D. Floreano, S. Nolfi, and F. Mondada, "Co-evolution and ontogenetic change in competing robots," in Advances in the Evolutionary Synthesis of Intelligent Agents, M. Patel, V. Hanover, and K. Balakrishnan, Eds. Cambridge, MA: MIT Press, 2001.
31. S. Luke, C. Hohn, J. Farris, G. Jackson, and J. Hendler, "Co-evolving soccer softbot team coordination with genetic programming," in RoboCup-97: Robot Soccer World Cup I (Lecture Notes in Artificial Intelligence no. 1395), H. Kitano, Ed. New York: Springer-Verlag, 1998, pp. 398-411.
32. G. Buason, N. Bergfeldt, and T. Ziemke, "Brains, bodies and beyond: Competitive co-evolution of robot controllers, morphologies and environments," Genetic Programming and Evolvable Machines, 2004, to be published.
33. D. Floreano and J. Urzelai, "Evolutionary robots with on-line self-organization and behavioral fitness," Neural Netw., vol. 13, pp. 431-443, 2000.
34. D. Keymeulen, M. Iwata, Y. Kuniyoshi, and T. Higuchi, "Comparison between an off-line model-free and an on-line model-based evolution applied to a robotics navigation system using evolvable hardware," in Artificial Life VI: Proc. 6th Int. Conf. Artificial Life, 1998, pp. 199-209.
35. A. Ram, R. Arkin, G. Boone, and M. Pearce, "Using genetic algorithms to learn reactive control parameters for autonomous robotic navigation," Adaptive Behav., vol. 2, no. 3, pp. 277-304, 1994.
36. Cyberbotics. (2005). [Online] http://www.cyberbotics.com
37. R. C. Arkin, "Motor schema-based mobile robot navigation," Int. J. Robot. Res., vol. 8, no. 4, pp. 9-12, 1989.