Challenges in evolving controllers for physical robots

Robotics and Autonomous Systems

Volumn 19, Issue 1, 1996, Pages 67-83

  Matarić, Maja ^a   Cliff, Dave ^b  

^a BRANDEIS UNIVERSITY   (United States)

^b UNIVERSITY OF SUSSEX   (United Kingdom)

Author keywords

Automated synthesis; Embodied systems; Evolutionary computation; Evolving controllers; Evolving hardware; ffs; Genetic algorithms; Genetic programming; Morphology; Physical robots; Robot control; Simulation

Indexed keywords

COMPUTER PROGRAMMING; CONTROL EQUIPMENT; GENETIC ALGORITHMS; MOBILE ROBOTS; MORPHOLOGY; SIMULATION;

EVOLUTIONARY COMPUTATION; EVOLVING CONTROLLERS; PHYSICAL ROBOTS; ROBOT CONTROL;

ROBOT APPLICATIONS;

EID: 0030291101     PISSN: 09218890     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0921-8890(96)00034-6     Document Type: Article

References (49)

1. A.N. Aizawa and B.W. Wah, Scheduling of genetic algorithms in a noisy environment, Evolutionary Computation 2 (2) (1994) 97-122.
2. R.D. Beer, On the dynamics of small continuous-time recurrent neural networks, Adaptive Behavior 3 (4) (1995) 471-511.
3. R.D. Beer and J.C. Gallagher, Evolving dynamical neural networks for adaptive behaviour, Adaptive Behaviour 1 (1) (1991) 91-122.
4. R.A. Brooks, A robust layered control system for a mobile robot, IEEE Journal of Robotics and Automation RA-2 (1986) 14-23.
5. R.A. Brooks, Intelligence without reason, in: Proc. IJCAI-91 (1991).
6. R.A. Brooks. Artificial life and real robots, in: Proc. Toward a Practice of Autonomous Systems, 1st European Conf., on Artificial Life (MIT Press, Cambridge, MA, 1992) 3-10.
7. D. Cliff, I. Harvey and P. Husbands, Evolved recurrent dynamical networks use noise, in: S. Gielen and B. Kappen, eds., Proc. Int. Conf. on Artificial Neural Networks (Springer, Berlin, 1993) 285-288.
8. D. Cliff, I. Harvey and P. Husbands, Explorations in evolutionary robotics. Adaptive Behavior 2 (1) (1993) 71-108.
9. D. Cliff, P. Husbands and I. Harvey, Analysis of evolved sensory motor controllers, Technical Report CSRP 264, School of Cognitive and Computing Sciences, Sussex University. Presented at: 2nd European Conf. on Artificla Life (1992) unpublished proceedings.
10. D. Cliff and G.F. Miller. Tracking the red queen: Measurements of adaptive progress in co-evolutionary simulations, in: F. Morán, A. Moreno, J.J. Merelo and P. Chacón, eds. Advances in Artificial Life: Proc. 3rd Int. Conf. on Artifical Life (Springer, Berlin, 1995) 200-218.
11. M. Colombetti and M. Dorigo, Learning to control an autonomous robot by distributed genetic algorithms, in: J.-A. Meyer, H.L. Roitblat and S.W. Wilson, eds., Proc. Simulation of Adaptive Behavior (MIT Press, Cambridge, MA, 1993) 305-311.
12. M. Colombetti and M. Dorigo, Training agents to perform sequential behavior, Adaptive Behavior 2 (3) (1994) 247-276.
13. D. Floreano, Patterns of interactions in shared environments, in: Toward a practice of autonomous systems: Proc. 1st European Conf. on Artificial Life (1993) 347-366.
14. D. Floreano and F. Mondada, Automatic creation of an autonomous agent: Genetic evolution of a neural-network driven robot, in: Simulation of Adaptive Behavior (1994) 421-430.
15. D. Floreano and F. Mondada, Evolution of homing navigation in a real mobile robot, IEEE Transactions on Systems, Man, and Cybernetics (1996).
16. K. Funahashi and Y. Nakamura, Approximation of dynamical systems by continuous time recurrent neural networks, Neural Networks 6 (1993) 801-806.
17. J.C. Gallagher and R.D. Beer, Application of evolved locomotion controllers to a hexapod robot. Technical Report CES-94-7, Case Western Reserve University Department of Computer Engineering and Science, 1994.
18. J. Grenfenstette and A. Schultz, An evolutionary approach to learning in robots, in: Proc. Machine Learning Workshop on Robot Learning, New Brunswick, NJ (1994).
19. F. Gruau, Automatic definition of modular neural networks, Adaptive Behavior 3 (2) (1994) 151-183.
20. I. Harvey, The artificial evolution of behaviour, in: J.-A. Meyer and S.W. Wilson, eds., From Animals to Animats: Proc. 1st Int. Conf. on the Simulation of Adaptive Behavior (MIT Press, Cambridge, MA, 1990).
21. I. Harvey, The SAGA cross: the mechanics of crossover for variable-length genetic algorithms, in: R. Männer and B. Manderick, eds., Parallel Problem Solving from Nature 2 (North-Holland, Amsterdam, 1992) 269-278. Also available as University of Sussex School of Cognitive and Computing Sciences Technical Report CSRP223.
22. I. Harvey, Spices adaptation genetic algorithms: A basis for a continuing SAGA, in: F. Varela and P. Bourgine, eds.,Towards a Practice of Autonomous Systems: Proc. 1st European Conf. on Artificial Life (MIT Press, Cambridge, MA, 1992) 346-354. Also available as University of Sussex School of Cognitive and Computing Sciences Technical Report CSRP221.
23. I. Harvey, Evolutionary robotics and SAGA: the case for hill crawling and tournament selection, in: C. Langton, ed., Artificial Life 3 Proc., Santa Fe Institute Studies in the Sciences of Complexity, Proc. Vol. XVI (Addison-Wesley, Reading, MA, 1993) also available as University of Sussex School of Cognitive and Computing Sciences Technical Report CSRP222, 1992.
24. I. Harvey, P. Husbands and D. Cliff, Seeing the light: Artificial evolution; Real vision, in: D. Cliff, P. Husbands, J.-A. Meyer and S.W. Wilson, eds., From Animals to Animats 3: Proc. 3rd Int. Conf. on Simulation of Adaptive Behavior, (MIT Press, Cambridge, MA, 1994) 392-401.
25. W.D. Hillis, Co-evolving parasites improve simulated evolution as an optimization procedure, Physica D 42 (1990) 228-234.
26. P. Husbands, I Harvey and D. Cliff, Circle in the round: state space attractors for evolved sighted robots, Robotics and Autonomous Systems 15 (1995) 83-106.
27. N. Jakobi, Evolving sensorimotor control architectures in simulation for a real robot. Master's thesis, University of Sussex School of Cognitive and Computing Sciences, 1994 (unpublished).
28. N. Jakobi, P. Husbands and I Harvey, Noise and the reality gap: the use of simulation in evolutionary robotics, in: F. Morán, A. Moreno, J.J. Merelo and P. Chacón, eds., Advances in Artificial Life: Proc. 3rd Int. Conf. on Artificial Life (Springer, berlin, 1995) 704-720.
29. J.R. Koza, Evolution of subscription using genetic programming, in: F.J. Varela and P. Bourgine, eds., Proc. 1st European Conf. on Artificial Life (MIT Presss, Cambridge, MA, 1990) 110-119.
30. J.R. Koza, Genetic Programming (MIT Press, Cambridge, MA, 1992).
31. J.R. Koza, Genetic Programming II: Automatic Discovery of Reusable Programs (MIT Press, Cambridge, MA, 1994).
32. J.R. Koza and J.P. Rice, Automatic programming of robots using genetic programming, in: Proc. AAAI-92 (MIT Press, Cambridge, MA, 1992) 194-201.
33. H.H. Lund, Specialization under social conditions in shared environments, in: Proc. Advances in Artificial Life, 3rd European Conf. on Artificial Life (1995) 477-489.
34. S. Mahadevan and J. Connell, Automatic programming of behavior-based robots using reinforcement learning, in: Proc. AAAI-91, Pittsburgh, PA (1991) 8-14.
35. M.J. Matarić, Integration of representation into goal-driven behavior-based robots. IEEE Transactions on Robotics and Automation 8 (3) (1992) 304-312.
36. M.J. Matarić, Learning to behave socially, in: D. Cliff, P. Husbands, J.-A. Meyer and S. Wilson, eds., From Animals to Animats: Int. Conf. on Simulation of Adaptive Behavior (1994) 453-462.
37. M.J. Matarić, Reward functions for accelerated learning, in: W.W. Cohen and H. Hirsh, eds., Proc. 11th Int. Conf. on Machine Learning (Morgan Kauffman, New Brunswick, NJ, 1994) 181-189.
38. M.J. Matarić, Evaluation of learning performance of situated emboided agents, in: Proc. Advances in Artificial Life, 3rd European Conf. on Artificial Life (1995) 579-589.
39. O. Miglino, H.H. Lund and S. Nolfi, Evolving mobile robots in simulated and real environments. Technical Report 95-04, Institute of Psychology, C.N.R., Rome, 1995.
40. F. Mondada and D. Floreano, Evolution of neural control structures: some experiments on mobile robots, Robotics and Autonomous Systems (1996).
41. S. Nolti, D. Floreano, O. Miglino, and F. Mondada, How to evolve autonomous robots: different approaches in evolutionary robotics, in: Proc. Artificial Life IV (1994) 190-197.
42. S. Nolfi and D. Parisi, Evolving non-trivial behaviors on real robots: an autonomous robot that picks up objects, in: Proc. 4th congress of the Italian Association for Artificial Intelligence (Springer, Berlin, 1995)
43. C. Reynolds, An evolved, vision-based behavioral model of coordinated group motion, in: J.-A. Meyer, H. Roitblat and S. Wilson, eds., Proc. 2nd Int. Conf. on Simulation of Adaptive Behaviour (SAB92) (MIT Press, Cambridge, MA, 1993) 384-393.
44. C. Reynolds, Competition, coevolution, and the game of tag, in: R. Brooks and P. Maes, eds., Artificial Life IV (MIT Press, Cambridge, MA, 1994) 59-69.
45. C. Reynolds, Evolution of corridor following behavior in a noisy world, in: D. Cliff, P. Husbands, J.-A. Meyer and S.W. Wilson, eds., From Animals to Animals 3: Proc. 3rd Int. Conf. on Simulation of Adaptive Behavior (MIT Press, Cambridge, MA, 1994) 402-410.
46. A.C. Schultz, Using a genetic algorithm to learn strategies for collision avoidance and local navigation, in: Proc. 7th Int. Symp. on Unmanned Untethered, Submersible Technology, Durham, NH (1991) 213-225.
47. K. Sims, Evolving 3D morphology and behavior by competition, in: Proc. Alife IV (MIT Press, Cambridge, MA, 1994) 28-39.
48. A. Thompson, Evolving electronic robot controllers that exploit hardware resources, in: F. Morán, A. Moreno, J.J. Merelo and P. Chacón, eds., Advances in Artificial Life: Proc. 3rd Int. Conf. on Artificial Life (Springer, Berlin, 1995) 640-656.
49. B.M. Yamauchi and R.D. Beer, Integrating reactive, sequential, and learning behavior using dynamical neural networks, in: D. Cliff, P. Husbands, J.-A. Meyer and S.W. Wilson, eds., From Animals to Animals 3: Proc. 3rd Int. Conf. on Simulation of Adaptive Behavior (MIT Press, Cambridge, MA, 1994) 382-391.