Evolution of adaptive behaviour in robots by means of Darwinian selection

PLoS Biology

Volumn 8, Issue 1, 2010, Pages

  Floreano, Dario ^a   Keller, Laurent ^b  

^a EPFL   (Switzerland)

^b UNIVERSITY OF LAUSANNE   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE BEHAVIOR; ALTRUISM; ARTIFICIAL NEURAL NETWORK; COEVOLUTION; COOPERATION; EVOLUTION; MOTOR SYSTEM; NATURAL SELECTION; PREDATOR PREY INTERACTION; REVIEW; ROBOTICS; SIMULATION; ARTICLE; ARTIFICIAL INTELLIGENCE; GENETIC SELECTION; THEORETICAL MODEL;

ARTIFICIAL INTELLIGENCE; EVOLUTION; MODELS, THEORETICAL; NEURAL NETWORKS (COMPUTER); SELECTION, GENETIC;

EID: 75749108269     PISSN: 15449173     EISSN: 15457885     Source Type: Journal    
DOI: 10.1371/journal.pbio.1000292     Document Type: Review

References (73)

1. Cliff D, Husbands P, Harvey I (1993) Explorations in evolutionary robotics. Adapt Behav 2: 73-110.
2. Nolfi S, Floreano D (2000) Evolutionary robotics: the biology, intelligence, and technology of self-organizing machines. CambridgeMA: MIT Press.
3. Miller JF, Job D, Vassilev VK (2000) Principles in the evolutionary design of digital circuits - part I. Genetic Programming and Evolvable Machines 1: 7-35.
4. Floreano D, Husbands P, Nolfi S (2008) Evolutionary Robotics. In: Siciliano B, Khatib O, eds (2008) Springer handbook of robotics. Berlin: Springer Verlag. pp 1423-1451.
5. Floreano D, Mattiussi C (2008) Bio-inspired artificial intelligence: theories, methods, and technologies. CambridgeMA: MIT Press.
6. Harvey I, Di Paolo E, Wood R, Quinn M, Tuci E (2005) Evolutionary robotics: a new scientific tool for studying cognition. Artif Life 11: 79-98.
7. Ray TS (1992) An approach to the synthesis of life. In: Langton CG, Taylor C, Farmer DJ, Rasmussen S, eds. Proceedings of the Second Workshop on Artificial Life. pp 371-408.
8. Adami C (1998) Introduction to artificial life. New York: Springer Verlag.
9. Lenski RE, Ofria C, Collier TC, Adami C (1999) Genome complexity, robustness, and genetic interactions in digital organisms. Nature 400: 661-664.
10. Lenski RE, Ofria C, Pennock RT, Adami C (2003) The evolutionary origin of complex features. Nature 423: 139-144.
11. Wilke CO, Wang J, Ofria C, Lenski RE, Adami C (2001) Evolution of digital organisms at high mutation rate leads to survival of the flattest. Nature 412: 331-333.
12. Clune J, Misevic D, Ofria C, Lenski RE, Elena SF, et al. (2008) Natural selection fails to optimize mutation rates for long-term adaptation on rugged fitness landscapes. PLoS Computational Biology 4: e1000187. doi:10.1371/journal. pcbi.1000187.
13. Turing AM (1950) Computing machinery and intelligence. Mind 49: 433-460.
14. Rechenberg I (1965) Cybernetic solution path of an experimental problem. Royal Air Force Establishment. 1122 p.
15. Fogel LJ, Owens AJ, Walsh MJ (1966) Artificial intelligence through simulated evolution. New York, NY: John Wiley.
16. Holland JH (1975) Adaptation in natural and artificial systems: an introductory analysis with applications to biology, control, and artificial intelligence. Ann ArborMI: University of Michigan Press.
17. Lewis MA, Fagg AH, Solidum A (1992) Genetic programming approach to the construction of a neural network for control of a walking robot. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA '92). pp 2618-2623.
18. Floreano D, Mondada F (1994) Automatic creation of an autonomous agent: genetic evolution of a neural network driven robot. In: Cliff D, Husbands P, Meyer JA, Wilson S, eds. Proceedings of third International Conference on Simulation of Adaptive Behavior: From Animals to Animats 3. CambridgeMA: MIT Press. pp 421-430.
19. Harvey I, Husbands P, Cliff D (1994) Seeing the light: artificial evolution, real vision. In: Cliff D, Husbands P, Meyer JA, Wilson S, eds. Proceedings of the third International Conference on Simulation of Adaptive Behavior: From Animals to Animats 3. CambridgeMA: MIT Press. pp 392-401.
20. Floreano D, Dürr P, Mattiussi C (2008) Neuroevolution: from architectures to learning. Evol Intelligence 1: 47-62.
21. Featherstone R (2000) Robot dynamics: equations and algorithms. Proceedings of IEEE International Conference on Robotics and Automation (ICRA '00). pp 826-834.
22. Schmajuk NA, Blair HT (1993) Place learning and the dynamics of spatial navigation: A neural network approach. Adapt Behav 1: 353-385.
23. Burgess N, Donnett JG, Jeffery KJ, O'Keefe J (1997) Robotic and neuronal simulation of hippocampal navigation. Philos Trans R Soc Lond B Biol Sci 352: 1535-1543.
24. Healy S, ed (1998) Spatial representations in animals. Oxford: Oxford University Press.
25. Floreano D, Mondada F (1996) Evolution of homing navigation in a real mobile robot. IEEE Trans Syst Man Cybern B Cybern 26: 396-407.
26. O'Keefe J, Nadel L (1978) The hippocampus as a cognitive map. Oxford: Clarendon Press.
27. Taube JS, Muller RU, Ranck JBJ (1990) Head-direction cells recorded from the postsubiculum in freely moving rats. I. Description and quantitative analysis. J Neurosci 10: 420-435.
28. Floreano D, Nolfi S (1997) God save the red queen! Competition in co-evolutionary robotics. In: Koza JR, Deb K, Dorigo M, Fogel DB, Garzon M, et al. (1997) Genetic Programming 1997: Proceedings of the Second Annual Conference. San FranciscoCA: Morgan Kaufmann. pp 398-406.
29. Nolfi S, Floreano D (1998) Co-evolving predator and prey robots: do "arm races" arise in artificial evolution. Artif Life 4: 311-335.
30. Floreano D, Nolfi S, Mondada F (1998) Competitive co-evolutionary robotics: from theory to practice. In: Pfeifer R, ed. Proceedings of the fifth International Conference on Simulation of Adaptive Behavior: From Animals to Animats 5. CambridgeMA: MIT Press. pp 515-524.
31. Van Valen L (1973) A new evolutionary law. Evol Theory 1: 1-30.
32. Bell G (1982) The masterpiece of nature: the evolution and genetics of sexuality. Berkeley: University of California Press.
33. Sims K (1994) Evolving 3D morphology and behavior by competition. In: Brooks R, Maes P, eds. Artificial Life IV. Cambridge, MA: MIT Press Bradford Books. pp 28-39.
34. Lipson H, Pollack JB (2000) Automatic design and manufacture of robotic lifeforms. Nature 406: 974-978.
35. Hamilton WD (1964) The genetical evolution of social behaviour. J Theor Biol 7: 1-52.
36. Lehmann L, Keller L (2006) The evolution of cooperation and altruism: A general framework and a classification of models. J Evol Biol 19: 1365-1379.
37. Waibel M, Keller L, Floreano D (2009) Genetic team composition and level of selection in the evolution of cooperation. IEEE Trans Evol Comput 13: 648-660.
38. Floreano D, Mitri S, Magnenat S, Keller L (2007) Evolutionary conditions for the emergence of communication in robots. Curr Biol 17: 514-519.
39. Mitri S, Floreano D, Keller L (2009) The evolution of information suppression in communicating robots with conflicting interests. PNAS 106: 15786-15790.
40. Sherman PW (1977) Nepotism and the evolution of alarm calls. Science 197: 1246-1253.
41. Sundström L, Chapuisat M, Keller L (1996) Conditional manipulation of sex ratios by ant workers: A test of kin selection theory. Science 274: 993-995.
42. Pfennig DW, Collins JP (1993) Kinship affects morphogenesis in cannibalistic salamanders. Nature 362: 836-838.
43. Langer P, Hogendoorn K, Keller L (2004) Tug-of-war over reproduction in a social bee. Nature 428: 844-847.
44. West SA, Murray MG, Machado CA, Griffin AS, Herre EA (2001) Testing Hamilton's rule with competition between relatives. Nature 409: 510-513.
45. West SA, Diggle SP, Buckling A, Gardner A, Griffin AS (2007) The social lives of microbes. Annu Rev Ecol Evol Syst 38: 53-77.
46. Gallagher JC, Beer RD, Espenschied KS, Quinn RD (1996) Application of evolved locomotion controllers to a hexapod robot. Rob Auton Syst 19: 95-103.
47. Gomi T, Ide K (1998) Emergence of gaits of a legged robot by collaboration through evolution. In: Sugisaka M, ed. Proceedings of the International Symposium on Artificial Life and Robotics. Berlin: Springer Verlag.
48. Gruau F, Quatramaran K (1996) Cellular encoding for interactive evolutionary robotics. In: Husbands P, Harvey I, eds. Fourth European Conference on Artificial Life. CambridgeMA: MIT Press. pp 368-377.
49. Kodjabachian J, Meyer J-A (1998) Evolution and development of neural controllers for locomotion, gradient-following, and obstacle-avoidance in artificial insects. IEEE Trans Neural Netw 9: 796-812.
50. Hornby GS, Lipson H, Pollack JB (2003) Generative representations for the automated design of modular physical robots. IEEE Trans Rob Autom 19: 709-713.
51. Quinn M, Smith L, Mayley G, Husbands P (2003) Evolving controllers for a homogeneous system of physical robots: structured cooperation with minimal sensors. Philos Trans Phys Sci Eng 361: 2321-2344.
52. Dorigo M, Trianni V, Sahin E, Groß R, Labella TH, et al. (2004) Evolving self-organizing behaviors for a swarm-bot. Auton Robots 17: 223-245.
53. Bongard J, Zykov V, Lipson H (2006) Resilient machines through continuous self-modeling. Science 314: 1118-1121.
54. Trianni V, Nolfi S, Dorigo M (2006) Cooperative hole avoidance in a swarm-bot. Rob Auton Syst 54: 97-103.
55. Tellez R, Angulo C, Pardo D (2006) Evolving the walking behaviour of a 12 DOF quadruped using a distributed neural architecture. In: Ijspeert AJ, Masuzawa T, Kusumoto S, eds. Proceedings of the International Workshop on Biologically Inspired Approaches to Advanced Information Technology. Berlin: Springer-Verlag. pp 5-19.
56. Watson RA, Ficici SG, Pollack JB (2002) Embodied evolution: distributing an evolutionary algorithm in a population of robots. Robotics and Autonomous Systems 39: 1-18.
57. Hauert S, Zufferey J-C, Floreano D (2009) Reverse-engineering of artificially evolved controllers for swarms of robots. Proceedings of the IEEE Congress on Evolutionary Computation. pp 55-61.
58. Brooks RA (1992) Artificial life and real robots. In: Varela FJ, Bourgine P, eds.Toward a Practice of Autonomous Systems: Proceedings of the First European Conference on Artificial Life. CambridgeMA: MIT Press. pp 3-10.
59. Jakobi N, Husbands P, Harvey I (1995) Noise and the reality gap: The use of simulation in evolutionary robotics. In: Moran F, Moreno A, Merelo J, Chacon P, eds. Advances in Artificial Life: Proceedings of the Third European Conference on Artificial Life. London: Springer-Verlag. pp 704-720.
60. Urzelai J, Floreano D (2001) Evolution of adaptive synapses: robots with fast adaptive behavior in new environments. Evol Comput 9: 495-524.
61. Bongard J, Pfeifer R (2003) Evolving complete agents using artificial ontogeny. In: Hara F, Pfeifer R, eds. Morpho-functional Machines: The New Species: Designing Embodied Intelligence. Berlin: Springer-Verlag. pp 237-258.
62. Reil T, Husbands P (2002) Evolution of central pattern generators for bipedal walking in a real-time physics environment. IEEE Trans Evol Comput 6: 159-168.
63. Vaughan ED, Di Paolo E, Harvey IR (2004) The evolution of control and adaptation in a 3D powered passive dynamic walker. In: Pollack J, BedauM, Husbands P, Ikegami T,Watson R, eds. Proceedings of the Ninth International Conference on the Simulation and Synthesis of Living Systems MIT Press. pp 139-145.
64. Pfeifer R, Bongard JC (2006) How the body shapes the way we think. CambridgeMA: MIT Press.
65. Bianco R, Nolfi S (2004) Evolving the neural controller for a robotic arm able to grasp objects on the basis of tactile sensors. Adapt Behav 12: 37-45.
66. Suzuki M, Floreano D, Di Paolo E (2005) The contribution of active body movement to visual development in evolutionary robots. Neural Netw 18: 656-665.
67. Di Paolo EA (2003) Evolving spike-timing-dependent plasticity for single-trial learning in robots. Philos Trans Phys Sci Eng 361: 2299-2319.
68. Niv Y, Joel D, Meilijson I, Ruppin E (2002) Evolution of reinforcement learning in uncertain environments: A simple explanation for complex foraging behaviors. Adapt Behav 10: 5-24.
69. Philippides A, Husbands P, Smith T, O'Shea M (2005) Flexible couplings: diffusing neuromodulators and adaptive robotics. Artif Life 11: 139-160.
70. Parisi D, Nolfi S (2001) Developmental in neural networks. In: Mukesh JP, Honavar V, Balakrishan K, eds. Advances in Evolutionary Synthesis of Neural Networks. Cambridge, MA: MIT Press. pp 215-246.
71. Ijspeert AJ, Crespi A, Ryczko D, Cabelguen J-M (2007) From swimming to walking with a salamander robot driven by a spinal cord model. Science 315: 1416-1420.
72. Pfeifer R, Lungarella M, Iida F (2007) Self-organization, embodiment, and biologically inspired robotics. Science 318: 1088-1093.
73. Webb B (2002) Robots in invertebrate neuroscience. Nature 417: 359-363.