Environment-driven distributed evolutionary adaptation in a population of autonomous robotic agents

Mathematical and Computer Modelling of Dynamical Systems

Volumn 18, Issue 1, 2012, Pages 101-129

  Bredeche, Nicolas ^a   Montanier, Jean Marc ^a   Liu, Wenguo ^b   Winfield, Alan F T ^b  

^a INRIA   (France)

^b UNIVERSITY OF THE WEST OF ENGLAND   (United Kingdom)

Author keywords

artificial life; evolutionary robotics; open ended evolution; swarm intelligence

Indexed keywords

EID: 84863142496     PISSN: 13873954     EISSN: 17445051     Source Type: Journal    
DOI: 10.1080/13873954.2011.601425     Document Type: Article

References (40)

1. Bonabeau, E., Dorigo, M. and Theraulaz, G. 1999. Swarm Intelligence: From Natural to Artificial Systems, Oxford: Oxford University Press.
2. Trianni, V., Nolfi, S. and Dorigo, M. 2008. "Evolution, self-organization and swarm robotics". In Swarm Intelligence, Natural Computing Series, Edited by: Blum, C. and Merkle, D. 163-191. Berlin: Springer.
3. Baele, G., Bredeche, N., Haasdijk, E., Maere, S., Michiels, N., Van de Peer, Y., Schmickl, T., Schwarzer, C. and Thenius, R. 2009. Open-ended on-board evolutionary robotics for robot swarms, 1123-1130. Trondheim, Norway: Proceedings of the IEEE Conference on Evolutionary Computation (CEC 2009).
4. Bernstein, D.S., Givan, R., Immerman, N. and Zilberstein, S. 2002. The complexity of decentralized control of Markov decision processes. Math. Oper. Res., 27(4): 819-840.
5. Kohl, N. and Stone, P. 2004. Policy gradient reinforcement learning for fast quadrupedal locomotion, 2619-2624. New Orleans, LA: Proceedings of the IEEE International Conference on Robotics and Automation.
6. Marbach, P. and Tsitsiklis, J.N. 2003. Approximate gradient methods in policy space optimization of Markov reward processes. J. Discrete Event Dyn. Syst., 13: 111-148.
7. Williams, R.J. 1992. Simple statistical gradient-following algorithms for connectionist reinforcement learning. Mach. Learn., 8: 229-256.
8. Taylor, M., Whiteson, S. and Stone, P. 2006. Comparing evolutionary and temporal difference methods for reinforcement learning, 1321-1328. Seattle, WA: Proceedings of the Genetic and Evolutionary Computation Conference (GECCO).
9. Taylor, M.E., Whiteson, S. and Stone, P. 2007. Temporal difference and policy search methods for reinforcement learning: An empirical comparison, 1675-1678. Vancouver, Canada: Proceedings of the Twenty-Second Conference on Artificial Intelligence (AAAI-07).
10. Ficici, S., Watson, R. and Pollack, J. 1999. Embodied evolution: A response to challenges in evolutionary robotics, Edited by: Wyatt, J.L. and Demiris, J. 14-22. Lausanne, Switzerland: Proceedings of the Eighth European Workshop on Learning Robots.
11. Elfwing, S., Uchibe, E., Doya, K. and Christensen, H.I. 2005. Biologically inspired embodied evolution of survival. Proceedings of the 2005 IEEE Congress on Evolutionary Computation IEEE Congress on Evolutionary Computation. September2-52005, Edinburgh, UK. Edited by: Corne, D., Michalewicz, Z., Dorigo, M., Eiben, G., Fogel, D., Fonseca, C., Greenwood, G., Chen, T.K., Raidl, G., Zalzala, A., Lucas, S., Paechter, B., Willies, J., Merelo, J.J. Guervos, Eberbach, E., McKay, B., Channon, A., Tiwari, A., Volkert, L. Gwenn, Ashlock, D. and Schoenauer, M. Vol. 3, pp.2210-2216. UK: IEEE Press.
12. Usui, Y. and Arita, T. 2003. Situated and embodied evolution in collective evolutionary robotics, 212-215. Oita, Japan: Proceedings of the 8th International Symposium on Artificial Life and Robotics.
13. Watson, R.A., Ficici, S.G. and Pollack, J.B. 2002. Embodied evolution: Distributing an evolutionary algorithm in a population of robots. Rob. Auton. Syst., 39(1): 1-18.
14. Wischmann, S., Stamm, K. and örgötter, F. W. 2007. "Embodied evolution and learning: The neglected timing of maturation". In Advances in Artificial Life: 9th European Conference on Artificial Life, Edited by: Francesco, Almeida e Costa. Vol. 4648, 284-293. Lisbon, Portugal: of Lecture Notes in Artificial Intelligence, Springer-Verlag.
15. Bredeche, N., Haasdijk, E. and Eiben, A.E. 2009. On-line, on-board evolution of robot controllers, 110-121. Proceedings of Artificial Evolution/Evolution Artificielle (EA'09), Strasbourg, France.
16. Montanier, J.-M. and Bredeche, N. 2011. "Embedded evolutionary robotics: The (1 + 1)-restart-online adaptation algorithm". In New Horizons in Evolutionary Robotics: Extended Contributions from the 2009 EvoDeRob Workshop, Edited by: Doncieux, S., Bredeche, N. and Mouret, J.-B. 155-168. Berlin: Springer.
17. Bedau, M.A. 2001. Comparison of the growth of adaptive structure in artificial life models and in the fossil record. PaleoBios, 21: 30
18. Bedau, M.A., McCaskill, J.S., Packard, N.H., Rasmussen, S., Adami, C., Green, D.G., Ikegami, T., Kaneko, K. and Ray, T.S. 2000. Open problems in artificial life. Artif. Life, 6: 363-376.
19. Holland, J.H. 1994. "Echoing emergence: Objectives, rough definitions, and speculations for echo - class models". In Complexity: Metaphors, Models and Reality, Edited by: Cowan, G.A., Pines, D. and Meltzer, D. 309-342. Reading, MA: Addison-Wesley.
20. Ray, T. 1991. Is it alive, or is it GA?, San Diego, CA: Proceedings of International Conference on Genetic Algorithms.
21. Spector, L., Klein, J., Perry, C. and Feinstein, M. 2005. Emergence of collective behavior in evolving populations of flying agents. Genet. Program. Evolvable Mach., 6(1): 111-125.
22. Dawkins, R. 1976. The Selfish Gene, Oxford: Oxford University Press.
23. Fletcher, J.A., Bedau, M.A. and Zwick, M. 1998. "Effect of environmental structure on evolutionary adaptation". In Artificial Life VI, Edited by: Adami, C., Belew, R., Kitano, H. and Taylor, C. 189-198. Cambridge, MA: MIT Press.
24. Beyer, H.-G. and Schwefel, H.-P. 2002. Evolution strategies - a comprehensive introduction. Nat. Comput., 1: 3-52.
25. Futuyma, D. 2009. Evolution, 2nd, Sunderland, MA: Sinauer Associates Inc.
26. Rosin, C. and Belew, R. 1996. New methods for competitive coevolution. Evol. Comput., 5: 1-29.
27. Jakobi, N., Husband, P. and Harvey, I. 1995. "Noise and the reality gap: The use of simulation in evolutionary robotics". In Advances in Artificial Life: Proceedings of the Third European Conference on Artificial Life, Edited by: Moran, F., Moreno, A., Merelo, J. and Chancon, P. 704-720. Berlin: Springer-Verlag.
28. Nolfi, S. and Floreano, D. 2000. Evolutionary Robotics: The Biology, Intelligence, and Technology of Self-Organizing Machines, Cambridge, MA: MIT Press/Bradford Books.
29. Şahin, E. and Spears, W. 2005. Swarm Robotics Workshop: State-of-the-Art Survey, Vol. 3342, New York: of Lecture Notes in Computer Science, Springer.
30. Şahin, E. and Winfield, A.F.T. 2008. Swarm Intelligence: Special Issue on Swarm Robotics, Vol. 2, Berlin: Springer.
31. Dorigo, M. and Şahin, E. 2004. Autonomous Robots: Special Issue on Swarm Robotics, Vol. 17, Berlin: Springer.
32. Winfield, A.F.T. and Holland, O.E. 2000. The application of wireless local area network technology to the control of mobile robots. Microprocess. Microsyst., 23(10): 597-607.
33. Caprari, G., Estier, T. and Siegwart, R. 2002. Fascination of down scaling - Alice the sugar cube robot. J. Micro Mechatron., 1(3): 177-189.
34. Kornienko, S., Kornienko, O. and Levi, P. 2005. Collective AI: Context Awareness via Communication, 1464-1470. San Francisco, CA: IJCAI'05: Proceedings of the 19th International Joint Conference on Artificial Intelligence, Morgan Kaufmann Publishers Inc.
35. Gross, R., Bonani, M., Mondada, F. and Dorigo, M. 2006. Autonomous selfassembly in swarm-bots. IEEE Trans. Rob., 22(6): 1115-1130.
36. Mondada, F., Bonani, M., Raemy, X., Pugh, J., Cianci, C., Klaptocz, A., Magnenat, S., Zufferey, J.-C., Floreano, D. and Martinoli, A. 2009. The e-puck, a robot designed for education in engineering, Vol. 1, 59-65. Castelo Branco, Portugal: Proceedings of the 9th Conference on Autonomous Robot Systems and Competitions.
37. Liu, W. and Winfield, A.F.T. 2011. Open-hardware e-puck Linux extension board for experimental swarm robotics research. Microprocess. Microsyst., 35(1): 60-67.
38. Vaughan, R. 2008. Massively multi-robot simulation in stage. Swarm Intell., 2(2-4): 189-208.
39. Wolpert, D.H. and Tumer, K. 2001. Optimal payoff functions for members of collectives. Adv. Complex Syst., 4(2/3): 265-279.
40. Lehman, J. and Stanley, K.O. 2011. Abandoning objectives: Evolution through the search for novelty alone. Evol. Comput., 19(2): 189-223.