Memory-enhanced evolutionary robotics: The echo state network approach

2009 IEEE Congress on Evolutionary Computation, CEC 2009

Volumn , Issue , 2009, Pages 2788-2795

  Hartland, Cedric ^a   Bredeche, Nicolas ^a   Sebag, Michèle ^a  

^a UNIVERSITÉ PARIS SACLAY   (France)

Author keywords

[No Author keywords available]

Indexed keywords

BENCH-MARK PROBLEMS; COMPLEX DYNAMIC SYSTEMS; COVARIANCE MATRIX ADAPTATION; ECHO STATE NETWORKS; EVOLUTION STRATEGIES; EVOLUTIONARY OPTIMIZATIONS; EVOLUTIONARY ROBOTICS; LINEAR OPTIMIZATION; NEURAL NET; NON-PARAMETRIC; RESERVOIR COMPUTING; ROBOTIC CONTROLLERS; SEARCH SPACES;

COVARIANCE MATRIX; DYNAMICAL SYSTEMS; ELECTRIC NETWORK PARAMETERS; EVOLUTIONARY ALGORITHMS; NEURAL NETWORKS; OPTIMIZATION; ROBOTS; TIME SERIES ANALYSIS;

ROBOTICS;

EID: 70449794079     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CEC.2009.4983292     Document Type: Conference Paper

References (41)

1. S. Thrun, M. Montemerlo, H. Dahlkamp, D. Stavens, A. Aron, J. Diebel, P. Fong, J. Gale, M. Halpenny, G. Hoffmann, K. Lau, C. Oakley, M. Palatucci, V. Pratt, P. Stang, S. Strohband, C. Dupont, L.-E. Jendrossek, C. Koelen, C. Markey, C. Rummel, J. van Niekerk, E. Jensen, P. Alessandrini, G. Bradski, B. Davies, S. Ettinger, A. Kaehler, A. Nefian, and P. Mahoney, "Winning the darpa grand challenge," Journal of Field Robotics, 2006.
2. M. Toussaint, V. Willert, J. Eggert, and E. Korner, "Motion segmentation using inference in dynamic bayesian networks," in British Machine Vision Conference 2007, 2007.
3. P. L. Lanzi, "Adding Memory to XCS," in Proceedings of the IEEE Conference on Evolutionary Computation (ICEC98). IEEE Press, 1998.
4. N. Meuleau and R. I. Brafman, "Hierarchical heuristic forward search in stochastic domains," in IJCAI, M. M. Veloso, Ed., 2007, pp. 2542-2549.
5. S. Nolfi and D. Floreano, Evolutionary Robotics: The Biology, Intelligence, and Technology of Self-Organizing Machines. Cambridge, MA: MIT Press/Bradford Books, 2000.
6. J. Urzelai and D. Floreano, "Evolution of adaptive synapses: Robots with fast adaptive behavior in new environments," Evol. Comput., vol.9, no.4, pp. 495-524, 2001.
7. E. Tuci, V. Trianni, and M. Dorigo, "Evolving the feeling of time through sensory-motor coordination: a robot-based model," in The 8th International Conference on Parallel Problem Solving From Nature (PPSN 2004), ser. Lecture Notes in Computer Science, X. Yao, E. Burke, J. Lozano, J. Smith, J. Merelo-Guerv́os, J. Bullinaria, J. Rowe, P. Tin̂o, A. Kabàn, and H. Schwefel, Eds., vol.3242. Springer Verlag, Berlin, Germany, 2004, pp. 1001-1010.
8. R. Hecht-Nielsen, Neuro-computing. Addison Wesley, 1989.
9. K. O. Stanley and R. Miikkulainen, "Evolving neural networks through augmenting topologies," Evolutionary Computation, vol.10, no.2, pp. 99-127, 2002.
10. E. Tolman and C. Honzik, "Insights in rats," University of California Publications in Psychology, vol.4, no.14, pp. 215-232, 1930.
11. P. L. Lanzi, "An analysis of the memory mechanism of XCSM," in Genetic Programming 1998: Proceedings of the Third Annual Conference, J. R. Koza, W. Banzhaf, K. Chellapilla, K. Deb, M. Dorigo, D. B. Fogel, M. H. Garzon, D. E. Goldberg, H. Iba, and R. Riolo, Eds. University of Wisconsin, Madison, Wisconsin, USA: Morgan Kaufmann, 22-25 1998, pp. 643-651.
12. H. Jaeger, "A tutorial on training recurrent neural networks. covering bptt, rtrl, ekf, and the echo state network approach," in GMD report 159. German National Research Center for Information Technology, 2002.
13. N. Hansen and A. Ostermeier, "Completely derandomized selfadaptation in evolution strategies," Evolutionary Computation, vol.9, no.2, pp. 159-195, 2001.
14. J.-P. P. Laumond, Robot Motion Planning and Control. Secaucus, NJ, USA: Springer-Verlag New York, Inc., 1998.
15. P. Abbeel, A. Coates, M. Quigley, and A. Y. Ng, "An application of reinforcement learning to aerobatic helicopter flight," in Advances in Neural Information Processing Systems 19, B. Scholkopf, J. Platt, and T. Hoffman, Eds. Cambridge, MA: MIT Press, 2007, pp. 1-8.
16. R. Sutton and A. Barto, Reinforcement Learning: An Introduction. MIT Press, 1998.
17. G. Baldassarre, D. Parisi, and S. Nolfi, "Distributed coordination of simulated robots based on self-organisation." Artificial Life, vol.12, no.3, pp. 289-311, Summer 2006.
18. H. Lipson and J. B. Pollack, "Automatic design and manufacture of robotic lifeforms." Nature, vol.406, no.6799, pp. 974-978, August 2000.
19. S. Nolfi and D. Parisi, "Auto-teaching networks that develop their own teaching input," in Proceedings of the Second European Conference on Artificial Life, J. Deneubourg, H. Bersini, S. Goss, G. Nicolis, and R. Dagonnier, Eds., Brussels, Free University of Brussels, 1993.
20. A. E. Eiben and J. E. Smith, Introduction to Evolutionary Computing (Natural Computing Series). Springer, November 2003.
21. J. L. Elman, "Finding structure in time," Cognitive Science, vol.14, no.2, pp. 179-211, 1990.
22. W. Maass, T. Natschläger, and H. Markram, "Real-time computing without stable states: a new framework for neural computation based on perturbations," Neural Comput., vol.14, no.11, pp. 2531-2560, 2002.
23. R. M. K.O. Stanley, B.D. Bryant, "Evolving adaptive neural networks with and without adaptive synapses," Evolutionary Computation, vol.4, pp. 2557-2564, 2003.
24. A. Devert, N. Bredeche, and M. Schoenauer, "Unsupervised learning of echo state networks: A case study in artificial embryogeny," in Artificial Evolution, 2007, pp. 278-290.
25. F. Jiang, H. Berry, and M. Schoenauer, "Supervised and evolutionary learning of echo state networks," in PPSN X, 10th International Conference on Parallel Problem Solving from Nature, 2008, pp. 215-224.
26. E. Antonelo, B. Schrauwen, X. Dutoit, D. Stroobandt, and M. Nuttin, "Event detection and localization in mobile robot navigation using reservoir computing," in Proceedings of the International Conference on Artificial Neural Networks. Porto: Portugal, 9 2007.
27. J. Lehman and K. O. Stanley, "Exploiting open-endedness to solve problems through the search for novelty," in Proceedings of the Eleventh International Conference on Artificial Life (ALIFE XI). Cambridge, MA: MIT Press, 2008.
28. L. Hugues and N. Bredeche, "Simbad : an autonomous robot simulation package for education and research," in Proceedings of The Ninth International Conference on the Simulation of Adaptive Behavior (SAB'06). Rome, Italy: Published in Springer's Lecture Notes in Computer Sciences / Artificial Intelligence series (LNCS/LNAI) n.4095, 2006, pp. 831-842.
29. N. Hansen and S. Kern, "Evaluating the CMA evolution strategy on multimodal test functions," in Parallel Problem Solving from Nature PPSN VIII, ser. LNCS, X. Yao et al., Eds., vol.3242. Springer, 2004, pp. 282-291.
30. V. Vapnik, Statistical learning theory. Wiley, 1998.
31. M. J. Mataric, "Reinforcement learning in the multi-robot domain," Autonomous Robots, vol.4, no.1, pp. 73-83, 1997.
32. H.-G. Beyer, "Mutate large, but inherit small ! On the analysis of mutations in (1, ë)-ES with noisy fitness data," in Proceedings of the 5th Conference on Parallel Problems Solving from Nature, T. Bäck, G. Eiben, M. Schoenauer, and H.-P. Schwefel, Eds. Springer Verlag, 1998, pp. 109-118.
33. T. P. Runarsson, "Reducing random fluctuations in mutative selfadaptation," in Parallel Problem Solving from Nature (PPSN VII). Lecture notes in computer science. Springer-Verlag, 2002, pp. 194-203.
34. P. Cramton, Y. Shoham, and R. Steinberg, "Combinatorial auctions," University of Maryland, Department of Economics - Peter Cramton, Papers of Peter Cramton 04mit, 2004.
35. M. Ozturk, D. Xu, and J. Principe, "Analysis and design of echo state networks," in Neural Computation, 19:1. MIT Press, 2007, pp. 111- 138.
36. M. Salmen and P. Ploger, "Echo state networks used for motor control," in In Proceedings of the 2005 IEEE international conference on robotics and automation, 2005, pp. 1953-1958.
37. Igel C., "Neuroevolution for reinforcement learning using evolution strategies," R. Sarker, R. Reynolds, H. Abbass, K. C. Tan, B. McKay, D. Essam, and T. Gedeon, Eds., Congress on Evolutionary Computation, 4, 2588-2595. Sanya, China, December 2003.
38. C. Hartland and N. Bredche, "Using echo state networks for robot navigation behavior acquisition," in IEEE International Conference on Robotics and Biomimetics (ROBIO07). Sanya, China: IEEE Computer Society Press, December 2007.
39. A. Billard and R. Siegwart, "Special issue on robot learning from demonstration," Robotics And Autonomous Systems, vol.47, no.2-3, pp. 65-67, 2004.
40. P. Abbeel and A. Y. Ng, "Apprenticeship learning via inverse reinforcement learning," in In Proc. ICML. ACM Press, 2004.
41. B. Schrauwen, L. Buesing, and R. A. Legenstein, "On computational power and the order-chaos phase transition in reservoir computing," in NIPS, 2008.