Innocent until proven guilty: Reducing robot shaping from polynomial to linear time

IEEE Transactions on Evolutionary Computation

Volumn 15, Issue 4, 2011, Pages 571-585

  Bongard, Josh C ^a  

^a University of Vermont   (United States)

Author keywords

Early stopping; evolutionary robotics

Indexed keywords

EARLY STOPPING; EVOLUTIONARY ROBOTICS; FITNESS FUNCTIONS; LINEAR TIME; STOPPING METHODS; SUBLINEAR TIME; TASK DIFFICULTY; TIME COMPLEXITY;

HEALTH; ROBOTICS; ROBOTS;

FUNCTION EVALUATION;

EID: 79961027592     PISSN: 1089778X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TEVC.2010.2096540     Document Type: Article

References (43)

1. I. Harvey, P. Husbands, D. Cliff, A. Thompson, and N. Jakobi, "Evolutionary robotics: The Sussex approach," Robot. Autonomous Syst., vol. 20, nos. 2-4, pp. 205-224, 1997. (Pubitemid 127399445)
2. S. Nolfi and D. Floreano, Evolutionary Robotics. Boston, MA: MIT Press, 2000.
3. J. Bongard, V. Zykov, and H. Lipson, "Resilient machines through continuous self-modeling," Science, vol. 314, pp. 1118-1121, Nov. 2006. (Pubitemid 44789036)
4. K. Sims, "Evolving 3-D morphology and behavior by competition," Artif. Life IV, vol. 1, no. 4, pp. 28-39, 1994.
5. H. Lipson and J. B. Pollack, "Automatic design and manufacture of artificial lifeforms," Nature, vol. 406, pp. 974-978, Aug. 2000.
6. J. C. Bongard, "Evolving modular genetic regulatory networks," in Proc. IEEE CEC, May 2002, pp. 1872-1877.
7. T. Reil and P. Husbands, "Evolution of central pattern generators for bipedal walking in a real-time physics environment," IEEE Trans. Evol. Comput., vol. 6, no. 2, pp. 159-168, Apr. 2002. (Pubitemid 34555370)
8. J. C. Bongard and C. Paul, "Making evolution an offer it can't refuse: Morphology and the extradimensional bypass," in Proc. 6th Eur. Conf. Artif. Life, 2001, pp. 401-412. (Pubitemid 33335280)
9. J. Bongard, "Behavior chaining: Incremental behavioral integration for evolutionary robotics," in Proc. 11th Artif. Life, 2008, pp. 64-71 [Online]. Available: http://www.alifexi.org/papers/ALIFExi pp064-071.pdf
10. S. P. Singh, "Transfer of learning across sequential tasks," Mach. Learning, vol. 8, no. 3, pp. 323-339, 1992.
11. M. Dorigo and M. Colombetti, "Robot shaping: Developing autonomous agents through learning," Artif. Intell., vol. 71, no. 2, pp. 321-370, 1994.
12. L. Saksida, S. Raymond, and D. Touretzky, "Shaping robot behavior using principles from instrumental conditioning," Robot. Autonomous Syst., vol. 22, nos. 3-4, pp. 231-250, 1997.
13. J. Pratt, C. Chew, A. Torres, P. Dilworth, and G. Pratt, "Virtual model control: An intuitive approach for bipedal locomotion," Int. J. Robot. Res., vol. 20, no. 2, pp. 129-143, 2001. (Pubitemid 32252541)
14. M. Lungarella, G. Metta, R. Pfeifer, and G. Sandini, "Developmental robotics: A survey," Connection Sci., vol. 15, no. 4, pp. 151-190, 2003. (Pubitemid 38474539)
15. T. Ziemke, N. Bergfeldt, G. Buason, T. Susi, and H. Svensson, "Evolving cognitive scaffolding and environment adaptation: A new research direction for evolutionary robotics," Connection Sci., vol. 16, no. 4, pp. 339-350, 2004. (Pubitemid 40025938)
16. S. Mahfoud, "Niching methods for genetic algorithms," Ph.D. dissertation, Dept. Industr. Enterprise Syst. Engineer. (IESE), Univ. Illinois at Urbana-Champaign, Urbana, 1995.
17. E. Cantú-Paz, "A survey of parallel genetic algorithms," Calculateurs Paralleles, Reseaux Syst. Repartis, vol. 10, no. 2, pp. 141-171, 1998.
18. D. Whitley, S. Rana, and R. Heckendorn, "The island model genetic algorithm: On separability, population size and convergence," J. Comput. Inform. Technol., vol. 7, no. 1, pp. 33-48, 1999.
19. E. Alba and B. Dorronsoro, Cellular Genetic Algorithms. Berlin, Germany: Springer-Verlag, 2008.
20. D. Goldberg and J. Richardson, "Genetic algorithms with sharing for multimodal function optimization," in Proc. 2nd Int. Conf. Genet. Algorithms Their Applicat. Table Contents, 1987, pp. 41-49.
21. P. Darwen and X. Yao, "Every niching method has its niche: Fitness sharing and implicit sharing compared," in Lecture Notes in Computer Science, vol. 1141. New York: Springer, 1996, pp. 398-407. (Pubitemid 126128328)
22. J. Hu, E. Goodman, K. Seo, Z. Fan, and R. Rosenberg, "The hierarchical fair competition (hfc) framework for sustainable evolutionary algorithms," Evol. Comput., vol. 13, no. 2, pp. 241-277, 2005. (Pubitemid 40892154)
23. B. Freisleben, "Meta-evolutionary approaches," in Evolutionary Computation: Advanced Algorithms and Operators. Bristol, U.K.: Institute of Physics Publishing, 2000, p. 212.
24. J. Moore, C. Greene, P. Andrews, and B. White, "Does complexity matter? Artificial evolution, computational evolution and the genetic analysis of epistasis in common human diseases," in Genetic Programming Theory and Practice VI. New York: Springer, 2008, p. 125.
25. R. Ursem, "Diversity-guided evolutionary algorithms," in Lecture Notes in Computer Science, vol. 2439. New York: Springer, 2003, pp. 462-474.
26. G. S. Hornby, "ALPS: The age-layered structure for reducing the problem of premature convergence," in Proc. 8th Annu. Conf. Genet. Evol. Comput., 2006, pp. 815-822. (Pubitemid 44611409)
27. J. Lehman and K. Stanley, "Exploiting open-endedness to solve problems through the search for novelty," in Proc. 11th Int. Conf ALIFE, vol. 54. 2008, pp. 329-336.
28. G. S. Hornby, "Steady-state ALPS for real-valued problems," in Proc. 11th Annu. Conf. Genet. Evol. Comput., 2009, pp. 795-802.
29. K. Deb, Multi-Objective Optimization Using Evolutionary Algorithms. New York: Wiley, 2001.
30. R. Beer, "Parameter space structure of continuous-time recurrent neural networks," Neural Comput., vol. 18, no. 12, pp. 3009-3051, 2006. (Pubitemid 44879151)
31. G. Gomez and P. Eggenberger, "Evolutionary synthesis of grasping through self-exploratory movements of a robotic hand," in Proc. IEEE CEC, Sep. 2007, pp. 3418-3425. (Pubitemid 351371841)
32. Y. Yamashita and J. Tani, "Emergence of functional hierarchy in a multiple timescale neural network model: A humanoid robot experiment," PLoS Comput. Biol., vol. 4, no. 11, p. e1000220, Nov. 2008.
33. E. Tuci, G. Massera, and S. Nolfi, "Active categorical perception in an evolved anthropomorphic robotic arm," in Proc. IEEE CEC, May 2009, pp. 31-38.
34. J. C. Bongard, "Accelerating self-modeling in cooperative robot teams," IEEE Trans. Evol. Comput., vol. 13, no. 2, pp. 321-332, Apr. 2009.
35. W. Hillis, "Co-evolving parasites improve simulated evolution as an optimization procedure," Physica D, vol. 42, nos. 1-3, pp. 228-234, 1990.
36. J. Bongard and H. Lipson, "Nonlinear system identification using coevolution of models and tests," IEEE Trans. Evol. Comput., vol. 9, no. 4, pp. 361-384, Aug. 2005. (Pubitemid 41226911)
37. H. S. Seung, M. Opper, and H. Sompolinsky, "Query by committee," in Proc. 5th Workshop Comput. Learning Theory, 1992, pp. 287-294. (Pubitemid 23615454)
38. J. Bongard and H. Lipson, "Active coevolutionary learning of deterministic finite automata," J. Mach. Learning Res., vol. 6, pp. 1651-1678, Oct. 2005.
39. D. Wood, J. Bruner, and G. Ross, "The role of tutoring in problem solving," J. Child Psychol Psychiatry, vol. 17, no. 2, pp. 89-100, 1976.
40. D. Cohn, L. Atlas, and R. Ladner, "Improving generalization with active learning," Mach. Learning, vol. 15, no. 2, pp. 201-221, 1994.
41. Y. Baram, R. El-Yaniv, and K. Luz, "Online choice of active learning algorithms," J. Mach. Learning Res., vol. 5, pp. 255-291, Mar. 2004.
42. J. C. Bongard, "A probabilistic functional crossover operator for genetic programming," in Proc. 12th Annu. Conf. Genet. Comput., 2009, pp. 312-318.
43. N. Jakobi, "Evolutionary robotics and the radical envelope of noise hypothesis," Adaptive Behavior, vol. 6, no. 1, pp. 131-174, 1997.