Evolved machines shed light on robustness and resilience

Proceedings of the IEEE

Volumn 102, Issue 5, 2014, Pages 899-914

  Bongard, Josh ^a   Lipson, Hod ^b  

^a University of Vermont   (United States)

^b School of Chemical and Molecular Engineering   (United States)

Author keywords

Embodied cognition; Evolutionary robotics

Indexed keywords

BIOINFORMATICS; BIOMIMETICS; MORPHOLOGY; ROBOTS;

ADAPTIVE BEHAVIOR; BIOLOGICAL EVOLUTION; CONTROLLED EXPERIMENT; EMBODIED COGNITION; EVOLUTIONARY ROBOTICS; NEURAL ARCHITECTURES; PROCESS OF EVOLUTION;

BIOLOGY;

EID: 84900512483     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/JPROC.2014.2312844     Document Type: Article

References (92)

1. M. Asada K. Hosoda Y. Kuniyoshi H. Ishiguro T. Inui Y. Yoshikawa M. Ogino and C. Yoshida "Cognitive developmental robotics: A survey," IEEE Trans. Autonom. Mental Develop. vol. 1 no. 1 pp. 12-34 May 2009.
2. J. E. Auerbach and J. C. Bongard "Environmental influence on the evolution of morphological complexity in machines," PLoS Comput. Biol. vol. 10 no. 1 2014 e1003399.
3. H. C. Barrett and R. Kurzban "Modularity in cognition: Framing the debate," Psychol. Rev. vol. 113 no. 3 pp. 628-647 2006.
4. R. D. Beer "Parameter space structure of continuous-time recurrent neural networks," Neural Comput. vol. 18 no. 12 pp. 3009-3051 2006.
5. N. Bernstein The Coordination and Regulation of Movements. Oxford U.K.: Pergamon Press 1967.
6. L. Berthouze and M. Lungarella "Motor skill acquisition under environmental perturbations: On the necessity of alternate freezing and freeing of degrees of freedom," Adapt. Behav. vol. 12 no. 1 pp. 47-64 2004.
7. J. Bongard V. Zykov and H. Lipson "Resilient machines through continuous self-modeling," Science vol. 314 pp. 1118-1121 2006.
8. J. C. Bongard "The utility of evolving simulated robot morphology increases with task complexity for object manipulation," Artif. Life 2010 DOI: 10.1162/artl.2010. Bongard.024.
9. J. C. Bongard "Spontaneous evolution of structural modularity in robot neural network controllers," in Proc. Gen. Evol. Comput. Conf. 2011 pp. 251-258.
10. J. C. Bongard "Accelerating self-modeling in cooperative robot teams," IEEE Trans. Evol. Comput. vol. 13 no. 2 pp. 321-332 Apr. 2009.
11. J. Bongard "Morphological change in machines accelerates the evolution of robust behavior," Proc. Nat. Acad. Sci. USA vol. 108 no. 4 pp. 1234-1239 2011.
12. R. A. Brooks "Intelligence without representation," Artif. Intell. vol. 47 pp. 139-160 1991.
13. E. Bullmore and O. Sporns "Complex brain networks: Graph theoretical analysis of structural and functional systems," Nature Rev. Neurosci. vol. 10 no. 3 pp. 186-198 2009.
14. W. H. Calvin The Cerebral Code: Thinking a Thought in the Mosaics of the Mind. Cambridge MA USA: MIT Press 2000.
15. S. B. Carroll "Chance and necessity: The evolution of morphological complexity and diversity," Nature vol. 409 no. 6823 pp. 1102-1109 2001.
16. A. Clark Being There: Putting Brain Body World Together Again. Cambridge MA USA: Bradford Books 1998.
17. A. Clark "Whatever next Predictive brains situated agents the future of cognitive science," Behav. Brain Sci. vol. 36 no. 3 pp. 181-204 2013.
18. D. Cliff P. Husbands and I. Harvey "Explorations in evolutionary robotics," Adapt. Behav. vol. 2 no. 1 pp. 73-110 1993.
19. J. Clune J.-B. Mouret and H. Lipson "The evolutionary origins of modularity," Proc. Roy. Soc. B Biol. Sci. vol. 280 no. 1755 2013 DOI: 10.1098/rspb.2012.2863.
20. S. Collins A. Ruina R. Tedrake and M. Wisse "Efficient bipedal robots based on passive-dynamic walkers," Science vol. 307 no. 5712 pp. 1082-1085 2005.
21. C. Consoulas C. Duch R. J. Bayline and R. B. Levine "Behavioral transformations during metamorphosis: Remodeling of neural and motor systems," Brain Res. Bull. vol. 53 no. 5 pp. 571-583 2000.
22. F. Crick "Neural edelmanism," Trends Neurosci. vol. 12 no. 7 pp. 240-248 1989.
23. K. A. De Jong Evolutionary Computation: A Unified Approach. Cambridge MA USA: MIT Press 2006.
24. F. De Vignemont "Body schema and body imageVPros and cons," Neuropsychologia vol. 48 no. 3 pp. 669-680 2010.
25. K. Deb A. Pratap S. Agarwal and T. Meyarivan "A fast and elitist multiobjective genetic algorithm: NSGA-II," IEEE Trans. Evol. Comput. vol. 6 no. 2 pp. 182-197 Apr. 2002.
26. J. Diedrichsen R. Shadmehr and R. B. Ivry "The coordination of movement: Optimal feedback control and beyond," Trends Cogn. Sci. vol. 14 no. 1 pp. 31-39 2010.
27. A. G. Dimitrov A. A. Lazar and J. D. Victor "Information theory in neuroscience," J. Comput. Neurosci. vol. 30 no. 1 pp. 1-5 2011 DOI: 10.1007/s10827-011-0314-3.
28. M. Dorigo and M. Colombetti "Robot shaping: Developing situated agents through learning," Artif. Intell. vol. 70 no. 2 pp. 321-370 1994.
29. G. M. Edelman Neural Darwinism: The Theory of Neuronal Group Selection. New York NY USA: Basic Books 1987.
30. C. Espinosa-Soto and A. Wagner "Specialization can drive the evolution of modularity," PLoS Comput. Biol. vol. 6 no. 3 2010 e1000719.
31. C. Fernando R. Goldstein and E. Szathmáry "The neuronal replicator hypothesis," Neural Comput. vol. 22 no. 11 pp. 2809-2857 2010.
32. D. Floreano and L. Keller "Evolution of adaptive behaviour in robots by means of Darwinian selection," PLoS Biol. vol. 8 no. 1 2010 e1000292.
33. N. Franceschini "Small brains smart machines: From insects to robots back again," Proc. IEEE vol. 102 no. 5 May 2014 DOI: 10.1109/JPROC.2014. 2312916.
34. M. Freeling and B. C. Thomas "Gene-balanced duplications like tetraploidy provide predictable drive to increase morphological complexity," Genome Res. vol. 16 no. 7 pp. 805-814 2006.
35. K. Friston "The free-energy principle: A unified brain theory" Nature Rev. Neurosci. vol. 11 no. 2 pp. 127-138 2010.
36. V. Gallese and A. Goldman "Mirror neurons and the simulation theory of mind-reading," Trends Cogn. Sci. vol. 2 no. 12 pp. 493-501 1998.
37. D. George and J. Hawkins "Towards a mathematical theory of cortical micro-circuits," PLoS Comput. Biol. vol. 5 no. 10 2009 e1000532.
38. G. Gómez M. Lungarella P. E. Hotz K. Matsushita and R. Pfeifer "Simulating development in a real robot: On the concurrent increase of sensory motor neural complexity," in Proc. 3rd Int. Conf. Develop. Learn. 2004 pp. 119-122.
39. M. A. Goodrich and A. C. Schultz "Human-robot interaction: A survey," Found. Trends Human-Comput. Interaction vol. 1 no. 3 pp. 203-275 2007.
40. A. Gopnik and L. Schulz "Mechanisms of theory formation in young children," Trends Cogn. Sci. vol. 8 no. 8 pp. 371-377 2004.
41. G. E. Hinton S. Osindero and Y. Teh "A fast learning algorithm for deep belief nets," Neural Comput. vol. 18 pp. 1527-1554 2006.
42. M. Hoffmann H. Marques A. Arieta H. Sumioka M. Lungarella and R. Pfeifer "Body schema in robotics: A review," IEEE Trans. Autonom. Mental Develop. vol. 2 no. 4 pp. 304-324 Dec. 2010.
43. M. Iacoboni "Imitation empathy mirror neurons," Annu. Rev. Psychol. vol. 60 pp. 653-670 2009.
44. H. Imamizu T. Kuroda S. Miyauchi T. Yoshioka and M. Kawato "Modular organization of internal models of tools in the human cerebellum," Proc. Nat. Acad. Sci. USA vol. 100 no. 9 pp. 5461-5466 2003.
45. B. Irie and S. Miyake "Capabilities of three-layered perceptrons," in Proc. IEEE Int. Conf. Neural Netw. 1988 pp. 641-648.
46. N. Jakobi P. Husbands and I. Harvey "Noise and the reality gap: The use of simulation in evolutionary robotics," in Advances in Artificial Life. Berlin Germany: Springer-Verlag 1995 pp. 704-720.
47. T. D. Jorgensen B. P. Haynes and C. C. F. Norlund "Pruning artificial neural networks using neural complexity measures," Int. J. Neural Syst. vol. 18 no. 5 pp. 389-403 2008.
48. T. Kanda D. F. Glas M. Shiomi H. Ishiguro and N. Hagita "Who will be the customer: A social robot that anticipates people's behavior from their trajectories," in Proc. 10th Int. Conf. Ubiquitous Comput. 2008 pp. 380-389.
49. N. Kashtan and U. Alon "Spontaneous evolution of modularity and network motifs," Proc. Nat. Acad. Sci. USA vol. 102 no. 39 pp. 13773-13778 2005.
50. K.-J. Kim and H. Lipson "Towards a theory of mind in simulated robots," in Proc. 11th Annu. Conf. Companion Gen. Evol. Comput. Conf. 2009 pp. 2071-2076.
51. K. N. Krishnanand J. C. Bongard and A. N. Meltzoff "Self discovery enables robot social cognition: Are you my teacher" Neural Netw. vol. 23 pp. 1113-1124 2010.
52. H. Lipson J. B. Pollack and N. P. Suh "On the origin of modular variation," Evolution vol. 56 no. 8 pp. 1549-1556 2002.
53. W. Maass "Noise as a resource for computation and learning in networks of spiking neurons," Proc. IEEE vol. 102 no. 5 May 2014 DOI: 10.1109/JPROC.2014. 2310593.
54. G. Massera A. Cangelosi and S. Nolfi "Evolution of prehension ability in an anthropomorphic neurorobotic arm," Front. Neurorobot. vol. 1 2007 DOI: 10.3389/neuro.12.004.2007.
55. D. W. McShea and R. N. Brandon Biology's First Law: The Tendency for Diversity and Complexity to Increase in Evolutionary Systems. Chicago IL USA: Univ. Chicago Press 2010.
56. A. N. Meltzoff "'Like me': A foundation for social cognition," Develop. Sci. vol. 10 no. 1 pp. 126-134 2007.
57. D. Meunier R. Lambiotte A. Fornito K. D. Ersche and E. T. Bullmore "Hierarchical modularity in human brain functional networks," Front. Neuroinf. vol. 3 2009 DOI: 10.3389/neuro.11.037.2009.
58. R. C. Miall "Connecting mirror neurons and forward models," NeuroReport vol. 14 no. 16 pp. 1-3 2003.
59. T. Miconi "Evolution and complexity: The double-edged sword," Artif. Life vol. 14 no. 3 pp. 325-344 2008.
60. M. Minsky Society of Mind. New York NY USA: Simon & Schuster 1988.
61. S. Murata E. Yoshida A. Kamimura H. Kurokawa K. Tomita and S. Kokaji "M-tran: Self-reconfigurable modular robotic system," IEEE/ASME Trans. Mechatron. vol. 7 no. 4 pp. 431-441 Dec. 2002.
62. C. L. Nehaniv and K. Dautenhahn Imitation and Social Learning in Robots Humans and Animals: Behavioural Social and Communicative Dimensions. Cambridge U.K.: Cambridge Univ. Press 2007.
63. D. L. Page A. F. Koschan S. R. Sukumar B. Roui-Abidi and M. A. Abidi "Shape analysis algorithm based on information theory," in Proc. IEEE Int. Conf. Image Process. 2003 vol. 1 pp. 229-232.
64. S. I. Passy "Environmental randomness underlies morphological complexity of colonial diatoms," Funct. Ecol. vol. 16 no. 5 pp. 690-695 2002.
65. R. Pfeifer and J. Bongard How the Body Shapes the WayWe Think: A New View of Intelligence. Cambridge MA USA: MIT Press 2006.
66. F. Pulvermüller and L. Fadiga "Active perception: Sensorimotor circuits as a cortical basis for language," Nature Rev. Neurosci. vol. 11 no. 5 pp. 351-360 2010.
67. R. Q. Quiroga and S. Panzeri "Extracting information from neuronal populations: Information theory and decoding approaches," Nature Rev. Neurosci. vol. 10 no. 3 pp. 173-185 2009.
68. T. Reil and P. Husbands "Evolution of central pattern generators for bipedal walking in a real-time physics environment," IEEE Trans. Evol. Comput. vol. 6 no. 2 pp. 159-168 Apr. 2002.
69. R. Saegusa G. Metta G. Sandini and S. Sakka "Active motor babbling for sensorimotor learning," in Proc. IEEE Int. Conf. Robot. Biomimetics 2009 pp. 794-799.
70. M. Schmidt and H. Lipson "Age-fitness Pareto optimization," in Genetic Programming Theory and Practice VIII. New York NY USA: Springer-Verlag 2011 pp. 129-146.
71. A. K. Seth and G. M. Edelman "Environment and behavior influence the complexity of evolved neural networks," Adapt. Behav. vol. 12 no. 1 pp. 5-20 2004.
72. H. S. Seung M. Opper and H. Sompolinsky "Query by committee," in Proc. 5th Workshop Comput. Learn. Theory 1992 pp. 287-294.
73. R. F. Shepherd F. Ilievski W. Choi S. A. Morin A. A. Stokes A. D. Mazzeo X. Chen M. Wang and G. M. Whitesides "Multigait soft robot," Proc. Nat. Acad. Sci. USA vol. 108 no. 51 pp. 20400-20403 2011.
74. K. Sims "Evolving 3D morphology and behaviour by competition," Artif. Life vol. 4 pp. 28-39 1994.
75. K. O. Stanley and R. Miikkulainen "Evolving neural networks through augmenting topologies," Evol. Comput. vol. 10 no. 2 pp. 99-127 2002.
76. K. O. Stanley "Compositional pattern producing networks: A novel abstraction of development," Genetic Programm. Evolvable Mach. vol. 8 no. 2 pp. 131-162 2007.
77. S. R. Sukumar D. L. Page A. F. Koschan and M. A. Abidi "Towards understanding what makes 3D objects appear simple or complex," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. 2008 DOI: 10.1109/CVPRW.2008.4562975.
78. R. Tedrake T. Zhang and H. Seung "Learning to walk in 20 minutes," in Proc. 14th Yale Workshop Adapt. Learn. Syst. pp. 1-6 2005.
79. E. Todorov and M. I. Jordan "Optimal feedback control as a theory of motor coordination," Nature Neurosci. vol. 5 no. 11 pp. 1226-1235 2002.
80. G. Tononi O. Sporns and G. M. Edelman "A measure for brain complexity: Relating functional segregation and integration in the nervous system," Proc. Nat. Acad. Sci. USA vol. 91 no. 11 pp. 5033-5037 1994.
81. L. G. Valiant "Evolvability," J. ACM vol. 56 no. 1 2009 DOI: 10.1145/1462153.1462156.
82. E. Vaughan E. A. Di Paolo and I. Harvey "The evolution of control and adaptation in a 3D powered passive dynamic walker," in Proc. 9th Int. Conf. Simul. Synthesis Living Syst. 2004 pp. 139-145.
83. G. P. Wagner and L. Altenberg "Perspective: Complex adaptations and the evolution of evolvability," Evolution vol. 50 no. 3 pp. 967-976 1996.
84. G. P. Wagner M. Pavlicev and J. M. Cheverud "The road to modularity," Nature Rev. Gen. vol. 8 no. 12 pp. 921-931 2007.
85. D. M. Wolpert J. Diedrichsen and J. R. Flanagan "Principles of sensorimotor learning," Nature Rev. Neurosci. vol. 12 no. 12 pp. 739-751 2011.
86. D. M. Wolpert and M. Kawato "Multiple paired forward and inverse models for motor control," Neural Netw. vol. 11 no. 7 pp. 1317-1329 1998.
87. D. Wood J. S. Bruner and G. Ross "The role of tutoring in problem solving," J. Child Psychol. Psychiatry vol. 17 no. 2 pp. 89-100 1976.
88. S. G. Wysoski L. Benuskova and N. Kasabov "Evolving spiking neural networks for audiovisual information processing," Neural Netw. vol. 23 no. 7 pp. 819-835 2010.
89. Y. Yamashita and J. Tani "Emergence of functional hierarchy in a multiple timescale neural network model: A humanoid robot experiment," PLoS Comput. Biol. vol. 4 no. 11 2008 e1000220.
90. M. Yim W.-M. Shen B. Salemi D. Rus M. Moll H. Lipson E. Klavins and G. S. Chirikjian "Modular self-reconfigurable robot systems [grand challenges of robotics]," IEEE Robot. Autom. Mag. vol. 14 no. 1 pp. 43-52 Mar. 2007.
91. M. Yim Y. Zhang and D. Duff "Modular robots," IEEE Spectrum vol. 39 no. 2 pp. 30-34 2002.
92. J. C. Zagal and H. Lipson "Towards self-reflecting machines: Two-minds in one robot," in Advances in Artificial Life. Darwin Meets von Neumann. New York NY USA: Springer-Verlag 2011 pp. 156-164.