Information-driven self-organization: The dynamical system approach to autonomous robot behavior

Theory in Biosciences

Volumn 131, Issue 3, 2012, Pages 161-179

  Ay, Nihat ^a,b   Bernigau, Holger ^a   Der, Ralf ^a   Prokopenko, Mikhail ^a,c  

^a MAX PLANCK INSTITUTE FOR MATHEMATICS IN THE SCIENCES   (Germany)

^b CSIRO   (Australia)

^c SANTA FE INSTITUTE   (United States)

Author keywords

Autonomous systems; Embodiment; Hebbian learning; Intrinsic motivation; Predictive information; Self organization; Sensorimotor loop

Indexed keywords

ARTICLE; INFORMATION SCIENCE; LEARNING; ROBOTICS; SENSORY FEEDBACK; STATISTICS;

FEEDBACK, SENSORY; INFORMATION THEORY; LEARNING; ROBOTICS; STOCHASTIC PROCESSES;

EID: 84865124417     PISSN: 14317613     EISSN: 16117530     Source Type: Journal    
DOI: 10.1007/s12064-011-0137-9     Document Type: Article

References (48)

1. S-I Amari 1998 Natural gradient works efficiently in learning Neural Comput 10 251 276 10.1162/089976698300017746 (Pubitemid 128463152)
2. Anthony T, Polani D, Nehaniv CL (2009) Impoverished empowerment: 'meaningful' action sequence generation through bandwidth limitation. In: Kampis G, Szathmry E (eds), vol 2. Springer, Budapest, pp 294-301
3. N Ay H Bertschinger R Der F Güttler E Olbrich 2008 Predictive information and explorative behavior of autonomous robots Eur Phys J B 63 3 329 339 10.1140/epjb/e2008-00175-0 1:CAS:528:DC%2BD1cXpt1Whsbk%3D
4. Ay N, Bernigau H, Der R, Martius G (2011) Information-driven homeokinesis (in preparation)
5. Baldassarre G (2008) Self-organization as phase transition in decentralized groups of robots: a study based on Boltzmann entropy. In: Prokopenko M (ed) Advances in applied self-organizing systems. Springer, Berlin, pp 127-146
6. Barto AG (2004) Intrinsically motivated learning of hierarchical collections of skills. In: Proceedings of 3rd international conference development Learning, San Diego, CA, USA, pp 112-119
7. W Bialek I Nemenman N Tishby 2001 Predictability, complexity and learning Neural Comput 13 2409 11674845 10.1162/089976601753195969 1:STN:280: DC%2BD3Mrmslyiuw%3D%3D (Pubitemid 33594578)
8. Cover TM, Thomas JA (2006) Elements of information theory. Wiley, New York
9. JP Crutchfield K Young 1989 Inferring statistical complexity Phys Rev Lett 63 105 108 10040781 10.1103/PhysRevLett.63.105
10. T DelSole 2004 Predictability and information theory. Part I: measures of predictability J Atmos Sci 61 3 2425 2440 10.1175/1520-0469(2004)061<2425: PAITPI>2.0.CO;2 (Pubitemid 39520325)
11. R Der 2001 Self-organized acquisition of situated behaviors Theory Biosci 120 179 187 (Pubitemid 34037455)
12. Der R, Liebscher R (2002) True autonomy from self-organized adaptivity. In: Proceedings of EPSRC/BBSRC international workshop on biologically inspired robotics. HP Labs, Bristol
13. Der R, Martius G (2006) From motor babbling to purposive actions: emerging self-exploration in a dynamical systems approach to early robot development. In: Nolfi S, Baldassarre G, Calabretta R, Hallam JCT, Marocco D, Meyer J-A, Miglino O, Parisi D (eds) Proceedings from animals to animats 9 (SAB 2006). LNCS, vol 4095. Springer, pp 406-421 (Pubitemid 44553374)
14. Der R, Martius G (2011) The playful machine-theoretical foundation and practical realization of self-organizing robots. Springer, Berlin
15. Der R, Hesse F, Martius G (2005) Learning to feel the physics of a body. In: Proceedings of the international conference on computational intelligence for modelling, control and automation (CIMCA 06). IEEE Computer Society, Washington, DC, pp 252-257
16. R Der F Hesse G Martius 2006 Rocking stamper and jumping snake from a dynamical system approach to artificial life Adapt Behav 14 2 105 115 10.1177/105971230601400202
17. Der R, Martius G, Hesse F (2006b) Let it roll-emerging sensorimotor coordination in a spherical robot. In: Rocha LM, Yaeger LS, Bedau MA, Floreano D, Goldstone RL, Vespignani A (eds) Proceedings of the artificial life X, August. International Society for Artificial Life, MIT Press, pp 192-198
18. Der R, Güttler F, Ay N (2008) Predictive information and emergent cooperativity in a chain of mobile robots. In: Artificial Life XI. MIT Press, Cambridge
19. Engel Y (2010) Gaussian process reinforcement learning. In: Claude S, Geoffrey IW (eds) Encyclopedia of machine learning. Springer, pp 439-447
20. Georgiev P, Cichocki A, Amari S-I (2001) On some extensions of the natural gradient algorithm. In: Proceedings of the 3rd international conference on independent component analysis and blind signal separation, pp 581-585
21. P Grassberger 1986 Toward a quantitative theory of self-generated complexity Int J Theor Phys 25 9 907 938 10.1007/BF00668821
22. Kantz H, Schreiber T (2003) Nonlinear time series analysis, 2nd ed. Cambridge University Press, Cambridge
23. Kaplan F, Oudeyer P-Y (2004) Maximizing learning progress: an internal reward system for development. In: Iida F, Pfeifer R, Steels L, Kuniyoshi Y (eds) Embodied artificial intelligence, Lecture Notes in Computer Science, vol 3139. Springer, pp 629-629
24. Klyubin AS, Polani D, Nehaniv CL (2005) Empowerment: a universal agent-centric measure of control. In: Congress on evolutionary computation, pp 128-135 (Pubitemid 41495847)
25. AS Klyubin D Polani CL Nehaniv 2007 Representations of space and time in the maximization of information flow in the perception-action loop Neural Comput 19 2387 2432 17650064 10.1162/neco.2007.19.9.2387
26. Kobayashi S, Nomizu K (1963) Foundations of differential geometry. Wiley, New York
27. Kober J, Peters J (2009) Policy search for motor primitives in robotics. In: Koller D, Schuurmans D, Bengio Y, Bottou L (eds) Twenty-Second annual conference on neural information processing systems, Red Hook, NY, USA, 06 2009, Curran, pp 849-856
28. Kühnel W (2006) Differential geometry, vol 16. American Mathematical Society Student Mathematical Library
29. M Lungarella T Pegors D Bulwinkle O Sporns 2005 Methods for quantifying the informational structure of sensory and motor data Neuroinformatics 3 3 243 262 16077161 10.1385/NI:3:3:243 (Pubitemid 41112872)
30. Magnus J, Neudecker H (1988) Matrix differential calculus with applications in statistics and econometrics. Wiley, New York
31. Martius G (2010) Goal-oriented control of self-organizing behavior in autonomous robots. PhD thesis, Georg-August-Universität Göttingen
32. Martius G, Herrmann J (2010) Taming the beast: guided self-organization of behavior in autonomous robots. In: Doncieux S, Girard B, Guillot A, Hallam J, Meyer J-A, Mouret J-B (eds) From animals to animats 11. LNCS, vol 6226. Springer, pp 50-61
33. Martius G, Herrmann JM, Der R (2007) Guided self-organisation for autonomous robot development. In: Almeida e Costa F, Rocha L, Costa E, Harvey I, Coutinho A (eds) Proceedings of the advances in artificial life, 9th European conference (ECAL 2007). LNCSm, vol 4648. Springer, pp 766-775
34. P-Y Oudeyer F Kaplan V Hafner 2007 Intrinsic motivation systems for autonomous mental development IEEE Trans Evol Comput 11 2 265 286 10.1109/TEVC.2006.890271 (Pubitemid 46547111)
35. Pearl J (2000) Causality. Cambridge University Press, Cambridge
36. Pfeifer R, Bongard JC (2006) How the Body Shapes the Way We Think: A New View of Intelligence. MIT Press, Cambridge
37. R Pfeifer M Lungarella F Iida 2007 Self-organization, embodiment, and biologically inspired robotics Science 318 1088 1093 18006736 10.1126/science.1145803 1:CAS:528:DC%2BD2sXht1ykurrJ (Pubitemid 350134861)
38. M Prokopenko P Wang D Price P Valencia M Foreman A.J. Farmer 2005 Self-organizing hierarchies in sensor and communication networks Artif Life 11 4 407 426 16197671 10.1162/106454605774270642 (Pubitemid 41430935)
39. Prokopenko M, Gerasimov V, Tanev I (2006) Evolving spatiotemporal coordination in a modular robotic system. In: Nolfi S, Baldassarre G, Calabretta R, Hallam J, Marocco D, Meyer J-A, Parisi D (eds) From animals to animats 9: 9th international conference on the simulation of adaptive behavior (SAB 2006). Lecture Notes in Computer Science, vol 4095. Springer, pp 558-569 (Pubitemid 44553386)
40. Schmidhuber J (1990) A possibility for implementing curiosity and boredom in model-building neural controllers. In: Proceedings of the first international conference on simulation of adaptive behavior. MIT Press, Cambridge, pp 222-227
41. Schmidhuber J (2007) Simple algorithmic principles of discovery, subjective beauty, selective attention, curiosity and creativity. Springer, Berlin
42. Schmidhuber J (2009) Driven by compression progress: a simple principle explains essential aspects of subjective beauty, novelty, surprise, interestingness, attention, curiosity, creativity, art, science, music, jokes. In: Pezzulo G, Butz MV, Sigaud O, Baldassarre G (eds) Anticipatory behavior in adaptive learning systems, Lecture Notes in Computer Science, vol 5499. Springer, pp 48-76
43. Spivak M (1999) Differential geometry, vol 1. Publish or Perish, Inc., Berkeley
44. Steels L (2004) The autotelic principle. In: Iida F, Pfeifer R, Steels L, Kuniyoshi Y (eds) Embodied artificial intelligence, Lecture Notes in Computer Science, vol 3139. Springer, pp 629-629
45. Storck J, Hochreiter S, Schmidhuber J (1995) Reinforcement driven information acquisition in non-deterministic environments. In: Proceedings of the international conference on artificial neural networks, pp 159-164
46. Theodorou EA, Buchli J, Schaal S (2010) Reinforcement learning of motor skills in high dimensions: a path integral approach. In: International conference of robotics and automation (ICRA 2010) (accepted)
47. Willmore T (1959) Differential geometry. Oxford University Press, Oxford
48. K Zahedi N Ay R Der 2010 Higher coordination with less control-a result of information maximization in the sensorimotor loop Adapt Behav 18 3-4 338 355 10.1177/1059712310375314