Higher coordination with less control-a result of information maximization in the sensorimotor loop

Adaptive Behavior

Volumn 18, Issue 3, 2010, Pages 338-355

  Zahedi, Keyan ^a   Ay, Nihat ^a,b   Der, Ralf ^a  

^a MAX PLANCK INSTITUTE FOR MATHEMATICS IN THE SCIENCES   (Germany)

^b SANTA FE INSTITUTE   (United States)

Author keywords

embodied artificial intelligence; information theory; predictive information; self organized learning; sensorimotor loop

Indexed keywords

EID: 77955729257     PISSN: 10597123     EISSN: 17412633     Source Type: Journal    
DOI: 10.1177/1059712310375314     Document Type: Article

References (45)

1. Amari, S. (1998). Natural gradient works efficiently in learning. Neural Computation, 10(2), 251-276.
2. Ay, N., Bertschinger, N., Der, R., Güttler, F., & Olbrich, E. (2008). Predictive information and explorative behavior of autonomous robots. The European Physical Journal B - Condensed Matter and Complex Systems, 63(3), 329- 339.
3. Barto, A.G., Singh, S., & Chentanez, N. (2004). Intrinsically motivated learning of hierarchical collections of skills. In J. Triesch & T. Jebara (Eds.), In Proceedings of 3rd International Conference on Development and Learning (pp. 112-119). San Diego, CA.
4. Benveniste, A., Priouret, P., & Métivier, M. (1990). Adaptive algorithms and stochastic approximations. New York: Springer-Verlag.
5. Bertschinger, N. (2008). An information theoretic perspective on cognitive systems: Memory and autonomy. Unpublished doctoral dissertation, University of Leipzig.
6. Bialek, W., Nemenman, I., & Tishby, N. (2001). Predictability, complexity, and learning. Neural Computation, 13(11), 2409-2463.
7. Brooks, R.A. (1986). A robust layered control system for a mobile robot. IEEE Journal of Robotics and Automation, 2(1), 14-23.
8. Brooks, R.A. (1991). Intelligence without reason. In J. Myopoulos & R. Reiter (Eds.), Proceedings of the 12th International Joint Conference on Artificial Intelligence (IJCAI-91) (pp. 569-595). San Mateo, CA: Morgan Kaufmann publishers.
9. Clark, A. (1996). Being there: Putting brain, body, and world together again. Cambridge, MA: MIT Press.
10. Cliff, D. (1990). Computational neuroethology: a provisional manifesto. In From Animals to Animats: Proceedings of the 1st International Conference on Simulation of Adaptive Behavior (pp. 29-39). Cambridge, MA: MIT Press.
11. Cover, T.M., & Thomas, J.A. (2006). Elements of information theory (2nd ed.). New Jersey: Wiley.
12. Crutchfield, J.P., & Young, K. (1989). Inferring statistical complexity. Physical Review Letters, 63(2), 105- 108.
13. Der, R. (2001). Self-organized acquisition of situated behavior. Theory in Biosciences, 120, 179-187.
14. Der, R., Güttler, F., & Ay, N. (2008). Predictive information and emergent cooperativity in a chain of mobile robots. In S. Bullock, J. Noble, R. Watson, & M. A. Bedau (Eds.), In Artifical Life XI. Proceedings of the Eleventh International Conference on the Simulation and Synthesis of Living Systems (pp. 166-172). Cambridge, MA: MIT Press.
15. Der, R., & Liebscher, R. (2002). True autonomy from self-organized adaptivity. In R. Damper & D. Ciff (Eds.) In Proceedings of the EPSRC/BBSRC International Workshop on Biologically-Inspired Robotics: The Legacy of Grey Walter. (pp. 134-141). Southampton, UK: University of Southampton.
16. Di Paolo, E.A. (2000). Homeostatic adaptation to inversion of the visual field and other sensorimotor disruptions. In J.-A. Meyer, A. Berthoz, H. Floreano, D. Roitblat, & S. Wilson (Eds.), From Animals to Animats 6. Proceedings of the VI International Conference on Simulation of Adaptive Behavior. (pp. 440-449) Cambridge, MA: MIT Press.
17. Förster, H. von. (1993). Wissen und Gewissen: Versuch einer Brücke (1. Aufl. ed.; S. J. Schmidt, Ed.). Frankfurt am Main, D: Suhrkamp.
18. Grassberger, P. (1986). Toward a quantitative theory of self-generated complexity. International Journal of Theoretical Physics, 25(9), 907-938.
19. Hofbauer, J., & Sigmund, K. (2003). Evolutionary game dynamics. Bulletin of the American Mathematical Society, 40, 479-519.
20. Kakade, S. (2002). A natural policy gradient. Advances in neural information processing systems, 14 (pp. 1531-1538). Cambridge, MA: MIT Press.
21. Kaplan, F., & Oudeyer, P.-Y. (2004). Maximizing learning progress: An internal reward system for development. Embodied artificial intelligence (pp. 259-270). Berlin: Springer.
22. Laughlin, S. (1981). A simple coding procedure enhances a neuron's information capacity. Zeitschrift fr Naturforschung C, 36(9-10), 910-912.
23. Linsker, R. (1988). Self-organization in a perceptual network. IEEE Computers, 88, 105-117.
24. Lungarella, M., & Sporns, O. (2005). Information self-structuring: Key principle for learning and development. In IEEE Proceedings of the 4th International Conference on Development and Learning (pp. 25-30). San Diego, CA: IEEE Press.
25. Meltzoff, A., & Moore, M.K. (1997). Explaining facial imitation: A theoretical model. Early Development and Parenting, 6, 179-192.
26. Mondada, F., Franzi, E., & Ienne, P. (1993). Mobile robot miniaturization: A tool for investigation in control algorithms. In Proceedings of the 3rd International Symposium on Experimental Robotics (pp. 501-513). Berlin: Springer Verlag.
27. Nolfi, S., & Floreano, D. (2000). Evolutionary robotics. Cambridge, MA: MIT Press.
28. Oudeyer, P.-Y., Kaplan, F., & Hafner, V. (2007). Intrinsic motivation systems for autonomous mental development. IEEE Transactions on Evolutionary Computation, 11(2), 265-286.
29. Peters, J., Vijayakumar, S., & Schaal, S. (2005). Natural actor-critic. In Proceedings of the 16th European Conference on Machine Learning (ECML 2005) (pp. 280-291). Berlin: Springer.
30. Pfeifer, R., & Bongard, J.C. (2006). How the body shapes the way we think: A new view of intelligence. Cambridge, MA: MIT Press (Bradford Books).
31. Pfeifer, R., Lungarella, M., & Iida, F. (2007). Self-organization, embodiment, and biologically inspired robotics. Science, 318(5853), 1088-1093.
32. Polani, D., Nehaniv, C., Martinetz, T., & Kim, J.T. (2006). Relevant information in optimized persistence vs. progeny strategies. In L. M. Rocha, M. Bedau, D. Floreano, R. Goldstone, A. Vespignani, & L. Yaeger (Eds.), Proceedings of Artificial Life X. (pp. 337-343). Cambridge, MA: MIT Press.
33. Porr, B. (2003). Sequence-learning in a self-referential closed-loop behavioural system. Phd thesis, Faculty of Human Sciences, Department of Psychology. University of Stir-ling.
34. Schmidhuber, J. (1990). A possibility for implementing curiosity and boredom in model-building neural controllers. In From Animals to Animats: Proceedings of the 1st International Conference on Simulation of Adaptive Behavior (pp.222-227). Cambridge, MA: MIT Press.
35. Schmidhuber, J. (2009). Driven by compression progress: A simple principle explains essential aspects of subjective beauty, novelty, surprise, interestingness, attention, curiosity, creativity, art, science, music, jokes. Anticipatory Behavior in Adaptive Learning Systems (pp. 48-76). Berlin: Springer.
36. Shannon, C.E. (1948). A mathematical theory of communication. Bell System Technical Journal, 27, 379-423.
37. Steels, L. (2004). The autotelic principle. Embodied artificial intelligence (pp. 231-242). Berlin: Springer.
38. Steels, L., & Wellens, P. (2007). Scaffolding language emergence using the autotelic principle. In H. A. Abbass, M, Bedau, S. Nolfi & J. Wiles (Eds.), in Proceedings of the 1st IEEE Symposium on Artificial Life (pp. 325-332). Honolulu, HI: IEEE Press.
39. Still, S. (2009). Information-theoretic approach to interactive learning. EPL, 85(2), 28005.
40. Storck, J., Hochreiter, S., & Schmidhuber, J. (1995). Reinforcement driven information acquisition in non-deterministic environments. In F. Fogelman-Soulíe, J. C. Rault, P. Gallinari & G. Dreyfus (Eds.), in Proceedings of the International Conference on Artificial Neural Networks (pp. 159- 164). Paris: EC2 & Cie.
41. Thelen, E., & Smith, L.B. (1996). A dynamic systems approach to the development of cognition and action. Cambridge, MA: MIT Press.
42. Uexkuell, J. von. (1957). A stroll through the worlds of animals and men. In C. H. Schiller (Ed.), Instinctive behavior (pp. 5-80). New York: International Universities Press. (Original work published 1934).
43. Williams, T., & Kelley, C. (2009). gnuplot 4.2.6. http://www.gnuplot.info.
44. Zahedi, K. & Paseman, F. (2007). Adaptive behavior control with self-regulating neurons. In M. Lungarella, F. Iida, J. Bongard, & R. Pfeifer (Eds.), (pp. 196-205). Berlin Heidelberg: Springer.
45. Zahedi, K., von Twickel, A., & Pasemann, F. (2008). Yars: A physical 3d simulator for evolving controllers for real robots. In S. Carpinet al.(Eds.), Simpar 2008 (pp.71-82). Berlin: Springer.