Keep your options open: An information-based driving principle for sensorimotor systems

PLoS ONE

Volumn 3, Issue 12, 2008, Pages

  Klyubin, Alexander S ^a   Polani, Daniel ^a   Nehaniv, Chrystopher L ^a  

^a UNIVERSITY OF HERTFORDSHIRE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE BEHAVIOR; ARTICLE; ASSOCIATIVE MEMORY; BAYESIAN LEARNING; COMPUTER MODEL; CONTROLLED STUDY; EMPOWERMENT; EVOLUTIONARY ADAPTATION; LEARNING; MATHEMATICAL COMPUTING; MEMORY CONSOLIDATION; MENTAL FUNCTION; PERCEPTION; ROBOTICS; SENSORIMOTOR FUNCTION; ARTIFICIAL NEURAL NETWORK; BEHAVIOR; BIOLOGICAL MODEL; EVOLUTION; INFORMATION SCIENCE; MOVEMENT (PHYSIOLOGY); PHYSIOLOGY; PSYCHOMOTOR PERFORMANCE; SENSATION;

EVOLUTION; INFORMATION THEORY; MODELS, NEUROLOGICAL; MOVEMENT; NEURAL NETWORKS (COMPUTER); POWER (PSYCHOLOGY); PSYCHOMOTOR PERFORMANCE; ROBOTICS; SENSATION;

EID: 58149185146     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0004018     Document Type: Article

References (71)

1. Ashby WR (1956) An Introduction to Cybernetics. Chapman & Hall Ltd.
2. Touchette H, Lloyd S (2000) Information-theoretic limits of control. Phys Rev Lett 84: 1156.
3. Tononi G, Sporns O, Edelman GM (1994) A measure for brain complexity: Relating functional segregation and integration in the nervous system. Proc Natl Acad Sci USA 91: 5033-5037.
4. Tononi G, Sporns O (2003) Measuring information integration. BMC Neuroscience 4: 31.
5. Klyubin AS, Polani D, Nehaniv CL (2004) Organization of the information flow in the perception-action loop of evolved agents. In: Proceedings of 2004 NASA/DoD Conference on Evolvable Hardware. IEEE Computer Society. pp 177-180. 10.1109/EH.2004.1310828.
6. Lungarella M, Pegors T, Bulwinkle D, Sporns O (2005) Methods for quantifying the information structure of sensory and motor data. Neuroinformatics 3: 243-262.
7. Bertschinger N, Olbrich E, Ay N, Jost J (2006) Autonomy: an information theoretic perspective. In: Proc. Workshop on Artificial Autonomy at Alife X. Bloomington, Indiana. pp 7-12.
8. Lungarella M, Sporns O (2006) Mapping information flow in sensorimotor networks. PLoS Computational Biology 2.
9. Klyubin A, Polani D, Nehaniv C (2007) Representations of space and time in the maximization of information flow in the perception-action loop. Neural Computation 19: 2387-2432.
10. Sporns O, Lungarella M (2006) Evolving coordinated behavior by maximizing information structure. In: Rocha et al. [68]. pp 323-329.
11. Prokopenko M, Gerasimov V, Tanev I (2006) Evolving spatiotemporal coordination in a modular robotic system. In: Nolfi S, Baldassarre G, Calabretta R, Hallam JCT, Marocco D, et al. (2006) From Animals to Animats 9: 9th International Conference on the Simulation of Adaptive Behavior (SAB 2006), Rome, Italy. Berlin, Heidelberg: Springer, volume 4095 of Lecture Notes in Computer Science. pp 558-569.
12. Laughlin SB, de Ruyter van Steveninck RR, Anderson JC (1998) The metabolic cost of neural information. Nature Neuroscience 1: 36-41.
13. Laughlin SB, Anderson JC, Carroll DC, de Ruyter van Steveninck RR (2000) Coding efficiency and the metabolic cost of sensory and neural information. In: Baddeley R, Hancock P, Földiák P, eds (2000) Information Theory and the Brain. Cambridge University Press. pp 41-61.
14. Laughlin SB (2001) Energy as a constraint on the coding and processing of sensory information. Current Opinion in Neurobiology 11: 475-480.
15. Rieke F, Warland D, de Ruyter van Steveninck R, Bialek W (1999) Spikes. A Bradford Book. MIT Press.
16. Brenner N, Bialek W, de Ruyter van Steveninck R (2000) Adaptive rescaling optimizes information transmission. Neuron 26: 695-702.
17. Fairhall AL, Lewen GD, Bialek W, de Ruyter van Steveninck R (2001) Efficiency and ambiguity in an adaptive neural code. Nature 412: 787-792.
18. Taylor SF, Tishby N, Bialek W (2007) Information and fitness. arXiv.org: 0712.4382 [q-bio.PE].
19. Friston K, Kilner J, Harrison L (2006) A free energy principle for the brain. Journal of Physiology-Paris 100: 70-87.
20. Klyubin AS, Polani D, Nehaniv CL (2004) Tracking information flow through the environment: Simple cases of stigmergy. In: Pollack J, Bedau M, Husbands P, Ikegami T, Watson RA, eds (2004) Artificial Life IX: Proceedings of the Ninth International Conference on Artificial Life. MIT Press. pp 563-568.
21. Vergassola M, Villermaux E, Shraiman BI (2007) 'infotaxis' as a strategy for searching without gradients. Nature 445: 406-409.
22. Attneave F (1954) Informational aspects of visual perception. Psychol Rev 61: 183-193.
23. Barlow HB (1959) Possible principles underlying the transformations of sensory messages. In: Rosenblith WA, ed (1959) Sensory Communication: Contributions to the Symposium on Principles of Sensory Communication. The M.I.T. Press. pp 217-234.
24. Barlow HB (2001) Redundancy reduction revisited. Network: Computation in Neural Systems 12: 241-253.
25. Atick JJ (1992) Could information theory provide an ecological theory of sensory processing. Network: Computation in Neural Systems 3: 213-251.
26. Linsker R (1988) Self-organization in a perceptual network. Computer 21: 105-117.
27. Nadal JP, Parga N (1995) Information transmission by networks of non linear neurons. In: Proc. of the Third Workshop on Neural Networks: from Biology to High Energy Physics, (1994, Elba, Italy). International Journal of Neural Systems, Supplement. pp 153-157.
28. Bell AJ, Sejnowski TJ (1995) An information-maximization approach to blind separation and blind deconvolution. Neural Computation 7: 1129-1159.
29. Harvey I (2004) Homeostasis and rein control: From Daisyworld to active perception. In: Pollack J, Bedau M, Husbands P, Ikegami T, Watson RA, eds (2004) Artificial Life IX: Proceedings of the Ninth International Conference on the Simulation and Synthesis of Living Systems. The MIT Press. pp 309-314.
30. Porr B, von Ferber C, Wörrgötter F (2003) ISO learning approximates a solution to the inverse-controller problem in an unsupervised behavioral paradigm. Neural Computation 15: 865-884.
31. Bialek W, Nemenman I, Tishby N (2001) Predictability, complexity and learning. Neural Computation 13: 2409-2463.
32. Ay N, Bertschinger N, Der R, Güttler F, Olbrich E (2008) Predictive information and explorative behavior of autonomous robots. European Journal of Physics B 63: 329-339.
33. Csíkszentmihályi M (1978) Beyond Boredom and Anxiety: Experiencing Flow in Work and Play. Cambridge: Cambridge University Press.
34. Schmidhuber J (2002) Exploring the predictable. In: Ghosh A, Tsutsui S, eds (2002) Advances in Evolutionary Computing. Springer. pp 579-612.
35. Singh S, Barto AG, Chentanez N (2005) Intrinsically motivated reinforcement learning. In: Proceedings of the 18th Annual Conference on Neural Information Processing Systems (NIPS). VancouverB.C., Canada.
36. Blank D, Kumar D, Meeden L, Marshall JB (2005) Self-motivated, task-independent reinforcement learning for robots. Cybernetics and Systems 36.
37. Kaplan F, Oudeyer PY (2004) Maximizing learning progress: an internal reward system for development. In: Iida F, Pfeifer R, Steels L, Kuniyoshi Y, eds (2004) Embodied Artificial Intelligence, Springer, volume 3139 of LNAI. pp 259-270.
38. Steels L (2004) The autotelic principle. In: Iida F, Pfeifer R, Steels L, Kuniyoshi Y, eds (2004) Embodied Artificial Intelligence: Dagstuhl Castle, Germany, July 7-11, 2003. Berlin: Springer Verlag, volume 3139 of Lecture Notes in AI. pp 231-242.
39. Pfeifer R (2001) Embodied artificial intelligence: 10 years back, 10 years forward. In: Wilhelm R, ed (2001) Informatics, Springer, volume 2000/2001 of LNCS. pp 294-310.
40. Klyubin AS, Polani D, Nehaniv CL (2005) All else being equal be empowered. In: Advances in Artificial Life, European Conference on Artificial Life (ECAL 2005). Springer, volume 3630 of LNAI. pp 744-753.
41. Ay N, Polani D (2008) Information flows in causal networks. Advances in Complex Systems 11: 17-41.
42. Pearl J (2000) Causality: Models, Reasoning and Inference. Cambridge, UK: Cambridge University Press.
43. Kauffman SA (1993) The origins of order: self-organization and selection in evolution. Oxford Univ. Press.
44. Gibson JJ (1979) The Ecological Approach to Visual Perception. Boston: Houghton Mifflin Company.
45. Moriarty DE, Miikkulainen R (1995) Discovering complex Othello strategies through evolutionary neural networks. Connection Science 7: 195-210.
46. Philipona D, O'Regan JK, Nadal JP, Coenen OJM () Perception of the structure of the physical world using unknown sensors and effectors. In: Advances in Neural Information Processing Systems, The MIT Press, volume 16 2004.
47. Shannon CE (1958) Channels with side information at the transmitter. IBM Journal of Research and Development 2: 289-293.
48. Crutchfield JP, Young K (1989) Inferring statistical complexity. Physical Review Letters 63: 105-108.
49. Shalizi CR, Crutchfield JP (2001) Computational mechanics: Pattern and prediction, structure and simplicity. Journal of Statistical Physics 104: 817-879.
50. Press WH, Teukolsky SA, Vetterling WT, Flannery BP (1996) Numerical Recipes in C. Cambridge University Press.
51. Blahut R (1972) Computation of channel capacity and rate distortion functions. IEEE Transactions on Information Theory 18: 460-473.
52. Sutton RS, Barto AG (1998) Reinforcement Learning. Cambridge, Mass.: MIT Press.
53. Cariani P (1992) Some epistemological implications of devices which construct their own sensors and effectors. In: Varela FJ, Bourgine P, eds (1992) Toward a Practice of Autonomous Systems: Proceedings of the First European Conference on Artificial Life. pp 484-493.
54. Polani D, Martinetz T, Kim J (2001) An information-theoretic approach for the quantification of relevance. In: Kelemen J, Sosik P, eds (2001) Advances in Artificial Life (Proc. 6th European Conference on Artificial Life). Springer, volume 2159 of LNAI. pp 704-713.
55. Bergstrom CT, Lachmann M (2004) Shannon information and biological fitness. In: Information Theory Workshop. IEEE. pp 50-54.
56. Polani D, Nehaniv C, Martinetz T, Kim JT (2006) Relevant information in optimized persistence vs. progeny strategies. In: Rocha et al. 68. pp 337-343.
57. Klyubin AS, Polani D, Nehaniv CL (2005) Empowerment: A universal agent-centric measure of control. In: Proc. IEEE Congress on Evolutionary Computation, 2-5 September 2005, Edinburgh, Scotland (CEC 2005). IEEE. pp 128-135. doi:10.1109/CEC.2005.1554676.
58. Emmeche C (2001) Does a robot have an Umwelt? Reflections on the qualitative biosemiotics of Jakob von Uexküll. Semiotica 134: 659-693.
59. Nehaniv CL (1999) Meaning for observers and agents. In: IEEE International Symposium on Intelligent Control/Intelligent Systems and Semiotics, ISIC/ISAS'99 - September 15-17, 1999. Cambridge, Massachusetts, USA: IEEE Press. pp 435-440.
60. Nehaniv CL, Polani D, Dautenhahn K, te Boekhorst R, Cañamero L (2002) Meaningful information, sensor evolution, and the temporal horizon of embodied organism. In: Proc. Artificial Life VIII. MIT Press. pp 345-349.
61. Tishby N, Pereira FC, Bialek W (1999) The information bottleneck method. In: Proc. 37th Annual Allerton Conference on Communication, Control and Computing, Illinois. Urbana-Champaign.
62. Varela FJ, Maturana HR, Uribe R (1974) Autopoiesis: The organization of living systems. BioSystems 5: 187-196.
63. Der R, Steinmetz U, Pasemann F (1999) Homeokinesis - a new principle to back up evolution with learning. In: Mohammadian M, ed (1999) Computational Intelligence for Modelling, Control, and Automation. IOS Press, volume 55 of Concurrent Systems Engineering Series. pp 43-47.
64. Der R (2000) Selforganized robot behavior from the principle of homeokinesis. In: Groß HM, Debes K, Böhme HJ, eds (2000) Proc. Workhop SOAVE '2000 (Selbstorganisation von adaptivem Verhalten). Ilmenau: VDI Verlag, volume 643 of Fortschritt-Berichte VDI, Reihe 10. pp 39-46.
65. Lungarella M, Metta G, Pfeifer R, Sandini G (2003) Developmental robotics: A survey. Connection Science 15: 151-190.
66. Anthony T, Polani D, Nehaniv CL (2008) On preferred states of agents: how global structure is reflected in local structure. In: Proc. Artificial Life XI. MIT Press. pp 25-32.
67. de Ruyter van Steveninck RR, Laughlin SB (1996) The rate of information transfer at graded-potential synapses. Nature 379: 642-645.
68. Rocha LM, Bedau M, Floreano D, Goldstone R, Vespignani A, et al. (2006) Proc. Artificial Life X.
69. Shannon CE (1948) A mathematical theory of communication. The Bell System Technical Journal 27: 379-423.
70. Cover TM, Thomas JA (1991) Elements of Information Theory. New York: Wiley.
71. Touchette H, Lloyd S (2004) Information-theoretic approach to the study of control systems. Physica A 331: 140-172.