Informational constraints-driven organization in goal-directed behavior

Advances in Complex Systems

Volumn 16, Issue 2-3, 2013, Pages

  Van Dijk, Sander G ^a   Polani, Daniel ^a  

^a UNIVERSITY OF HERTFORDSHIRE   (United Kingdom)

Author keywords

constrained cognition; embrainment; goal abstraction; Goal directed; informational structure; relevant information; sub goals

Indexed keywords

EID: 84880376482     PISSN: 02195259     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0219525913500161     Document Type: Article

References (30)

1. Ay, N., Bernigau, H., Der, R. and Prokopenko, M., Information-driven selforganization: The dynamical system approach to autonomous robot behavior, Theory Biosci. 131 (2012) 161-179.
2. Barlow, H., Redundancy reduction revisited, Network 12 (2001) 241-254.
3. Bialek, W., Nemenman, I. and Tishby, N., Predictability, complexity, and learning, Neural Comput. 13 (2001) 2409-2463. (Pubitemid 33594578)
4. Botvinick, M. M., Hierarchical models of behavior and prefrontal function, Trends Cogn. Sci. (Regul. Ed.) 12 (2008) 201-208.
5. Şim̧sek, O. and Barto, A. G., Skill characterization based on betweenness, In Advances in Neural Information Processing Systems, eds. D. Koller, D. Schuurmans, Y. Bengio and L. Bottou (2009), pp. 1497-1504.
6. Carroll, J. L. and Seppi, K., Task similarity measures for transfer in reinforcement learning task libraries, in The 2005 Int. Joint Conf. Neural Networks (IJCNN 2005), (2005), pp. 803-808. (Pubitemid 44055554)
7. Cover, T. M. and Thomas, J. A., Elements of Information Theory (Wiley-Interscience, 1991).
8. Hamilton, A. F. D. C. and Grafton, S. T., Goal representation in human anterior intraparietal sulcus, J. Neurosci. 26 (2006) 1133-7. (Pubitemid 43237045)
9. Klyubin, A., Polani, D. and Nehaniv, C., Organization of the information flow in the perception-action loop of evolved agents, in Proceedings of 2004 NASA/DoD Conference on Evolvable Hardware, Zebulum, R. S., Gwaltney, D., Hornby, G., Keymeulen, D., Lohn, A., J. and Stoica (IEEE Computer Society, 2004), pp. 177-180. (Pubitemid 40060324)
10. Klyubin, A. S., Polani, D. and Nehaniv, C. L., Keep your options open: An information-based driving principle for sensorimotor systems, PloS One 3 (2008) e4018.
11. Kupfermann, I., Kandel, E. and Iversen, S., Motivational and addictive states, in Principles of Neural Science, Kandel, E., Schwarz, J. and Jessell, T. (eds.) (Elsevier, 2000), pp. 998-1013.
12. Lipton, J., Kleemann, G., Ghosh, R., Lints, R. and Emmons, S. W., Mate searching in Caenorhabditis elegans: A genetic model for sex drive in a simple invertebrate, J. Neurosci. 24 (2004) 7427-7434. (Pubitemid 39166734)
13. Montague, P. R., Hyman, S. E. and Cohen, J. D., Computational roles for dopamine in behavioural control, Nature 431 (2004) 760-767. (Pubitemid 39434064)
14. Pfeifer, R., Lungarella, M., Sporns, O. and Kuniyoshi, Y., On the informationtheoretic implications of embodiment - principles and methods, in 50 Years of Artificial Intelligence, Vol. 4850 (Springer-Verlag, 2007), pp. 76-86. (Pubitemid 350261323)
15. Polani, D., Information: Currency of life?, HFSP J. 3 (2009) 307-316.
16. Polani, D., An informational perspective on how the embodiment can relieve cognitive burden, in IEEE Symposium on Artificial Life (2011), pp. 78-85.
17. Polani, D., Nehaniv, C., Martinetz, T. and Kim, J., Relevant information in optimized persistence vs. progeny strategies, in Artificial Life X: Proceedings of the Tenth International Conference on the Simulation and Synthesis of Living Systems (Citeseer, 2006), pp. 337-343.
18. Radvansky, G. A., Krawietz, S. A. and Tamplin, A. K., Walking through doorways causes forgetting: Further explorations, Q. J. Exp. Psychol. 64 (2011) 1632-1645.
19. Saito, N., Mushiake, H., Sakamoto, K., Itoyama, Y. and Tanji, J., Representation of immediate and final behavioral goals in the monkey prefrontal cortex during an instructed delay period, Cerebral Cortex (New York, N.Y.: 1991) 15 (2005) 1535-46.
20. Salge, C. and Polani, D., Digested information as an information theoretic motivation for social interaction, J. Artif. Soc. Soc. Simul. 14 (2010).
21. Sporns, O. and Lungarella, M., Evolving coordinated behavior by maximizing information structure, in Artificial life X: Proceedings of the Tenth Int. Conf. Simulation and Synthesis of Living Systems (Citeseer, 2006), pp. 323-329.
22. Sutton, R. S. and Barto, A. G., Reinforcement Learning: An Introduction (MIT Press, Cambridge, MA, USA, 1998).
23. Taylor, M. E. and Stone, P., Transfer learning for reinforcement learning domains: A survey, J. Mach. Learning Res. 10 (2009) 1633-1685.
24. Tishby, N., Pereira, F. C. and Bialek, W., The information bottleneck method, in Proc. of the 37th Annual Allerton Conference on Communication, Control and Computing (1999), pp. 368-377.
25. Tishby, N. and Polani, D., Information theory of decisions and actions, in Perception-Action Cycle, Cutsuridis, V., Hussain, A. and Taylor, J. G. (eds.), Springer Series in Cognitive and Neural Systems (Springer New York, 2011), ISBN 978-1-4419-1452-1, pp. 601-636.
26. Touchette, H. and Lloyd, S., Information-theoretic limits of control, Phys. Rev. Lett. 84 (2000) 1156-1159.
27. Touchette, H. and Lloyd, S., Information-theoretic approach to the study of control systems, Physica A: Stat. Mech. Appl. 331 (2004) 140-172.
28. van Dijk, S. G. and Polani, D., Grounding subgoals in information transitions, in IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (Paris, France, 2011), pp. 105-111.
29. van Dijk, S. G., Polani, D. and Nehaniv, C. L., What do you want to do today? Relevant-information bookkeeping in goal-oriented behaviour, in Artificial Life XII: The 12th Int. Conf. on the Synthesis and Simulation of Living Systems, Fellermann, H., Dörr, M., Hanczyc, M., Ladegaard, L. L., Maurer, S., Merkle, D., Monnard, P-A., Støy, K. and Rasmussen, S. (eds.) (MIT Press, Odense, Denmark, 2010), pp. 176-183.
30. Vergassola, M., Villermaux, E. and Shraiman, B. I., "Infotaxis" as a strategy for searching without gradients, Nature 445 (2007) 406-409. (Pubitemid 46160905)