Hierarchical behaviours: Getting the most bang for your bit

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 5778 LNAI, Issue PART 2, 2011, Pages 342-349

  Van Dijk, Sander G ^a   Polani, Daniel ^a   Nehaniv, Chrystopher L ^a  

^a UNIVERSITY OF HERTFORDSHIRE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL AGENTS; HIERARCHICAL ARCHITECTURES; HIERARCHICAL STRUCTURING; INFORMATION PROCESSING CAPABILITY;

INFORMATION THEORY;

DATA PROCESSING;

EID: 79959957608     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-21314-4_43     Document Type: Conference Paper

References (18)

1. Prete, F.R., Wells, H., Wells, P.H., Hurd, L.E.E.: The Praying Mantids. Johns Hopkins University Press, Baltimore (1999)
2. Yu, A.C., Margoliash, D.: Temporal Hierarchical Control of Singing in Birds. Science 273(5283), 1871-1875 (1996)
3. McGonigle, B.O., Chalmers, M., Dickinson, A.: Concurrent disjoint and reciprocal classification by Cebus apella in serial ordering tasks: evidence for hierarchical organization. Animal Cognition 6, 185-197 (2003)
4. Dawkins, R.: Hierarchical organisation: A candidate principle for ethology. In: Growing Points in Ethology, pp. 7-54. Cambridge University Press, Cambridge (1976)
5. Quinlan, J.R.: Induction of Decision Trees. Machine Learning 1(1), 81-106 (2007)
6. Barto, A.G., Mahadevan, S.: Recent Advances in Hierarchical Reinforcement Learning. Discrete Event Dynamic Systems 13(4), 341-379 (2003)
7. McGovern, A., Barto, A.G.: Automatic Discovery of Subgoals in Reinforcement Learning using Diverse Density. In: Proc. 18th International Conf. on Machine Learning, pp. 361-368. Morgan Kaufmann, San Francisco (2001)
8. Şimşek, O., Barto, A.G.: Using relative novelty to identify useful temporal abstractions in reinforcement learning. In: ICML 2004: Proceedings of the Twenty-First International Conference on Machine Learning, ACM, New York (2004)
9. Prescott, T.J., Redgrave, P., Gurney, K.: Layered Control Architectures in Robots and Vertebrates. Adaptive Behavior 7, 99-127 (1999)
10. Botvinick, M.M.: Hierarchical models of behavior and prefrontal function. Trends in Cognitive Science 12(5), 201-208 (2008)
11. Polani, D., Nehaniv, C., Martinetz, T., Kim, J.T.: Relevant Information in Optimized Persistence vs. Progeny Strategies. In: Proceedings of Artificial Life X. MIT Press, Cambridge (2006)
12. Capdepuy, P., Polani, D., Nehaniv, C.L.: Constructing the Basic Umwelt of Artificial Agents: An Information-Theoretic Approach. In: Almeida e Costa, F., Rocha, L.M., Costa, E., Harvey, I., Coutinho, A. (eds.) ECAL 2007. LNCS (LNAI), vol. 4648, pp. 375-383. Springer, Heidelberg (2007)
13. Klyubin, A.S., Polani, D., Nehaniv, C.L.: All Else Being Equal Be Empowered. In: Capcarrère, M.S., Freitas, A.A., Bentley, P.J., Johnson, C.G., Timmis, J. (eds.) ECAL 2005. LNCS (LNAI), vol. 3630, pp. 744-753. Springer, Heidelberg (2005)
14. Tishby, N., Pereira, F.C., Bialek, W.: The information bottleneck method. In: Proc. 37th Annual Allerton Conference on Communication, Control and Computing, Illinois, Urbana-Champaign (1999)
15. Sutton, R.S., Precup, D., Singh, S.: Between MDPs and semi-MDPs: a framework for temporal abstraction in reinforcement learning. Artificial Intelligence 112(1-2), 181-211 (1999)
16. Blahut, R.E.: Computation of Channel Capacity and Rate-Distortion Functions. IEEE Transactions on Information Theory 18, 460-473 (1972)
17. Massey, J.L.: Causality, Feedback and Directed Information. In: Proceedings of the International Symposium on Information Theory and Its Applications (ISITA 1990), pp. 303-305 (1990)
18. Ay, N., Polani, D.: Information Flows in Causal Networks. Advances in Complex Systems 11(1), 17-41 (2008)