Planning to be surprised: Optimal Bayesian exploration in dynamic environments

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 6830 LNAI, Issue , 2011, Pages 41-51

  Sun, Yi ^a   Gomez, Faustino ^a   Schmidhuber, Jürgen ^a  

^a DALLE MOLLE INSTITUTE FOR ARTIFICIAL INTELLIGENCE IDSIA   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

DYNAMIC ENVIRONMENTS;

OPTIMIZATION;

EID: 79961180493     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-22887-2_5     Document Type: Conference Paper

References (11)

1. Chaloner, K., Verdinelli, I.: Bayesian experimental design: A review. Statistical Science 10, 273-304 (1995)
2. Fedorov, V.V.: Theory of optimal experiments. Academic Press, London (1972)
3. Itti, L., Baldi, P.F.: Bayesian surprise attracts human attention. In: NIPS 2005, pp. 547-554 (2006)
4. Lindley, D.V.: On a measure of the information provided by an experiment. Annals of Mathematical Statistics 27(4), 986-1005 (1956)
5. Penny, W.: Kullback-liebler divergences of normal, gamma, dirichlet and wishart densities. Tech. rep., Wellcome Department of Cognitive Neurology, University College London (2001)
6. Schmidhuber, J.: Curious model-building control systems. In: IJCNN 1991, vol. 2, pp. 1458-1463 (1991)
7. Schmidhuber, J.: Formal theory of creativity, fun, and intrinsic motivation (1990-2010). Autonomous Mental Development, IEEE Trans. on Autonomous Mental Development 2(3), 230-247 (2010)
8. Settles, B.: Active learning literature survey. Tech. rep., University of Wisconsin Madison (2010)
9. Singh, S., Barto, A., Chentanez, N.: Intrinsically motivated reinforcement learning. In: NIPS 2004 (2004)
10. Storck, J., Hochreiter, S., Schmidhuber, J.: Reinforcement driven information acquisition in non-deterministic environments. In: ICANN 1995 (1995)
11. Sun, Y., Gomez, F.J., Schmidhuber, J.: Planning to be surprised: Optimal Bayesian exploration in dynamic environments (2011), http://arxiv.org/abs/1103. 5708