The forget-me-not process

Advances in Neural Information Processing Systems

Volumn , Issue , 2016, Pages 3709-3717

  Milan, Kieran ^a   Veness, Joel ^a   Kirkpatrick, James ^a   Hassabis, Demis ^a   Koop, Anna ^b   Bowling, Michael ^b  

^a DEEPMIND   (United Kingdom)

^b UNIVERSITY OF ALBERTA   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN APPROACHES; LOGARITHMIC LOSS; META-ALGORITHMS; PIECEWISE STATIONARIES; PROBABILISTIC SEQUENCES; SEQUENCE PREDICTION; SPECIFIC SEGMENTS; TASK IDENTIFICATION;

BAYESIAN NETWORKS;

EID: 85016401232     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. Ryan Prescott Adams and David J.C. MacKay. Bayesian Online Changepoint Detection. In arXiv, http://arxiv.org/abs/0710.3742, 2007.
2. M. G. Bellemare, Y. Naddaf, J. Veness, and M. Bowling. The arcade learning environment: An evaluation platform for general agents. Journal of Artificial Intelligence Research, 47: 253-279, 06 2013.
3. Nicolo Cesa-Bianchi and Gabor Lugosi. Prediction, Learning, and Games. Cambridge University Press, New York, NY, USA, 2006. ISBN 0521841089.
4. Anne Collins and Etienne Koechlin. Reasoning, learning, and creativity: Frontal lobe function and human decision-making. PLoS Biol, 10(3): 1-16, 03 2012.
5. Anne G.E. Collins and Michael J. Frank. Cognitive Control over Learning: Creating, Clustering and Generalizing Task-Set Structure. Psychological review, 120.1: 190-229, 2013.
6. Maël Donoso, Anne G. E. Collins, and Etienne Koechlin. Foundations of human reasoning in the prefrontal cortex. Science, 344(6191): 1481-1486, 2014. doi: 10.1126/science.1252254.
7. Kenji Doya and Kazuyuki Samejima. Multiple model-based reinforcement learning. Neural Computation, 14: 1347-1369, 2002.
8. John Duchi, Elad Hazan, and Yoram Singer. Adaptive Subgradient Methods for Online Learning and Stochastic Optimization. Journal of Machine Learning Research (JMLR), 12: 2121-2159, 07 2011.
9. Mathieu Germain, Karol Gregor, Iain Murray, and Hugo Larochelle. MADE: masked autoencoder for distribution estimation. In Proceedings of the 32nd International Conference on Machine Learning, JMLR W&CP, Volume 37, pages 881-889, 2015.
10. A. György, T. Linder, and G. Lugosi. Efficient tracking of large classes of experts. IEEE Transactions on Information Theory, 58(11): 6709-6725, 2011.
11. E. Hazan and C. Seshadhri. Efficient learning algorithms for changing environments. In Proceedings of the 26th Annual International Conference on Machine Learning, pages 393-400. ACM, 2009.
12. Marcus Hutter. On universal prediction and Bayesian confirmation. Theoretical Computer Science, 384(1): 33-48, 2007.
13. R. Krichevsky and V. Trofimov. The performance of universal encoding. Information Theory, IEEE Transactions on, 27(2): 199-207, 1981.
14. Tor Lattimore, Marcus Hutter, and Peter Sunehag. Concentration and confidence for discrete bayesian sequence predictors. In Sanjay Jain, Rémi Munos, Frank Stephan, and Thomas Zeugmann, editors, Proceedings of the 24th International Conference on Algorithmic Learning Theory, pages 324-338. Springer, 2013.
15. Y. Lecun, L. Bottou, Y. Bengio, and P. Haffner. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11): 2278-2324, Nov 1998.
16. Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A. Rusu, Joel Veness, Marc G. Bellemare, Alex Graves, Martin Riedmiller, Andreas K. Fidjeland, Georg Ostrovski, Stig Petersen, Charles Beattie, Amir Sadik, Ioannis Antonoglou, Helen King, Dharshan Kumaran, Daan Wierstra, Shane Legg, and Demis Hassabis. Human-level control through deep reinforcement learning. Nature, 518, 2015.
17. J. Veness, M. White, M. Bowling, and A. Gyorgy. Partition tree weighting. In Data Compression Conference (DCC), pages 321-330, March 2013.
18. Joel Veness, Marc G. Bellemare, Marcus Hutter, Alvin Chua, and Guillaume Desjardins. Compress and control. In Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, January 25-30, 2015, Austin, Texas, USA., pages 3016-3023, 2015.
19. Jeffrey S. Vitter. Random sampling with a reservoir. ACM Trans. Math. Softw., 11(1): 37-57, March 1985. ISSN 0098-3500. doi: 10.1145/3147.3165.
20. F. Willems and M. Krom. Live-and-die coding for binary piecewise i.i.d. sources. In Information Theory. 1997. Proceedings., 1997 IEEE International Symposium on, page 68, jun-4 jul 1997.
21. Frans M. J. Willems. Coding for a binary independent piecewise-identically-distributed source. IEEE Transactions on Information Theory, 42: 2210-2217, 1996.
22. Frans M.J. Willems, Yuri M. Shtarkov, and Tjalling J. Tjalkens. The Context Tree Weighting Method: Basic Properties. IEEE Transactions on Information Theory, 41: 653-664, 1995.