Human-level control through deep reinforcement learning

Nature

Volumn 518, Issue 7540, 2015, Pages 529-533

  Mnih, Volodymyr ^a   Kavukcuoglu, Koray ^a   Silver, David ^a   Rusu, Andrei A ^a   Veness, Joel ^a   Bellemare, Marc G ^a   Graves, Alex ^a   Riedmiller, Martin ^a   Fidjeland, Andreas K ^a   Ostrovski, Georg ^a   Petersen, Stig ^a   Beattie, Charles ^a   Sadik, Amir ^a   Antonoglou, Ioannis ^a   King, Helen ^a   Kumaran, Dharshan ^a   Wierstra, Daan ^a   Legg, Shane ^a   Hassabis, Demis ^a  

^a DEEPMIND   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ARTIFICIAL INTELLIGENCE; BEHAVIORAL ECOLOGY; GAME THEORY; HARMONIC ANALYSIS; HIERARCHICAL SYSTEM; NEUROLOGY; PARAMETERIZATION; SENSORY SYSTEM;

ANIMAL BEHAVIOR; ARTICLE; HUMAN; LEARNING ALGORITHM; NONHUMAN; PRIORITY JOURNAL; REINFORCEMENT; SENSORY STIMULATION; ALGORITHM; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; PSYCHOLOGICAL MODEL; RECREATION; REWARD;

ANIMALIA;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; HUMANS; MODELS, PSYCHOLOGICAL; NEURAL NETWORKS (COMPUTER); REINFORCEMENT (PSYCHOLOGY); REWARD; VIDEO GAMES;

EID: 84924051598     PISSN: 00280836     EISSN: 14764687     Source Type: Journal    
DOI: 10.1038/nature14236     Document Type: Article

References (33)

1. Sutton, R. & Barto, A. Reinforcement Learning: An Introduction (MIT Press, 1998).
2. Thorndike, E. L. Animal Intelligence: Experimental studies (Macmillan, 1911).
3. Schultz, W., Dayan, P. & Montague, P. R. A neural substrate of prediction and reward. Science 275, 1593-1599 (1997).
4. Serre, T., Wolf, L. & Poggio, T. Object recognition with features inspired by visual cortex. Proc. IEEE. Comput. Soc. Conf. Comput. Vis. Pattern. Recognit. 994-1000 (2005).
5. Fukushima, K. Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biol. Cybern. 36, 193-202 (1980).
6. Tesauro, G. Temporal difference learning and TD-Gammon. Commun. ACM 38, 58-68 (1995).
7. Riedmiller, M., Gabel, T., Hafner, R. & Lange, S. Reinforcement learning for robot soccer. Auton. Robots 27, 55-73 (2009).
8. Diuk, C., Cohen, A. & Littman, M. L. An object-oriented representation for efficient reinforcement learning. Proc. Int. Conf. Mach. Learn. 240-247 (2008).
9. Bengio, Y. Learning deep architectures for AI. Foundations and Trends in Machine Learning 2, 1-127 (2009).
10. Krizhevsky, A., Sutskever, I. & Hinton, G. ImageNet classification with deep convolutional neural networks. Adv.Neural Inf. Process. Syst.25, 1106-1114 (2012).
11. Hinton, G. E. & Salakhutdinov, R. R. Reducing the dimensionality of data with neural networks. Science 313, 504-507 (2006).
12. Bellemare, M. G., Naddaf, Y., Veness, J. & Bowling, M. The arcade learning environment: An evaluation platform for general agents. J. Artif. Intell. Res. 47, 253-279 (2013).
13. Legg, S. & Hutter, M. Universal Intelligence: a definition of machine intelligence. Minds Mach. 17, 391-444 (2007).
14. Genesereth, M., Love, N. & Pell, B. General game playing: overview of the AAAI competition. AI Mag. 26, 62-72 (2005).
15. Bellemare, M. G., Veness, J. & Bowling, M. Investigating contingency awareness using Atari 2600 games. Proc. Conf. AAAI. Artif. Intell. 864-871 (2012).
16. McClelland, J. L., Rumelhart, D. E. & Group, T. P. R. Parallel Distributed Processing: Explorations in the Microstructure of Cognition (MIT Press, 1986).
17. LeCun, Y., Bottou, L., Bengio, Y. & Haffner, P. Gradient-based learning applied to document recognition. Proc. IEEE 86, 2278-2324 (1998).
18. Hubel, D. H. & Wiesel, T. N. Shape and arrangement of columns in cat?s striate cortex. J. Physiol. 165, 559-568 (1963).
19. Watkins, C. J. & Dayan, P. Q-learning. Mach. Learn. 8, 279-292 (1992).
20. Tsitsiklis, J. & Roy, B. V. An analysis of temporal-difference learning with function approximation. IEEE Trans. Automat. Contr. 42, 674-690 (1997).
21. McClelland, J. L., McNaughton, B. L.& O?Reilly, R. C.Why there are complementary learning systems in the hippocampus and neocortex: insights fromthe successes and failures of connectionist models of learning and memory. Psychol. Rev. 102, 419-457 (1995).
22. O?Neill, J., Pleydell-Bouverie, B., Dupret, D. & Csicsvari, J. Play it again: reactivation of waking experience and memory. Trends Neurosci. 33, 220-229 (2010).
23. Lin, L.-J. Reinforcement learning for robots using neural networks. Technical Report, DTIC Document (1993).
24. Riedmiller, M. Neural fitted Q iteration - first experiences with a data efficient neural reinforcement learning method. Mach. Learn.: ECML, 3720, 317-328 (Springer, 2005).
25. Van der Maaten, L. J. P. & Hinton, G. E. Visualizing high-dimensional data using t-SNE. J. Mach. Learn. Res. 9, 2579-2605 (2008).
26. Lange, S. & Riedmiller, M. Deep auto-encoder neural networks in reinforcement learning. Proc. Int. Jt. Conf. Neural. Netw. 1-8 (2010).
27. Law, C.-T. & Gold, J. I. Reinforcement learning can account for associative and perceptual learning on a visual decision task. Nature Neurosci. 12, 655 (2009).
28. Sigala, N. & Logothetis, N. K. Visual categorization shapes feature selectivity in the primate temporal cortex. Nature 415, 318-320 (2002).
29. Bendor, D.& Wilson, M. A. Biasing the content of hippocampal replay during sleep. Nature Neurosci. 15, 1439-1444 (2012).
30. Moore, A.&Atkeson, C. Prioritized sweeping: reinforcement learning with less data and less real time. Mach. Learn. 13, 103-130 (1993).
31. Jarrett, K., Kavukcuoglu, K., Ranzato, M. A.&LeCun, Y.What is the bestmulti-stage architecture for object recognition? Proc. IEEE. Int. Conf. Comput. Vis. 2146-2153 (2009).
32. Nair, V. & Hinton, G. E. Rectified linear units improve restricted Boltzmann machines. Proc. Int. Conf. Mach. Learn. 807-814 (2010).
33. Kaelbling, L. P., Littman, M. L. & Cassandra, A. R. Planning and acting in partially observable stochastic domains. Artificial Intelligence 101, 99-134 (1994).