Meta-Learning with Memory-Augmented Neural Networks

33rd International Conference on Machine Learning, ICML 2016

Volumn 4, Issue , 2016, Pages 2740-2751

  Santoro, Adam ^a   Bartunov, Sergey ^b   Botvinick, Matthew ^a   Wierstra, Daan ^a   Lillicrap, Timothy ^a  

^a DEEPMIND   (United Kingdom)

^b NATIONAL RESEARCH UNIVERSITY HIGHER SCHOOL OF ECONOMICS   (Russian Federation)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; ITERATIVE METHODS; LEARNING SYSTEMS;

ACCURATE PREDICTION; CONVENTIONAL MODELS; DEEP NEURAL NETWORKS; EXTERNAL MEMORY; FOCUSING MECHANISMS; MEMORY CAPACITY; MEMORY LOCATIONS; ONE-SHOT LEARNING;

TURING MACHINES;

EID: 84998717754     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. Braun, Daniel A, Aertsen, Ad, Wolpert, Daniel M, and Mehring, Carsten. Motor task variation induces structural learning. Current Biology, 19(4):352-357, 2009.
2. Brazdil, Pavel B, Soares, Carlos, and Da Costa, Joaquim Pinto. Ranking learning algorithms: Using ibl and meta-learning on accuracy and time results. Machine Learning, 50(3):251-277, 2003.
3. Caruana, Rich. Multitask learning. Machine learning, 28 (1):41-75, 1997.
4. Cowan, Nelson. The magical mystery four how is working memory capacity limited, and why? Current Directions in Psychological Science, 19(1):51-57, 2010.
5. Giraud-Carrier, Christophe, Vilalta, Ricardo, and Brazdil, Pavel. Introduction to the special issue on meta-learning. Machine learning, 54(3):187-193, 2004.
6. Graves, Alex, Wayne, Greg, and Danihelka, Ivo. Neural turing machines. arXiv preprint arXiv:1410.5401, 2014.
7. He, Kaiming, Zhang, Xiangyu, Ren, Shaoqing, and Sun, Jian. Delving deep into rectifiers: Surpassing human- level performance on imagenet classification. arXiv preprint arXiv: 1502.01852, 2015.
8. Hochreiter, Sepp and Schmidhuber, Jiirgen. Long short- term memory. Neural computation, 9(8): 1735-1780, 1997.
9. Hochreiter, Sepp, Younger, A Steven, and Conwell, Peter R. Learning to learn using gradient descent. In Artificial Neural NetworksICANN 2001, pp. 87-94. Springer, 2001.
10. Jankowski, Norbert, Duch, Wlodzislaw, and Grabczewski, Krzysztof. Meta-learning in computational intelligence, volume 358. Springer Science & Business Media, 2011.
11. Lake, Brenden M, Salakhutdinov, Ruslan, and Tenenbaum, Joshua B. Human-level concept learning through probabilistic program induction. Science, 350(6266): 1332- 1338, 2015.
12. Mnih, Volodymyr, Kavukcuoglu, Koray, Silver, David, Rusu, Andrei A, Veness, Joel, Bellemare, Marc G, Graves, Alex, Riedmiller, Martin, Fidjeland, Andreas K, Ostrovski, Georg, et al. Human-level control through deep reinforcement learning. Nature, 518(7540):529- 533, 2015.
13. Rendell, Larry A, Sheshu, Raj, and Tcheng, David K. Layered concept-learning and dynamically variable bias management. In IJCAI, pp. 308-314. Citeseer, 1987.
14. Schmidhuber, Jiirgen, Zhao, Jieyu, and Wiering, Marco. Shifting inductive bias with success-story algorithm, adaptive levin search, and incremental self- improvement. Machine Learning, 28(1): 105-130, 1997.
15. Schweighofer, Nicolas and Doya, Kenji. Meta-learning in reinforcement learning. Neural Networks, 16(1):5-9, 2003.
16. Silver, David, Huang, Aja, Maddison, Chris J, Guez, Arthur, Sifre, Laurent, van den Driessche, George, Schrittwieser, Julian, Antonoglou, Ioannis, Panneershel- vam, Veda, Lanctot, Marc, et al. Mastering the game of go with deep neural networks and tree search. Nature, 529(7587):484-489, 2016.
17. Thrun, Sebastian. Lifelong learning algorithms. In Learning to learn, pp. 181-209. Springer, 1998.
18. Underwood, Benton J. Interference and forgetting. Psychological review, 64(1):49, 1957.
19. Vilalta, Ricardo and Drissi, Youssef. A perspective view and survey of meta-learning. Artificial Intelligence Review, 18(2):77-95, 2002.
20. Weston, Jason, Chopra, Sumit, and Bordes, Antoine. Memory networks. arXiv preprint arXiv: 1410.3916, 2014.
21. Yu, Dong and Deng, Li. Automatic Speech Recognition. Springer, 2012.