Dual-memory deep learning architectures for lifelong learning of everyday human behaviors

IJCAI International Joint Conference on Artificial Intelligence

Volumn 2016-January, Issue , 2016, Pages 1669-1675

  Lee, Sang Woo ^a   Lee, Chung Yeon ^a   Kwak, Dong Hyun ^a   Kim, Jiwon ^b   Kim, Jeonghee ^b   Zhang, Byoung Tak ^a  

^a Seoul National University   (South Korea)

^b NAVER LABS EUROPE   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ANTHROPOMORPHIC ROBOTS; ARTIFICIAL INTELLIGENCE; INTELLIGENT ROBOTS; INTELLIGENT SYSTEMS; LEARNING ALGORITHMS; MEMORY ARCHITECTURE; SOCIAL SCIENCES; WEARABLE SENSORS;

AUTONOMOUS HUMANOID ROBOTS; DIGITAL ASSISTANTS; GLOBAL PATTERNS; HUMAN BEHAVIORS; LIFE LONG LEARNING; ONLINE LEARNING ALGORITHMS; REAL LIFE DATASETS; WEIGHT TRANSFER;

BEHAVIORAL RESEARCH;

EID: 85006173402     PISSN: 10450823     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (24)

1. Tianqi Chen, Ian Goodfellow, and Jonathon Shlens. Net2net: Accelerating learning via knowledge transfer. arXiv preprint arXiv: 1511. 05641, 2015.
2. Jeff Donahue, Yangqing Jia, Oriol Vinyals, Judy Hoffman, Ning Zhang, Eric Tzeng, and Trevor Darrell. Decaf: A deep convolutional activation feature for generic visual recognition. In Proeedings of the 31th International Conference on Machine Learning, pages 647-655, 2014.
3. Tony Finch. Incremental calculation of weighted mean and variance. University of Cambridge, 2009.
4. Ian J Goodfellow, Mehdi Mirza, Da Xiao, Aaron Courville, and Yoshua Bengio. An empirical investigation of catastrophic forgetting in gradientbased neural networks. arXiv preprint arXiv: 1312. 6211, 2013.
5. Jung-Woo Ha, Kyung-Min Kim, and Byoung-Tak Zhang. Automated construction of visuallinguistic knowledge via concept learning from cartoon videos. In Proceedings of the 29th AAAI Conference on Artificial Intelligence, pages 522-528, 2015.
6. Georg Heigold, Vincent Vanhoucke, Alan Senior, Patrick Nguyen, Marc'Aurelio Ranzato, Matthieu Devin, and Jeffrey Dean. Multilingual acoustic models using distributed deep neural networks. In IEEE International Conference on Acoustics, Speech and Signal Processing, pages 8619-8623, 2013.
7. Seunghoon Hong, Tackgeun You, Suha Kwak, and Bohyung Han. Online tracking by learning discriminative saliency map with convolutional neural network. In Proeedings of the 32th International Conference on Machine Learning, pages 597-606, 2015.
8. Tâm Huynh, Mario Fritz, and Bernt Schiele. Discovery of activity patterns using topic models. In Proceedings of the 10th International Conference on Ubiquitous Computing, pages 10-19, 2008.
9. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. Imagenet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems, pages 1097-1105, 2012.
10. Min Lin, Qiang Chen, and Shuicheng Yan. Network in network. In International Conference on Learning Representations, 2014.
11. Roderick JA Little. Regression with missing x's: a review. Journal of the American Statistical Association, 87(420): 1227-1237, 1992.
12. Xinwang Liu, Guomin Zhang, Yubin Zhan, and En Zhu. An incremental feature learning algorithm based on least square support vector machine. In Proceedings of the 2nd annual international workshop on Frontiers in Algorithmics, pages 330-338, 2008.
13. Hyeonseob Nam and Bohyung Han. Learning multi-domain convolutional neural networks for visual tracking. arXiv preprint arXiv: 1510. 07945, 2015.
14. Nikunj C Oza. Online bagging and boosting. In Systems, Man and Cybernetics, IEEE International Conference On, pages 2340-2345, 2005.
15. Robi Polikar, Lalita Upda, Satish S Upda, and Vasant Honavar. Learn++: An incremental learning algorithm for supervised neural networks. IEEE Transactions on Systems, Man, and Cybernetics Part C: Applications and Reviews, 31(4): 497-508, 2001.
16. Paul L Ruvolo and Eric Eaton. Ella: An efficient lifelong learning algorithm. In Proeedings of the 30th International Conference on Machine Learning, pages 507-515, 2013.
17. Sebastian Thrun and Joseph O'Sullivan. Discovering structure in multiple learning tasks: The tc algorithm. In Proeedings of the 13th International Conference on Machine Learning, pages 489-497, 1996.
18. Andrea Vedaldi and Karel Lenc. Matconvnet-convolutional neural networks for matlab. In Proceedings of the ACM International Conference on Multimedia, pages 689-692, 2015.
19. Jason Yosinski, Jeff Clune, Yoshua Bengio, and Hod Lipson. How transferable are features in deep neural networks In Advances in Neural Information Processing Systems, pages 3320-3328, 2014.
20. Matthew D Zeiler and Rob Fergus. Visualizing and understanding convolutional networks. In Proceedings of European Conference on Computer Vision, pages 818-833, 2014.
21. Byoung-Tak Zhang, Jung-Woo Ha, and Myunggu Kang. Sparse population code models of word learning in concept drift. In Proceedings of the 34th Annual Conference of Cogitive Science Society, pages 1221-1226, 2012.
22. Byoung-Tak Zhang. Information-theoretic objective functions for lifelong learning. In AAAI Spring Symposium on Lifelong Machine Learning, 2013.
23. Guanyu Zhou, Kihyuk Sohn, and Honglak Lee. Online incremental feature learning with denoising autoencoders. In International Conference on Artificial Intelligence and Statistics, pages 1453-1461, 2012.
24. Martin Zinkevich. Online convex programming and generalized infinitesimal gradient ascent. In Proeedings of the 20th International Conference on Machine Learning, pages 928-936, 2003.