Dual-memory neural networks for modeling cognitive activities of humans via wearable sensors

Neural Networks

Volumn 92, Issue , 2017, Pages 17-28

  Lee, Sang Woo ^a   Lee, Chung Yeon ^a   Kwak, Dong Hyun ^a   Ha, Jung Woo ^b   Kim, Jeonghee ^b   Zhang, Byoung Tak ^a,c  

^a Seoul National University   (South Korea)

^b NAVER LABS EUROPE   (France)

^c Surromind Robotics   (South Korea)

Author keywords

Complementary learning systems; Deep neural networks; Dual memory architecture; Hypernetworks; Lifelog dataset; Online learning

Indexed keywords

DEEP LEARNING; DEEP NEURAL NETWORKS; E-LEARNING; GLASS; INTELLIGENT AGENTS; KNOWLEDGE REPRESENTATION; LEARNING SYSTEMS; MEMORY ARCHITECTURE; NETWORK ARCHITECTURE; ONLINE SYSTEMS; WEARABLE TECHNOLOGY;

CATASTROPHIC FORGETTING; CATASTROPHIC FORGETTING PROBLEM; COMPLEMENTARY LEARNING; HYPERNETWORKS; LEARNING NEURAL NETWORKS; LIFE LOG; ON-LINE LEARNING METHODS; ONLINE LEARNING;

WEARABLE SENSORS;

ARTICLE; ARTIFICIAL NEURAL NETWORK; COGNITION; CONTROLLED STUDY; DEEP NEURAL NETWORK; DUAL MEMORY NEURAL NETWORK; HIPPOCAMPUS; INTERMETHOD COMPARISON; KERNEL METHOD; LEARNING; MACHINE LEARNING; MATHEMATICAL MODEL; NEOCORTEX; PRIORITY JOURNAL; SENSOR; BIOLOGICAL MODEL; BRAIN; HUMAN; MICROCOMPUTER; PHYSIOLOGY;

BRAIN; COGNITION; HUMANS; MICROCOMPUTERS; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER);

EID: 85014999216     PISSN: 08936080     EISSN: 18792782     Source Type: Journal    
DOI: 10.1016/j.neunet.2017.02.008     Document Type: Article

References (58)

1. Bendor, D., Wilson, M.A., Biasing the content of hippocampal replay during sleep. Nature Neuroscience 15 (2012), 1439–1444.
2. Bettadapura, V., Essa, I., & Pantofaru, C. (2015). Egocentric field-of-view localization using first-person point-of-view devices. In IEEE winter conference on applications of computer vision (pp. 626–633).
3. Blundell, C., Uria, B., Pritzel, A., Li, Y., Ruderman, A., Leibo, J.Z., Rae, J., Wierstra, D., & Hassabis, D. (2016). Model-free episodic control. arXiv preprint arXiv:1606.04460.
4. Bottou, L., Online learning and stochastic approximations. On-line learning in neural networks, 1998, Cambridge University Press, 9–42 (Chapter 2).
5. Bottou, L., Stochastic gradient descent tricks. Neural networks: Tricks of the trade, 2012, Springer, 421–436.
6. Carlson, A., Betteridge, J., Kisiel, B., Settles, B., Hruschka, E.R., & Mitchell, T.M. (2010). Toward an architecture for never-ending language learning. In Proceedings of the Twenty-Fourth AAAI conference on artificial intelligence (pp. 1306–1313).
7. Carr, M.F., Jadhav, S.P., Frank, L.M., Hippocampal replay in the awake state: a potential substrate for memory consolidation and retrieval. Nature Neuroscience 14 (2011), 147–153.
8. Chen, T., Goodfellow, I., & Shlens, J. (2016). Net2net: Accelerating learning via knowledge transfer. In International conference on learning representations.
9. Chen, X., Shrivastava, A., & Gupta, A. (2013). Neil: Extracting visual knowledge from web data. In Proceedings of the IEEE international conference on computer vision (pp. 1409–1416).
10. Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., & Darrell, T. (2014). Decaf: A deep convolutional activation feature for generic visual recognition. In Proceedings of the 31th international conference on machine learning (pp. 647–655).
11. Doshi, J., Kira, Z., & Wagner, A. (2015). From deep learning to episodic memories: Creating categories of visual experiences. In Proceedings of the third annual conference on advances in cognitive systems ACS.
12. Duchi, J., Hazan, E., Singer, Y., Adaptive subgradient methods for online learning and stochastic optimization. Journal of Machine Learning Research 12 (2011), 2121–2159.
13. Fei-Fei, L., Fergus, R., Perona, P., One-shot learning of object categories. IEEE Transactions on Pattern Analysis and Machine Intelligence 28 (2006), 594–611.
14. Goodfellow, I.J., Mirza, M., Xiao, D., Courville, A., & Bengio, Y. (2013). An empirical investigation of catastrophic forgetting in gradient-based neural networks. arXiv preprint arXiv:1312.6211.
15. Graves, A., Mohamed, A.-r., & Hinton, G. (2013). Speech recognition with deep recurrent neural networks. In IEEE international conference on acoustics, speech and signal processing (pp. 6645–6649).
16. Graves, A., Wayne, G., & Danihelka, I. (2014). Neural turing machines. arXiv preprint arXiv:1410.5401.
17. Guyonneau, R., VanRullen, R., Thorpe, S.J., Temporal codes and sparse representations: a key to understanding rapid processing in the visual system. Journal of Physiology-Paris 98 (2004), 487–497.
18. Ha, J.-W., Kim, K.-M., & Zhang, B.-T. (2015). Automated construction of visual-linguistic knowledge via concept learning from cartoon videos. In Proceedings of the 29th AAAI conference on artificial intelligence (pp. 522–528).
19. He, K., Zhang, X., Ren, S., & Sun, J. (2015). Deep residual learning for image recognition. arXiv preprint arXiv:1512.03385.
20. Heigold, G., Vanhoucke, V., Senior, A., Nguyen, P., Ranzato, M., Devin, M., & Dean, J. (2013). Multilingual acoustic models using distributed deep neural networks. In IEEE international conference on acoustics, speech and signal processing (pp. 8619–8623).
21. Hong, S., You, T., Kwak, S., & Han, B. (2015). Online tracking by learning discriminative saliency map with convolutional neural network. In Proceedings of the 32th international conference on machine learning (pp. 597–606).
22. Kim, Y.-D., Jang, T., Han, B., & Choi, S. (2016). Learning to select pre-trained deep representations with Bayesian evidence framework. In Proceedings of the IEEE international conference on computer vision (pp. 5318–5326).
23. Kim, J.-H., Lee, S.-W., Kwak, D.-H., Heo, M.-O., Kim, J., Ha, J.-W., & Zhang, B.-T. (2016). Multimodal residual learning for visual qa. arXiv preprint arXiv:1606.01455.
24. Knierim, J.J., Neunuebel, J.P., Tracking the flow of hippocampal computation: Pattern separation, pattern completion, and attractor dynamics. Neurobiology of Learning and Memory 129 (2016), 38–49.
25. Krizhevsky, A., Sutskever, I., & Hinton, G.E. (2012). Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems (pp. 1097–1105).
26. Kumaran, D., Hassabis, D., McClelland, J.L., What learning systems do intelligent agents need? complementary learning systems theory updated. Trends in Cognitive Sciences 20 (2016), 512–534.
27. Lee, S.-W., Lee, C.-Y., Kwak, D.H., Kim, J., Kim, J., & Zhang, B.-T. (2016). Dual-memory deep learning architectures for lifelong learning of everyday human behaviors. In Proceedings of the international joint conference on artificial intelligence (pp. 1669–1675).
28. Lin, M., Chen, Q., & Yan, S. (2014). Network in network. In International conference on learning representations.
29. Little, R.J., Regression with missing x's: a review. Journal of the American Statistical Association 87 (1992), 1227–1237.
30. Liu, X., Zhang, G., Zhan, Y., & Zhu, E. (2008). An incremental feature learning algorithm based on least square support vector machine. In Proceedings of the 2nd annual international workshop on frontiers in algorithmics (pp. 330–338).
31. McClelland, J.L., McNaughton, B.L., O'Reilly, R.C., Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. Psychological Review, 102, 1995, 419.
32. Mitchell, T., Cohen, W., Hruschka, E., Talukdar, P., Betteridge, J., Carlson, A., Dalvi, B., Gardner, M., Kisiel, B., & Krishnamurthy, J. et al. (2015). Never-ending learning. In Proceedings of the Twenty-Ninth AAAI conference on artificial intelligence (pp. 2302–2310).
33. Nam, H., & Han, B. (2016). Learning multi-domain convolutional neural networks for visual tracking. In Proceedings of the IEEE international conference on computer vision (pp. 4293–4302).
34. Noh, H., Hong, S., & Han, B. (2015). Learning deconvolution network for semantic segmentation. In Proceedings of the IEEE international conference on computer vision (pp. 1520–1528).
35. O'Reilly, R.C., Bhattacharyya, R., Howard, M.D., Ketz, N., Complementary learning systems. Cognitive Science 38 (2014), 1229–1248.
36. Oza, N.C. (2005). Online bagging and boosting. In IEEE international conference on systems, man and cybernetics (pp. 2340–2345).
37. Polikar, R., Upda, L., Upda, S.S., Honavar, V., Learn++: An incremental learning algorithm for supervised neural networks. IEEE Transactions on Systems, Man, and Cybernetics Part C: Applications and Reviews 31 (2001), 497–508.
38. Ruvolo, P.L., & Eaton, E. (2013). Ella: An efficient lifelong learning algorithm. In Proceedings of the 30th international conference on machine learning (pp. 507–515).
39. Sainath, T.N., Vinyals, O., Senior, A., & Sak, H. (2015). Convolutional, long short-term memory, fully connected deep neural networks. In IEEE international conference on acoustics, speech and signal processing (pp. 4580–4584).
40. Simonyan, K., Zisserman, A., Two-stream convolutional networks for action recognition in videos. Advances in neural information processing systems, 2014, 568–576.
41. Snoek, J., Rippel, O., Swersky, K., Kiros, R., Satish, N., Sundaram, N., Patwary, M., Prabhat, M., & Adams, R. (2015). Scalable Bayesian optimization using deep neural networks. In Proceedings of the 32nd international conference on machine learning (pp. 2171–2180).
42. Sukhbaatar, S., Weston, J., Fergus, R., et al. End-to-end memory networks. Advances in neural information processing systems, 2015, 2440–2448.
43. Sundermeyer, M., Schlüter, R., & Ney, H. (2012). Lstm neural networks for language modeling. In Interspeech (pp. 194–197).
44. Sutskever, I., Vinyals, O., & Le, Q.V. (2014). Sequence to sequence learning with neural networks. In Advances in neural information processing systems (pp. 3104–3112).
45. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015). Going deeper with convolutions. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1–9).
46. Thrun, S., & O'Sullivan, J. (1996). Discovering structure in multiple learning tasks: The tc algorithm. In Proceedings of the 13th international conference on machine learning (pp. 489–497).
47. Treves, A., Rolls, E.T., Computational constraints suggest the need for two distinct input systems to the hippocampal ca3 network. Hippocampus 2 (1992), 189–199.
48. Vedaldi, A., & Lenc, K. (2015). Matconvnet–convolutional neural networks for matlab. In Proceedings of the ACM international conference on multimedia (pp. 689–692).
49. Wei, T., Wang, C., Rui, R., & Chen, C.W. (2016). Network morphism. In Proceedings of the 33th international conference on machine learning.
50. Weston, J., Chopra, S., & Bordes, A. (2014). Memory networks. In International conference on learning representations.
51. Yamins, D.L., Hong, H., Cadieu, C.F., Solomon, E.A., Seibert, D., DiCarlo, J.J., Performance-optimized hierarchical models predict neural responses in higher visual cortex. Proceedings of the National Academy of Sciences 111 (2014), 8619–8624.
52. Yosinski, J., Clune, J., Bengio, Y., & Lipson, H. (2014). How transferable are features in deep neural networks? In Advances in neural information processing systems (pp. 3320–3328).
53. Yu, H., Wang, J., Huang, Z., Yang, Y., & Xu, W. (2015). Video paragraph captioning using hierarchical recurrent neural networks. arXiv preprint arXiv:1510.07712.
54. Zeiler, M.D., & Fergus, R. (2014). Visualizing and understanding convolutional networks. In Proceedings of European conference on computer vision (pp. 818–833).
55. Zhang, B.-T., Hypernetworks: A molecular evolutionary architecture for cognitive learning and memory. IEEE Computational Intelligence Magazine 3 (2008), 49–63.
56. Zhang, B.-T., Ha, J.-W., & Kang, M. (2012). Sparse population code models of word learning in concept drift. In Proceedings of the 34th annual conference of cogitive science society (pp. 1221–1226).
57. Zhou, G., Sohn, K., & Lee, H. (2012). Online incremental feature learning with denoising autoencoders. In International conference on artificial intelligence and statistics (pp. 1453–1461).
58. Zinkevich, M. (2003). Online convex programming and generalized infinitesimal gradient ascent. In Proceedings of the 20th international conference on machine learning (pp. 928–936).