Continual lifelong learning with neural networks: A review

Neural Networks

Volumn 113, Issue , 2019, Pages 54-71

  Parisi, German I ^a   Kemker, Ronald ^b   Part, Jose L ^c   Kanan, Christopher ^b   Wermter, Stefan ^a  

^a UNIVERSITY OF HAMBURG   (Germany)

^b ROCHESTER INSTITUTE OF TECHNOLOGY   (United States)

^c HERIOT WATT UNIVERSITY   (United Kingdom)

Author keywords

Catastrophic forgetting; Continual learning; Developmental systems; Lifelong learning; Memory consolidation

Indexed keywords

AUTONOMOUS AGENTS;

CATASTROPHIC FORGETTING; CONTINUAL LEARNING; DEVELOPMENTAL SYSTEMS; LIFE LONG LEARNING; MEMORY CONSOLIDATION;

DEEP NEURAL NETWORKS;

BIOLOGY; CURRICULUM; HUMAN; LIFELONG LEARNING; MACHINE LEARNING; MEMORY CONSOLIDATION; MOTIVATION; PLASTICITY; REVIEW; ROBOTICS; TRANSFER OF LEARNING; ANIMAL; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; MEMORY; PROCEDURES; TRENDS;

ANIMALS; HUMANS; MACHINE LEARNING; MEMORY; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, AUTOMATED;

EID: 85061575306     PISSN: 08936080     EISSN: 18792782     Source Type: Journal    
DOI: 10.1016/j.neunet.2019.01.012     Document Type: Review

References (196)

1. Abbott, L.F., Nelson, S.B., Synaptic plasticity: taming the beast. Nature Neuroscience 3 (2000), 1178–1183.
2. Abraham, W.C., Robins, A., Memory retention and weight plasticity in ANN simulations. Trends in Neurosciences 28:2 (2005), 73–78.
3. Achille, A., Rovere, M., & Soatto, S. (2017). Critical Learning Periods in Deep Neural Networks,.
4. Adams, R.A., Friston, K.J., Bastos, A.M., Active inference, predictive coding and cortical architecture. Casanova, M.F., Opris, I., (eds.) Recent advances on the modular organization of the cortex, 2015, Springer Netherlands.
5. Aimone, J.B., Wiles, J., Gage, F.H., Potential role for adult neurogenesis in the encoding of time in new memories. Nature Neuroscience 9 (2006), 723–727.
6. Aimone, J.B., Wiles, J., Gage, F.H., Computational influence of adult neurogenesis on memory encoding. Neuron 61 (2009), 187–202.
7. Altman, J., Autoradiographic investigation of cell proliferation in the brains of rats and cats. The Anatomical Record 145:4 (1963), 573–591.
8. Aström, K.J., Murray, R.M., Feedback systems: An introduction for scientists and engineers. 2010, Princeton University Press.
9. Baldassarre, G., Mirolli, M., Intrinsically motivated learning in natural and artificial systems. 2013, Springer-Verlag, Berlin.
10. Baranes, A., Oudeyer, P.Y., Active learning of inverse models with intrinsically motivated goal exploration in robots. Robotics and Autonomous Systems 61:1 (2013), 49–73.
11. Barnett, S., Ceci, S., When and where do we apply what we learn? a taxonomy for far transfer. Psychological Bulletin 128 (2002), 612–637.
12. Barros, P., Parisi, G.I., Fu, D., Liu, X., Wermter, S., Expectation learning for adaptive crossmodal stimuli association. EUCog Meeting Proceedings, 2017.
13. Barto, A., Intrinsic motivation and reinforcement learning. Baldassarre, G., Mirolli, M., (eds.) Intrinsically motivated learning in natural and artificial systems, 2013, Springer, 17–47.
14. Bellemare, M., Srinivasan, S., Ostrovski, G., Schaul, T., Saxton, D., Munos, R., Unifying count-based exploration and intrinsic motivation. NIPS'16, 2016.
15. Bengio, Y., Louradour, J., Collobert, R., Weston, J., Curriculum learning. ICML'09, 2009, 41–48.
16. Benna, M.K., Fusi, S., Computational principles of synaptic memory consolidation. Nature Neuroscience 19:12 (2016), 1697–1708.
17. Bienenstock, E., Cooper, L., Munro, P., Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex. The Journal of Neuroscience 2 (1982), 32–48.
18. Boldrini, M., Fulmore, C., Tartt, A., Simeon, L., Pavlova, I.e.a., Human hippocampal neurogenesis persists throughout aging. Cell Stem Cell 22:4 (2018), 589–599.
19. Bontempi, B., Laurent-Demir, C., Destrade, C., Jaffard, R., Time-dependent reorganization of brain circuitry underlying long-term memory storage. Nature 400 (1999), 671–675.
20. Braun, C., Heinz, U., Schweizer, R., Weich, K., Birbaumer, N., Topka, H., Dynamic organization of the somato-sensory cortex induced by motor activity. Brain 124 (2001), 2259–2267.
21. Bremner, A., Lewkowicz, D., Spence, C., Multisensory development. 2012, Oxford University Press, Oxford, UK.
22. Burgess, N., Shapiro, J.L., Moore, M.A., Neural network models of list learning. Networks 2 (1991), 399–422.
23. Calvert, G., Spence, C., Stein, B., The handbook of multisensory processes. 2004, Cambridge, MA: The MIT Press.
24. Cameron, H.A., Woolley, C.S., McEwen, B.S., Gould, E., Differentiation of newly born neurons and glia in the dentate gyrus of the adult rat. Neuroscience 56:2 (1993), 337–344.
25. Cangelosi, A., Schlesinger, M., Developmental robotics: From babies to robots. 2015, MIT Press.
26. Chen, Y.C., Spence, C., Assessing the role of the unity assumption on multisensory integration: a review. Frontiers in Psychology, 8(445), 2017.
27. Cichon, J., Gan, W., Branch-specific dendritic Ca(2+) spikes cause persistent synaptic plasticity. Nature 520 (2015), 180–185.
28. Coop, R., Mishtal, A., Arel, I., Ensemble learning in fixed expansion layer networks for mitigating catastrophic forgetting. IEEE Transactions on Neural Networks & Learning Systems 24:10 (2013), 1623–1634.
29. Cortes, C., Gonzalvo, X., Kuznetsov, V., Mohri, M., & Yang, S. (2016). AdaNet: Adaptive structural learning of artificial neural networks,.
30. Dai, W., Yang, Q., Xue, G.R., Yu, Y., Boosting for transfer learning. ICML'17, 2007, 193–200.
31. Davis, G.W., Homeostatic control of neural activity: from phenomenology to molecular design. Annual Review of Neuroscience 29 (2006), 307–323.
32. Deng, W., Aimone, J.B., Gage, F.H., New neurons and new memories: how does adult hippocampal neurogenesis affect learning and memory?. Nature Reviews Neuroscience 11:5 (2010), 339–350.
33. Ditzler, G., Roveri, M., Alippi, C., Polikar, R., Learning in nonstationary environments: A survey. IEEE Computational Intelligence Magazine 10:4 (2015), 12–25.
34. Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., et al. Decaf: A deep convolutional activation feature for generic visual recognition. ICML'14, 2014.
35. Douglas, R.J., Koch, C., Mahowald, M., Martin, K.A., Suarez, H.H., Recurrent excitation in neocortical circuits. Science 269 (1995), 981–985.
36. Doumas, L., Hummel, J., Sandhofer, C., A theory of the discovery and predication of relational concepts. Psychological Review 115 (2008), 1–43.
37. Draelos, T.J., Miner, N.E., Lamb, C.C., Vineyard, C.M., Carlson, K.D., James, C.D., et al. Neurogenesis deep learning. IJCNN'17, 2017, 526–533.
38. Elfaramawy, N., Barros, P., Parisi, G.I., Wermter, S., Emotion recognition from body expressions with a neural network architecture. Proceedings of the international conference on human agent interaction (HAI'17), 2017, 143–149.
39. Elman, J.L., Learning and development in neural networks: The importance of starting small. Cognition 48:1 (1993), 71–99.
40. Eriksson, P.S., Perfilieva, E., Bjork-Eriksson, T., Alborn, A.M., Nordborg, C., Peterson, D.A., et al. Neurogenesis in the adult human hippocampus. Nature medicine 4:11 (1998), 1313–1317.
41. Ernst, M.O., Bülthoff, H., Merging the senses into a robust percept. Trends in Cognitive Sciences 8:4 (2004), 162–169.
42. Fei-Fei, L., Fergus, R., Perona, P., A Bayesian approach to unsupervised one-shot learning of object categories. ICCV'03, 2003.
43. Fernando, C., Banarse, D., Blundell, C., Zwols, Y., Ha, D., & Rusu, A. A., et al. (2017). Pathnet: Evolution channels gradient descent in super neural networks,.
44. Forestier, S., Mollard, Y., & Oudeyer, P. Y. (2017). Intrinsically Motivated Goal Exploration Processes with Automatic Curriculum Learning,.
45. Forestier, S., Oudeyer, P.Y., Curiosity-driven development of tool use precursors: a computational model. Proceedings of the annual conference of the cognitive science society, 2016.
46. French, R.M., Pseudo-recurrent connectionist networks: An approach to the sensitivity-stability dilemma. Connection Science 9:4 (1997), 353–380.
47. French, R.M., CaTastrophic forgetting in connectionist networks. Trends in Cognitive Sciences 3:4 (1999), 128–135.
48. Friston, K., Rigoli, F., Ognibene, D., Mathys, D., Fitzgerald, T., Pezzulo, G., Active inference and epistemic value. Cognitive neuroscience 6 (2015), 187–214.
49. Fritzke, B., A growing neural gas network learns topologies. NIPS'95, vol. 7, 1992, 625–632.
50. Fusi, S., Drew, P.J., Abbott, L.F., CaScade models of synaptically stored memories. Neuron 45:4 (2005), 599–611.
51. Gage, F.H., Mammalian neural stem cells. Science 287 (2000), 1433–1438.
52. Gais, S., Albouy, G., Boly, M., Dang-Vu, T.T., Darsaud, A., Desseilles, M., et al. Sleep transforms the cerebral trace of declarative memories. Proceedings of the National Academy of Sciences 104:47 (2007), 18778–18783.
53. Gelbard-Sagiv, H., Mukamel, R., Harel, M., Malach, R., Fried, I., Internally generated reactivation of single neurons in human hippocampus during free recall. Science 322 (2008), 96–101.
54. Gemmeke, J.F., Ellis, D.P.W., Freedman, D., Jansen, A., Lawrence, W., Moore, R.C., et al. Audio set: An ontology and human-labeled dataset for audio events. ICASSP'17, 2017.
55. Gepperth, A., Karaoguz, C., A bio-inspired incremental learning architecture for applied perceptual problems. Cognitive Computation 8:5 (2015), 924–934.
56. Goodfellow, I. J., Mirza, M., Xiao, D., Courville, A., & Bengio, Y. (2013). An empirical investigation of catastrophic forgetting in gradient-based neural networks,.
57. Gopnik, A., Meltzoff, A.N., Kuhl, P.K., The scientist in the crib: Minds, brains, and how children learn. 1999, William Morrow & Co.
58. Gorelick, L., Blank, M., Shechtman, E., Irani, M., Basri, R., Actions as space-time shapes. ICCV'05, 2005, 1395–1402.
59. Gottlieb, J., Oudeyer, P.Y., Lopes, M., Baranes, A., Information seeking, curiosity and attention: Computational and neural mechanisms. Trends in Cognitive Science 17:11 (2013), 585–596.
60. Grant, W.S., Tanner, J., Itti, L., Biologically plausible learning in neural networks with modulatory feedback. Neural Networks 88 (2017), 32–48.
61. Graves, A., Bellemare, M. G., Menick, J., Munos, R., & Kavukcuoglu, K. (2017). Automated curriculum learning for neural networks,.
62. Graves, A., Wayne, G., Reynolds, M., Harley, T., Danihelka, I., Grabska-Barwinska, A., et al. Hybrid computing using a neural network with dynamic external memory. Nature 538 (2016), 471–476.
63. Grossberg, S., How does a brain build a cognitive code?. Psychology Review 87 (1980), 1–51.
64. Grossberg, S., Adaptive resonance theory: how a brain learns to consciously attend, learn, and recognize a changing world. Neural Networks 37 (2012), 1–41.
65. Guo, Y., Liu, Y., Oerlemans, A., Lao, S., Wu, S., Lew, M., Deep learning for visual understanding: A review. Neurocomputing 187:8 (2016), 27–48.
66. Hassabis, D., Kumaran, D., Summerfield, C., Botvinick, M., Neuroscience-inspired artificial intelligence. Neuron Review 95:2 (2017), 245–258.
67. Hasson, U., Yang, E., Vallines, I., Heeger, D.J., Rubin, N., A hierarchy of temporal receptive windows in human cortex. The Journal of Neuroscience 28:10 (2008), 2539–2550.
68. Hebb, D., The organization of behavior. 1949, John Wiley & Sons.
69. Heeger, D.J., Theory of cortical function. Proceedings of the National Academy of Sciences of the United States of America 114:8 (2017), 1773–1782.
70. Hensch, T., Critical period regulation. Annual Review of Neuroscience 27 (2004), 549–579.
71. Hensch, T.K., Fagiolini, M., Mataga, N., Stryker, M.P., Baekkeskov, S., Kash, S.F., Local gaba circuit control of experience-dependent plasticity in developing visual cortex. Science 282 (1998), 1504–1508.
72. Hertz, J., Krogh, A., Palmer, R.G., Introduction to the theory of neural computation. 1991, Redwood City CA: Addison-Wesley.
73. Hinton, G.E., Plaut, D.C., Using fast weights to deblur old memories. Proceedings of the annual conference of the cognitive science society, 1987, 177–186.
74. Hinton, G., Vinyals, O., Dean, J., Distilling the knowledge in a neural network. NIPS'14, workshop on deep learning and representation, 2014.
75. Hirsch, H., Spinelli, D., Visual experience modifies distribution of horizontally and vertically oriented receptive fields in cats. Science 168 (1970), 869–871.
76. Holyoak, K., Thagard, P., The analogical mind. American Psychologist 52 (1997), 35–44.
77. Hubel, D.H., Wiesel, T.H., Receptive fields, binocular and functional architecture in the cats visual cortex. Journal Physiology 160 (1962), 106–154.
78. Hubel, D.H., Wiesel, T.H., Cortical and callosal connections concerned with the vertical meridian of visual fields in the cat. Journal of Neurophysiology 30 (1967), 1561–1573.
79. Hubel, D.H., Wiesel, T.H., The period of susceptibility to the psychological effects of unilateral eye closure in kittens. Journal Physiology 206 (1970), 419–436.
80. Hubel, D.H., Wiesel, T.H., LeVay, S., Plasticity of ocular dominance columns in monkey striate cortex. Philosophical Transactions of the Royal Society of London, Series B: Biological Sciences 278 (1977), 377–409.
81. Jung, H., Ju, J., Jung, M., Kim, J., Less-forgetting learning in deep neural networks., 2018, AAAI'18, New Orleans, LA.
82. Kamra, N., Gupta, U., & Liu, Y. (2018). Deep Generative Dual Memory Network for Continual Learning,.
83. Kemker, R., Kanan, C., Fearnet: Brain-inspired model for incremental learning. ICLR'18, 2018.
84. Kemker, R., McClure, M., Abitino, A., Hayes, T., Kanan, C., Measuring catastrophic forgetting in neural networks. AAAI'18, 2018.
85. Kirkpatrick, J., Pascanu, R., Rabinowitz, N., Veness, J., Desjardins, G., Rusu, A.A., et al. Overcoming catastrophic forgetting in neural networks. Proceedings of the National Academy of Sciences 114:13 (2017), 3521–3526.
86. Kitamura, T., Ogawa, S.K., Roy, D.S., Okuyama, T., Morrissey, M.D., Smith, L.M., et al. Engrams and circuits crucial for systems consolidation of a memory. Science 356 (2017), 73–78.
87. Kiyota, T., Neurogenesis and brain repair. 2017, Neuroimmune Pharmacology. Springer, 575–597.
88. Knoblauch, A., Impact of structural plasticity on memory formation and decline. van Ooyen, A., Butz, M., (eds.) Rewiring the brain: A computational approach to structural plasticity in the adult brain, 2017, Elsevier, Academic Press, 361–386.
89. Knoblauch, A., Körner, E., Krner, U., Sommer, F.T., Structural plasticity has high memory capacity and can explain graded amnesia, catastrophic forgetting, and the spacing effect. PLoS ONE, 9:e96485, 2014.
90. Kohonen, T., Self-organized formation of topologically correct feature maps. Biological Cybernetics 43 (1982), 59–69.
91. Kohonen, T., Self-organizing maps. 1995, New York: Springer.
92. Krizhevsky, A., Learning multiple layers of features from tiny images. (Master's thesis), 2009, University of Toronto.
93. Krueger, K.A., Dayan, P., Flexible shaping: how learning in small steps helps. Cognition 110 (2009), 380–394.
94. Kulkarni, T., Narasimhan, K., Saeedi, A., & Tenenbaum, J. (2016). Hierarchical deep reinforcement learning: integrating temporal abstraction and intrinsic motivation,.
95. Kumaran, D., Hassabis, D., McClelland, J.L., What learning systems do intelligent agents need? Complementary learning systems theory updated. Trends in Cognitive Sciences 20:7 (2016), 512–534.
96. Kumaran, D., McClelland, J.L., Generalization through the recurrent interaction of episodic memories: a model of the hippocampal system. Psychological Review 119 (2012), 573–616.
97. Lambon Ralph, M., Ehsan, S., Age of acquisition effects depend on the mapping between representations and the frequency of occurrence: empirical and computational evidence. Visual Cognition 13:7–8 (2006), 928–948.
98. Lampert, C., Nickisch, H., Harmeling, S., Learning to detect unseen object classes by between-class attribute transfer. CVPR'09, 2009.
99. LeCun, Y., Bengio, Y., Hinton, G., Deep learning. Nature 521 (2015), 436–444.
100. LeCun, Y., Bottou, L., Bengio, Y., Haffner, P., Gradient-based learning applied to document recognition. In Proceedings of the IEEE, 1998.
101. Lenneberg, E., Biological foundations of language. 1967, New York: Wiley.
102. Lewandowsky, S., Li, S., CaTastrophic interference in neural networks: Causes, solutions, and data. Dempster, F.N., Brainerd, C., (eds.) New perspectives on interference and inhibition in cognition, 1994, Academic Press, New York.
103. Lewkowicz, D.J., Early experience & multisensory perceptual narrowing. Developmental Psychobiology 56:2 (2014), 292–315.
104. Li, P., Farkas, I., McWhinney, B., Early lexical development in a self-organising neural network. Neural Networks 17 (2004), 1345–1362.
105. Li, Z., Hoiem, D., Learning without forgetting., 2016, ECCV'16, Amsterdam, The Netherlands, 614–629.
106. Lomonaco, V., Maltoni, D., Core50: A new dataset and benchmark for continuous object recognition. CoRL, 2017.
107. Lopez-Paz, D., Ranzato, M., Gradient episodic memory for continual learning. NIPS'17, 2017.
108. Lüders, B., Schläger, M., Risi, S., Continual learning through evolvable neural turing machines. NIPS'16, workshop on continual learning and deep networks, 2016.
109. Maltoni, D., & Lomonaco, V. (2018). Continuous Learning in Single-Incremental-Task Scenarios.,.
110. Marchman, V.A., Constraints on plasticity in a connectionist model of english past tense. Journal of Cognitive Neuroscience 5:2 (1993), 215–234.
111. Mareschal, D., Johnson, M., Sirios, S., Spratling, M., Thomas, M., Westermann, G., Neuroconstructivism: How the brain constructs cognition. 2007, Oxford: Oxford University Press.
112. Marsland, S., Shapiro, J., Nehmzow, U., A self-organising network that grows when required. Neural Networks 15:8–9 (2002), 1041–1058.
113. Martinetz, T., Berkovich, S., Schulten, K., Neural-gas network for vector quantization and its application to time-series prediction. IEEE Transactions on Neural Networks 4:4 (1993), 558–569.
114. McClelland, J.L., McNaughton, B.L., O'Reilly, R.C., Why there are complementary learning systems in the hippocampus and neocortex: Insights from the successes and failures of connectionist models of learning and memory. Psychological Review 102 (1995), 419–457.
115. McCloskey, M., Cohen, N.J., CaTastrophic interference in connectionist networks: The sequential learning problem. The Psychology of Learning & Motivation 24 (1989), 104–169.
116. Mermillod, M., Bugaiska, A., Bonin, P., The stability-plasticity dilemma: Investigating the continuum from Catastrophic forgetting to age-limited learning effects. Frontiers in Psychology, 4(504), 2013.
117. Mici, L., Parisi, G. I., & Wermter, S. (2017). An Incremental Self-Organizing Architecture for Sensorimotor Learning and Prediction,.
118. Mici, L., Parisi, G.I., Wermter, S., A self-organizing neural network architecture for learning human-object interactions. Neurocomputing 307 (2018), 14–24.
119. Miikkulainen, R., Dyslexic and category-specific aphasic impairments in a self-organizing feature map model of the lexicon. Brain & Language 59 (1997), 334–366.
120. Miller, K., Keller, J., Stryker, M., Occular dominance column development: Analysis and simulation. Science 245 (1989), 605–615.
121. Miller, K., MacKay, D.J., The role of constraints in hebbian learning. Neural Computation 6 (1994), 100–126.
122. Ming, G.L., Song, H., Adult neurogenesis in the mammalian brain: Significant answers and significant questions. Neuron 70 (2011), 687–702.
123. Moon, S., Kim, S., Wang, H., Multimodal transfer deep learning with applications in audio-visual recognition. NIPS'15, 2015.
124. Murray, M.M., Lewkowicz, D.J., Amedi, A., Wallace, M.T., Multisensory processes: A balancing act across the lifespan. Trends in Neurosciences 39 (2016), 567–579.
125. Nadal, J.P., Toulouse, G., Changeux, J.P., Dehaene, S., Networks of formal neurons and memory palimpsets. Europhysics Letters 1 (1986), 535–543.
126. Nelson, C.A., Neural plasticity and human development: The role of early experience in sculpting memory systems. Developmental Science 3:2 (2000), 115–136.
127. Netzer, Y., Wang, T., Coates, A., Bissacco, A., Wu, B., Ng, A.Y., Reading digits in natural images with unsupervised feature learning. NIPS'11, Workshop on deep learning and unsupervised feature learning, 2011.
128. O'Neill, J., Pleydell-Bouverie, B., Dupret, D., Csicsvari, J., Play it again: Reactivation of waking experience and memory. Trends in Neuroscience 33 (2010), 220–229.
129. O'Reilly, R.C., The division of labor between the neocortex and hippocampus. connectionist modeling in cognitive (neuro-)science. 2004, George Houghton, Ed., Psychology Press.
130. O'Reilly, R.C., Norman, K.A., Hippocampal and neocortical contributions to memory: Advances in the complementary learning systems framework. Trends in Cognitive Sciences 6:12 (2002), 505–510.
131. O'Reilly, R.C., Rudy, J.W., Computational principles of learning in the neocortex and hippocampus. Hippocampus 10 (2000), 389–397.
132. Oudeyer, P.Y., Kaplan, F., Hafner, V., Intrinsic motivation systems for autonomous mental development. IEEE Transactions on Evolutionary Computation 11:2 (2007), 265–286.
133. Palatucci, M., Pomerleau, D.A., Hinton, G.E., Mitchell, T., Zero-shot learning with semantic output codes. NIPS'09, 2009.
134. Pallier, C., Dehaene, S., Poline, J.B., LeBihan, D., Argenti, A.M., Dupoux, E., et al. Brain imaging of language plasticity in adopted adults: can a second language replace a first?. Cerebral Cortex 13 (2003), 155–161.
135. Pan, S.J., Yang, Q., A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering 22:10 (2010), 1345–1359.
136. Parisi, G., Barros, P., Fu, D., Magg, S., Wu, H., & Liu, X., et al. (2018). A Neurorobotic Experiment for Crossmodal Conflict Resolution in Complex Environments,.
137. Parisi, G.I., Barros, P., Kerzel, M., Wu, H., Yang, G., Li, Z., et al. A computational model of crossmodal processing for conflict resolution. ICDL-EPIROB'17, 2017, 33–38.
138. Parisi, G., Ji, X., Wermter, S., On the role of neurogenesis in overcoming catastrophic forgetting. NIPS'18, workshop on continual learning, 2018.
139. Parisi, G.I., Magg, S., Wermter, S., Human motion assessment in real time using recurrent self-organization. Proceedings of the IEEE international symposium on robot and human interactive communication, 2016, 71–79.
140. Parisi, G.I., Tani, J., Weber, C., Wermter, S., Lifelong learning of humans actions with deep neural network self-organization. Neural Networks 96 (2017), 137–149.
141. Parisi, G., Tani, J., Weber, C., & Wermter, S. (2018). Lifelong Learning of Spatiotemporal Representations with Dual-Memory Recurrent Self-Organization,.
142. Part, J.L., Lemon, O., Incremental on-line learning of object classes using a combination of self-organizing incremental neural networks and deep convolutional neural networks. IROS'16, workshop on bio-inspired social robot learning in home scenarios, 2016.
143. Part, J.L., Lemon, O., Incremental online learning of objects for robots operating in real environments. ICDL-EPIROB'17, 2017.
144. Pathak, D., Agrawal, P., Efros, A.A., Darrell, F., Curiosity-driven exploration by self-supervised prediction. ICML'17, 2017.
145. Polikar, R., Upda, L., Upda, S.S., Honavar, V., Learn++: An incremental learning algorithm for supervised neural networks. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications & Reviews) 31:4 (2001), 497–508.
146. Power, J.D., Schlaggar, B.L., Neural plasticity across the lifespan. Wiley Interdisciplinary Reviews: Developmental Biology, 6(216), 2016.
147. Quadrato, G., Elnaggar, M.Y., Di Giovanni, S., Adult neurogenesis in brain repair: Cellular plasticity vs. cellular replacement. Frontiers in Neuroscience, 8(17), 2014.
148. Rao, R.P.N., Ballard, D.H., Predictive coding in the visual cortex: A functional interpretation of some extra-classical receptive-field effects. Nature Neuroscience 2:1 (1999), 79–87.
149. Ratcliff, R., Connectionist models of recognition memory: Constraints imposed by learning and forgetting functions. Psychological Review 97:2 (1990), 285–308.
150. Razavian, A.S., Azizpour, H., Sullivan, J., Carlsson, S., CNN features off-the-shelf: An astounding baseline for recognition., 2014, CVPR'14, Columbus, OH, 806–813.
151. Rebuffi, S. A., Kolesnikov, A., Sperl, G., & Lampert, C. H. (2016). iCaRL: Incremental Classifier and Representation Learning,.
152. Reed, S., & de Freitas, N. (2015). Neural programmer interpreters,.
153. Ren, B., Wang, H., Li, J., Gao, H., Life-long learning based on dynamic combination model. Applied Soft Computing 56 (2017), 398–404.
154. Richardson, F.M., Thomas, M.S.C., Critical periods and catastrophic interference effects in the development of self-organising feature maps. Developmental Science 11:3 (2008), 371–389.
155. Ring, M.B., Child: A first step towards continual learning. Machine Learning 28 (1997), 77–104.
156. Robins, A.V., CaTastrophic forgetting in neural networks: The role of rehearsal mechanisms. Proceedings of the first new zealand international two-stream conference on artificial neural networks and expert systems, 1993, IEEE Computer Society Press.
157. Robins, A.V., CaTastrophic forgetting, rehearsal and pseudorehearsal. Connection Science 7:2 (1995), 123–146.
158. Rusu, A. A., Rabinowitz, N. C., Desjardins, G., Soyer, H., Kirkpatrick, J., & Kavukcuoglu, K., et al. (2016). Progressive Neural Networks,.
159. Rusu, A.A., Vecerik, M., Rothörl, T., Heess, N., Pascanu, R., Hadsell, R., Sim-to-real robot learning from pixels with progressive nets. CoRL'17, 2017.
160. Sanger, T.D., Neural network learning control of robot manipulators using gradually increasing task difficulty. IEEE Transactions on Robotics and Automation, 10, 1994.
161. Schmidhuber, J. (1991). Curious model-building control systems.
162. Schuldt, C., Laptev, I., Caputo, B., Recognizing human actions: A local SVM approach. ICPR'04, 2004, 32–36.
163. Seidenberg, M., Zevin, J., Connectionist models in developmental cognitive neuroscience: Critical periods and the paradox of success. Munakata, Y., Johnson, M.H., (eds.) Processes of change in brain and cognitive development: Attention and Performance XXI, 2006, Oxford: Oxford University Press, 315–347.
164. Senghas, A., Kita, S., Özyürek, A., Children creating core properties of language: Evidence from an emerging sign language in nicaragua. Science 305 (2004), 1779–1782.
165. Shatz, C.J., Emergence of order in visual system development. Proceedings of the National Academy of Sciences 93 (1996), 602–608.
166. Shin, H., Lee, J.K., Kim, J., Kim, J., Continual learning with deep generative replay. NIPS'17, 2017.
167. Skinner, B.F., Reinforcement today. American Psychologist 13 (1958), 94–99.
168. Soltoggio, A., Short-term plasticity as cause-effect hypothesis testing is distal reward learning. Biological Cybernetics 109 (2015), 75–94.
169. Soltoggio, A., Stanley, K. O., & Risi, S. (2017). Born to learn: the inspiration, progress, and future of evolved plastic artificial neural networks,.
170. Song, S., Miller, K.D., Abbott, L.F., Competitive hebbian learning through spike-timing-dependent synaptic plasticity. Nature Neuroscience 3 (2000), 919–926.
171. Sorrells, S.F., Paredes, M.F., Arantxa, C.S., Sandoval, K., Dashi, Q., Kelley, K.W., et al. Human hippocampal neurogenesis drops sharply in children to undetectable levels in adults. Nature 555 (2018), 377–381.
172. Spence, C., Crossmodal spatial attention. Annals of the New York Academy of Sciences 1191 (2010), 182–200.
173. Spence, C., Orienting attention: A crossmodal perspective. The Oxford handbook of attention, 2014, Oxford, UK: Oxford University Press, 446–471.
174. Stein, B.E., Meredith, M.A., The merging of the senses. 1993, The MIT Press, Cambridge, MA, US.
175. Stein, B.E., Stanford, T.R., Rowland, B.A., Development of multisensory integration from the perspective of the individual neuron. Nature Reviews Neuroscience 15:8 (2014), 520–535.
176. Sur, M., Leamey, C.A., Development and plasticity of cortical areas and networks. Nature Reviews Neuroscience 2 (2001), 251–262.
177. Tani, J., Exploring robotic minds: Actions, Symbols, and consciousness a self-organizing dynamic phenomena. 2016, Oxford University Press.
178. Tanneberg, D., Peters, J., Rueckert, E., Online learning with stochastic recurrent neural networks using intrinsic motivation signals. CoRL'17, 2017.
179. Taupin, P., Gage, F.H., Adult neurogenesis and neural stem cells of the central nervous system in mammals. Journal of Neuroscience Research 69:6 (2002), 745–749.
180. Taylor, P., Hobbs, J.N., Burroni, J., Siegelmann, H.T., The global landscape of cognition: hierarchical aggregation as an organizational principle of human cortical networks and functions. Scientific Reports, 5(18112), 2015.
181. Tessler, C., Givony, S., Zahavy, T., Mankowitz, D.J., Mannor, S., A deep hierarchical approach to lifelong learning in minecraft. AAAI'17, 2017.
182. Thomas, M., Johnson, M., The computational modelling of sensitive periods. Developmental Psychobiology 48:4 (2006), 337–344.
183. Thrun, S., Mitchell, T., Lifelong robot learning. Robotics and Autonomous Systems 15 (1995), 25–46.
184. Tse, D., Takeuchi, T., Kakeyama, M., Kajii, Y., Okuno, H., Tohyama, C., et al. Schema-dependent gene activation and memory encoding in neocortex. Science 333 (2011), 891–895.
185. Turrigiano, G., Too many cooks? Intrinsic and synaptic homeostatic mechanisms in cortical circuit refinement. Annual Review of Neuroscience 34 (2011), 89–103.
186. Uylings, H., Development of the human cortex and the concept of critical or sensitive periods. Language Learning 56 (2006), 59–90.
187. Vinyals, O., Blundell, C., Lillicrap, T., Wierstra, D., Matching networks for one shot learning. NIPS'16, 2016.
188. Wah, C., Branson, S., Welinder, P., Perona, P., Belongie, S., CaLtech-UCSD birds-200-2011 dataset. Tech Report: CNS-TR-2011-001, 2011.
189. Weiss, K., Khoshgoftaar, T.M., Wang, D.D., A survey of transfer learning. Journal of Big Data, 3(9), 2016.
190. Wermter, S., Palm, G., Elshaw, M., Biomimetic neural learning for intelligent robots. 2005, Intelligent Systems, Cognitive Robotics, and Neuroscience. Springer, Berlin, Heidelberg.
191. Willshaw, D.J., von der Malsburg, C., How patterned neural connections can be set up by self-organization. Proceedings of the Royal Society of London B: Biological Sciences 194:1117 (1976), 431–445.
192. Xiao, T., Zhang, J., Yang, K., Peng, Y., Zhang, Z., Error-driven incremental learning in deep convolutional neural network for large-scale image classification. Proceedings of the ACM International Conference on Multimedia, Orlando, FL, 2014, 177–186.
193. Yoon, J., Yang, E., Lee, J., Hwang, S.J., Lifelong learning with dynamically expandable networks. ICLR'18, 2018.
194. Zenke, F., Gerstner, W., Ganguli, S., The temporal paradox of hebbian learning and homeostatic plasticity. Neurobiology 43 (2017), 166–176.
195. Zenke, F., Poole, B., Ganguli, S., Continual learning through synaptic intelligence., 2017, ICML'17, Sydney, Australia.
196. Zhou, G., Sohn, K., Lee, H., Online incremental feature learning with denoising autoencoders. International conference on artificial intelligence and statistics, 2012, 1453–1461.