Critical periods and catastrophic interference effects in the development of self-organizing feature maps: Paper

Developmental Science

Volumn 11, Issue 3, 2008, Pages 371-389

  Richardson, Fiona M ^a   Thomas, Michael S C ^a  

^a UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; COGNITION; HUMAN; LEARNING;

ALGORITHMS; COGNITION; CRITICAL PERIOD (PSYCHOLOGY); HUMANS; NEURAL NETWORKS (COMPUTER);

EID: 43449083218     PISSN: 1363755X     EISSN: 14677687     Source Type: Journal    
DOI: 10.1111/j.1467-7687.2008.00682.x     Document Type: Article

References (67)

1. Ans, B., Rousset, S., French, R.M. Musca, S. (2004). Self-refreshing memory in artificial neural networks: learning temporal sequences without catastrophic forgetting. Connection Science, 16 (2 71 99.
2. Birdsong, D. (2005). Interpreting age effects in second language acquisition. In J.F. Kroll A.M.B. de Groot (Eds.), Handbook of bilingualism (pp. 109 127). Oxford : Oxford University Press.
3. Brainard, M.S. Doupe, A.J. (2002). What songbirds teach us about learning. Nature, 417, 351 358.
4. Braun, C., Heinz, U., Schweizer, R., Weich, K., Birbaumer, N. Topka, H. (2001). Dynamic organization of the somatosensory cortex induced by motor activity. Brain, 124, 2259 2267.
5. Buonomano, D.V. Merzenich, M.M. (1998). Cortical plasticity: from synapses to maps. Annual Review of Neuroscience, 21, 149 186.
6. DeKeyser, R. Larson-Hall, J. (2005). What does the critical period really mean? In J.F. Kroll A.M.B. de Groot (Eds.), Handbook of bilingualism (pp. 88 108). Oxford : Oxford University Press.
7. Doupe, A.J. Kuhl, P.K. (1999). Birdsong and human speech: common themes and mechanisms. Annual Review of Neuroscience, 22, 567 631.
8. Ellis, A.W. Lambon-Ralph, M.A. (2000). Age of acquisition effects in adult lexical processing reflect loss of plasticity in maturing systems: insights from connectionist networks. Journal of Experimental Psychology: Learning, Memory and Cognition, 26, 1103 1123.
9. Elman, J.L., Bates, E.A., Johnson, M.H., Karmiloff-Smith, A., Parisi, D. Plunkett, K. (1996). Rethinking innateness: A connectionist perspective on development. Cambridge, MA : MIT Press.
10. Finlay, B.L., Cheung, D.T.-M. Darlington, R.B. (2005). Developmental constraints on developmental structure in brain evolution. In Y. Munakata M.H. Johnson (Eds.), Processes of change in brain and cognitive development: Attention and Performance XXI (pp. 131 162). Oxford : Oxford University Press.
11. French, R.M. (1991). Using semi-distributed representations to overcome catastrophic forgetting in connectionist networks. In Proceedings of the 13th Annual Cognitive Science Society Conference (pp. 173 178). Hillsdale, NJ : Lawrence Erlbaum.
12. French, R.M. (1992). Semi-distributed representations and catastrophic forgetting in connectionist networks. Connection Science, 4, 365 377.
13. French, R.M. (1999). Catastrophic forgetting in connectionist networks. Trends in Cognitive Sciences, 3 (4 128 135.
14. French, R.M. Chater, N. (2002). Using noise to compute error surfaces in connectionist networks: a novel means of reducing catastrophic forgetting. Neural Computation, 14 (7 1755 1769.
15. French, R.M., Mareschal, D., Mermillod, M. Quinn, P.C. (2004). The role of bottom-up processing in perceptual categorization by 3- to-4-month-old infants: simulations and data. Journal of Experimental Psychology: General, 133 (3 382 397.
16. Grossberg, S. (1987). Competitive learning: from interactive activation to adaptive resonance. Cognitive Science, 11, 23 64.
17. Gustafsson, L. (1997). Inadequate cortical feature maps: a neural circuit theory of autism. Biological Psychiatry, 42, 1138 1147.
18. Hensch, T.K. (2004). Critical period regulation. Annual Review of Neuroscience, 27, 549 579.
19. Hernandez, A., Li, P. MacWhinney, B. (2005). The emergence of competing modules in bilingualism. Trends in Cognitive Sciences, 9 (5 220 225.
20. Hertz-Pannier, L., Chiron, C., Jambaqué, I., Renaux-Kieffer, V., Van de Moortele, P.-F., Delalande, O., Fohlen, M., Brunelle, F. Le Bihan, D. (2002). Late plasticity for language in a child's non-dominant hemisphere: a pre- and post-surgery fMRI study. Brain, 125, 361 372.
21. Hubel, D. Weisel, T. (1963). Receptive fields of cells in the striate cortex of very young, visually inexperienced kittens. Journal of Neurophysiology, 26, 944 1002.
22. Huffman, K.J., Molnar, Z., Van Dellen, A., Kahn, D.M., Blakemore, C. Krubitzer, L. (1999). Formation of cortical fields on a reduced cortical sheet. Journal of Neuroscience, 19 (22 9939 9952.
23. Huttenlocher, P.R. (2002). Neural plasticity: The effects of the environment on the development of the cerebral cortex. Cambridge, MA : Harvard University Press.
24. Johnson, J.S. Newport, E.L. (1989). Critical period effects in second language learning - the influence of maturational state on the acquisition of English as a second language. Cognitive Psychology, 21 (1 60 99.
25. Johnson, J.S. Newport, E.L. (1991). Critical period effects on universal properties of language - the status of subjacency in the acquisition of a second language. Cognition, 39 (3 215 258.
26. Johnson, M.H. (2005). Sensitive periods in functional brain development: problems and prospects. Developmental Psychobiology, 46, 287 292.
27. Jones, E.G. (2000). Cortical and subcortical contributions to activity-dependent plasticity in primate somatosensory cortex. Annual Review of Neuroscience, 23, 1 37.
28. Knudsen, E.I. (2004). Sensitive periods in the development of the brain and behaviour. Journal of Cognitive Neuroscience, 16 (8 1412 1425.
29. Kohonen, T. (1982). Self-organized formation of topologically correct feature maps. Biological Cybernetics, 43, 59 69.
30. Kohonen, T. (1995). Self-organizing maps. New York : Springer.
31. Kortge, C. (1990). Episodic memory in connectionist networks. In Proceedings of the 12th Annual Cognitive Science Society Conference (pp. 764 771). Hillsdale, NJ : Lawrence Erlbaum.
32. Lambon Ralph, M.A. Ehsan, S. (2006). Age of acquisition effects depend on the mapping between representations and the frequency of occurrence: empirical and computational evidence. Visual Cognition, 13 (7-8 928 948.
33. Lenneberg, E. (1967). Biological foundations of language. New York : Wiley.
34. Li, P., Farkas, I. McWhinney, B. (2004). Early lexical development in a self-organising neural network. Neural Networks, 17, 1345 1362.
35. Lorenz, K.Z. (1958). The evolution of behaviour. Scientific American, 199, 67 74.
36. McCandliss, B.D., Fiez, J.A., Protopapas, A., Conway, M. McClelland, J.L. (2002). Success and failure in teaching the [r]-[l] contrast to Japanese: predictions of a Hebbian model of plasticity and stabilization in spoken language perception. Cognitive, Affective and Behavioral Neuroscience, 2, 89 108.
37. McClelland, J.L., McNaughton, B.L. O'Reilly, R.C. (1995). Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. Psychological Review, 102 (3 419 457.
38. McClelland, J.L., Thomas, A.G., McCandliss, B.D. Fiez, J.A. (1999). Understanding failures of learning: Hebbian learning, competition for representational space, and some preliminary experimental data. In J. Reggia, E. Ruppin D. Glanzman (Eds.), Progress in brain research. Volume 121: Disorders of brain, behavior and cognition: The neurocomputational perspective (pp. 75 80). Amsterdam : Elsevier.
39. McCloskey, M. Cohen, N. (1989). Catastrophic interference in connectionist networks: the sequential learning problem. In G.H. Bower (Ed.), The psychology of learning and motivation (Vol. 24, pp. 109 164). New York : Academic Press.
40. McCrae, K. Hetherington, P.A. (1993). Catastrophic interference is eliminated in pre-trained networks. In Proceedings of the 15th Annual Cognitive Science Society Conference (pp. 723 728). Hillsdale, NJ : Lawrence Erlbaum.
41. Marchman, V.A. (1993). Constraints on plasticity in a connectionist model of English past tense. Journal of Cognitive Neuroscience, 5 (2 215 234.
42. Mareschal, D., Johnson, M., Sirios, S., Spratling, M., Thomas, M.S.C. Westermann, G. (2007). Neuroconstructivism: How the brain constructs cognition. Oxford : Oxford University Press.
43. Mareschal, D. Quinn, P.C. (2001). Categorization in infancy. Trends in Cognitive Sciences, 5 (10 443 450.
44. Mareschal, D., Quinn, P. French, R.M. 2002). Asymmetric interference in 3- to 4-month-olds' sequential category learning. Cognitive Science, 79, 1 13.
45. Miikkulainen, R. (1997). Dyslexic and category-specific aphasic impairments in a self-organizing feature map model of the lexicon. Brain and Language, 59, 334 366.
46. Miller, K.D., Keller, J.B. Stryker, M.P. (1989). Occular dominance column development: analysis and simulation. Science, 245, 605 615.
47. Mirman, D. Spivey, M. (2001). Retroactive interference in neural networks and in humans: the effect of pattern-based learning. Connection Science, 13 (3 257 275.
48. Oliver, A., Johnson, M.H., Karmiloff-Smith, A. Pennington, B. (2000). Deviations in the emergence of representations: a neuroconstructivist framework for analysing developmental disorders. Developmental Science, 3, 1 23.
49. O'Reilly, R.C. (1998). Six principles for biologically based computational models of cortical cognition. Trends in Cognitive Sciences, 2, 455 462.
50. O'Reilly, R.C. Johnson, M.H. (1994). Object recognition and sensitive periods: a computational analysis of visual imprinting. Neural Computation, 6, 357 389.
51. Pallier, C., Dehaene, S., Poline, J.-B., LeBihan, D., Argenti, A.-M., Dupoux, E. Mehler, J. (2003). Brain imaging of language plasticity in adopted adults: can a second language replace a first? Cerebral Cortex, 13, 155 161.
52. Ratcliff, R. (1990). Connectionist models of recognition memory - constraints imposed by learning and forgetting functions. Psychological Review, 97 (2 285 308.
53. Robins, A. (1995). Catastrophic forgetting, rehearsal, and pseudo-rehearsal. Connection Science, 7, 123 146.
54. Robins, A. McCallum, S. (1998). Catastrophic forgetting and the pseudo-rehearsal solution in Hopfield-type networks. Connection Science, 10 (2 121 135.
55. Schaefer, M., Flor, H., Heinze, H.J. Rotte, M. (2005). Dynamic shifts in the organization of the primary somatosensory cortex induced by bimanual spatial coupling of motor activity. Neuroimage, 25 (2 359 400.
56. Seidenberg, M.S. Zevin, J.D. (2006). Connectionist models in developmental cognitive neuroscience: critical periods and the paradox of success. In Y. Munakata M.H. Johnson (Eds.), Processes of change in brain and cognitive development: Attention and Performance XXI (pp. 315 347). Oxford : Oxford University Press.
57. Senghas, A., Kita, S. Özyürek, A. (2004). Children creating core properties of language: evidence from an emerging sign language in Nicaragua. Science, 305, 1779 1782.
58. Sharkey, N. Sharkey, A. (1995). An analysis of catastrophic interference. Connection Science, 7, 301 329.
59. Small, S.L., Hart J., Nguyen, T. Gordon, B. (1996). Distributed representations of semantic knowledge in the brain: computational experiments using feature based codes. In J. Reggia, E. Ruppin R.S. Berndt (Eds.), Neural modelling of brain and cognitive disorders (pp. 109 132). Singapore : World Scientific.
60. Thomas, M.S.C. (2004). State of connectionism 2004. Parallaxis, 8, 43 61.
61. Thomas, M.S.C. Johnson, M.H. (2006). The computational modelling of sensitive periods. Developmental Psychobiology, 48 (4 337 344.
62. Thomas, M.S.C. Karmiloff-Smith, A. (2002). Residual normality: friend or foe? Behavioural and Brain Sciences, 25, 772 787.
63. Thomas, M.S.C. Richardson, F. (2006). Atypical representational change: conditions for the emergence of atypical modularity. In Y. Munakata M.H. Johnson (Eds.), Processes of change in brain and cognitive development: Attention and Performance XXI (pp. 315 347). Oxford : Oxford University Press.
64. Uylings, H.B.M. (2006). Development of the human cortex and the concept of 'critical' or 'sensitive' periods. Language Learning, 56, Suppl.1, 59 90.
65. Westermann, G. Miranda, E.R. (2002). Modelling development of mirror neurons for auditory-motor integration. Journal of New Music Research, 31 (4 367 375.
66. Westermann, G. Miranda, E.R. (2004). A new model of sensorimotor coupling in the development of speech. Brain and Language, 89, 393 400.
67. Zevin, J.D. Seidenberg, M.S. (2002). Age of acquisition effects in reading and other tasks. Journal of Memory and Language, 47, 1 29.