Self-organizing map models of language acquisition

Frontiers in Psychology

Volumn 4, Issue NOV, 2013, Pages

  Li, Ping ^a   Zhao, Xiaowei ^b  

^a PENNSYLVANIA STATE UNIVERSITY   (United States)

^b EMMANUEL COLLEGE   (United States)

Author keywords

Age of acquisition; Connectionism; Cross language priming; Language acquisition; Lexical aspect; SOM; Vocabulary spurt

Indexed keywords

EID: 84889676891     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2013.00828     Document Type: Review

References (82)

1. Addyman, C., and French, R. M. (2012). Computational modeling in cognitive science: a manifesto for change. Top. Cogn. Sci. 4, 332-341. doi: 10.1111/j.1756-8765.2012.01206.x
2. Basnight-Brown, D., and Altarriba, J. (2007). Differences in semantic and translation priming across languages: the role of language direction and language dominance. Mem. Cogn. 35, 953-965. doi: 10.3758/BF03193468
3. Bates, E. (1999). "Plasticity, localization and language development," in The Changing Nervous System: Neurobehavioral Consequences of Early Brain Disorders, eds S. Broman and J. M. Fletcher (New York: Oxford University Press), 214-253.
4. Bates, E., and Carnevale, G. (1993). New directions in research on language development. Dev. Rev. 13, 436-470. doi: 10.1006/drev.1993.1020
5. Benedict, H. (1979). Early lexical development: comprehension and production. J. Child Lang. 6, 183-200. doi: 10.1017/S0305000900002245
6. Bickerton, D. (1984). The language bioprogram hypothesis. Behav. Brain Sci. 7, 173-188. doi: 10.1017/S0140525X00044149
7. Bloom, K., Lifter, K., and Hafitz, J. (1980). Semantics of verbs and the development of verb inflection in child language. Language 56, 386-412.
8. Bowers, J. S. (2002). Challenging the widespread assumption that connectionism and distributed representations go hand-in-hand. Cogn. Psychol. 45, 413-445. doi: 10.1016/S0010-0285(02)00506-6
9. Clark, E. V. (2009). First Language Acquisition, 2nd Edn. Cambridge: Cambridge University Press. doi: 10.1017/CBO9780511806698
10. Clark, E. V., and Hecht, B. F. (1983). Comprehension, production, and language acquisition. Annu. Rev. Psychol. 34, 325-349. doi: 10.1146/annurev.ps.34.020183.001545
11. Cuppini, C., Magosso, E., and Ursino, M. (2013). Learning the lexical aspects of a second language at different proficiencies: a neural computational study. Biling. Lang. Cogn. 16, 266. doi: 10.1017/S1366728911000617
12. Dale, P. S., and Fenson, L. (1996). Lexical development norms for young children. Behav. Res. Methods Instrum. Comput. 28, 125-127. doi: 10.3758/BF03203646
13. Davis, C. (1999). The Self-Organising Lexical Acquisition and Recognition (SOLAR) Model of Visual Word Recognition. Unpublished doctoral dissertation, University of New South Wales, Kensington.
14. Dijkstra, T., and van Heuven, W. J. B. (1998). "The BIA model and bilingual word recognition," in Localist Connectionist Approaches to Human Cognition, eds J. Grainger and A. M. Jacobs (Mahwah, NJ: Erlbaum), 189-226.
15. Dimitropoulou, M., Duñabeitia, J. A., and Carreiras, M. (2011). Two words, one meaning: evidence of automatic co-activation of translation equivalents. Front. Psychol. 2:188. doi: 10.3389/fpsyg.2011.00188
16. Elman, J. (1990). Finding structure in time. Cogn. Sci. 14, 179-211. doi: 10.1207/s15516709cog1402_1
17. Elman, J., Bates, E. A., Johnson, M. H., Karmiloff-Smith, A., Parisi, D., and Plunkett, K. (1996). Rethinking Innateness: A Connectionist Perspective on Development. Cambridge, MA: MIT Press.
18. Foster-Cohen, S. H. (1999). An Introduction to Child Language Development. London: Longman.
19. French, R. M. (1999). Catastrophic forgetting in connectionist networks. Trends Cogn. Sci. 3, 128-135. doi: 10.1016/S1364-6613(99)01294-2
20. Goldfield, B. A., and Reznick, J. S. (1990). Early lexical acquisition: rate, content, and the vocabulary spurt. J. Child Lang. 17, 171-183. doi: 10.1017/S0305000900013167
21. Grossberg, S. (1976a). Adaptive pattern classification and universal recoding: I. Parallel development and coding of neural feature detectors. Biol. Cybern. 23, 121-134. doi: 10.1007/BF00344744
22. Grossberg, S. (1976b). Adaptive pattern classification and universal recoding: II. Feedback, expectation, olfaction, illusions. Biol. Cybern. 23, 187-202. doi: 10.1007/BF00340335
23. Guenther, F. H., and Gjaja, M. N. (1996). The perceptual magnet effect as an emergent property of neural map formation. J. Acoust. Soc. Am. 100, 1111-1121. doi: 10.1121/1.416296
24. Haykin, S. (1999). Neural Networks: A Comprehensive Foundation, 2nd Edn. Upper Saddle River, NJ: Prentice Hall. Hebb, D. (1949). The Organization of Behavior: A Neuropsychological Theory. New York: Wiley.
25. Hebb, D. (1949). The Organization of Behavior: A Neuropsychological Theory. New York: Wiley.
26. Hernandez, A., and Li, P. (2007). Age of acquisition: its neural and computational mechanisms. Psychol. Bull. 133, 638. doi: 10.1037/0033-2909.133.4.638
27. Hernandez, A., Li, P., and MacWhinney, B. (2005). The emergence of competing modules in bilingualism. Trends Cogn. Sci. 9, 220-225. doi: 10.1016/j.tics.2005.03.003
28. Hinton, G. E., and Sejnowski, T. J. (1999). Unsupervised Learning: Foundations of Neural Computation. Cambridge, MA: The MIT press.
29. James, D., and Miikkulainen, R. (1995). "SARDNET: a self-organizing feature map for sequences," in Advances in Neural Information Processing Systems, Vol. 7, eds G. Tesauro, D. S. Touretzky, and T. K. Leen (Cambridge, MA: MIT Press), 577-584.
30. Johnson, J. S., and Newport, E. L. (1989). Critical period effects in second language learning: the influence of maturational state on the acquisition of English as a second language. Cogn. Psychol. 21, 60-99. doi: 10.1016/0010-0285(89)90003-0
31. Kiran, S., Graesman, U., Sandberg, C., and Miikkulainen, R. (2013). A computational account of bilingual aphasia rehabilitation. Biling. Lang. Cogn. 16, 325. doi: 10.1017/S1366728912000533
32. Kohonen, T. (2001). Self-Organizing Maps, 3rd Edn. Berlin: Springer. doi: 10.1007/978-3-642-56927-2
33. Kuhl, P. K. (1991). Human adults and human infants show a "perceptual magnet effect" for the prototypes of speech categories, monkeys do not. Percept. Psychophys. 50, 93-107. doi: 10.3758/BF03212211
34. Lenneberg, E. H. (1967). Biological Foundations of Language. New York, NY: Wiley.
35. Li, P. (2003). "Language acquisition in a self-organising neural network model," in Connectionist Models of Development: Developmental Processes in Real and Artificial Neural Networks, ed. P. Quinlan (Hove: Psychology Press), 115-149.
36. Li, P. (in press). "Bilingualism as a dynamic process," in Handbook of Language Emergence, eds B. MacWhinney and W. O'Grady (Boston: John Wiley & Sons, Inc.).
37. Li, P. (2013). Computational modeling of bilingualism. Biling. Lang. Cogn. 16, 241-366. doi: 10.1017/S1366728913000059
38. Li, P., Burgess, C., and Lund, K. (2000). "The acquisition of word meaning through global lexical co-occurrences," in Proceedings of the Thirtieth Annual Child Language Research Forum, ed. E. V. Clark (Stanford, CA: Center for the Study of Language and Information), 167-178.
39. Li, P., and Farkaš, I. (2002). A self-organizing connectionist model of bilingual processing. Adv. Psychol. 134, 59-85. doi: 10.1016/S0166-4115(02)80006-1
40. Li, P., Farkaš, I., and MacWhinney, B. (2004). Early lexical development in a self-organizing neural network. Neural Netw. 17, 1345-1362. doi: 10.1016/j.neunet.2004.07.004
41. Li, P., and MacWhinney, B. (2002). PatPho: a phonological pattern generator for neural networks. Behav. Res. Methods Instrum. Comput. 34, 408-415. doi: 10.3758/BF03195469
42. Li, P., and Shirai, Y. (2000). The Acquisition of Lexical and Grammatical Aspect. Berlin: Mouton de Gruyter.
43. Li, P., and Zhao, X. (2009). "Computational modeling of the expression of time," in The Expression of Time, eds W. Klein and P. Li (Berlin: Mouton de Gruyter), 241-271.
44. Li, P., and Zhao, X. (2012). "Connectionism," in Oxford Bibliographies Online: Linguistics, ed. M. Aronoff (New York, NY: Oxford University Press). Available at: http://www.oxfordbibliographies.com/view/document/obo-9780199772810/obo-9780199772810-0010.xml
45. Li, P, Zhao, X., and MacWhinney, B. (2007). Dynamic self-organization and early lexical development in children. Cogn. Sci. 31, 581-612. doi: 10.1080/15326900701399905
46. MacWhinney, B. (2000). The CHILDES Project: Tools for Analyzing Talk. Hillsdale, NJ: Lawrence Erlbaum.
47. MacWhinney, B. (2010). Computational models of child language learning: an introduction. J. Child Lang. 37, 477-485. doi: 10.1017/S0305000910000139
48. MacWhinney, B. (2012). "The logic of the unified model," in Routledge Handbook of Second Language Acquisition, eds S. Gass and A. Mackey (New York, NY: Routledge), 211-227.
49. Markman, E. M. (1994). Constraints on word meaning in early language acquisition. Lingua 92, 199-227. doi: 10.1016/0024-3841(94)90342-5
50. Mayor, J., and Plunkett, K. (2010). A neurocomputational account of taxonomic responding and fast mapping in early word learning. Psychol. Rev. 117, 1-31. doi: 10.1037/a0018130
51. McClelland, J. (2009). The place of modeling in cognitive science. Top. Cogn. Sci. 1, 11-28. doi: 10.1111/j.1756-8765.2008.01003.x
52. McClelland, J., and Rumelhart, D. (1981). An interactive activation model of context effects in letter perception: part 1. An account of basic findings. Psychol. Rev. 88, 375-407. doi: 10.1037/0033-295X.88.5.375
53. McClelland, J., Rumelhart, D., and the PDP Research Group. (1986). Parallel Distributed Processing: Explorations in the Microstructure of Cognition, Vol. 2. Cambridge, MA: MIT Press.
54. Menn, L., and Stoel-Gammon, C. (1993). "Phonological development: learning sounds and sound patterns," in The Development of Language, 3rd Edn, ed. J. B. Gleason (New York, NY: Macmillan), 65-113.
55. Mervis, C. B., and Bertrand, J. (1994). Acquisition of the novel name-nameless category (N3C) principle. Child Dev. 65, 1646-1663. doi: 10.2307/1131285
56. Miikkulainen, R. (1993). Subsymbolic Natural Language Processing: An Integrated Model of Scripts, Lexicon, and Memory. Cambridge, MA: MIT Press.
57. Miikkulainen, R. (1997). Dyslexic and category-specific aphasic impairments in a self organizing feature map model of the lexicon. Brain Lang. 59, 334-366. doi: 10.1006/brln.1997.1820
58. Miikkulainen, R., Bednar, J. A., Choe, Y., and Sirosh, J. (2005). Computational Maps in the Visual Cortex. New York: Springer.
59. Miikkulainen, R., and Kiran, S. (2009). "Modeling the bilingual lexicon of an individual subject," in Lecture Notes in Computer Science 5629: Proceedings of the Workshop on Self-Organizing Maps (WSOM'09, St. Augustine, FL) (Berlin: Springer), PMC2767190.
60. Miller, G. A. (1990). WordNet: an on-line lexical database. Int. J. Lexicogr. 3, 235-312. doi: 10.1093/ijl/3.4.235
61. Monner, D., Vatz, K., Morini, G., Hwang, S., and DeKeyser, R. (2013). A neural network model of the effects of entrenchment and memory development on grammatical gender learning. Biling. Lang. Cogn. 16, 246. doi: 10.1017/S1366728912000454
62. Munakata, Y., and Pfaffly, J. (2004). Hebbian learning and development. Dev. Sci. 7. 141-148. doi: 10.1111/j.1467-7687.2004.00331.x
63. Neely, J. H., and Durgunoglu, A. (1985). Dissociative episodic and semantic priming effects in episodic recognition and lexical decision tasks. J. Mem. Lang. 24, 466-489. doi: 10.1016/0749-596X(85)90040-3
64. Pavlenko, A. (2009). "Conceptual representation in the bilingual lexicon and second language vocabulary learning," in The Bilingual Mental Lexicon: Interdisciplinary Approaches, ed. A. Pavlenko (Tonawanda, NY: Multilingual Matters), 125-160.
65. Reznick, J. S., and Goldfield, B. A. (1992). Rapid change in lexical development in comprehension and production. Dev. Psychol. 28, 406-413. doi: 10.1037/0012-1649.28.3.406
66. Richardson, F. M., and Thomas, M. S. (2008). Critical periods and catastrophic interference effects in the development of self-organizing feature maps. Dev. Sci. 11, 371-389. doi: 10.1111/j.1467-7687.2008.00682.x
67. Ritter, H., and Kohonen, T. (1989). Self-organizing semantic maps. Biol. Cybern. 61, 241-254. doi: 10.1007/BF00203171
68. Rumelhart, D., and McClelland, J. (1986). "On learning the past tenses of english verbs," in Parallel Distributed Processing: Explorations, in the Microstructure of Cognition, Vol. 2, in Psychological and Biological Models, eds L. J. McClelland, D. E. Rumelhart, and PDP Research Group (Cambridge: MIT Press), 216-271.
69. Saxton, M. (2010). Child Language: Acquisition and Development. London: SAGE Publications. Shirai, Y. (1991). Primacy of Aspect in Language Acquisition: Simplified Input and Prototype. Ph.D. dissertation, Applied Linguistics, University of California at Los Angeles.
70. Shirai, Y. (1991). Primacy of Aspect in Language Acquisition: Simplified Input and Prototype. Ph.D. dissertation, Applied Linguistics, University of California at Los Angeles.
71. Silberman, Y., Bentin, S., and Miikkulainen, R. (2007). Semantic boost on episodic associations: an empirically-based computational model. Cogn. Sci. 31, 645-671. doi: 10.1080/15326900701399921
72. Spitzer, M. (1999). The Mind within the Net: Models of Learning, Thinking, and Acting. Cambridge, MA: MIT Press. Sporns, O. (2010). Networks of the Brain. Cambridge: The MIT Press.
73. Sporns, O. (2010). Networks of the Brain. Cambridge: The MIT Press.
74. Thomas, M. S. C., and Johnson, M. H. (2008). New advances in understanding sensitive periods in brain development. Curr. Dir. Psychol. Sci. 17, 1-5. doi: 10.1111/j.1467-8721.2008.00537.x
75. Tiňo, P., Farkaš, I., and van Mourik, J. (2006). Dynamics and topographic organization of recursive self-organizing maps. Neural Comput. 18, 2529-2567. doi: 10.1162/neco.2006.18.10.2529
76. Wang, X., and Forster, K. I. (2010). Masked translation priming with semantic categorization: testing the sense model. Biling. Lang. Cogn. 13, 327-340. doi: 10.1017/S1366728909990502
77. Westermann, G., Ruh, N., and Plunkett, K. (2009). Connectionist approaches to language learning. Linguistics 47, 413-452. doi: 10.1515/LING.2009.015
78. Xing, H., Shu, H., and Li, P. (2004). The acquisition of Chinese characters: corpus analyses and connectionist simulations. J. Cogn. Sci. 5, 1-49.
79. Zhao, X., and Li, P. (2009). Acquisition of aspect in self-organizing connectionist models. Linguist. Interdiscip. J. Lang. Sci. 47. 1075-1112. doi: 10.1515/LING.2009.038
80. Zhao, X., and Li, P. (2010). Bilingual lexical interactions in an unsupervised neural network model. Int. J. Biling. Educ. Biling. 13, 505-524. doi: 10.1080/13670050.2010.488284
81. Zhao, X., and Li, P. (2013). Simulating cross-language priming with a dynamic computational model of the lexicon. Biling. Lang. Cogn. 16. 288-303. doi: 10.1017/S1366728912000624
82. Zhao, X., Li, P., and Kohonen, T. (2011). Contextual self-organizing map: software for constructing semantic representation. Behav. Res. Methods 43, 77-88. doi: 10.3758/s13428-010-0042-z