Connectionist approaches to language learning

Linguistics

Volumn 47, Issue 2, 2009, Pages 413-452

  Westermann, Gert ^a   Ruh, Nicolas ^b   Plunkett, Kim ^b  

^a OXFORD BROOKES UNIVERSITY   (United Kingdom)

^b UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 62449145677     PISSN: 00243949     EISSN: None     Source Type: Journal    
DOI: 10.1515/LING.2009.015     Document Type: Article

References (120)

1. Abbott-Smith, Kirsten, Elena Lieven & Michael Tomasello. 2004. Training 2;6-year-olds to produce the transitive construction: the role of frequency, semantic similarity and shared syntactic distribution. Developmental Science 7. 48-55.
2. Altmann, Gerry T. M. 2002. Learning and development in neural networks - the importance of prior experience. Cognition 85. B43-B50.
3. Beretta, Alan, Carrie Campbell, Thomas H. Carr, Jie Huang, Lothar M. Schmitt, Kiel Christianson & Yue Cao. 2003. An ER-fMRI investigation of morphological inflection in German reveals that the brain makes a distinction between regular and irregular forms. Brain and Language 85. 67-92.
4. Blaubergs, Maija S. & Martin D. S. Braine. 1974. Short-term memory limitations on decoding self-embedded sentences. Journal of Experimental Psychology 102. 745-48.
5. Cairns, Paul, Richard Shillcock, Nick Chater & Joe Levy. 1997. Bootstrapping word boundaries: A bottom-up corpus-based approach to speech segmentation. Cognitive Psychology 33. 111-153.
6. Chalmers, David J. 1990. Syntactic transformations on distributed representations. Connection Science 2. 53-62.
7. Chalmers, David J. 1992. Subsymbolic computation and the Chinese room. In John Dinsmore (eds.), The Symbolic and Connectionist Paradigms: Closing the Gap, 25-48. Hillsdale, NJ: Lawrence Erlbaum Associates.
8. Chomsky, Noam. 1957. Syntactic structures. The Hague: Mouton.
9. Christiansen, Morten H. & Joseph Allen. 1997. Coping with variation in speech segmentation. In Antonella Sorace, Caroline Heycock & Richard Shillcock (eds.), Language acquisition: Knowledge representation and processing, 327-332. Edinburgh: University of Edinburgh Press.
10. Christiansen, Morten H., Joseph Allen & Mark S. Seidenberg. 1998. Learning to segment speech using multiple cues: A connectionist model. Language and Cognitive Processes 13. 221-268.
11. Christiansen, Morten H. & Nick Chater. 1999. Toward a connectionist model of recursion in human linguistic performance. Cognitive Science 23. 157-205.
12. Christiansen, Morten H., Christopher M. Conway & Suzanne Curtin. 2005. Multiple-cue integration in language acquisition: A connectionist model of speech segmentation and rulelike behavior. In James W. Minett & William S.-Y. Wang (eds.), Language acquisition, change and emergence: Essay in evolutionary linguistics, 205-249. Hong Kong: City University of Hong Kong Press.
13. Clahsen, Harald. 1999. Lexical Entries and rules of language: A multidisciplinary study of German inflection. Behavioral and Brain Sciences 22. 991-1013.
14. Dale, Philip S. & Larry Fenson. 1996. Lexical development norms for young children. Behavior Research Methods, Instruments & Computers 28. 125-27.
15. Daugherty, Kim & Mark S. Seidenberg. 1992. Rules or connections? The past tense revisited. In David P. Corina (ed.), Proceedings of the 14th annual conference of the cognitive science society, 259-264. Hillsdale, NJ: Lawrence Erlbaum.
16. Davies, Matt H. 2003. Connectionist modelling of lexical segmentation and vocabulary acquisition. In Philip Quinlan (eds.), Connectionist models of development: Developmental processes in real and artificial neural networks, 151-187. Hove: Psychology Press.
17. Davis, Barbara L. & Peter F. MacNeilage. 2000. An embodiment perspective on the acquisition of speech perception. Phonetica 57. 229-241.
18. Ellis, Andrew W. & Matthew A. Lambon-Ralph. 2000. Age of acquisition effects in adult lexical processing reflect loss of plasticity in maturing systems: Insights from connectionist networks. Journal of Experimental Psychology-Learning Memory and Cognition 26. 1103-1123.
19. Elman, Jeffrey L. 1990. Finding structure in time. Cognitive Science 14. 179-211.
20. Elman, Jeffrey L. 1991. Distributed representations, simple recurrent networks, and grammatical structure. Machine Learning 7. 195-225.
21. Elman, Jeffrey L. 1993. Learning and development in neural networks: the importance of starting small. Cognition 48. 71-99.
22. Elman, Jeff L. 1998. Generalization, simple recurrent networks, and the emergence of structure. In Morton Ann Gernsbacher & Sharon J. Derry (eds.), Twentieth Annual Conference of the Cognitive Science Society, 6-12. Mahwah, NJ: Lawrence Erlbaum.
23. Elman, Jeff L. 2003. Development: It's about time. Developmental Science 6. 430-433.
24. Elman, Jeffrey L. 2005. Connectionist models of cognitive development: where next? Trends in Cognitive Sciences 9. 111-117.
25. Elman, Jeffrey L., Elizabeth A. Bates, Mark H. Johnson, Annette Karmiloff-Smith, Domenico Parisi & Kim Plunkett. 1996. Rethinking innateness. A connectionist perspective on development. Cambridge, MA: MIT Press.
26. Fenson, Larry & Stephen J. Pethick. 1994. Variability in early communicative development (Monographs of the Society for Research in Child Development 59). Oxford: Blackwell.
27. Fodor, Jerry F. & Zenon W. Pylyshyn. 1988. Connectionism and cognitive architecture: A critical analysis. Cognition 28. 73-193.
28. Fritzke, Bernd. 1994. Growing cell structures - A self-organizing network for unsupervised and supervised learning. Neural Networks 7. 1441-1460.
29. Garofolo, John S., Lori F. Lamel, William M. Fisher, Jonathon G. Fiscus, David S. Pallett & Nancy L. Dahlgren. 1990. DARPA TIMIT Acoustic-Phonetic Continuous Speech Corpus CD-ROM. Tech. Rep. No. NISTIR 4930. Gaithersburg, MD: National Institute of Standards and Technology.
30. Gibbs, Raymond W. 2006. Embodiment and cognitive science. Cambridge: Cambridge University Press.
31. Gopnik, Alison, Clark Glymour, David M. Sobel, Laura E. Schulz, Tamar Kushnir & David Danks. 2004. A theory of causal learning in children: Causal maps and Bayes nets. Psychological Review 111. 3-32.
32. Gopnik, Alison & Joshua B. Tenenbaum. 2007. Bayesian networks, Bayesian learning and cognitive development. Developmental Science 10. 281-287.
33. Gow, David W. & Peter C. Gordon. 1995. Lexical and prelexical influences on word segmentation: Evidence from priming. Journal of Experimental Psychology: Human Perception and Performance 21. 344-359.
34. Guenther, Frank H. & Marin N. Gjaja. 1996. The perceptual magnet effect as an emergent property of neural map formation. Journal of the Acoustic Society of America 100. 1111-1121.
35. Guenther, Frank H., Satrajit S. Ghosh & Jason A. Tourville. 2006. Neural modeling and imaging of the cortical interactions underlying syllable production. Brain and Language 96. 280-301.
36. Hahn, Ulrike & Ramin C. Nakisa. 2000. German inflection: Single route or dual route? Cognitive Psychology 41. 313-60.
37. Hare, Mary & Jeffrey L. Elman. 1995. Learning and morphological change. Cognition 56. 61-98.
38. Hebb, Donald O. 1949. The organization of behavior: A neuropsychological theory. New York: Wiley.
39. Jaeger, Jeri J., Alan H. Lockwood, David L. Kemmerer, Robert D. Van Valin, Brian W. Murphy & Hanif G. Khalak. 1996. Positron emission tomographic study of regular and irregular verb morphology in English. Language 72. 451-497.
40. Joanisse, Marc F. & Mark S. Seidenberg. 1998. Specific language impairment: a deficit in grammar or processing? Trends in Cognitive Sciences 2. 240-47.
41. Joanisse, Marc F. & Mark S. Seidenberg. 1999. Impairments in verb morphology after brain injury: A connectionist model. Proceedings of the National Academy of Sciences of the United States of America 96. 7592-7597.
42. Joanisse, Marc F. 2004. Specific language impairments in children - Phonology, semantics, and the English past tense. Current Directions in Psychological Science 13. 156-160.
43. Joanisse, Marc F. & Mark S. Seidenberg. 2005. Imaging the past: Neural activation in frontal and temporal regions during regular and irregular past-tense processing. Cognitive Affective & Behavioral Neuroscience 5. 282-296.
44. Johnson, Mark H. 2005. Developmental cognitive neuroscience. Oxford: Blackwell.
45. Jusczyk, Peter W. 1999. How infants begin to extract words from speech. Trends in Cognitive Science 3. 323-328.
46. Kandel, Eric R., James H. Schwartz & Thomas M. Jessel. 2000. Principles of Neural Science. McGraw-Hill New York: Elsevier.
47. Kohonen, Teuvo. 1982. Self-organized formation of topologically correct feature maps. Biological Cybernetics 43. 59-69.
48. Kuhl, Patricia K. 1991. Human adults and human infants show a "perceptual magnet effect" for the prototypes of speech categories, monkeys do not. Perception and Psychophysics 50. 93-107.
49. Kuhl, Patricia K. 1995. Mechanisms of developmental change in speech and language. In Kjell Elenius & Peter Branderud (eds.), Proceedings of the XIIIth International Congress of Phonetic Sciences, 131-139. Stockholm: KTH and Stockholm University.
50. Lacerda, Francisco. 1995. The perceptual-magnet effect: An emergent consequence of exemplar-based phonetic memory. In Kjell Elenius & Peter Branderud (eds.), Proceedings of the XIIIth International Congress of Phonetic Sciences, 140-147. Stockholm: KTH and Stockholm University.
51. Li, Ping. 2003. Language acquisition in a self-organizing neural network model. In Philip Quinlan (ed.), Connectionist models of development: Developmental processes in real and artificial neural networks, 115-149. New York: Psychology Press.
52. Li, Ping, Igor Farkas & Brian MacWhinney. 2004. Early lexical development in a selforganizing neural network. Neural Networks 17. 1345-1362.
53. Li, Ping, Xiaowei Zhao & Brian MacWhinney. 2007. Dynamic self-organization and early lexical development in children. Cognitive Science 31. 581-612.
54. Liberman, Alvin M., Katherine S. Harris, Howard S. Hoffman & Belver C. Grith. 1957. The discrimination of speech sounds within and across phoneme boundaries. Journal of Experimental Psychology 54. 358-368.
55. Liberman, Alvin M. & Ignatius G. Mattingly. 1985. The motor theory of speech-perception revised. Cognition 21. 1-36.
56. Lisker, Leigh & Arthur S. Abramson. 1971. Distinctive features and laryngeal control. Language 47. 767-785.
57. MacWhinney, Brian. 2000. The CHILDES project: Tools for analyzing talk. Hillsdale, NJ: Lawrence Erlbaum.
58. MacWhinney, Brian. 2004. A multiple process solution to the logical problem of language acquisition. Journal of Child Language 31. 883-914.
59. MacWhinney, Brian & Jared Leinbach. 1991. Implementations are not conceptualizations: Revising the verb learning model. Cognition 40. 121-157.
60. Marchman, Virginia A. 1997. Children's productivity in the English past tense: The role of frequency, phonology, and neighborhood structure. Cognitive Science: A Multidisciplinary Journal 21. 283-304.
61. Marchman, Virginia A. & Elizabeth Bates. 1994. Continuity in lexical and morphological development: A test of the critical mass hypothesis. Journal of Child Language 21. 339-366.
62. Marcus, Gary F. 1995. The acquisition of the English past tense in children and multilayered connectionist networks. Cognition 56. 271-279.
63. Marcus, Gary F. 1999. Connectionism: With or without rules? Trends in Cognitive Sciences 3. 168-170.
64. Marcus, Gary, Ursula Brinkmann, Harald Clahsen, Richard Wiese & Steven Pinker. 1995. German inflection: The exception that proves the rule. Cognitive Psychology 29. 189-256.
65. Marcus, Gary F., Steven Pinker, Michael Ullman, Michelle Hollander, T. John Rosen & Fei Xu. 1992. Overregularization in language acquisition (Monographs of the Society for Research in Child Development, Serial No. 228, Vol. 57 no. 4). Oxford: Blackwell.
66. Mareschal, Denis, Mark H. Johnson, Sylvain Sirois, Michael W. Spratling, Michael Thomas & Gert Westermann. 2007a. Neuroconstructivism: How the brain constructs cognition. Oxford: Oxford University Press.
67. Mareschal, Denis, Sylvain Sirois, Gert Westermann & Mark Johnson (eds.). 2007b. Neuroconstructivism, vol II: Perspectives and prospects. Oxford: Oxford University Press.
68. Mareschal, Denis & Gert Westermann. In press. Mixing the old with the new and the new with the old: Combining prior and current knowledge in conceptual change. In Scott P. Johnson (ed.), Neoconstructivism: The new science of cognitive development. New York: Oxford University Press.
69. Marks, Lawrence E. 1968. Scaling of grammaticalness of self-embedded English sentences. Journal of Verbal Learning and Verbal Behavior 7. 965-967.
70. Marslen-Wilson, William & Lorraine K. Tyler. 1998. Rules, representations, and the English past tense. Trends in Cognitive Sciences 2. 428-435.
71. Marslen-Wilson, William & Alan Welsh. 1978. Processing interactions and lexical access during word recognition in continuous speech. Cognitive Psychology 10. 29-63.
72. McClelland, James L. & Karalyn Patterson. 2002. 'Words or rules' cannot exploit the regularities in exceptions. Trends in Cognitive Sciences 6. 464-65.
73. McLeod, Peter, Kim Plunkett & Edmund T. Rolls. 1998. Introduction to connectionist modelling of cognitive processes. Oxford: Oxford University Press.
74. Miikkulainen, Risto. 1997. Dyslexic and category-specific aphasic impairments in a selforganizing feature map model of the lexicon. Brain and Language 59. 334-366.
75. Miller, George A. & Patricia E. Nicely. 1955. An analysis of perceptual confusions among some English consonants. Journal of the Acoustical Society of America 27. 338-352.
76. Morgan, James L. & Katherine Demuth (eds.). 1996. From Signal to Syntax. Mahwah, NJ: Lawrence Erlbaum.
77. Nakisa, Ramin C. & Kim Plunkett. 1998. Evolution of a rapidly learned representation for speech. Language and Cognitive Processes 13. 105-127.
78. Oaksford, Mike & Nick Chater. 2007. Bayesian rationality: The probabilistic approach to human reasoning. Oxford: Oxford University Press.
79. O'Reilly, Randall C. 1996. Biologically plausible error-driven learning using local activation differences: The generalized recirculation algorithm. Neural Computation 8. 895-938.
80. Penke, Martina & Gert Westermann. 2006. Broca's area and inflectional morphology: Evidence from Broca's aphasia and computer modeling. Cortex 42. 563-576.
81. Pinker, Steven. 1997. Words and rules in the human brain. Nature 387. 547-548.
82. Pinker, Steven. 2001. Four decades of rules and associations, or whatever happened to the past tense debate? In Emmanuel Dupoux (ed.), Language, brain, and cognitive development: Essays in honor of Jacques Mehler, 157-179. Cambridge, MA: MIT Press.
83. Pinker, Steven & Michael T. Ullman. 2002. The past and future of the past tense. Trends in Cognitive Sciences 6. 456-463.
84. Plaut, David C., James L. McClelland, Mark S. Seidenberg & Karalyn Patterson. 1996. Understanding normal and impaired word reading: Computational principles in quasiregular domains. Psychological Review 103. 56-115.
85. Plunkett, Kim & Stephan Bandelow. 2006. Stochastic approaches to understanding dissociations in inflectional morphology. Brain and Language 98. 194-209.
86. Plunkett, Kim & Patrick Juola. 1999. A connectionist model of English past tense and plural morphology. Cognitive Science 23. 463-490.
87. Plunkett, Kim & Virginia A. Marchman. 1991. U-Shaped learning and frequency-effects in a multilayered perceptron - Implications for child language-acquisition. Cognition 38. 43-102.
88. Plunkett, Kim & Virginia A. Marchman. 1993. From rote learning to system building - acquiring verb morphology in children and connectionist nets. Cognition 48. 21-69.
89. Plunkett, Kim & Ramin C. Nakisa. 1997. A connectionist model of the Arabic plural system. Language and Cognitive Processes 12. 807-836.
90. Popper, Karl. 1959. The logic of scientific discovery. London: Hutchinson.
91. Pullum, Geoffrey K. & Barbara C. Scholz. 2002. Empirical assessment of poverty of stimulus arguments. The Linguistic Review 19. 9-50.
92. Ritter, Helge J. & Teuvo Kohonen. 1989. Self-organizing semantic maps. Biological Cybernetics 61. 241-54.
93. Rodriguez, Paul, Janet Wiles & Jeffrey L. Elman. 1999. A recurrent neural network that learns to count. Connection Science 11. 5-40.
94. Rumelhart, David E., Geoffrey E. Hinton & Ronald J. Williams. 1986. Learning internal representations by error propagation. In David E. Rumelhart & James L. McClelland (eds.), Parallel distributed processing: Explorations in the microstructure of cognition, volume 1: Foundations, 318-362. Cambridge, MA: MIT Press.
95. Rumelhart, David E. & James L. McClelland. 1986. On learning the past tense of English verbs: implicit rules or parallel distributed processing? In James L. McClelland, Dave Rumelhart & the PDP Research Group (eds.), Parallel Distributed Processing: Explorations in the Microstructure of Cognition, 195-248. Cambridge, MA: MIT Press.
96. Saffran, Jenny R., Richard N. Aslin & Elissa L. Newport. 1996. Statistical learning by 8-month-old infants. Science 274. 1926-1928.
97. Seidenberg, Mark. S. & Aimee Arnoldussen. 2003. The brain makes a distinction between hard and easy stimuli: Comments on Beretta et al. Brain and Language 85. 527-530.
98. Seidenberg, Mark & M. Bruck. 1990. Consistency effects in the generation of past tense morphology. Paper presented at the 31st meeting of the Psychonomic Society, New Orleans, LA.
99. Seidenberg, Mark S. & Jeffrey L. Elman. 1999a. Do Infants Learn Grammar with Algebra or Statistics? Science 284. 433.
100. Seidenberg, Mark S. & Jeffrey L. Elman. 1999b. Networks are not 'hidden rules'. Trends in Cognitive Sciences 3. 288-289.
101. Seidenberg, Mark S. & Marc F. Joanisse. 2003. Show us the model. Trends in Cognitive Sciences 7. 106-107.
102. Shultz, Thomas R. 2003. Computational developmental psychology. Cambridge, MA: MIT Press.
103. Shultz, Thomas R. 2007. The Bayesian revolution approaches psychological development. Developmental Science 10. 357-364.
104. Smith, Linda B. & Larissa K. Samuelson. 2003. Different is good: connectionism and dynamic systems theory are complementary emergentist approaches to development. Developmental Science 6. 434-439.
105. Smolensky, Paul, Michael Mozer & David E. Rumelhart (eds.). 1996. Mathematical perspectives on neural networks. Mahwah, NJ: Lawrence Erlbaum.
106. Thal, Donna, Elizabeth E. Bates, Judith Goodman & Jennifer Jahn-Samilo. 1997. Continuity of language abilities in late- and early-talking toddlers. Developmental Neuropsychology 13. 239-273.
107. Thelen, Esther & Elizabeth Bates. 2003. Connectionism and dynamic systems: are they really different? Developmental Science 6. 378-391.
108. Thelen, Esther & Linda B. Smith. 1994. A dynamic systems approach to the development of cognition and action (Bradford Books). Cambridge, MA: MIT Press.
109. Thomas, Michael S. C. & Walter J. B. van Heuven. 2003. Computational models of bilingual comprehension. In Judith F. Kroll & Annette M. B. De Groot (eds.), Handbook of bilingualism: Psycholinguistic approaches, 202-225. Oxford: University Press.
110. Ullman, Michael T. 1999. Acceptability ratings of regular and irregular past-tense forms: Evidence for a dual-system model of language from word frequency and phonological neighbourhood effects. Language and Cognitive Processes 14. 47-67.
111. Vihman, Marilyn May. 1993. Variable paths to early word production. Journal of Phonetics 21. 61-82.
112. Vihman, Marilyn May. 2002. The role of mirror neurons in the ontogeny of speech. In Maxim Stamenov & Victor Gallese (eds.), Mirror Neurons and the Evolution of Brain and Language, 305-314. Amsterdam: John Benjamins.
113. Weckerly, Jill & Jeffrey L. Elman. 1992. A PDP approach to processing center-embedded sentences. In John Kruschke (ed.), Proceedings of the Fourteenth Annual Conference of the Cognitive Science Society, 414-419. Hillsdale, NJ: Lawrence Erlbaum.
114. Westermann, Gert. 1998. Emergent modularity and U-shaped learning in a constructivist neural network learning the English past tense. Proceedings of the Twentieth Annual Conference of the Cognitive Science Society, Morton Ann Gernsbacher & Sharon. J. Derry (eds.), 1130-1135. Hillsdale, NJ: Lawrence Erlbaum.
115. Westermann, Gert & Eduardo Reck Miranda. 2004. A new model of sensorimotor coupling in the development of speech. Brain and Language 89. 393-400.
116. Westermann, Gert, Sylvain Sirois, Thomas R. Shultz & Denis Mareschal. 2006. Modeling developmental cognitive neuroscience. Trends in Cognitive Sciences 10. 227-233.
117. Willshaw, David J. & Christoph von der Malsburg. 1976. How patterned neural connections can be set up by self-organization. Proceedings of the Royal Society of London B 194. 431-445.
118. Xu, Fei & Joshua B. Tenenbaum. 2007. Sensitivity to sampling in Bayesian word learning. Developmental Science 10. 288-297.
119. Yoshikawa, Yuichiro, Minoru Asada, Koh Hosoda & Junpei Koga. 2003. A constructivist approach to infants' vowel acquisition through mother-infant interaction. Connection Science 15. 245-258.
120. Zuidema, Willem & Gert Westermann. 2003. Evolution of an optimal lexicon under constraints from embodiment. Artificial Life 9. 387-402.