A neuroconstructivist model of past tense development and processing

Psychological Review

Volumn 119, Issue 3, 2012, Pages 649-667

  Westermann, Gert ^a   Ruh, Nicolas ^a  

^a OXFORD BROOKES UNIVERSITY   (United Kingdom)

Author keywords

Computational modeling; English past tense; Experience dependent brain development; Language development; Learning; Neuroconstructivism; Processing

Indexed keywords

ADOLESCENT; ADULT; APHASIA; ARTICLE; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; BRAIN; CHILD; CHRONIC BRAIN DISEASE; COGNITION; COMPUTER SIMULATION; GROWTH, DEVELOPMENT AND AGING; HUMAN; LANGUAGE DEVELOPMENT; LEARNING; LINGUISTICS; PATHOPHYSIOLOGY; PHYSIOLOGY; PRESCHOOL CHILD; UNITED KINGDOM;

ADOLESCENT; ADULT; APHASIA; BRAIN; BRAIN DAMAGE, CHRONIC; CHILD; CHILD, PRESCHOOL; COGNITION; COMPUTER SIMULATION; ENGLAND; GENERALIZATION (PSYCHOLOGY); HUMANS; LANGUAGE DEVELOPMENT; LEARNING; LINGUISTICS; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER);

EID: 84867357100     PISSN: 0033295X     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0028258     Document Type: Article

References (82)

1. Alegre, M., & Gordon, P. (1999). Frequency effects and the representational status of regular inflections. Journal of Memory and Language, 40, 41-61. doi:10.1006/jmla.1998.2607
2. Baayen, R. H., Piepenbrock, R., & van Rijn, H. (1995). The CELEX lexical database [CD-ROM]. Linguistic Data Consortium, University of Pennsylvania, Philadelphia.
3. Beretta, A., Campbell, C., Carr, T. H., Huang, J., Schmitt, L. M., Chris-tianson, K., & Cao, Y. (2003). An ER-fMRI investigation of morphological inflection in German reveals that the brain makes a distinction between regular and irregular forms. Brain and Language, 85, 67-92. doi:10.1016/S0093-934X(02)00560-6
4. Berko, J. (1958). The child's learning of English morphology. Word, 14, 150-177.
5. Bird, H., Lambon Ralph, M. A., Seidenberg, M. S., McClelland, J. L., & Patterson, K. (2003). Deficits in phonology and past-tense morphology: What's the connection? Journal of Memory and Language, 48, 502-526. doi:10.1016/S0749-596X(02)00538-7
6. Braber, N., Patterson, K., Ellis, K., & Lambon Ralph, M. A. (2005). The relationship between phonological and morphological deficits in Broca's aphasia: Further evidence from errors in verb inflection. Brain and Language, 92, 278-287. doi:10.1016/j.bandl.2004.05.012
7. Bright, P., Moss, H. E., Stamatakis, E. A., & Tyler, L. K. (2008). Longi-tudinal studies of semantic dementia: The relationship between struc-tural and functional changes over time. Neuropsychologia, 46, 2177-2188. doi:10.1016/j.neuropsychologia.2008.02.019
8. Bybee, J. L., & Slobin, D. I. (1982). Rules and schemas in the development and use of the English past tense. Language, 58, 265-289. doi:10.2307/414099
9. Casey, B. J., Giedd, J. N., & Thomas, K. M. (2000). Structural and functional brain development and its relation to cognitive development. Biological Psychology, 54, 241-257. doi:10.1016/S0301-0511(00) 00058-2
10. Casey, B. J., Tottenham, N., Liston, C., & Durston, S. (2005). Imaging the developing brain: What have we learned about cognitive development? Trends in Cognitive Sciences, 9, 104-110. doi:10.1016/j.tics.2005 .01.011
11. Chen, C., Xue, G., Mei, L., Chen, C., & Dong, Q. (2009). Cultural neurolinguistics. In J. Chiao (Ed.), Progress in Brain Research: Vol. 178. Cultural neuroscience: Cultural influences on brain function (pp. 159-171). Amsterdam, the Netherlands: Elsevier. doi:10.1016/S0079-6123(09)17811-1
12. Clahsen, H. (1999). Lexical entries and rules of language: A multidisciplinary study of German inflection. Behavioral and Brain Sciences, 22, 991-1013. doi:10.1017/S0140525X99002228
13. Coltheart, M., Curtis, B., Atkins, P., & Haller, M. (1993). Models of reading aloud: Dual-route and parallel-distributed-processing approaches. Psychological Review, 100, 589-608. doi:10.1037/0033-295X .100.4.589
14. Cortese, M. J., Balota, D. A., Sergent-Marshall, S. D., Buckner, R. L., & Gold, B. T. (2006). Consistency and regularity in past-tense verb generation in healthy ageing, Alzheimer's disease, and semantic dementia. Cognitive Neuropsychology, 23, 856-876. doi:10.1080/02643290500483124
15. Dannemiller, J. L. (2001). Brain-behavior relationships in early visual development. In C. A. Nelson & M. Luciana (Eds.), Handbook of developmental cognitive neuroscience (pp. 221-235). Cambridge, MA: MIT Press.
16. Daugherty, K., & Seidenberg, M. S. (1992). Rules or connections? The past tense revisited. In Proceedings of the 14th Annual Conference of the Cognitive Science Society (pp. 259-264). Hillsdale, NJ: Erlbaum.
17. De Haan, M., Pascalis, O., & Johnson, M. H. (2002). Specialization of neural mechanisms underlying face recognition in human infants. Journal of Cognitive Neuroscience, 14, 199-209. doi:10.1162/089892902317236849
18. Desai, R., Conant, L. L., Waldron, E., & Binder, J. R. (2006). fMRI of past tense processing: The effects of phonological complexity and task difficulty. Journal of Cognitive Neuroscience, 18, 278-297. doi:10.1162/jocn.2006.18.2.278
19. Dhond, R. P., Marinkovic, K., Dale, A. M., Witzel, T., & Halgren, E. (2003). Spatiotemporal maps of past-tense verb inflection. NeuroImage 19, 91-100.
20. Fahlman, S. E., & Lebiere, C. (1990). The cascade-correlation learning architecture. In D. S. Touretzky (Ed.), Advances in Neural Information Processing Systems 2 (pp. 524-532). Los Altos, CA: Morgan Kaufman.
21. Faroqi-Shah, Y. (2007). Are regular and irregular verbs dissociated in non-fluent aphasia? A meta-analysis. Brain Research Bulletin, 74, 1-13. doi:10.1016/j.brainresbull.2007.06.007
22. Fritzke, B. (1994). Fast learning with incremental RBF networks. Neural Processing Letters, 1, 2-5. doi:10.1007/BF02312392
23. Jaeger, J. J., Lockwood, A. H., Kemmerer, D. L., Van Valin, R. D., Jr., Murphy, B. W., & Khalak, H. G. (1996). A positron emission tomographic study of regular and irregular verb morphology in English. Language, 72, 451-497. doi:10.2307/416276
24. Joanisse, M. F., & Seidenberg, M. S. (1999). Impairments in verb morphology after brain injury: A connectionist model. Proceedings of the National Academy of Sciences of the United States of America, 96, 7592-7597. doi:10.1073/pnas.96.13.7592
25. Joanisse, M. F., & Seidenberg, M. S. (2005). Imaging the past: Neural activation in frontal and temporal regions during regular and irregular past-tense processing. Cognitive, Affective, & Behavioral Neuroscience, 5, 282-296. doi:10.3758/CABN.5.3.282
26. Johnson, M. H. (2001). Functional brain development in humans. Nature Reviews Neuroscience, 2, 475-483. doi:10.1038/35081509
27. Johnson, M. H., & Munakata, Y. (2005). Processes of change in brain and cognitive development. Trends in Cognitive Sciences, 9, 152-158. doi: 10.1016/j.tics.2005.01.009
28. Karmiloff-Smith, A (1992). Beyond modularity: A developmental perspective on cognitive science. Cambridge, MA: MIT Press.
29. Kidd, E., & Lum, J. A. G. (2008). Sex differences in past tense overregularization. Developmental Science, 11, 882-889. doi:10.1111/j.1467-7687.2008.00744.x
30. Kochunov, P., Fox, P., Lancaster, J., Tan, L. H., Amunts, K., Zilles, K., Gao, J. H. (2003). Localized morphological brain differences between English-speaking Caucasians and Chinese-speaking Asians: New evi-dence of anatomical plasticity. NeuroReport, 14, 961-964. doi:10.1097/01.wnr.0000075417.59944.00
31. Kuczaj, S. A. (1977). The acquisition of regular and irregular past tense forms. Journal of Verbal Learning and Verbal Behavior, 16, 589-600. doi:10.1016/S0022-5371(77)80021-2
32. Lambon Ralph, M. A., Braber, N., McClelland, J. L., & Patterson, K. (2005). What underlies the neuropsychological pattern of irregular > regular past-tense verb production? Brain and Language, 93, 106-119. doi:10.1016/j.bandl.2004.09.001
33. Li, P., & MacWhinney, B. (2002) PatPho: A phonological pattern generator for neural networks. Behavior Research Methods, Instruments & Computers, 34, 408-415.
34. MacWhinney, B. (1993). Connections and symbols: Closing the gap. Cognition, 49, 291-296. doi:10.1016/0010-0277(93)90007-I
35. MacWhinney, B., & Leinbach, J. (1991). Implementations are not conceptualizations: Revising the verb learning model. Cognition, 40, 121-157. doi:10.1016/0010-0277(91)90048-9
36. Maratsos, M. (2000). More overregularizations after all: New data and discussion on Marcus, Pinker, Ullman, Hollander, Rosen & Xu. Journal of Child Language, 27, 183-212. doi:10.1017/S0305000999004067
37. Marchman, V. A. (1993). Constraints on plasticity in a connectionist model of the English past tense. Journal of Cognitive Neuroscience, 5, 215-234. doi:10.1162/jocn.1993.5.2.215
38. Marchman, V. A. (1997). Children's productivity in the English past tense: The role of frequency, phonology, and neighborhood structure. Cognitive Science, 21, 283-304. doi:10.1207/s15516709cog2103_2
39. Marcus, G. F., Brinkmann, U., Clahsen, H., Wiese, R., & Pinker, S. (1995). German inflection: The exception that proves the rule. Cognitive Psychology, 29, 189-256. doi:10.1006/cogp.1995.1015
40. Marcus, G. F. (1995). The acquisition of the English past tense in children and multilayered connectionist networks. Cognition, 56, 271-279. doi: 10.1016/0010-0277(94)00656-6
41. Marcus, G. F., Pinker, S., Ullman, M., Hollander, M., Rosen, T. J., & Xu, F. (1992). Overregularization in language acquisition, Monographs of the Society for Research in Child Development, 57(4, Serial No. 228). doi:10.2307/1166115
42. Marslen-Wilson, W. D., & Tyler, L. K. (1997). Dissociating types of mental computation. Nature, 387, 592-594. doi:10.1038/42456
43. Marslen-Wilson, W., & Tyler, L. K. (1998). Rules, representations, and the English past tense. Trends in Cognitive Sciences, 2, 428-435. doi: 10.1016/S1364-6613(98)01239-X
44. Marslen-Wilson, W. D., & Tyler, L. K. (2003). Capturing underlying differentiation in the human language system. Trends in Cognitive Sciences, 7, 62-63. doi:10.1016/S1364-6613(02)00047-5
45. Maslen, R. J. C., Theakston, A. L., Lieven, E. V. M., & Tomasello, M. (2004). A dense corpus study of past tense and plural overregularization in English. Journal of Speech, Language, and Hearing Research, 47, 1319-1333. doi:10.1044/1092-4388(2004/099)
46. McClelland, J. L., & Patterson, K. (2002). Rules or connections in past-tense inflections: What does the evidence rule out? Trends in Cognitive Sciences, 6, 465-472. doi:10.1016/S1364-6613(02)01993-9
47. Miozzo, M. (2003). On the processing of regular and irregular forms of verbs and nouns: Evidence from neuropsychology. Cognition, 87, 101-127. doi:10.1016/s0010-0277(02)00200-7
48. Miozzo, M., & Gordon, P. (2005). Facts, events, and inflection: When language and memory dissociate. Journal of Cognitive Neuroscience, 17, 1074-1086. doi:10.1162/0898929054475163
49. Munakata, Y. (2004). Computational cognitive neuroscience of early mem-ory development. Developmental Review, 24, 133-153. doi:10.1016/j.dr.2003.09.008
50. Nation, K., Snowling, M. J., & Clarke, P. (2005). Production of the English past tense by children with language comprehension impairments. Journal of Child Language, 32, 117-137. doi:10.1017/S0305000904006555
51. Nelson, C. A., Moulson, M. C., & Richmond, J. (2006). How does neuroscience inform the study of cognitive development? Human Development, 49, 260-272. doi:10.1159/000095579
52. Park, D. C., & Huang, C.-M. (2010). Culture wires the brain: A cognitive neuroscience perspective. Perspectives on Psychological Science, 5, 391-400. doi:10.1177/1745691610374591
53. Patterson, K., Lambon Ralph, M. A., Hodges, J. R., & McClelland, J. L. (2001). Deficits in irregular past-tense verb morphology associated with degraded semantic knowledge. Neuropsychologia, 39, 709-724. doi: 10.1016/S0028-3932(01)00008-2
54. Pinker, S. (1991). Rules of language. Science, 253, 530-535. doi:10.1126/science.1857983
55. Pinker, S. (1998). Words and rules. Lingua, 106, 219-242. doi:10.1016/S0024-3841(98)00035-7
56. Pinker, S. (1999). Words and rules: The ingredients of language. New York, NY: Basic Books.
57. Pinker, S. (2001). Four decades of rules and associations, or whatever happened to the past tense debate? In E. Dupoux (Ed.), Language, brain, and cognitive development: Essays in Honor of Jacques Mehler (pp. 157-180). Cambridge, MA: MIT Press.
58. Pinker, S., & Ullman, M. T. (2002). The past and future of the past tense. Trends in Cognitive Sciences, 6, 456-463. doi:10.1016/S1364-6613(02)01990-3
59. Pinker, S., & Ullman, M. T. (2003). Beyond one model per phenomenon. Trends in Cognitive Sciences, 7, 108-109. doi:10.1016/S1364-6613(03)00021-4
60. Plunkett, K., & Juola, P. (1999). A connectionist model of English past tense and plural morphology. Cognitive Science, 23, 463-490. doi: 10.1207/s15516709cog2304_4
61. Plunkett, K., & Marchman, V. (1991). U-shaped learning and frequency effects in a multi-layered perceptron: Implications for child language acquisition. Cognition, 38, 43-102. doi:10.1016/0010-0277(91)90022-V
62. Plunkett, K., & Marchman, V. (1993). From rote learning to system building: Acquiring verb morphology in children and connectionist nets. Cognition, 48, 21-69. doi:10.1016/0010-0277(93)90057-3
63. Prasada, S., & Pinker, S. (1993). Generalisation of regular and irregular morphological patterns. Language and Cognitive Processes, 8, 1-56. doi:10.1080/01690969308406948
64. Quartz, S. R. (1999). The constructivist brain. Trends in Cognitive Sciences, 3, 48-57. doi:10.1016/S1364-6613(98)01270-4
65. Quartz, S. R., & Sejnowski, T. J. (1997). The neural basis of cognitive development: A constructivist manifesto. Behavioral and Brain Sciences, 20, 537-556. doi:10.1017/S0140525X97001581
66. Rosenblatt, F. (1958). The perceptron: A probabilistic model for informa-tion storage and organization in the brain. Psychological Review, 65, 386-408. doi:10.1037/h0042519
67. Rumelhart, D. E., & McClelland, J. L. (1986). On learning the past tenses of English verbs: Implicit rules or parallel distributed processing? In J. L. McClelland, D. E. Rumelhart, & the PDP Research Group (Eds.), Parallel distributed processing: Explorations in the microstructure of cognition: Vol. 2: Psychological and biological models (pp. 216-271). Cambridge, MA: MIT Press.
68. Shultz, T. R. (2003). Computational developmental psychology. Cambridge, MA: MIT Press.
69. Stemberger, J. P. (1993). Vowel dominance in overregularizations. Journal of Child Language, 20, 503-521. doi:10.1017/S030500090000845X
70. Stiles, J. (2009). On genes, brains, and behavior: Why should developmen-tal psychologists care about brain development? Child Development Perspectives, 3, 196-202. doi:10.1111/j.1750-8606.2009.00106.x
71. Tyler, L. K., deMornay-Davies, P., Anokhina, R., Longworth, C., Randall, B., & Marslen-Wilson, W. D. (2002). Dissociations in processing past tense morphology: Neuropathology and behavioral studies. Journal of Cognitive Neuroscience, 14, 79-94. doi:10.1162/089892902317205348
72. Tyler, L. K., Stamatakis, E. A., Jones, R. W., Bright, P., Acres, K., & Marslen-Wilson, W. D. (2004). Deficits for semantics and the irregular past tense: A causal relationship? Journal of Cognitive Neuroscience, 16, 1159-1172. doi:10.1162/0898929041920559
73. Ullman, M. T. (2004). Contributions of memory circuits to language: The declarative/procedural model. Cognition, 92, 231-270. doi:10.1016/j.cognition.2003.10.008
74. Ullman, M. T., Corkin, S., Coppola, M., Hickok, G., Growdon, J. H., Koroshetz, W. J., & Pinker, S. (1997). A neural dissociation within language: Evidence that the mental dictionary is part of declarative memory, and that grammatical rules are processed by the procedural
75. system. Journal of Cognitive Neuroscience, 9, 266-276. doi:10.1162/jocn.1997.9.2.266
76. Ullman, M. T., Pancheva, R., Love, T., Yee, E., Swinney, D., & Hickok, G. (2005). Neural correlates of lexicon and grammar: Evidence from the production, reading, and judgment of inflection in aphasia. Brain and Language, 93, 185-238. doi:10.1016/j.bandl.2004.10.001
77. van der Lely, H. K. J., & Ullman, M. T. (2001). Past tense morphology in specifically language impaired and normally developing children. Language and Cognitive Processes, 16, 177-217. doi:10.1080/01690960042000076
78. Westermann, G. (1998). Emergent modularity and U-shaped learning in a con-structivist neural network learning the English past tense. In M. A. Gernsbacher & S. J. Derry (Eds.), Proceedings of the 20th Annual Conference of the Cognitive Science Society (pp. 1130-1135). Hillsdale, NJ: Erlbaum.
79. Westermann, G. (2000). A constructivist dual-representation model of verb inflection. In L. R. Gleitman & A. K. Joshi (Eds.), Proceedings of the 22nd Annual Conference of the Cognitive Science Society (pp. 977-982). Austin, TX: Cognitive Science Society.
80. Westermann, G., Kovic, V., & Ruh, N (2008). English past tense inflection: Regular vs. irregular or easy vs. hard? In B. C. Love & K. McRae & V. M. Sloutsky (Eds.), Proceedings of the 30th Annual Conference of the Cognitive Science Society (pp. 739-744): Austin, TX: Cognitive Science Society.
81. Westermann, G., Mareschal, D., Johnson, M. H., Sirois, S., Spratling, M. W., & Thomas, M. S. C. (2007). Neuroconstructivism. Developmental Science, 10, 75-83. doi:10.1111/j.1467-7687.2007.00567.x
82. Westermann, G, & Plunkett, K. (2007). Connectionist models of inflection processing. Lingue e Linguaggio, 1, 291-311. doi:10.1418/25655