A neural network model of the effects of entrenchment and memory development on grammatical gender learning

Bilingualism

Volumn 16, Issue 2, 2013, Pages 246-265

  Monner, Derek ^a   Vatz, Karen ^a   Morini, Giovanna ^a   Hwang, So One ^b   Dekeyser, Robert ^a  

^a UNIVERSITY OF MARYLAND   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

age effects; entrenchment; grammatical gender; memory development; recurrent neural networks

Indexed keywords

EID: 84874939704     PISSN: 13667289     EISSN: 14691841     Source Type: Journal    
DOI: 10.1017/S1366728912000454     Document Type: Article

References (91)

1. Abrahamsson, N., & Hyltenstam, K. (2008). The robustness of aptitude effects in near-native second language acquisition. Studies in Second Language Acquisition, 30 (4), 481-509.
2. Abrahamsson, N., & Hyltenstam, K. (2009). Age of onset and nativelikeness in a second language: Listener perception versus linguistic scrutiny. Language Learning, 59 (2), 249-306.
3. Avons, S. E., Wragg, C. A., Cupplesa, W. L., & Lovegrove, W. J. (1998).Measures of phonological short-term memory and their relationship to vocabulary development. Applied Psycholinguistics, 19, 583-601. (Pubitemid 128182373)
4. Baddeley, A. (2003). Working memory and language: An overview. Journal of Communication Disorders, 36, 189-208. (Pubitemid 36547905)
5. Baddeley, A. D., Gathercole, S. E., & Papagno, C. (1998). The phonological loop as a language learning device. Psychological Review, 105, 158-173. (Pubitemid 128459562)
6. Baker, W. (2010). Effects of age and experience on the production of English word-final stops by Korean speakers. Bilingualism: Language and Cognition, 13 (3), 263-278.
7. Bley-Vroman, R. (1988). The fundamental character of foreign language learning. InW. Rutherford &M. Sharwood Smith (eds.), Grammar and second language teaching: A book of readings, pp. 19-30. New York: Newbury House.
8. Brown, G. D. A., & Hulme, C. (1996). Non-word repetition, STM, and age-of-acquisition: A computational model. In S. E. Gathercole (ed.), Models of short-term memory, pp. 129-148, Hove: Psychology Press.
9. Carroll, S. E. (1995). The hidden dangers of computer modeling: Remarks on Sokolik and Smith's connectionist learning model of French gender. Second Language Research, 11 (3), 193-205.
10. Chen, L., Shu, H., Liu, Y., Zhao, J., & Li, P. (2007). ERP signatures of subject-verb agreement in L2 learning. Bilingualism: Language and Cognition, 10 (2), 161-174.
11. Cochran, B. P., McDonald, J. L., & Parault, S. J. (1999). Too smart for their own good: The disadvantage of a superior processing capacity for adult language learners. Journal of Memory and Language, 41, 30-58.
12. Conway, A. R. A., Cowan, N., & Bunting, M. F. (2001). The cocktail party phenomenon revisited: The importance of WM capacity. Psychonomic Bulletin & Review, 8, 331-335. (Pubitemid 33604184)
13. Corbett, G. (1991). Gender. New York: Cambridge University Press.
14. CUMBRE(n.d.).Corpus del Español Contemporáneo de España e Hispanoamérica Madrid: SGEL.
15. DeKeyser, R. M. (2000). The robustness of critical period effects in second language acquisition. Studies in Second Language Acquisition, 22 (4), 499-533.
16. DeKeyser, R. M. (2012). Age effects in second language learning. In S. Gass & A. Mackey (eds.), Handbook of second language acquisition, pp. 442-460. London: Routledge.
17. DeKeyser, R. M., Alfi-Shabtay, I., & Ravid, D. (2010). Crosslinguistic evidence for the nature of age effects in second language acquisition. Applied Psycholinguistics, 31 (3), 413-438.
18. DeKeyser, R. M., & Larson-Hall, J. (2005). What does the critical period really mean? In J. F. Kroll & A. M. B. de Groot (eds.), Handbook of bilingualism: Psycholinguistic approaches, pp. 89-108. Oxford: Oxford University Press.
19. Duncan, J., Seitz, R. J., Kolodny, J., Bor, D., Herzog, H., & Ahmed, A. (2000). A neural basis for general intelligence. Science, 289 (5478), 457.
20. Elman, J. L. (1990). Finding structure in time. Cognitive Science, 14, 179-211.
21. Elman, J. L. (1993). Learning and development in neural networks: The importance of starting small. Cognition, 48, 71-99.
22. Engle, R. W. (2002). Working memory capacity as executive attention. Current Directions in Psychological Science, 11 (1), 19-23.
23. Gathercole, S. E. (1999). Cognitive approaches to the development of short-term memory. Trends in Cognitive Sciences, 3 (11), 410-419. (Pubitemid 29499809)
24. Gathercole, S. E., & Baddeley, A. D. (1993). Working memory and language. Hove: Lawrence Erlbaum.
25. Gathercole, S. E., & Pickering, S. J. (2000). Assessment of working memory in six-and seven-year old children. Journal of Educational Psychology, 92, 377-390.
26. Gers, F. A.,&Cummins, F. (2000). Learning to forget: Continual prediction with LSTM. Neural Computation, 12 (10), 2451-2471.
27. Gers, F. A.,&Schmidhuber, J. (2001). LSTMrecurrent networks learn simple context-free and context-sensitive languages. IEEE Transactions on Neural Networks, 12 (6), 1333-1340. (Pubitemid 33106038)
28. Goldowsky, B. N., & Newport, E. L. (1993). Modeling the effects of processing limitations on the acquisition of morphology: The less is more hypothesis. In E. Clark (ed.), Proceedings of the 24th Annual Child Language Research Forum, pp. 124-138. Stanford, CA: Center for the Study of Language and Information (CSLI).
29. Guillelmon, D., & Grosjean, F. (2001). The gender marking effect in spoken word recognition: The case of bilinguals. Memory & Cognition, 29, 503-511. (Pubitemid 34163663)
30. Guion, S. G., Harada, T., & Clark, J. J. (2004). Early and late Spanish-English bilinguals' acquisition of English word stress patterns. Bilingualism: Language and Cognition, 7, 207-226.
31. Hakuta, K., Bialystok, E., &Wiley, E. (2003). Critical evidence: A test of the critical-period hypothesis for second-language acquisition. Psychological Science, 14 (1), 31-38. (Pubitemid 37283113)
32. Harley,B. (1979). French gender 'rules' in the speech of Englishdominant, French-dominant and monolingual Frenchspeaking children. Working Papers in Bilingualism, 19, 129-156.
33. Hernandez, A.,&Li, P. (2007).Age of acquisition: Its neural and computational mechanisms. Psychological Bulletin, 133 (4), 638-650.
34. Hernandez, A., Li, P.,&MacWhinney,B. (2005). The emergence of competing modules in bilingualism. Trends in Cognitive Sciences, 9 (5), 220-225. (Pubitemid 40615109)
35. Hochreiter, S., & Schmidhuber, J. (1997). Long short-term memory. Neural Computation, 9 (8), 1735-1780. (Pubitemid 127462305)
36. Hudson Kam, C. L., & Newport, E. L. (2005). Regularizing unpredictable variation: The roles of adult and child learners in language Information and change. Language Learning and Development, 1 (2), 151-195.
37. Hudson Kam, C. L., & Newport, E. L. (2009). Getting it right by getting it wrong: When learners change languages. Cognitive Psychology, 59, 30-66.
38. Hyltenstam, K., & Abrahamsson, N. (2003). Maturational constraints in second language acquisition. In C. J. Doughty & M. H. Long (eds.), Handbook of second language acquisition, pp. 539-588. Oxford: Blackwell.
39. Iverson, P., Kuhl, P. K., Akahane-Yamada, R., Diesch, E., Tohkura, Y., Kettermann, A., & Siebert, C. (2003). A perceptual interference account of acquisition difficulties for non-native phonemes. Cognition, 87, B47-B57. (Pubitemid 36034228)
40. Jia, G., & Aaronson, D. (2003). A longitudinal study of Chinese children and adolescents learning English in the United States. Applied Psycholinguistics, 24 (1), 131-161. (Pubitemid 36891777)
41. Jia, G., Aaronson, D., & Wu, Y. (2002). Long-term language attainment of bilingual immigrants: Predictive variables and language group differences. Applied Psycholinguistics, 23 (4), 599-621. (Pubitemid 36399869)
42. Johnson, J. S., & Newport, E. L. (1989). Critical period effects in second language learning: The influence of maturational state on the acquisition of English as a second language. Cognitive Psychology, 21, 60-99.
43. Kane, M. J., & Engle, R. W. (2003). Working memory capacity and the control of attention: The contributions of goal neglect, response competition, and task set to Stroop interference. Journal of Experimental Psychology: General, 132, 47-70. (Pubitemid 37170598)
44. Kareev, Y., Lieberman, I., & Lev, M. (1997). Through a narrow window: Sample size and the perception of correlation. Journal of Experimental Psychology: General, 126 (3), 278-287.
45. Kersten, A. W., & Earles, J. L. (2001). Less really is more for adults learning a miniature artificial language. Journal of Memory and Language, 44, 250-273. (Pubitemid 33378328)
46. Lapkin, S., & Swain, M. (1977). The use of English and French cloze tests in a bilingual education program evaluation: Validity and error analysis. Language Learning, 27, 279-314.
47. Lenneberg, E. H. (1967). Biological foundations of language. New York: Wiley.
48. Lew-Williams, C., & Fernald, A. (2010). Real-time processing of gender-marked articles by native and non-native Spanish speakers. Journal of Memory and Language, 63, 447-464.
49. Li, P., Farkas, I., & MacWhinney, B. (2004). Early lexical development in a self-organizing neural network. Neural Networks, 17 (8-9), 1345-1362. (Pubitemid 39539546)
50. Li, P., Zhao, X., & Mac Whinney, B. (2007). Dynamic selforganization and early lexical development in children. Cognitive Science, 31 (4), 581-612.
51. Long, M. (1990). Maturational constraints on language development. Studies in Second Language Acquisition, 12 (3), 251-285.
52. Long, M. (2005). Problems with supposed counter-evidence to the Critical Period Hypothesis. International Review of Applied Linguistics in Language Teaching (IRAL), 43 (4), 287-316.
53. Lyster, R. (2006). Predictability in French gender attribution: A corpus analysis. Journal of French Language Studies, 16, 69-92.
54. MacWhinney, B. (2006). Emergent fossilization. In Z. Han & T. Odlin (eds.), Studies of fossilization in second language acquisition, pp. 134-156. Clevedon: Multilingual Matters.
55. MacWhinney, B., Leinbach, J., Taraban, R., & McDonald, J. (1989). Language learning: Cues or rules? Journal of Memory and Language, 28, 255-277.
56. Matthews, C. A. (1999). Connectionism and French gender attribution: Sokolik and Smith re-visited. Second Language Research, 15, 412-427.
57. Mayberry, R. I. (1993). First-language acquisition after childhood differs from second-language acquisition: The case of American Sign Language. Journal of Speech and Hearing Research, 36, 51-68.
58. Mayberry, R. I., & Lock, E. (2003). Age constraints on first versus second language acquisition: Evidence for linguistic plasticity and epigenesis. Brain and Language, 87, 369-383.
59. Mayberry, R. I., Lock, E.,&Kazmi, H. (2002). Linguistic ability and early language exposure. Nature, 417, 38. (Pubitemid 34498809)
60. Metsala, J. L. (1999). Young children's phonological awareness and non-word repetition as a function of vocabulary development. Journal of Educational Psychology, 91, 3-19
61. Miller, G. A. (1956). The magical number seven, plus or minus two: some limits on our capacity for processing Information. Psychological Review, 63, 81-97.
62. Monner, D., & Reggia, J. A. (2012). A generalized LSTMlike training algorithm for second-order recurrent neural networks. Neural Networks, 25, 77-83.
63. Morford, J. P., & Carlson, M. L. (2011). Sign perception and recognition in non-native signers of ASL. Language Learning and Development, 7, 149-168.
64. Munakata, Y. (2004). Computational cognitive neuroscience of early memory development. Developmental Review, 24, 133-153. (Pubitemid 38148286)
65. New, B. (2006). Lexique 3: Une nouvelle base de données lexicales. Actes de la Conférence Traitement Automatique des Langues Naturelles (TALN 2006), Louvain, Belgique. http://www.lexique.org (retrieved March 18, 2009).
66. Newport, E. L. (1988). Constraints on learning and their role in language acquisition: Studies of the acquisition of American Sign Language. Language Sciences, 10, 147-172.
67. Newport, E. L. (1990). Maturational constraints on language learning. Cognitive Science, 14 (1), 11-28.
68. O'Reilly, R. C.,&Frank, M. J. (2006).Makingworking memory work: A computational model of learning in the prefrontal cortex and nasal ganglia. Neural Computation, 18 (2), 283-328. (Pubitemid 43543839)
69. Paradis, M. (2009). Declarative and procedural determinants of second languages. Amsterdam: John Benjamins.
70. Petanjek, Z., Judaš, M., Kostovíc, I., & Uylings, H. B. (2008). Lifespan alterations of basal dendritic trees of pyramidal neurons in the human prefrontal cortex: A layer-specific pattern. Cerebral Cortex, 18, 915-929. (Pubitemid 351398351)
71. Pulvermüller, F., & Schumann, J. H. (1994). Neurobiological mechanisms of language acquisition. Language Learning, 44 (4), 681-734.
72. Rohde, D. L. T., & Plaut, D. C. (1999). Language acquisition in the absence of explicit negative evidence: How important is starting small? Cognition, 72, 67-109. (Pubitemid 29459117)
73. Sabourin, L., Stowe, L., & de Haan, G. (2006). Transfer effects in learning a second language grammatical gender system. Second Language Research, 22, 1-29. (Pubitemid 43275681)
74. Scherag, A., Demuth, L., Rösler, F., Neville, H. J., & Röder, B. (2004). The effects of late acquisition of L2 and the consequences of immigration on L1 for semantic and morphosyntactic language aspects. Cognition, 93, B97-B108. (Pubitemid 39445617)
75. Schmid, H. (1994). Probabilistic part-of-speech tagging using decision trees. Proceedings of the International Conference on New Methods in Language Processing, 12, 44-49.
76. Seidenberg, M. S., & Zevin, J. D. (2006). Connectionist models in developmental cognitive neuroscience: Critical periods and the paradox of success. In Y. Munakata & M. Johnson (eds.), Attention & Performance XXI: Processes of Change in Brain and Cognitive Development, pp. 585-612. Oxford: Oxford University Press.
77. Sokolik, M. E., & Smith, M. E. (1992). Assignment of gender to French nouns in primary and secondary language: A connectionist model. Second Language Research, 8, 39-58.
78. Surridge,M. E. (1989). Le facteur sémantique dans l'attribution du genre aux inanimés en français. Canadian Journal of Linguistics/Revue Canadienne de Linguistique, 34, 19-44.
79. Surridge, M. E. (1993). Gender assignment in French: The hierarchy of rules and the chronology of acquisition. International Review of Applied Linguistics in Language Teaching (IRAL), 31, 77-95.
80. Surridge, M. E. (1995). Le ou la? The gender of French nouns. Philadelphia, PA: Multilingual Matters.
81. Teschner, R. V., & Russell, W. M. (1984). The gender patterns of Spanish nouns: An inverse dictionary-based analysis. Hispanic Linguistics, 1, 115-132.
82. Thomas, M. S. C. (2009). Competition as a mechanism for producing sensitive periods in connectionist models of development. In J. Mayor, N. Ruh & K. Plunkett (eds.), Progress in Neural Processing 18: Proceedings of the Eleventh Neural Computation and Psychology Workshop, pp. 349-360. Singapore: World Scientific.
83. Thomas, M. S. C., & Johnson, M. H. (2008). New advances in understanding sensitive periods in brain development. Current Directions in Psychological Science, 17 (1), 1-5.
84. Trofimovich, P., & Baker,W. (2006). Learning second language suprasegmentals: Effect of L2 experience on prosody and fluency characteristics of L2 speech. Studies in Second Language Acquisition, 28 (1), 1-30. (Pubitemid 43379922)
85. Ullman, M. T. (2004). Contributions of memory circuits to language:The declarative/procedural model. Cognition, 92, 231-270. (Pubitemid 38270267)
86. Uylings, H. B.M. (2006). Development of the human cortex and the concept of "critical" or "sensitive" periods. Language Learning, 56, 59-90. (Pubitemid 44127824)
87. Vogel, E. K., McCollough, A. W., & Machizawa, M. G. (2005). Neural measures reveal individual differences in controlling access to working memory. Nature, 438, 500-503. (Pubitemid 41742021)
88. Wikipedia: The free encyclopedia. (2011). FL: Wikimedia Foundation, Inc http://www.wikipedia.org (retrieved January 15 2011)
89. Wilson, M., & Emmorey, K. (1997). A visuospatial "phonological loop" in working memory: Evidence from American Sign Language. Memory and Cognition, 25, 313-320. (Pubitemid 27225080)
90. Xie, X., & Seung, H. S. (2003). Equivalence of backpropagation and contrastive Hebbian learning in a layered network. Neural Computation, 15 (2), 441-454. (Pubitemid 37049828)
91. Zhao, X., & Li, P. (2010). Bilingual lexical interactions in an unsupervised neural network model. International Journal of Bilingual Education and Bilingualism, 13, 505-524.