Learning to order words: A connectionist model of heavy NP shift and accessibility effects in Japanese and English

Journal of Memory and Language

Volumn 61, Issue 3, 2009, Pages 374-397

  Chang, Franklin ^a,b  

^a Hanyang University   (South Korea)

^b NTT Communication Science Laboratories   (Japan)

Author keywords

Connectionist model; Cross linguistic; English; Japanese; Learning; Sentence production; Syntax acquisition; Word order

Indexed keywords

EID: 69449102180     PISSN: 0749596X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jml.2009.07.006     Document Type: Article

References (93)

1. Agresti A. Categorical data analysis (2002), John Wiley & Sons, Inc., Hoboken, NJ
2. Aikawa, T., Melero, M., Schwartz, L., & Wu, A. (2001). Sentence generation for multilingual machine translation. In 8th European workshop on natural language generation, Toulouse, France.
3. Allum P.H., and Wheeldon L.R. Planning scope in spoken sentence production: The role of grammatical units. Journal of Experimental Psychology: General 33 (2007) 791-810
4. Altmann G.T.M., and Kamide Y. Incremental interpretation at verbs: Restricting the domain of subsequent reference. Cognition 73 (1999) 247-264
5. Arnold J.E., Wasow T., Losongco A., and Ginstrom R. Heaviness vs. Newness: The effect of structural complexity and discourse status on constituent ordering. Language 76 1 (2000) 28-55
6. Baayen R.H. Analyzing linguistic data: A practical introduction to statistics (2008), Cambridge University Press, New York
7. Baayen R.H., Davidson D.J., and Bates D.M. Mixed-effects modeling with crossed random effects for subjects and items. Journal of Memory and Language 59 4 (2008) 390-412
8. Baker M.C. Mapping the terrain of language learning. Language Learning and Development 1 1 (2005) 93-129
9. Bencini G.M.L., and Valian V. Abstract sentence representation in 3-year-olds: Evidence from comprehension and production. Journal of Memory and Language 59 (2008) 97-113
10. Benor S.B., and Levy R. The chicken or the egg? A probabilistic analysis of English binomials. Language 82 2 (2006) 233-278
11. Bock J.K. Toward a cognitive psychology of syntax: Information processing contributions to sentence formulation. Psychological Review 89 (1982) 1-47
12. Bock J.K. Meaning, sound, and syntax: Lexical priming in sentence production. Journal of Experimental Psychology: Learning, Memory and Cognition 12 (1986) 575-586
13. Bock J.K. An effect of the accessibility of word forms on sentence structures. Journal of Memory and Language 26 2 (1987) 119-137
14. Bock J.K., and Griffin Z.M. The persistence of structural priming: Transient activation or implicit learning?. Journal of Experimental Psychology: General 129 (2000) 177-192
15. Bock J.K., and Irwin D.E. Syntactic effects of information availability in sentence production. Journal of Verbal Learning and Verbal Behavior 19 4 (1980) 467-484
16. Bock J.K., Irwin D.E., Davidson D.J., and Levelt W.J.M. Minding the clock. Journal of Memory and Language 48 4 (2003) 653-685
17. Bock J.K., and Levelt W. Language production: Grammatical encoding. In: Gernsbacher M.A. (Ed). Handbook of psycholinguistics (1994), Academic Press, San Diego 945-984
18. Bock J.K., and Loebell H. Framing sentences. Cognition 35 (1990) 1-39
19. Bock J.K., Loebell H., and Morey R. From conceptual roles to structural relations: Bridging the syntactic cleft. Psychological Review 99 (1992) 150-171
20. Bock J.K., and Warren R.K. Conceptual accessibility and syntactic structure in sentence formulation. Cognition 21 (1985) 47-67
21. Botvinick M., and Plaut D.C. Doing without schema hierarchies: A recurrent connectionist approach to normal and impaired routine sequential action. Psychological Review 111 (2004) 395-429
22. Branigan H.P., and Feleki E. Conceptual accessibility and serial order in Greek speech production. Proceedings of the 21st cognitive science society conference (1999), Canada, Vancouver
23. Branigan H.P., Pickering M.J., and Tanaka M. Contributions of animacy to grammatical function assignment and word order during production. Lingua 118 2 (2008) 172-189
24. Bresnan, J., Cueni, A., Nikitina, T., & Baayen, R. H. (2004). Predicting the dative alternation. In Proceedings of the royal Netherlands academy of science colloquium on foundations of interpretation, Amsterdam.
25. Brown P.M., and Dell G.S. Adapting production to comprehension: The explicit mention of instruments. Cognitive Psychology 19 (1987) 441-472
26. Byrne B., and Davidson E. On putting the horse before the cart: Exploring conceptual bases of word order via acquisition of a miniature artificial language. Journal of Memory and Language 24 (1985) 377-389
27. Chang F. Symbolically speaking: A connectionist model of sentence production. Cognitive Science 26 (2002) 609-651
28. Chang F., Dell G.S., and Bock J.K. Becoming syntactic. Psychological Review 113 (2006) 234-272
29. Chang F., Dell G.S., Bock K., and Griffin Z.M. Structural priming as implicit learning: A comparison of models of sentence production. Journal of Psycholinguistic Research 29 (2000) 217-229
30. Chang F., Lieven E., and Tomasello M. Automatic evaluation of syntactic learners in typologically-different languages. Cognitive Systems Research 9 (2008) 198-213
31. Cheung, A. (2006). Processing factors in language comprehension and production: The case of Cantonese dative constructions. Unpublished master's thesis. The University of Hong Kong, Hong Kong.
32. Clark H. Using language (1996), Cambridge University Press, Cambridge
33. Croft W. Radical construction grammar: Syntactic theory in typological perspective (2001), Oxford University Press, Oxford, UK
34. de Marneffe M.-C., Grimm S., Priva U.C., Lestrade S., Ouzbek G., Schnoebelen T., et al. A statistical model of grammatical choices in children's production of dative sentences (2007), Formal Approaches to Variation in Syntax, University of York, England
35. De Smedt K. Parallelism in incremental sentence generation. In: Adriaens G., and Hahn U. (Eds). Parallel natural language processing (1994), Ablex, Norwood, NJ 421-447
36. Dell G.S. A spreading-activation theory of retrieval in sentence production. Psychological Review 93 (1986) 283-321
37. Dell G.S., Burger L.K., and Svec W.R. Language production and serial order: A functional analysis and a model. Psychological Review 104 (1997) 123-147
38. Dell G.S., Chang F., and Griffin Z.M. Connectionist models of language production: Lexical access and grammatical encoding. Cognitive Science 23 (1999) 517-542
39. In: Dijkstra A., and De Smedt K. (Eds). Computational psycholinguistics: AI and connectionist models of human language processing (1996), Taylor & Francis, London
40. Dominey P.F., Hoen M., and Inui T. A neurolinguistic model of grammatical construction processing. Journal of Cognitive Neuroscience 18 (2006) 2088-2107
41. Elman J.L. Finding structure in time. Cognitive Science 14 (1990) 179-211
42. Ferreira F. Choice of the passive voice is affected by verb type and animacy. Journal of Memory and Language 33 (1994) 715-736
43. Ferreira V.S. Is it better to give than to donate? Syntactic flexibility in language production. Journal of Memory and Language 35 5 (1996) 724-755
44. Ferreira V.S., Bock K., Wilson M., and Cohen N.J. Memory for syntax despite amnesia. Psychological Science 19 (2008) 940-946
45. Ferreira V.S., and Dell G.S. Effect of ambiguity and lexical availability on syntactic and lexical production. Cognitive Psychology 40 (2000) 296-340
46. Ferreira V.S., and Yoshita H. Given-new ordering effects on the production of scrambled sentences in Japanese. Journal of Psycholinguistic Research 32 (2003) 669-692
47. Fitz H. Neural Syntax (2009), ILLC publication series, Amsterdam
48. Fitz, H. & Chang, F. (2008). The role of the input in a connectionist account of the accessibility hierarchy in development. In Proceedings of the 32nd Boston University Conference on Language Development. (pp. 120-131).
49. Garrett M.F. Processes in language production. In: Newmeyer F.J. (Ed). Linguistics: The Cambridge survey. Language: Psychological and biological aspects Vol. 3 (1988), Cambridge University Press, Cambridge, England 69-96
50. Gibson E. Linguistic complexity: Locality of syntactic dependencies. Cognition 68 (1998) 1-76
51. Gleitman L.R., January D., Nappa R., and Trueswell J.C. On the give and take between event apprehension and utterance formulation. Journal of Memory and Language 57 4 (2007) 544-569
52. Gordon J.K., and Dell G.S. Learning to divide the labor: An account of deficits in light and heavy verb production. Cognitive Science 27 (2003) 1-40
53. Griffin Z.M., and Bock K. What the eyes say about speaking. Psychological Science 11 (2000) 274-279
54. Hakuta K. Grammatical description versus configurational arrangement in language acquisition: The case of relative clauses in Japanese. Cognition 9 (1981) 197-236
55. Hakuta K., de Villiers J.G., and Tager-Flusberg H. Sentence coordination in Japanese and English. Journal of Child Language 9 (1982) 193-207
56. Hartsuiker R.J., Bernolet S., Schoonbaert S., Speybroeck S., and Vanderelst D. Syntactic priming persists while the lexical boost decays: Evidence from written and spoken dialogue. Journal of Memory and Language 58 2 (2008) 214-238
57. Hawkins J.A. A performance theory of order and constituency (1994), Cambridge University Press, Cambridge, UK
58. Hawkins J.A. Efficiency and complexity in grammars (2004), Oxford University Press, New York City
59. Horton W.S., and Gerrig R.J. Conversational common ground and memory processes in language production. Discourse Processes 40 1 (2005) 1-35
60. Huttenlocher J., Vasilyeva M., and Shimpi P. Syntactic priming in young children. Journal of Memory and Language 50 2 (2004) 182-195
61. Jaeger, T. F., & Snider, N. (2008). Implicit learning and syntactic persistence: Surprisal and cumulativity. In Proceedings of the cognitive science society conference, Washington, DC.
62. Kaschak M.P., and Borreggine K.L. Is long-term structural priming affected by patterns of experience with individual verbs?. Journal of Memory and Language 58 (2008) 862-878
63. Kelly, M. (1986). On the selection of linguistic options. Unpublished doctoral dissertation, Cornell University, Ithaca, NY.
64. Kelly M.H., Bock J.K., and Keil F.C. Prototypicality in a linguistic context: Effects on sentence structure. Journal of Memory and Language 25 1 (1986) 59-74
65. Kempen G., and Harbusch K. Word order scrambling as a consequence of incremental sentence production. In: Härtl H., and Tappe T. (Eds). Mediating between concepts and grammar (2003), Mouton De Gruyter, Berlin 141-164
66. Kempen G., and Harbusch K. A corpus study into word order variation in German subordinate clauses: Animacy affects linearization independently of grammatical function assignment. In: Pechmann T. (Ed). Language production (2004), Mouton, Berlin
67. Kempen G., and Hoenkamp E. An incremental procedural grammar for sentence formulation. Cognitive Science 11 (1987) 201-258
68. Konopka A.E., and Bock K. Lexical or syntactic control of sentence formulation? Structural generalizations from idiom production. Cognitive Psychology 58 (2009) 68-101
69. Langkilde-Geary, I. (2002). An empirical verification of coverage and correctness for a general-purpose sentence generator. In Proceedings of the international natural language generation conference, New York City, NY.
70. Lohse B., Hawkins J.A., and Wasow T. Domain minimization in English verb-particle constructions. Language 80 (2004) 238-261
71. Mazuka R. The development of language processing strategies: A cross-linguistic study between Japanese and English (1998), Lawrence Erlbaum Associates, Mahwah, NJ
72. McDonald J.L., Bock K., and Kelly M.H. Word and world order: Semantic, phonological, and metrical determinants of serial position. Cognitive Psychology 25 (1993) 188-230
73. Narasimhan B., and Dimroth C. Word order and information status in child language. Cognition 107 (2008) 317-329
74. Onishi K.H., Murphy G.L., and Bock K. Prototypicality in sentence production. Cognitive Psychology 56 (2008) 103-141
75. Pinker S. Language learnability and language development (1984), Harvard University Press, Cambridge, MA
76. Pinker S. Learnability and cognition: The acquisition of argument structure (1989), MIT Press, Cambridge, MA
77. Pinker S., and Birdsong D. Speakers' sensitivity to rules of frozen word order. Journal of Verbal Learning and Verbal Behavior 18 4 (1979) 497-508
78. Pomerleau D.A. Efficient training of artificial neural networks for autonomous navigation. Neural Computation 3 1 (1991) 88-97
79. Prat-Sala M., and Branigan H.P. Discourse constraints on syntactic processing in language production: A cross-linguistic study in English and Spanish. Journal of Memory and Language 42 2 (2000) 168-182
80. Rohde D.L.T. LENS: The light, efficient network simulator (No. CMU-CS-99-164) (1999), Carnegie Mellon University, Department of Computer Science, Pittsburgh, PA
81. Roland D., Dick F., and Elman J.L. Frequency of basic English grammatical structures: A corpus analysis. Journal of Memory and Language 57 (2007) 348-379
82. Rosenbach A. Animacy versus weight as determinants of grammatical variation in English. Language 81 613-644 (2005)
83. Ross, J. R. (1967). Constraints on variables in syntax. Unpublished doctoral dissertation, Massachusetts Institute of Technology, Cambridge.
84. Savage C., Lieven E.V.M., Theakston A.L., and Tomasello M. Testing the abstractness of children's linguistic representations: Lexical and structural priming of syntactic constructions in young children. Developmental Science 6 5 (2003) 557-567
85. Sridhar S.N. Cognition and sentence production: A cross-linguistic study (1988), Springer-Verlag, New York
86. St. John M.F., and McClelland J.L. Learning and applying contextual constraints in sentence comprehension. Artificial Intelligence 46 1-2 (1990) 217-257
87. Stallings L.M., MacDonald M.C., and O'Seaghdha P.G. Phrasal ordering constraints in sentence production: Phrase length and verb disposition in heavy-NP shift. Journal of Memory and Language 39 3 (1998) 392-417
88. Staub A., Clifton C.J., and Frazier L. Heavy NP shift is the parser's last resort: Evidence from eye movements. Journal of Memory and Language 54 3 (2006) 389-406
89. Tanaka, M., Branigan, H. P., & Pickering, M. J. (2008). Conceptual influences on word order and voice in Japanese sentence production. Unpublished manuscript.
90. Thothathiri M., and Snedeker J. Give and take: Syntactic priming during spoken language comprehension. Cognition 108 (2008) 51-68
91. Tomasello M. Constructing a language: A usage-based theory of language acquisition (2003), Harvard University Press, Cambridge, MA
92. Wasow T. Postverbal behavior (2002), CSLI Publications, Stanford
93. Yamashita H., and Chang F. "Long before short" preference in the production of a head-final language. Cognition 81 (2001) B45-B55