Toward a connectionist model of recursion in human linguistic performance

Cognitive Science

Volumn 23, Issue 2, 1999, Pages 157-205

  Christiansen, Morten H ^a   Chater, Nick ^b  

^a SOUTHERN ILLINOIS UNIVERSITY   (United States)

^b UNIVERSITY OF WARWICK   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0000046043     PISSN: 03640213     EISSN: None     Source Type: Journal    
DOI: 10.1207/s15516709cog2302_2     Document Type: Article

References (88)

1. Allen J., Christiansen M.H. Integrating multiple cues in word segmentation A connectionist model using hints . Proceedings of the Eighteenth Annual Cognitive Science Society Conference. 1996;370-375 Lawrence Erlbaum Associates, Mahwah, NJ.
2. Anderson J.R. The architecture of cognition. 1983;Harvard University Press, Cambridge, MA.
3. Bach E., Brown C., Marslen-Wilson W. Crossed and nested dependencies in German and Dutch A psycholinguistic study . Language and Cognitive Processes. 1:1986;249-262.
4. Batali J. Artificial evolution of syntactic aptitude. Proceedings from the Sixteenth Annual Conference of the Cognitive Science Society. 1994;27-32 Lawrence Erlbaum Associates, Hillsdale, NJ.
5. Berwick R.C., Weinberg A.S. The grammatical basis of linguistic performance Language use and acquisition . 1984;MIT Press, Cambridge, MA.
6. Blaubergs M.S., Braine M.D.S. Short-term memory limitations on decoding self-embedded sentences. Journal of Experimental Psychology. 102:1974;745-748.
7. Brill E., Magerman D., Marcus M., Santorini B. Deducing linguistic structure from the statistics of large corpora. DARPA Speech and Natural Language Workshop. 1990;Morgan Kaufmann, Hidden Valley, Pennsylvania.
8. Bullinaria J.A. Internal representations of a connectionist model of reading aloud. Proceedings from the Sixteenth Annual Conference of the Cognitive Science Society. 1994;84-89 Lawrence Erlbaum Associates, Hillsdale, NJ.
9. Chalmers D.J. Syntactic transformations on distributed representations. Connection Science. 2:1990;53-62.
10. Charniak E. Statistical language learning. 1993;MIT Press, Cambridge, MA.
11. Chater N., Conkey P. Finding linguistic structure with recurrent neural networks. Proceedings of the Fourteenth Annual Meeting of the Cognitive Science Society. 1992;402-407 Lawrence Erlbaum Associates, Hillsdale, NJ.
12. Chater N., Oaksford M. Autonomy, implementation and cognitive architecture A reply to Fodor and Pylyshyn . Cognition. 34:1990;93-107.
13. Chomsky N. Syntactic structures. 1957;Mouton, The Hague.
14. Chomsky N. Review of Skinner (1957). Language. 35:1959;26-58.
15. Chomsky N. Aspects of the theory of syntax. 1965;MIT Press, Cambridge, MA.
16. Christiansen M.H. The (non)necessity of recursion in natural language processing. Proceedings of the Fourteenth Annual Meeting of the Cognitive Science Society. 1992;665-670 Lawrence Erlbaum Associates, Hillsdale, NJ.
17. Christiansen, M. H. (1994). Infinite languages, finite minds: Connectionism, learning and linguistic structure. Unpublished doctoral dissertation, University of Edinburgh.
18. Christiansen, M. H. (1999). Intrinsic constraints on the processing of recursive sentence structure. Manuscript in preparation, Southern Illinois University.
19. Christiansen M.H., Allen J., Seidenberg M.S. Learning to segment speech using multiple cues A connectionist model . Language and Cognitive Processes. 13:1998;221-268.
20. Christiansen M.H., Chater N. Generalization and connectionist language learning. Mind and Language. 9:1994;273-287.
21. Christiansen, M. H. & MacDonald, M. C. (1999). Processing of recursive sentence structure: Testing predictions from a connectionist model. Manuscript in preparation, Southern Illinois University.
22. Church K. On memory limitations in natural language processing. 1982;Indiana University Linguistics Club, Bloomington, IN.
23. Cleeremans A., Servan-Schreiber D., McClelland J.L. Finite state automata and simple recurrent networks. Neural Computation. 1:1989;372-381.
24. Cliff N. Analyzing multivariate data. 1987;Harcourt Brace Jovanovich, Orlando, FL.
25. Cottrell G.W., Plunkett K. Learning the past tense in a recurrent network Acquiring the mapping from meanings to sounds . Proceedings of the Thirteenth Annual Meeting of the Cognitive Science Society. 1991;328-333 Lawrence Erlbaum Associates, Hillsdale, NJ.
26. Dell, G. S., Chang, F., & Griffin, Z. M. (in press). Connectionist models of language production: Lexical access and grammatical encoding. Cognitive Science.
27. Dickey, M. W. & Vonk, W. (1997). Center-embedded structures in Dutch: An on-line study. Poster presented at the Tenth Annual CUNY Conference on Human Sentence Processing. Santa Monica, CA, March 20-22.
28. Elman J.L. Finding structure in time. Cognitive Science. 14:1990;179-211.
29. Elman J.L. Distributed representation, simple recurrent networks, and grammatical structure. Machine Learning. 7:1991;195-225.
30. Elman J.L. Learning and development in neural networks The importance of starting small . Cognition. 48:1993;71-99.
31. Fanty, M. (1985). Context-free parsing in connectionist networks (Tech. Rep. No. TR-174). Rochester, NY: University of Rochester, Department of Computer Science.
32. Foss D.J., Cairns H.S. Some effects of memory limitations upon sentence comprehension and recall. Journal of Verbal Learning and Verbal Behavior. 9:1970;541-547.
33. Frazier L., Fodor J.D. The sausage machine A new two stage parsing model . Cognition. 6:1978;291-325.
34. Gale, W. & Church, K. (1990). Poor estimates of context are worse than none. In Proceedings of the June 1990 DARPA Speech and Natural Language Workshop. Hidden Valley, PA.
35. Gazdar, G. & Pullum, G. K. (1985). Computationally relevant properties of natural languages and their grammars (Tech. Rep. No. CSLI-85-24). Palo Alto, CA: Stanford University, Center for the Study of Language and Information.
36. Gibson E. Linguistic complexity Locality of syntactic dependencies . Cognition. 68:1998;1-76.
37. Gibson, E. & Thomas, J. (1997). Memory limitations and structural forgetting: The perception of complex ungrammatical sentences as grammatical. Unpublished manuscript, Cambridge, MA: MIT.
38. Gibson, E. & Thomas, J. (1996). The processing complexity of English center-embedded and self-embedded structures. In C. Schütze (Ed.) Proceedings of the NELS 26 sentence processing workshop (pp. 45-71). Cambridge, MA: MIT Occasional Papers in Linguistics 9.
39. Gibson E., Wexler K. Triggers. Linguistic Inquiry. 25:1994;407-454.
40. Giles C., Omlin C. Extraction, insertion and refinement of symbolic rules in dynamically driven recurrent neural networks. Connection Science. 5:1993;307-337.
41. Giles C., Miller C., Chen D., Chen H., Sun G., Lee Y. Learning and extracting finite state automata with second-order recurrent neural networks. Neural Computation. 4:1992;393-405.
42. Green D.M., Swets J.A. Signal detection theory and psychophysics. 1966;Wiley, New York.
43. Hadley R.F. Systematicity in connectionist language learning. Mind and Language. 9:1994;247-272.
44. Hanson S.J., Kegl J. PARSNIP A connectionist network that learns natural language grammar from exposure to natural language sentences . Proceedings of the Eight Annual Meeting of the Cognitive Science Society. 1987;106-119 Lawrence Erlbaum Associates, Hillsdale, NJ.
45. Jelinek, F., Lafferty, J. D., & Mercer, R. L. (1990). Basic methods of probabilistic context-free grammars (Tech. Rep. RC 16374 (72684)). Yorktown Heights, NY: IBM.
46. Joshi A.K. Processing crossed and nested dependencies An automaton perspective on the psycholinguistic results . Language and Cognitive Processes. 5:1990;1-27.
47. Just M.A., Carpenter P.A. A capacity theory of comprehension Individual differences in working memory . Psychological Review. 99:1992;122-149.
48. Kimball J. Seven principles of surface structure parsing in natural language. Cognition. 2:1973;15-47.
49. King J., Just M.A. Individual differences in syntactic processing The role of working memory . Journal of Memory and Language. 30:1991;580-602.
50. Kolen J.F. The origin of clusters in recurrent neural network state space. Proceedings from the Sixteenth Annual Conference of the Cognitive Science Society. 1994;508-513 Lawrence Erlbaum Associates, Hillsdale, NJ.
51. Larkin W., Burns D. Sentence comprehension and memory for embedded structure. Memory & Cognition. 5:1977;17-22.
52. Luce D. Individual choice behavior. 1959;Wiley, New York.
53. MacDonald, M. C. & Christiansen, M. H. (1999). Reassessing working memory: A reply to Just & Carpenter and Waters & Caplan. Manuscript submitted for publication.
54. Marcus M. A theory of syntactic recognition for natural language. 1980;MIT Press, Cambridge, MA.
55. Marks L.E. Scaling of grammaticalness of self-embedded English sentences. Journal of Verbal Learning and Verbal Behavior. 7:1968;965-967.
56. McClelland J.L., Kawamoto A.H. Mechanisms of sentence processing. McClelland J.L., Rumelhart D.E. Parallel distributed processing. Vol. 2:1986;272-325 MIT Press, Cambridge, MA.
57. Miller G.A. Some psychological studies of grammar. American Psychologist. 17:1962;748-762.
58. Miller G.A., Isard S. Free recall of self-embedded English sentences. Information and Control. 7:1964;292-303.
59. Miyata Y., Smolensky P., Legendre G. Distributed representation and parallel distributed processing of recursive structures. Proceedings of the Fifteenth Annual Meeting of the Cognitive Science Society. 1993;759-764 Lawrence Erlbaum, Hillsdale, NJ.
60. Mozer M.C., Soukup T. Connectionist music composition based on melodic and stylistic constraints. Lippmann R.P., Moody J.E., Touretzky D.S. Advances in Neural Information Processing Systems 3. 1991;789-796 Morgan-Kaufmann, San Mateo, CA.
61. Newell A., Simon H.A. Computer science as empirical inquiry. Communications of the ACM. 19:1976;113-126.
62. Niklasson L., van Gelder. On being systematically connectionist. Mind and Language. 9:1994;288-302.
63. Niyogi P., Berwick R.C. A language learning model for finite parameter spaces. Cognition. 61:1996;161-193.
64. Norris D.G. A dynamic net model of human speech recognition. Altmann G. Cognitive models of speech processing Psycholinguistic and cognitive perspectives . 1990;MIT Press, Cambridge, Mass.
65. Pollack J.B. Recursive auto-associative memory Devising compositional distributed representations . Proceedings of the Tenth Annual Meeting of the Cognitive Science Society. 1988;33-39 Lawrence Erlbaum Associates, Hillsdale, NJ.
66. Pollack J.B. Recursive distributed representations. Artificial Intelligence. 46:1990;77-105.
67. Pullum G.K., Gazdar G. Natural languages and context-free languages. Linguistics and Philosophy. 4:1982;471-504.
68. Pulman S.G. Grammars, parsers, and memory limitations. Language and Cognitive Processes. 2:1986;197-225.
69. Rambow O., Joshi A.K. A processing model for free word-order languages. Clifton C., Frazier L., Rayner K. Perspectives on sentence processing. 1994;267-301 Lawrence Erlbaum Associates, Hillsdale, NJ.
70. Redington M., Chater N., Finch S. Distributional information A powerful cue for acquiring syntactic categories . Cognitive Science. 22:1998;425-469.
71. Reich P. The finiteness of natural language. Language. 45:1969;831-843.
72. Rumelhart D.E., Hinton G.E., Williams R.J. Learning internal representations by error propagation. McClelland J.L., Rumelhart D.E. Parallel distributed processing. Vol. 1:1986;318-362 MIT Press, Cambridge, MA.
73. Schütze C.T. The empirical base of linguistics Grammaticality judgments and linguistic methodology . 1996;The University of Chicago Press, Chicago, IL.
74. Servan-Schreiber D., Cleeremans A., McClelland J.L. Graded state machines The representation of temporal contingencies in simple recurrent networks . Machine Learning. 7:1991;161-193.
75. Shieber S. Evidence against the context-freeness of natural language. Linguistics and Philosophy. 8:1985;333-343.
76. Shillcock R., Levy J., Chater N. A connectionist model of word recognition in continuous speech. Proceedings from the Thirteenth Annual Conference of the Cognitive Science Society. 1991;340-345 Lawrence Erlbaum Associates, Hillsdale, NJ.
77. Small, S. L., Cottrell, G. W., & Shastri, L. (1982). Towards connectionist parsing. In Proceedings of the National Conference on Artificial Intelligence. Pittsburgh, PA.
78. Smolensky, P. (in press). Grammar-based connectionist approaches to language. Cognitive Science.
79. Stabler E.P. The finite connectivity of linguistic structure. Clifton C., Frazier L., Rayner K. Perspectives on sentence processing. 1994;303-336 Lawrence Erlbaum Associates, Hillsdale, NJ.
80. Steijvers M., Grünwald P. A recurrent network that performs a context-sensitive prediction task. Proceedings from the Eighteenth Annual Conference of the Cognitive Science Society. 1996;335-339 Lawrence Erlbaum Associates, Mahwah, NJ.
81. Stolcke A. Syntactic category formation with vector space grammars. Proceedings from the Thirteenth Annual Conference of the Cognitive Science Society. 1991;908-912 Lawrence Erlbaum Associates, Hillsdale, NJ.
82. Stolz W.S. A study of the ability to decode grammatically novel sentences. Journal of Verbal Learning and Verbal Behavior. 6:1967;867-873.
83. Vogel, C., Hahn, U., & Branigan, H. (1996). Cross-serial dependencies are not hard to process. In Proceedings of COLING-96, The 16th International Conference on Computational Linguistics (pp. 157-162), Copenhagen, Denmark.
84. Wanner E. The ATN and the sausage machine Which one is baloney? Cognition. 8:1980;209-225.
85. Weckerly J., Elman J. A PDP approach to processing center-embedded sentences. Proceedings of the Fourteenth Annual Meeting of the Cognitive Science Society. 1992;414-419 Lawrence Erlbaum Associates, Hillsdale, NJ.
86. Wiles J., Bloesch A. Operators and curried functions Training and analysis of simple recurrent networks . Moody J.E., Hanson S.J., Lippmann R.P. Advances in Neural Information Processing Systems 4. 1992;Morgan-Kaufmann, San Mateo, CA.
87. Wiles J., Elman J. Learning to count without a counter A case study of dynamics and activation landscapes in recurrent networks . Proceedings of the Seventeenth Annual Meeting of the Cognitive Science Society. 1995;482-487 Lawrence Erlbaum Associates, Hillsdale, NJ.
88. Wiles J., Ollila M. Intersecting regions The key to combinatorial structure in hidden unit space . Hanson S.J., Cowan J.D., Giles C.L. Advances in Neural Information Processing Systems 5. 1993;27-33 Morgan-Kaufmann, San Mateo, CA.