Language acquisition in the absence of explicit negative evidence: How important is starting small?

Cognition

Volumn 72, Issue 1, 1999, Pages 67-109

  Rohde, Douglas L T ^a   Plaut, David C ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Connectionist simulations; Explicit negative evidence; Language acquisition

Indexed keywords

ARTICLE; CONTROLLED STUDY; LANGUAGE DEVELOPMENT; LEARNING; LINGUISTICS; MEMORY; PRIORITY JOURNAL; SEMANTICS; STOCHASTIC MODEL;

ARTIFICIAL INTELLIGENCE; HUMANS; LANGUAGE DEVELOPMENT; MODELS, STATISTICAL; NEURAL NETWORKS (COMPUTER);

EID: 0032888001     PISSN: 00100277     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0010-0277(99)00031-1     Document Type: Article

References (78)

1. Allen, J., Seidenberg, M.S., 1999. The emergence of grammaticality in connectionist networks. In: MacWhinney, B. (Ed.), Emergentist approaches to language, Proceedings of the 28th Carnegie Symposium on Cognition. Lawrence Erlbaum Associates, Hillsdale, NJ.
2. Angluin, D., 1988. Identifying languages from stochastic examples (Tech. Rep. YALEU/DCS/RR-614). Yale University, Department of Computer Science, New Haven, CT.
3. Baker C.L. Syntactic theory and the projection problem. Linguistic Inquiry. 10:1979;533-581.
4. Baker, C.L., McCarthy, J.J., 1981. The Logical Problem of Language Acquisition. The MIT Press, Cambridge, MA.
5. Bengio Y., Simard P., Frasconi P. Learning long-term dependencies with gradient descent is difficult. IEEE Transactions on Neural Networks. 5:1994;157-166.
6. Berwick, R.C., 1985. The acquisition of syntactic knowledge. The MIT Press, Cambridge, MA.
7. Berwick, R.C., 1987. Parsability and learnability. In: MacWhinney, B. (Ed.), Mechanisms of Language Acquisition. Lawrence Erlbaum Associates, Hillsdale, NJ, pp. 345-366.
8. Bowerman, M., 1987. Commentary: mechanisms of language acquisition. In: MacWhinney, B. (Ed.), Mechanisms of Language Acquisition. Lawrence Erlbaum Associates, Hillsdale, NJ, pp. 443-466.
9. Bowerman, M., 1988. The 'no negative evidence' problem: How do children avoid constructing an overly general grammar? In: Hawkins, J. (Ed.), Explaining Language Universals. Basil Blackwell, Oxford, pp. 73-101.
10. Chomsky, N., 1957. Syntactic structures. Mouton, The Hague.
11. Chomsky, N., 1981. Lectures on government and binding. Foris Publications, Dordrecht, Holland.
12. Cleeremans A., Servan-Schreiber D., McClelland J. Finite state automata and simple recurrent networks. Neural Computation. 1:1989;372-381.
13. Crain S. Language acquisition in the absence of experience. Behavioral and Brain Sciences. 14:1991;597-650.
14. Elman J.L. Finding structure in time. Cognitive Science. 14:1990;179-211.
15. Elman J.L. Distributed representations, simple recurrent networks, and grammatical structure. Machine Learning. 7:1991;195-225.
16. Elman J.L. Learning and development in neural networks: the importance of starting small. Cognition. 48:1993;71-99.
17. Elman, J.L., Bates, E.A., Johnson, M.H., Karmiloff-Smith, A., Parisi, D., Plunkett, K., 1996. Rethinking innateness: a connectionist perspective on development. MIT Press, Cambridge, MA.
18. Flege, J.E., 1992. Speech learning in a second language. In: Ferguson, C.A., Menn, L., Stoel-Gammon, C. (Eds.), Phonological Development: Models, Research, Implications. York Press, Timonium, MD, pp. 565-604.
19. Flege J.E., Munro M.J., MacKay I.R.A. Factors affecting strength of perceived foreign accent in a second language. Journal of the Acoustical Society of America. 97:1995;3125-3134.
20. Fodor, J.D., Crain, S., 1987. Simplicity and generality of rules in language acquisition. In: MacWhinney, B. (Ed.) Mechanisms of Language Acquisition. Lawrence Erlbaum Associates, Hillsdale, NJ, pp. 35-63.
21. Gallaway, C., Richards, B. (Eds.), 1994. Input and Interaction in Language Acquisition. Cambridge University Press, London.
22. Gold E.M. Language identification in the limit. Information and Control. 10:1967;447-474.
23. Goldowsky, B.N., Newport, E.J., 1993. Modeling the effects of processing limitations on the acquisition of morphology: the less is more hypothesis. In: E. Clark (Ed.), The Proceedings of the 24th Annual Child Language Research Forum. Center for the Study of Language and Information, Stanford, CA, pp. 124-138.
24. Gropen J., Pinker S., Hollander M., Goldberg R. Syntax and semantics in the acquisition of locative verbs. Journal of Child Language. 18:1991;115-151.
25. Hinton G.E., Shallice T. Lesioning an attractor network: investigations of acquired dyslexia. Psychological Review. 98:1991;74-95.
26. Hopcroft, J.E., Ullman, J.D., 1979. Introduction to Automata Theory, Languages, and Computation. Addison-Wesley, Reading, MA.
27. Horning, J.J., 1969. A study of grammatical inference. PhD thesis, Stanford University.
28. Huang, X.D., Ariki, Y., Jack, M.A., 1990. Hidden Markov Models for speech recognition. Edinburgh University Press, Edinburgh.
29. Johnson J.S., Newport E.J. Critical period effects in second language learning: the influence of maturational state on the acquisition of English as a second language. Cognitive Psychology. 21:1989;60-99.
30. Jordan M.I. Constrained supervised learning. Journal of Mathematical Psychology. 36:1992;396-425.
31. Jordan M.I., Rumelhart R.A. Forward models: supervised learning with a distal teacher. Cognitive Science. 16:1992;307-354.
32. Joyce, J., 1996. When/why/of what is less more? Masters thesis, Centre for Cognitive Science, University of Edinburgh.
33. Kapur, S., Bilardi, G., 1992. Language learning from stochastic input. In Proceedings of the 5th Annual ACM Workshop on Computational Learning Theory. Pittsburgh, PA, pp. 303-310.
34. Kawamoto, A.H., Farrar, W.T., Kello, C.T., 1994. When two meanings are better than one: modeling the ambiguity advantage using a recurrent distributed network. Journal of Experimental Psychology: Human Perception and Performance 20, 1233-1247.
35. Kohonen, T., 1984. Self-Organization and Associative Memory. Springer, New York.
36. Lin, T., Horne, B.G., Giles, C.L., 1996. How embedded memory in recurrent neural network architectures helps learning long-term temporal dependencies (Tech. Rep. CS-TR-3626, UMIACS-TR-96-28). University of Maryland, College Park, MD.
37. Logan S.E., Lively J.S., Pisoni D.B. Training Japanese listeners to identify English /r/ and /l/: a first report. Journal of the Acoustical Society of America. 89:1991;874-886.
38. Long M.H. Maturational constraints on language development. Studies in Second Language Acquisition. 12:1990;251-285.
39. Luce, D.R., 1986. Response Times. Oxford University Press, New York.
40. MacWhinney, B., 1991. The CHILDES Database. Discovery Systems, Dublin, OH.
41. MacWhinney B., Snow C. The Child Language Data Exchange System. Journal of Child Language. 12:1985;271-295.
42. MacWhinney, B., 1993. The (il)logical problem of language acquisition. Proceedings of the 15th Annual Conference of the Cognitive Science Society. Lawrence Erlbaum Associates, Mahwah, NJ, pp. 61-70.
43. Marchman V.A. Constraints on plasticity in a connectionist model of the English past tense. Journal of Cognitive Neuroscience. 5:1993;215-234.
44. Marcus G.F. Negative evidence in language acquisition. Cognition. 46:1993;53-85.
45. Marcus, G.F., Pinker, S., Ullman, M., Hollander, M., Rosen, T.J., Xu, F., 1992. Overregularization in Language Acquisition. Monographs of the Society for Research in Child Development 57(4), Serial No. 228.
46. Marslen-Wilson W. Functional parallelism in spoken word-recognition. Cognition. 25:1987;71-102.
47. McClelland, J.L., 1999. Failures to learn and their remediation: a competitive, Hebbian approach. In: McClelland, J.L., Siegler, R.S. (Eds.), Mechanisms of Cognitive Development: Behavioral and Neural Perspectives. Erlbaum, Mahwah, NJ, in press.
48. McClelland, J.L., 1994. The interaction of nature and nurture in development: a parallel distributed processing perspective. In: Bertelson, P., Eelen, P., d'Ydewalle, G. (Eds.), International Perspectives on Psychological Science, Vol. 1: Leading Themes. Erlbaum, Hillsdale, NJ, pp. 57-88.
49. McClelland J.L., McNaughton B.L., O'Reilly R.C. Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. Psychological Review. 102:1995;419-457.
50. McClelland, J.L., St. John, M., Taraban, R., 1989. Sentence comprehension: a parallel distributed processing approach. Language and Cognitive Processes 4, 287-335.
51. McCloskey, M., Cohen, N.J., 1989. Catastrophic interference in connectionist networks: the sequential learning problem. In: Bower, G.H. (Ed.), The Psychology of Learning and Motivation. Academic Press, New York, pp. 109-165.
52. Merzenich, M.M., Jenkins, W.M., 1995. Cortical plasticity, learning and learning dysfunction. In: Julesz, B., Kovacs, I. (Eds.), Maturational Windows and Adult Cortical Plasticity. Addison-Wesley, Reading, MA, pp. 247-272.
53. Merzenich M.M., Jenkins W.M., Johnson P., Schreiner C., Miller S.L., Tallal P. Temporal processing deficits of language-learning impaired children ameliorated by training. Science. 271:1996;77-81.
54. Miller, G.A., Chomsky, N., 1963. Finitary models of language users. In: Luce, R.D., Bush, R.B., Galanter, E. (Eds.), Handbook of Mathematical Psychology, Vol. II. Wiley, New York, pp. 419-491.
55. Morgan J.L., Bonamo K.M., Travis L.L. Negative evidence on negative evidence. Developmental Psychology. 31:1995;180-197.
56. Morgan J.L., Travis L.L. Limits on negative information in language input. Journal of Child Language. 16:1989;531-552.
57. Newport E.L. Maturational constraints on language learning. Cognitive Science. 14:1990;11-28.
58. Newport, E.L., Gleitman H., Gleitman, L.R., 1977. Mother, I'd rather do it myself: some effects and non-effects of maternal speech style. In: Snow, C.E., Ferguson, C.A. (Eds.), Talking to Children: Language Input and Acquisition. Cambridge University Press, Cambridge, UK, pp. 109-149.
59. Osherson, D., Stob, M., Weinstein, S., 1986. Systems That Learn. MIT Press, Cambridge, MA.
60. Pine, J.M., 1994. The language of primary caregivers. In: Gallaway, C., Richards, B.J. (Eds.), Input and Interaction in Language Acquisition. Cambridge University Press, Cambridge, UK, pp. 38-55.
61. Pinker, S., 1984. Language Learnability and Language Development. Harvard University Press, Cambridge, MA.
62. Quartz, S.R., Sejnowski, T.J., 1997. The neural basis of cognitive development: a constructivist manifesto. Behavioral and Brain Sciences 20, 537-596.
63. Ratcliff R. Connectionist models of recognition memory: constraints imposed by learning and forgetting functions. Psychological Review. 97:1990;285-308.
64. Richards, B.J., 1994. Child-directed speech and influences on language acquisition: methodology and interpretation. In: Gallaway, C., Richards, B.J. (Eds.), Input and Interaction in Language Acquisition. Cambridge University Press, Cambridge, UK, pp. 74-106.
65. Rohde, D.L.T., 1999. The Simple Language Generator: Encoding complex languages with simple grammars (Tech. Rep. CMU-CS-99-123). Carnegie Mellon University, Pittsburgh, PA.
66. Rohde, D.L.T., Plaut, D.C., 1997. Simple recurrent networks and natural language: how important is starting small? In Proceedings of the 19th Annual Conference of the Cognitive Science Society. Erlbaum, Hillsdale, NJ.
67. Rumelhart, D.E., Hinton, G.E., Williams, R.J., 1986. Learning internal representations by error propagation. In: Rumelhart, D.E., McClelland, J.L. and the PDP Research Group (Eds.), Parallel Distributed Processing: Explorations in the Microstructure of Cognition, Vol. 1: Foundations. MIT Press, Cambridge, MA, pp. 318-362.
68. Rumelhart, D.E., Durbin, R., Golden, R., Chauvin, Y., 1995. Backpropagation: The basic theory. In: Chauvin, Y., Rumelhart, D.E. (Eds.), Back-Propagation: Theory, Architectures, and Applications. Erlbaum, Hillsdale, NJ, pp. 1-34.
69. Seidenberg M.S. Language acquisition and use: learning and applying probabilistic constraints. Science. 275:1997;1599-1603.
70. Seidenberg, M.S., MacDonald, M.C., 1999. A probabilistic constraints approach to language acquisition and processing. Cognitive Science, in press.
71. Snow, C.E., 1994. Beginning from baby talk: twenty years of research on input and interaction. In: Gallaway, C., Richards, B.J. (Eds.), Input and Interaction in Language Acquisition. Cambridge University Press, Cambridge, UK, pp. 3-12.
72. Snow, C.E., 1995. Issues in the study of input: finetuning, universality, individual and developmental differences, and necessary causes. In: Fletcher, P., MacWhinney, B. (Eds.), The Handbook of Child Language. Blackwell, Oxford.
73. Snow, C.E., Ferguson, C.A. (Eds.), Talking to Children: Language Input and Acquisition. Cambridge University Press, Cambridge, UK.
74. Sokolov J.L. A local contingency analysis of the fine-tuning hypothesis. Developmental Psychology. 29:1993;1008-1023.
75. Sokolov, J.L., Snow, C.E., 1994. The changing role of negative evidence in theories of language development. In: Gallaway, C., Richards, B.J. (Eds.), Input and Interaction in Language Acquisition. Cambridge University Press, Cambridge, pp. 38-55.
76. Tallal P., Miller S.L., Bedi G., Byma G., Wang X., Nagaraja S.S., Schreiner C., Jenkins W.M., Merzenich M.M. Language comprehension in language-learning impaired children improved with acoustically modified speech. Science. 271:1996;81-84.
77. Thomas A., McClelland J.L. How plasticity can prevent adaptation: Induction and remediation of perceptual consequences of early experience (Abstract 97.2). Society for Neuroscience Abstracts. 23:1997;234.
78. Wexler, K., Cullicover, P., 1980. Formal Principles of Language Acquisition. MIT Press, Cambridge, MA.