The Logical Problem of Language Acquisition: A Probabilistic Perspective

Cognitive Science

Volumn 34, Issue 6, 2010, Pages 972-1016

  Hsu, Anne S ^a   Chater, Nick ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

Bayesian probabilistic models; Child language acquisition; Identification in the limit; Minimum description length; Natural language; No negative evidence; Poverty of the stimulus; Simplicity principle

Indexed keywords

EID: 78651501814     PISSN: 03640213     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1551-6709.2010.01117.x     Document Type: Article

References (77)

1. Ambridge, B., Pine, J., Rowland, C., & Young, C. (2008). The effect of verb semantic class and verb frequency (entrenchment) on children's and adults' graded judgements of argument-structure overgeneralization errors. Cognition, 106, 87-129.
2. Baker, C. L. (1979). Syntactic theory and the projection problem. Linguistic Inquiry, 10, 533-581.
3. Baker, C. L., & McCarthy, J. J. (1981). The logical problem of language acquisition. Cambridge, MA: MIT Press.
4. Bates, E., Marchman, V. A., Thal, D., Fenson, L., & Dale, P. (1994). Development and stylistic variation in the composition of early vocabulary. Journal of Child Language, 21, 85-123.
5. Beck, I. L., & McKeown, M. G. (1991). Social studies texts are hard to understand: Mediating some of the difficulties. Language Arts, 68, 482-490.
6. Bowerman, M.. (1988). The 'No Negative Evidence' problem: How do children avoid constructing an overly general grammar? In J. Hawkins (Ed.), Explaining language universals (pp. 73-101). Oxford, England: Blackwell.
7. Braine, M. D. S.. (1971). On two types of models on the internalization of grammars. In D. I. Slobin (Ed.), The ontogenesis of grammar (pp. 153-186). New York: Academic Press.
8. Brent, M. R. (1999). Speech segmentation and word discovery: A computational perspective. Trends in Cognitive Sciences, 3, 294-301.
9. Brooks, P., & Tomasello, M. (1999). How children constrain their argument structure constructions. Language, 75, 720-738.
10. Brooks, P., Tomasello, M., Dodson, K., & Lewis, L. (1999). Young children's overgeneralizations with fixed transitivity verbs. Child Development, 70, 1325-1337.
11. Brooks, P., & Zizak, O. (2002). Does preemption help children learn verb transitivity? Journal of Child Language, 29, 759-781.
12. Brown, R., & Hanlon, C. (1970). Derivational complexity and order of acquisition in child speech. In J. R. Hayes (Ed.), Cognition and the development of language. New York: Wiley.
13. Chater, N. (1996). Reconciling simplicity and likelihood principles in perceptual organization. Psychological Review, 103, 566-581.
14. Chater, N. (2004). What can be learned from positive data? Insights from an 'ideal learner'. Journal of Child Language, 31, 915-918.
15. Chater, N., & Vitányi, P. (2002). Simplicity: A unifying principle in cognitive science? Trends in Cognitive Sciences, 7, 19-22.
16. Chater, N., & Vitányi, P. (2007). Ideal learning' of natural language: Positive results about learning from positive evidence. Journal of Mathematical Psychology, 51, 135-163.
17. Chomsky, N. (1955). The logical structure of linguistic theory. Phd dissertation, University of Pennsylvania.
18. Chomsky, N. (1965). Aspects of the theories of syntax. Cambridge, MA: MIT Press.
19. Chomsky, N. (1975). Reflections on language. New York: Pantheon.
20. Christiansen, M. H., & Chater, N. (2007). Generalization and connectionist language learning. Mind & Language, 9, 273-287.
21. Crain, S. (1991). Language acquisition in the absence of experience. Behavioral and Brain Sciences, 14, 597-612.
22. Crain, S., & Lillo-Martin, D. (1999). An introduction to linguistic theory and language acquisition. Oxford, England: Blackwell.
23. Davies, M. (2008). The Corpus of Contemporary American English (COCA): 385 million words, 1990-present. Corpus of Contemporary American English [On-line]. Available at: [accessed on June 24, 2010]
24. Davies, M. (2009). BYU-BNC: The British National Corpus. British National Corpus [On-line]. Available at: [accessed on June 29, 2010]
25. Dowman, M. (2000). Addressing the learnability of verb subcategorizations with Bayesian inference. In L. R. Gleitman & A. K. Joshi (Eds.), Proceedings of the twenty-second annual conference of the Cognitive Science Society (pp. 107-112). Mahwah, NJ: Erlbaum.
26. Dowman, M. (2007, June). Using minimum description length to make grammatical generalizations. Presented at Machine Learning and Cognitive Science of Language Acquisition meeting at UCL, London. Available at.
27. Elman, J. (1990). Finding structure in time. Cognitive Science, 14, 179-211.
28. Elman, J., Bates, E., Johnson, M. H., Karmiloff-Smith, A., Parisi, D., & Plunkett, K. (1996). Rethinking innateness: A connectionist perspective on development. Cambridge, MA: MIT Press.
29. Feldman, J. (2000). Minimization of Boolean complexity in human concept learning. Nature, 403, 630-633.
30. Fodor, J. D., Bever, T. G., & Garrett, M. F. (1974). The psychology of language: An introduction to psycholinguistics and generative grammar. New York: McGraw-Hill.
31. Fodor, J. D., & Crain, S. (1987). Simplicity and generality of rules in language acquisition. In B. Mac Whinney (Ed.), Mechanisms of language acquisition. Proceedings of the 20th Annual Carnegie-Mellon Conference on Cognition (pp. 35-63). Hillsdale, NJ: Lawrence Erlbaum.
32. Foraker, S., Regier, T., Khetarpal, N., Perfors, A., & Tenenbaum, J. B. (2007). Indirect evidence and the poverty of the stimulus: The case of anaphoric one. In D. McNamara & J. Trafton (Eds.), Proceedings of the 29th Annual Conference of the Cognitive Science Society (pp. 275-281). Austin, TX: Cognitive Science Society.
33. Foraker, S., Regier, T., Khetarpal, N., Perfors, A., & Tenenbaum, J. B. (2009). Indirect evidence and the poverty of the stimulus: The case of anaphoric one. Cognitive Science, 33, 300.
34. Gathercole, V. C. M. (2002). Monolingual and bilingual acquisition: Learning different treatments of that-trace phenomena in English and Spanish. In D. K. Oller & R. E. Eiler (Eds.), Language and literacy in bilingual children (pp. 220-254). New York: Multilingual Matters.
35. Goldberg, A. E. (1995). Constructions: A construction grammar approach to argument structure. Chicago: The University of Chicago Press.
36. Goldberg, A. E. (2003). Constructions: A new theoretical approach to language. Trends in Cognitive Sciences, 7, 219-224.
37. Goldsmith, J. (2001). Unsupervised learning of the morphology of a natural language. Computational Linguistics, 27, 153-198.
38. Gropen, J., Pinker, S., Hollander, M., Goldberg, R., & Wilson, R. (1989). The learnability and acquisition of the dative alternation in English. Language, 65, 203-207.
39. Grünwald, P. (1994). A minimum description length approach to grammar inference. In S. Scheler, S. Wernter, & E. Rilof (Eds.), Connectionist, statistical and symbolic approaches to learning for natural language (pp. 203-216). Berlin: Springer Verlag.
40. Haegeman, L. (1994). Introduction to government and binding theory. Oxford, England: Blackwell.
41. Hart, B., & Risley, J. (1995). Meaningful differences in the everyday experience of young American children. Baltimore, MD: Brookes Publishing.
42. Kemp, C., Perfors, A., & Tenenbaum, J. B. (2007). Learning overhypothesis with hierarchical Bayesian models. Developmental Science, 10, 307-321.
43. Lakoff, G. (1987). Women, fire and dangerous things: What categories reveal about the mind. Chicago, IL, University of Chicago Press.
44. Langacker, R. W. (1991). Foundations of cognitive grammar (Vols. 2). Stanford, CA: Stanford University Press.
45. Langley, P., & Stromsten, S. (2000). Learning context-free grammars with a simplicity bias. Proceedings of the eleventh European conference on machine learning (pp. 220-228). Barcelona: Springer-Verlag.
46. Lightfoot, D. (1998a). Promises, promises, general learning algorithms. Mind & Language, 13, 582-587.
47. Lightfoot, D. (1998b). The development of language: Acquisition, change, and evolution. Oxford, England: Blackwell Publishers.
48. Mac Whinney, B. (1987). The competition model. In B. Mac Whinney (Ed.), Mechanisms of language acquistion (pp. 249-308). Hillsdale, NJ: Erlbaum.
49. Mac Whinney, B. (1995). The CHILDES project: Tools for analyzing talk. Hillsdale, NJ: Lawrence Erlbaum Associates.
50. MacDonald, M. C. (2002). Reassessing working memory: Comment on Just and Carpenter (1992) and Waters and Caplan (1996). Psychological Review, 109, 35-54.
51. MacKay, D. (2003). Information theory, inference, and learning algorithms. Cambridge, England: Cambridge University Press.
52. De Marcken, C. (1996). Unsupervised Language Acquisition. PhD dissertation, MIT.
53. Marcus, G. F. (1993). Negative evidence in language acquisition. Cognition, 46, 53-85.
54. Mazurkewich, I., & White, L. (1984). The learnability and acquisition of the dative alternation in English. Cognition, 16, 261-283.
55. McClelland, J. L., & Elman, J. (1986). The TRACE model of speech perception. Cognitive Psychology, 18, 1-86.
56. Nation, P., & Waring, R. (1997). Vocabulary size, text coverage and word lists. In N. Schmitt & M. McCarthy (Eds.), Vocabulary: description, acquisition and pedagogy (pp. 6-19). Cambridge, England: Cambridge University Press.
57. Newport, E. L., & Aslin, R. N. (2004). Learning at a distance I. Statistical learning of non-adjacent dependencies. Cognitive Psychology, 48, 127-162.
58. Onnis, L., Roberts, M., & Chater, N. (2002). Simplicity: A cure for overgeneralizations in language acquisition? In Proceedings of the 24th annual conference of the Cognitive Science Society (pp. 720-725). Mahwah, NJ: Erlbaum.
59. Park, N. S. (1989). Weight as a linguistic variable with reference to English. Language Research, 28, 803-894.
60. Perfors, A., Regier, T., & Tenenbaum, J. B. (2006). Poverty of the stimulus? A rational approach. Proceedings of the twenty-eighth annual conference of the Cognitive Science Society (pp. 663-668). Mahwah, NJ: Erlbaum.
61. Pinker, S. (1989). Learnability and cognition: The acquisition of argument structure. Cambridge, MA: MIT Press.
62. Pinker, S. (1994). The language instinct. New York: Harper Collins.
63. Pullum, G. (1997). The morpholexical nature of English to-contraction. Language, 73, 79-102.
64. Pullum, G., & Scholtz, B. (2002). Empirical assessment of stimulus poverty arguments. The Linguistic Review, 19, 9-50.
65. Reali, F., & Christiansen, M. H. (2005). Uncovering the richness of the stimulus: Structure dependence and indirect statistical evidence. Cognitive Science, 29, 1000-1028.
66. Redington, M., Chater, N., & Finch, S. (1998). Distributional information: A powerful cue for acquiring syntactic categories. Cognitive Science, 22, 425-469.
67. Regier, T., & Gahl, S. (2004). Learning the unlearnable: The role of missing evidence. Cognition, 93, 147-155.
68. Ritter, H., & Kohonen, T. (1989). Self-organizing semantic maps. Biological Cybernetics, 61, 241-254.
69. Seidenberg, M. (1997). Language acquisition and use: Learning and applying probabilistic constraints. Science, 275, 1599-1603.
70. Spencer, J. P., Blumberg, M. S., McMurray, B., Robinson, S. R., Samuelson, L. K., & Tomblin, J. B. (2009). Short arms and talking eggs: Why we should no longer abide the nativist-empiricist debate. Child Development Perspectives, 3, 79-87.
71. Stolcke, A. (1994). Bayesian learning of probabilistic language models. Berkeley: Department of Electrical Engineering and Computer Science, University of California.
72. Theakston, A. (2004). The role of entrenchment in children's and adults' performance on grammaticality judgment tasks. Cognitive Development, 19, 15-34.
73. Tomasello, M. (2003). Constructing a language: A usage-based theory of language acquisition. Cambridge, MA: Harvard University Press.
74. Tomasello, M. (2004). What kind of evidence could refute the UG hypothesis? Studies in Language, 28, 642-644.
75. Vitányi, P., & Li, M. (2000). Minimum description length induction, Bayesianism, and Kolmogorov complexity. IEEE Transactions on Information Theory, IT-46, 446-464.
76. White, L. (1987). Children's overgeneralizations of the dative alternation. In K. Nelson & A. Van Kleeck (Eds.), Children's language (6th ed., pp. 261-287). Hillsdale, NJ: Erlbaum.
77. Yang, C. (2004). Universal Grammar, statistics, or both? Trends in Cognitive Sciences, 8, 451-456.