Statistical construction learning: Does a Zipfian problem space ensure robust language learning?

Statistical Learning and Language Acquisition

Volumn , Issue , 2012, Pages 265-304

  Ellis, Nick C ^a   O'Donnell, Matthew Brook ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84954239314     PISSN: None     EISSN: None     Source Type: Book    
DOI: None     Document Type: Chapter

References (101)

1. Allan, Lorraine G. 1980 A note on measurement of contingency between two binary variables in judgment tasks. Bulletin of the Psychonomic Society 15: 147-149
2. Andersen, Øistein E., Julien Nioche, Ted Briscoe, and John Carroll 2008 The BNC Parsed with RASP4UIMA. Proceedings of the Sixth International Language Resources and Evaluation (LREC08): 28-30
3. Anderson, John Robert 2000 Cognitive psychology and its implications (5th ed.). New York: W.H. Freeman
4. Baayen, Harald 2008 Corpus linguistics in morphology: morphological productivity. In Corpus Linguistics. An international handbook, edited by A. Ludeling and M. Kyto. Berlin: Mouton De Gruyter
5. Bannard, Colin and Elena Lieven 2009 Repetition and reuse in child language learning. In Formulaic Language: Volume 2 Acquisition, loss, psychological reality, and functional explanations, edited by R. Corrigan, E. A. Moravcsik, H. Ouali and K. M. Wheatley. Amsterdam: John Benjamins
6. Bartlett, Frederick Charles [1932] 1967 Remembering: A Study in Experimental and Social Psychology. Cambridge: Cambridge University Press
7. BNC 2007 BNC XML Edition http://www.natcorp.ox.ac.uk/corpus/
8. Bod, Rens, Jennifer Hay, and Stefanie Jannedy, eds. 2003 Probabilistic linguistics. Cambridge, MA: MIT Press
9. Briscoe, Ted, John Carroll, and Rebecca Watson 2006 The Second Release of the RASP System. Paper read at Proceedings of the COLING/ACL 2006 Interactive Presentation Sessions, at Sydney, Australia
10. Bybee, Joan 2010 Language, usage, and cognition. Cambridge: Cambridge University Press
11. Bybee, Joan and Paul Hopper, eds. 2001 Frequency and the emergence of linguistic structure. Amsterdam: Benjamins
12. Bybee, Joan and Sandra Thompson 2000 Three frequency effects in syntax. Berkeley Linguistic Society 23: 65-85
13. Christiansen, Morten H., and Nick Chater, eds. 2001 Connectionist psycholinguistics. Westport, CO: Ablex
14. Clark, Eve V. 1978 Discovering what words can do. In Papers from the parasession on the lexicon, Chicago Linguistics Society April 14-15, 1978, edited by D. Farkas, W. M. Jacobsen and K. W. Todrys. Chicago: Chicago Linguistics Society
15. Clark, Eve V. and Barb Kelly, eds. 2006 Constructions in acquisition. Chicago: University of Chicago Press
16. Dorogovstev, Sergey N. and José F. F. Mendes 2003 Evolution of Networks: From Biological Nets to the Internet and WWW. Oxford: Oxford University Press
17. Ebbinghaus, Hermann 1885 Memory: A contribution to experimental psychology. Translated by H. A. R. C. E. B. (1913). New York: Teachers College, Columbia
18. Ellis, Nick C. 2002 Frequency effects in language processing: A review with implications for theories of implicit and explicit language acquisition. Studies in Second Language Acquisition 24(2): 143-188
19. Ellis, Nick C. 2006 Language acquisition as rational contingency learning. Applied Linguistics 27(1): 1-24
20. Ellis, Nick C. 2006 Selective attention and transfer phenomena in SLA: Contingency, cue competition, salience, interference, overshadowing, blocking, and perceptual learning. Applied Linguistics 27(2): 1-31
21. Ellis, Nick C. 2008 The dynamics of second language emergence: Cycles of language use, language change, and language acquisition. Modern Language Journal 41(3): 232-249
22. Ellis, Nick C. 2008 Usage-based and form-focused language acquisition: The associative learning of constructions, learned-attention, and the limited L2 endstate. In Handbook of cognitive linguistics and second language acquisition, edited by P. Robinson and N. C. Ellis. London: Routledge
23. Ellis, Nick C. in press What can we count in language, and what counts in language acquisition, cognition, and use? In Frequency effects in cognitive linguistics (Vol. 1): Statistical effects in learnability, processing and change, edited by S. T. Gries and D. S. Divjak. Berlin: Mouton de Gruyter
24. Ellis, Nick C. and Teresa Cadierno 2009 Constructing a second language. Annual Review of Cognitive Linguistics 7 (Special section): 111-290
25. Ellis, Nick C. and Fernando Ferreira-Junior 2009 Construction Learning as a function of Frequency, Frequency Distribution, and Function Modern Language Journal 93: 370-386
26. Ellis, Nick C. and Fernando Ferreira-Junior 2009 Constructions and their acquisition: Islands and the distinctiveness of their occupancy. Annual Review of Cognitive Linguistics 7: 111-139
27. Ellis, Nick C. and Diane Larsen-Freeman 2009 Constructing a second language: Analyses and computational simulations of the emergence of linguistic constructions from usage. Language Learning 59 (Supplement 1): 93-128
28. Ellis, Nick C., Rita Simpson-Vlach, and Carson Maynard 2008 Formulaic Language in Native and Second-Language Speakers: Psycholinguistics, Corpus Linguistics, and TESOL. TESOL Quarterly 42(3): 375-396
29. Evert, Stefan 2005 The Statistics of Word Cooccurrences: Word Pairs and Collocations, University of Stuttgart, Stuttgart
30. Ferrer-i-Cancho, Ramon and Ricard V. Sole 2002 Zipf 's law and random texts. Advances in Complex Systems 5(1): 1-6
31. Fillmore, Charles J., Christopher R. Johnson, and Miriam R. L. Petruck 2003 Background to Framenet. International Journal of Lexicography 16: 235-250
32. Francis, Gill, Susan Hunston, and Elizabeth Manning, eds. 1996 Grammar Patterns 1: Verbs. The COBUILD Series. London: Harper Collins
33. Goldberg, Adele E. 1995 Constructions: A construction grammar approach to argument structure. Chicago: University of Chicago Press
34. Goldberg, Adele E. 2006 Constructions at work: The nature of generalization in language. Oxford: Oxford University Press
35. Goldberg, Adele E., Devin M. Casenhiser, and Nitya Sethuraman 2004 Learning argument structure generalizations. Cognitive Linguistics 15: 289-316
36. Gómez, Rebecca 2002 Variability and detection of invariant structure. Psychological Science 13: 431-436
37. Gries, Stefan Th. and Anatol Stefanowitsch 2004 Extending collostructional analysis: a corpus-based perspective on 'alternations'. International Journal of Corpus Linguistics 9: 97-129
38. Gries, Stefan Th., and Stefanie Wulff 2005 Do foreign language learners also have constructions? Evidence from priming, sorting, and corpora. Annual Review of Cognitive Linguistics 3: 182-200
39. Grinberg, Dennis, John Lafferty, and Danniel Sleator 1995 A robust parsing algorithm for link grammars. Carnegie Mellon University Computer Science technical report CMU-CS-95-125
40. Harnad, Steven, ed. 1987 Categorical perception: The groundwork of cognition. New York: Cambridge University Press
41. Herbst, Thomas, David Heath, Ian Roe, and Dieter Gö tz 2004 Valency Dictionary of English. Berlin/New York: Mouton de Gruyter
42. Herbst, Thomas and Peter Uhrig. Erlangen Valency Patternbank 2010 Available from http://www.patternbank.uni-erlangen.de/cgi-bin/ patternbank.cgi?do=help
43. Hunston, Susan and Gill Francis 1996 Pattern grammar: A corpus driven approach to the lexical grammar of English. Amsterdam: Benjamins
44. Hunt, Ruskin H. and Richard N. Aslin 2010 Category induction via distributional analysis: Evidence from a serial reaction time task. Journal of Memory and Language 62: 98-112
45. Jackendoff, Ray 1997 Twistin' the night away. Language 73: 543-559
46. Jurafsky, Daniel 2002 Probabilistic Modeling in Psycholinguistics: Linguistic Comprehension and Production. In Probabilistic Linguistics, edited by R. Bod, J. Hay and S. Jannedy. Harvard, MA: MIT Press
47. Jurafsky, Daniel and James H. Martin 2000 Speech and language processing: An introduction to natural language processing, speech recognition, and computational linguistics. Englewood Cliffs, NJ: Prentice-Hall
48. Kello, Chris T. and Brandon C. Beltz 2009 Scale-free networks in phonological and orthographic wordform lexicons. In Approaches to Phonological Complexity, edited by I. Chitoran, C. Coupé, E. Marsico and F. Pellegrino. Berlin: Mouton de Gruyter
49. Kello, Chris T., Gordon D. A. Brown, Ramon Ferrer-i-Cancho, John G. Holden, Klaus Linkenkaer-Hansen, Theo Rhodes, and Guy C. Van Orden 2010 Scaling laws in cognitive sciences. Trends in Cognitive Science 14: 223-232
50. Kipper, Karin, Anna Korhonen, Neville Ryant, and Martha Palmer 2008 A large-scale classification of English verbs. Language Resources and Evaluation 41: 21-40
51. Klein, Dan and Christopher D. Manning 2003 Fast Exact Inference with a Factored Model for Natural Language Parsing. In Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press
52. Lakoff, George 1987 Women, fire, and dangerous things: What categories reveal about the mind. Chicago: University of Chicago Press
53. Landauer, Thomas K., Danielle S. McNamara, Simon Dennis, and Walter Kintsch, eds. 2007 Handbook of Latent Semantic Analysis. Mahwah, NJ: Lawrence Erlbaum
54. Levin, Beth 1993 English verb classes and alternations: A preliminary analysis. Chicago: Chicago University Press
55. Li, Wentian 1992 Random Texts Exhibit Zipf 's Law-Like Word Frequency Distribution. IEEE Transactions on Information Theory 38.6: 1842-1845
56. MacWhinney, Brian 1987 Applying the Competition Model to bilingualism. Applied Psycholinguistics 8(4): 315-327
57. MacWhinney, Brian 1987 The Competition Model. In Mechanisms of language acquisition, edited by B. MacWhinney. Hillsdale, NJ: Erlbaum
58. MacWhinney, Brian 1997 Second language acquisition and the Competition Model. In Tutorials in bilingualism: Psycholinguistic perspectives, edited by A. M. B. De Groot and J. F. Kroll. Mahwah, NJ: Lawrence Erlbaum Associates
59. MacWhinney, Brian 2000 The CHILDES project: Tools for analyzing talk, Vol 1: Transcription format and programs (3rd ed.): (2000). xi, 366pp
60. MacWhinney, Brian 2000 The CHILDES Project: Tools for analyzing talk, Vol 2: The database (3rd ed.): (2000). viii, 418pp
61. MacWhinney, Brian 2001 The competition model: The input, the context, and the brain. In Cognition and second language instruction, edited by P. Robinson. New York: Cambridge University Press
62. Manin, Dmitrii Y. 2008 Zipf 's Law and Avoidance of Excessive Synonymy Cognitive Science 32: 1075-1098
63. Manning, Chris D. and Hinrich Schü tze 1999 Foundations of statistical natural language processing. Cambridge, MA: The MIT Press
64. Mason, Oliver and Susan Hunston 2004 The automatic recognition of verb patterns: A feasibility study. International Journal of Corpus Linguistics 9: 253-270
65. Miller, George A. 1957 Some effects of intermittent silence. American Journal of Psychology 70: 311-314
66. Miller, George A. 1965 Preface to the MIT press publication of G. H. K. Zipf (1935) The psychobiology of language: An introduction to dynamic philology. Boston MA: MIT Press
67. Miller, George A. 2009 WordNet-About us. Princeton University
68. Mintz, Toben 2002 Category induction from distributional cues in an artificial language. Memory & Cognition 30: 678-686
69. Newman, Mark 2005 Power laws, Pareto distributions and Zipf 's law. Contemporary Physics 46: 323-351
70. Ninio, Anat 1999 Pathbreaking verbs in syntactic development and the question of prototypical transitivity. Journal of Child Language 26:619-653
71. Ninio, Anat 2006 Language and the learning curve: A new theory of syntactic development. Oxford: Oxford University Press
72. Nivre, Joakim, Johan Hall, and Jens Nilsson 2004 Memory-Based Dependency Parsing. Paper read at Proceedings of the Eighth Conference on Computational Natural Language Learning (CoNLL)
73. O'Donnell, Matthew B. and Nick C. Ellis submitted 'Zipfing across the input' Analyzing the distribution and semantics of verbs in verb argument patterns in child directed and general English. In BUCLD 35. Boston
74. O'Donnell, Matthew B. and Nick C. Ellis 2009 Measuring formulaic language in corpora from the perspective of Language as a Complex System. Paper read at 5th Corpus Linguistics Conference, 20-23 July, 2009, at University of Liverpool
75. O'Donnell, Matthew B. and Nick C. Ellis 2010 Towards an Inventory of English Verb Argument Constructions. Proceedings of the 11th Annual Conference of the North American Chapter of the Association for Computational Linguistics, Los Angeles
76. Onnis, Luca, Padraic Monaghan, Morten H. Christiansen, and Nick Chater 2004 Variability is the spice of learning, and a crucial ingredient for detecting and generalising nonadjacent dependencies. Proceedings of the 26th Annual Conference of the Cognitive Science Society
77. Palmer, Martha 2010 VerbNet: A class based verb lexicon 2010. Available from http:// verbs.colorado.edu/~mpalmer/projects/verbnet.html
78. Pedersen, Ted and Varada Kolhatkar 2009 WordNet::SenseRelate::AllWords-A Broad Coverage Word Sense Tagger that Maximizes Semantic Relatedness Paper read at Proceedings of the Demonstration Session of the Human Language Technology Conference and the Tenth Annual Meeting of the North American Chapter of the Association for Computational Linguistics, at Boulder, Colorado
79. Pedersen, Ted, Siddharth Patwardhan, and Jason Michelizzi 2004 WordNet::Similarity-Measuring the Relatedness of Concepts. Paper read at Proceedings of Fifth Annual Meeting of the North American Chapter of the Association of Computational Linguistics (NAACL 2004)
80. Perruchet, Pierre and Sébastian Pacton 2006 Implicit learning and statistical learning: one phenomenon, two approaches. Trends in Cognitive Sciences 10: 233-238
81. Pinker, Steven 1989 Learnability and cognition: The acquisition of argument structure. Cambridge, MA: Bradford Books
82. Posner, Michael I., and Stephen W. Keele 1970 Retention of abstract ideas. Journal of Experimental Psychology 83: 304-308
83. Posner, Michael I., and Stephen W. Keele 2010 A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria
84. Rescorla, Robert A. 1968 Probability of shock in the presence and absence of CS in fear conditioning. Journal of Comparative and Physiological Psychology 66: 1-5
85. Resnik, Philip 1995 Using Information Content to Evaluate Semantic Similarity in a Taxonomy. IJCAI: 448-453
86. Rosch, Eleanor and Carolyn B. Mervis 1975 Cognitive representations of semantic categories. Journal of Experimental Psychology: General 104: 192-233
87. Rosch, Eleanor, Carolyn B. Mervis, Wayne D. Gray, David M. Johnson, and Penny Boyes-Braem 1976 Basic objects in natural categories. Cognitive Psychology 8: 382-439
88. Sagae, Kenji, Eric Davis, Alon Lavie, Brain MacWhinney, and Shuly Wintner 2007 High-accuracy annotation and parsing of CHILDES transcripts. In Proceedings of the ACL-2007 Workshop on Cognitive Aspects of Computational Language Acquisition. Prague: Czech Republic
89. Schneider, Gerold, Fabio Rinaldi, and James Dowdall 2004 Fast, deep-linguistic statistical dependency parsing. Paper read at Recent advances in DG workshop, Coling 2004, at Geneva
90. Shanks, David R. 1995 The psychology of associative learning. New York: Cambridge University Press
91. Sinclair, John 2004 Trust the text: Language, corpus and discourse. London: Routledge
92. Sinclair, John, ed. 1987 Looking Up: An Account of The COBUILD Project in Lexical Computing. London: Collins ELT
93. Solé, Ricard V., Bernat Murtra, Sergi Valverde, and Luc Steels 2005 Language Networks: their structure, function and evolution. Trends in Cognitive Sciences 12
94. Stefanowitsch, Anatol and Stefan Th. Gries 2003 Collostructions: Investigating the interaction between words and constructions. International Journal of Corpus Linguistics 8: 209-43
95. Steyvers, Mark and Josh Tennenbaum 2005 The large-scale structure of semantic networks: statistical analyses and a model of semantic growth. Cognitive Science 29: 41-78
96. Taylor, John R. 1998 Syntactic constructions as prototype categories. In The new psychology of language: Cognitive and functional approaches to language structure, edited by M. Tomasello. Mahwah, NJ: Erlbaum
97. Tomasello Michael 2003 Constructing a language. Boston, MA: Harvard University Press
98. Tversky, Alan 1977 Features of similarity. Psychological Review 84: 327-352
99. Wittgenstein, Ludwig 1953 Philosophical investigations. Translated by G. E. M. Anscombe. Oxford: Blackwell
100. Yang, Charles 2010 Who's afraid of George Kingsley Zipf? http://www.ling.upenn. edu/~ycharles/papers/zipfnew.pdf
101. Zipf, George K. 1935 The psycho-biology of language: An introduction to dynamic philology. Cambridge, MA: The M.I.T. Press