Zipfian frequency distributions facilitate word segmentation in context

Cognition

Volumn 127, Issue 3, 2013, Pages 439-453

  Kurumada, Chigusa ^a   Meylan, Stephan C ^b   Frank, Michael C ^a  

^a STANFORD UNIVERSITY   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Computational modeling; Statistical learning; Word segmentation; Zipfian frequency distributions

Indexed keywords

ARTICLE; FORCED CHOICE METHOD; HUMAN; LANGUAGE; PRIORITY JOURNAL; PROCEDURES; STATISTICS; TASK PERFORMANCE; WORD RECOGNITION; WORD SEGMENTATION; ZIPFIAN FREQUENCY DISTRIBUTION;

ADULT; ALGORITHMS; COMPUTER SIMULATION; FEMALE; HUMANS; LANGUAGE; LANGUAGE DEVELOPMENT; MALE; MODELS, STATISTICAL; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; READING; REGRESSION ANALYSIS;

EID: 84875774517     PISSN: 00100277     EISSN: 18737838     Source Type: Journal    
DOI: 10.1016/j.cognition.2013.02.002     Document Type: Article

References (54)

1. Aslin R.N., Saffran J.R., Newport E.L. Computation of conditional probability statistics by 8-month-old infants. Psychological Science 1998, 9:321-324.
2. Aslin R.N., Woodward J., LaMendola N., Bever T. Models of word segmentation in fluent maternal speech to infants. Signal to Syntax: Bootstrapping from Speech to Grammar in Early Acquisition 1996, 117-134.
3. Blanchard D., Heinz J., Golinkoff R. Modeling the contribution of phonotactic cues to the problem of word segmentation. Journal of Child Language 2010, 37:487-511.
4. Börschinger B., Johnson M. A particle filter algorithm for bayesian word segmentation. Proceedings of the Australasian Language Technology Association 2011, 2011:10-18.
5. Bortfeld H., Morgan J., Golinkoff R., Rathbun K. Mommy and me: Familiar names help launch babies into speech stream segmentation. Psychological Science 2005, 16:298-304.
6. Brent M.R. An efficient, probabilistically sound algorithm for segmentation and word discovery. Machine Learning 1999, 34:71-105.
7. Brent M.R., Cartwright T. Distributional regularity and phonotactic constraints are useful for segmentation. Cognition 1996, 61:93-125.
8. Brent M.R., Siskind J.M. The role of exposure to isolated words in early vocabulary development. Cognition 2001, 81:33-44.
9. Breslow N.E., Clayton D.G. Approximate inference in generalized linear mixed models. Journal of the American Statistical Association 1993, 88:9-25.
10. Conway C., Bauernschmidt A., Huang S., Pisoni D. Implicit statistical learning in language processing: Word predictability is the key. Cognition 2010, 114:356-371.
11. Cunillera T., Càmara E., Laine M., Rodri{dotless}́guez-Fornells A. Words as anchors: Known words facilitate statistical learning. Experimental Psychology 2010, 57:134-141.
12. Dahan D., Brent M.R. On the discovery of novel wordlike units from utterances: An artificial-language study with implications for native-language acquisition. Journal of Experimental Psychology: General 1999, 128:165-185.
13. Doucet A., Godsill S., Andrieu C. On sequential monte carlo sampling methods for bayesian filtering. Statistics and Computing 2000, 10:197-208.
14. Dutoit, T., Pagel, V., Pierret, N., Bataille, F., & Van Der Vrecken, O. (1996). The MBROLA project: Towards a set of high quality speech synthesizers free of use for non-commercial purposes. In Proceedings of the fourth international conference on spoken language (Vol. 3, pp. 1393-1396). Philadelphia, PA.
15. Ellis, N.C., & O'Donnell, M.B. (2011). Robust language acquisition: An emergent consequence of language as a complex adaptive system. In Proceedings of the 33rd annual meeting of the cognitive science society.
16. Fiser J. The other kind of perceptual learning. Learning Perception 2009, 1:69-87.
17. Fiser J., Aslin R.N. Statistical learning of new visual feature combinations by infants. Proceedings of the National Academy of Sciences 2002, 99:15822-15826.
18. Frank, M.C., Arnon, I., Tily, H., & Goldwater, S., (2010). Beyond transitional probabilities: Human learners impose a parsimony bias in statistical word segmentation. In Proceedings of the 31st annual meeting of the cognitive science society.
19. Frank, M. C., Tenenbaum, J. B., & Gibson, E. (2013). Learning and long-term retention of large-scale artificial languages. PLoS ONE, 8, e52500.
20. Frank M.C., Gibson E. Overcoming memory limitations in rule learning. Language, Learning, and Development 2011, 7:130-148.
21. Frank M.C., Goldwater S., Griffiths T.L., Tenenbaum J.B. Modeling human performance in statistical word segmentation. Cognition 2010, 117:107-125.
22. Frank M.C., Goodman N., Tenenbaum J. Using speakers' referential intentions to model early cross-situational word learning. Psychological Science 2009, 20:579-585.
23. French R., Addyman C., Mareschal D. TRACX: A recognition-based connectionist framework for sequence segmentation and chunk extraction. Psychological Review 2011, 118:614-636.
24. Gelman A., Hill J. Data analysis using regression and multilevel/hierarchical models 2006, Cambridge University Press, Cambridge, UK.
25. Goldwater S., Griffiths T., Johnson M. Interpolating between types and tokens by estimating power-law generators. Advances in neural information processing systems 2006, Vol. 18:459-466. MIT Press, Cambridge, MA.
26. Goldwater S., Griffiths T., Johnson M. A Bayesian framework for word segmentation: Exploring the effects of context. Cognition 2009, 112:21-54.
27. Graf Estes K.M., Evans J.L., Alibali M.W., Saffran J.R. Can infants map meaning to newly segmented words?. Psychological Science 2007, 18:254-260.
28. Hauser M.D., Newport E.L., Aslin R.N. Segmentation of the speech stream in a human primate: Statistical learning in cotton-top tamarins. Cognition 2001, 78:B53-B64.
29. Hochmann J.-R., Endress A.D., Mehler J. Word frequency as a cue for identifying function words in infancy. Cognition 2010, 115:444-457.
30. Hollich G., Jusczyk P., Brent M.R. How infants use the words they know to learn new words. Proceedings of the 25th annual Boston University conference on language development 2001, Vol. 1:353-364. Cascadilla Press.
31. Jaeger T.F. Categorical data analysis: Away from anovas (transformation or not) and towards logit mixed models. Journal of Memory and Language 2008, 59:434-446.
32. Johnson E.K., Jusczyk P.W. Word segmentation by 8-month-olds: When speech cues count more than statistics. Journal of Memory and Language 2001, 44:548-567.
33. Johnson E.K., Tyler M. Testing the limits of statistical learning for word segmentation. Developmental Science 2010, 13:339-345.
34. Jusczyk P., Hohne E., Bauman A. Infants' sensitivity to allophonic cues for word segmentation. Attention, Perception, & Psychophysics 1999, 61:1465-1476.
35. Kirkham N.Z., Slemmer J.A., Johnson S.P. Visual statistical learning in infancy: Evidence for a domain general learning mechanism. Cognition 2002, 83:B35-B42.
36. Kurumada, C., Meylan, S. C., & Frank, M. C. (2011). Zipfian word frequencies support statistical word segmentation. In Proceedings of the 33rd annual meeting of the cognitive science society.
37. Lew-Williams, C., Pelucchi, B., & Saffran, J. R. (2011). Isolated words enhance statistical language learning in infancy. Developmental Science, 14, 1323-1329.
38. Li W. Random texts exhibit Zipf's-law-like word frequency distribution. IEEE Transactions on Information Theory 1992, 38:1842-1845.
39. Mattys S.L., Jusczyk P.W. Phonotactic cues for segmentation of fluent speech by infants. Cognition 2001, 78:91-121.
40. Mitchell C., McMurray B. On leveraged learning in lexical acquisition and its relationship to acceleration. Cognitive Science 2009, 33:1503-1523.
41. Monaghan P., Christiansen M.H. Words in puddles of sound: Modelling psycholinguistic effects in speech segmentation. Journal of Child Language 2010, 37:545-564.
42. Orbán G., Fiser J., Aslin R.N., Lengyel M. Bayesian learning of visual chunks by human observers. Proceedings of the National Academy of Sciences 2008, 105:2745-2750.
43. Pelucchi B., Hay J., Saffran J. Statistical learning in a natural language by 8-month-old infants. Child Development 2009, 80:674-685.
44. Perruchet P., Tillmann B. Exploiting multiple sources of information in learning an artificial language: Human data and modeling. Cognitive Science 2010, 34:255-285.
45. Perruchet P., Vinter A. Parser: A model for word segmentation. Journal of Memory and Language 1998, 39:246-263.
46. Saffran J.R., Aslin R.N., Newport E. Statistical learning by 8-month-old infants. Science 1996, 274:1926.
47. Saffran J.R., Newport E.L., Aslin R.N. Word segmentation: The role of distributional cues. Journal of Memory and Language 1996, 35:606-621.
48. Shukla M., White K.S., Aslin R.N. Prosody guides the rapid mapping of auditory word forms onto visual objects in 6-mo-old infants. Proceedings of the National Academy of Sciences of the United States of America 2011, 108:6038-6043.
49. Swingley D. Statistical clustering and the contents of the infant vocabulary. Cognitive Psychology 2005, 50:86-132.
50. Thiessen E.D., Saffran J.R. When cues collide: Use of stress and statistical cues to word boundaries by 7- to 9-month-old infants. Developmental Psychology 2003, 39:706-716.
51. Valian V., Coulson S. Anchor points in language learning: The role of marker frequency. Journal of Memory and Language 1988, 27:71-86.
52. van de Weijer, J. (2001). The importance of single-word utterances for early word recognition. In Early lexicon acquisition: Normal and pathological development. Lyon, France.
53. Yang C. Universal grammar, statistics or both?. Trends in Cognitive Sciences 2004, 8:451-456.
54. Zipf G. Human behavior and the principle of least effort: An introduction to human ecology 1965, Hafner, New York.