Modeling human performance in statistical word segmentation

Cognition

Volumn 117, Issue 2, 2010, Pages 107-125

  Frank, Michael C ^a   Goldwater, Sharon ^b   Griffiths, Thomas L ^c   Tenenbaum, Joshua B ^d  

^a STANFORD UNIVERSITY   (United States)

^b UNIVERSITY OF EDINBURGH   (United Kingdom)

^c UNIVERSITY OF CALIFORNIA   (United States)

^d MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Computational modeling; Language acquisition; Statistical learning; Word segmentation

Indexed keywords

ADULT; ARTICLE; HUMAN; HUMAN EXPERIMENT; LANGUAGE; LINGUISTICS; MEMORY; NORMAL HUMAN; PERFORMANCE; PRIORITY JOURNAL; PROBABILITY; STATISTICAL MODEL; WORD LIST RECALL;

ACOUSTIC STIMULATION; CHOICE BEHAVIOR; HUMANS; LANGUAGE; LANGUAGE DEVELOPMENT; LEARNING; LOGISTIC MODELS; MODELS, STATISTICAL; SPEECH PERCEPTION;

EID: 77957664574     PISSN: 00100277     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cognition.2010.07.005     Document Type: Article

References (56)

1. Aitchison J. Words in the mind: An introduction to the mental lexicon 2003, Blackwell, Oxford, UK.
2. Aslin R.N., Saffran J.R., Newport E.L. Computation of conditional probability statistics by 8-month-old infants. Psychological Science 1998, 9(4):321-324.
3. Brady T., Oliva A. Statistical learning using real-world scenes: Extracting categorical regularities without conscious intent. Psychological Science 2008, 7:678-685.
4. Brent M.R. An efficient, probabilistically sound algorithm for segmentation and word discovery. Machine Learning 1999, 34(1):71-105.
5. Brent M.R. Speech segmentation and word discovery: A computational perspective. Trends in Cognitive Sciences 1999, 3(8):294-301.
6. Brown S., Steyvers M. Detecting and predicting changes. Cognitive Psychology 2009, 58(1):49-67.
7. Chen S.F., Goodman J. An empirical study of smoothing techniques for language modeling. Computer Speech and Language 1999, 13(4):359-394.
8. Conway C.M., Christiansen M.H. Modality-constrained statistical learning of tactile, visual, and auditory sequences. Journal of Experimental Psychology Learning Memory and Cognition 2005, 31(1):24-3916.
9. Cowan N. The magical number 4 in short-term memory: A reconsideration of mental storage capacity. Behavioral and Brain Sciences 2001, 24(1):87-114.
10. Daw N., Courville A. The pigeon as particle filter. Advances in neural information processing systems 2008, Vol. 20. MIT Press, Cambridge, MA.
11. Dayan P., Kakade S. Explaining away in weight space. Advances in neural information processing systems 2000, Vol. 14. MIT Press, Cambridge, MA.
12. Doucet A., De Freitas N., Gordon N. Sequential Monte Carlo methods in practice 2001, Springer Verlag, New York, NY.
13. Dutoit, T., Pagel, V., Pierret, N., Bataille, F., & Van Der Vrecken, O. (1996). The MBROLA project: Towards a set of high quality speech synthesizers free of use for non commercial purposes. In Proceedings of the fourth international conference on spoken language (Vol. 3, pp. 1393-1396). Philadelphia, PA.
14. Elman J. Finding structure in time. Cognitive Science 1990, 14(2):179-211.
15. Endress A., Mehler J. The surprising power of statistical learning: When fragment knowledge leads to false memories of unheard words. Journal of Memory and Language 2009, 60(3):351-367.
16. Fiser J., Aslin R.N. Statistical learning of new visual feature combinations by infants. Proceedings of the National Academy of Sciences 2002, 99(24):15822-15826.
17. Frank M., Goldwater S., Mansinghka V.K., Griffiths T., Tenenbaum J. Modeling human performance on statistical word segmentation tasks. Proceedings of the 28th annual conference of cognitive science society 2007, Lawrence Earlbaum, Inc., Mahwah, NJ.
18. Gelman A., Carlin J.B., Stern H.S., Rubin D.B. Bayesian data analysis 2004, Chapman and Hall, London, UK. 2nd ed.
19. Gelman A., Hill J. Data analysis using regression and multilevel/hierarchical models 2006, Cambridge University Press, Cambridge, UK.
20. Gerken L., Bollt A. Three exemplars allow at least some linguistic generalizations: Implications for generalization mechanisms and constraints. Language Learning and Development 2008, 3:228-248.
21. Giroux I., Rey A. Lexical and sublexical units in speech perception. Cognitive Science 2009, 33:260-272.
22. Goldwater, S., Griffiths, T., & Johnson, M. (2006b). Contextual dependencies in unsupervised word segmentation. In Proceedings of the annual meeting of the association for computational linguistics (Vol. 44, p. 673).
23. Goldwater S., Griffiths T., Johnson M. Interpolating between types and tokens by estimating power-law generators. Advances in neural information processing systems 2006, Vol. 18:459-466. MIT Press, Cambridge, MA.
24. Goldwater S., Griffiths T., Johnson M. A Bayesian framework for word segmentation: Exploring the effects of context. Cognition 2009, 112:21-54.
25. Gómez R. Variability and detection of invariant structure. Psychological Science 2002, 13:431-436.
26. Goodman N.D., Tenenbaum J.B., Feldman J., Griffiths T.L. A rational analysis of rule-based concept learning. Cognitive Science 2008, 32:108-154.
27. Harris Z.S. Methods in structural linguistics 1951, University of Chicago Press, Chicago, IL.
28. Hastie T., Tibshirani R., Friedman J., Franklin J. The elements of statistical learning: Data mining, inference and prediction 2005, Springer, New York, NY.
29. Hauser M.D., Newport E.L., Aslin R.N. Segmentation of the speech stream in a human primate: Statistical learning in cotton-top tamarins. Cognition 2001, 78:B53-B64.
30. Johnson, M. H. (2008). Using adaptor grammars to identify synergies in the unsupervised acquisition of linguistic structure. In Human language technology and association for computational linguistics (pp. 398-406).
31. Jurafsky D., Martin J. Speech and language processing 2008, Prentice Hall, Saddle River, NJ.
32. Jusczyk P., Aslin R.N. Infants detection of the sound patterns of words in fluent speech. Cognitive Psychology 1995, 29(1):1-23.
33. Kirkham N.Z., Slemmer J.A., Johnson S.P. Visual statistical learning in infancy: Evidence for a domain general learning mechanism. Cognition 2002, 83:B35-B42.
34. Kirkpatrick S., Gelatt C., Vecchi M. Optimization by simulated annealing. Science 1983, 220(4598):671-680.
35. Levy, R. P., Reali, F., & Griffiths, T. L. (2009). Modeling the effects of memory on human online sentence processing with particle filters. In D. Koller, D. Schuurmans, Y. Bengio, L. Bottou (Eds.), Advances in neural information processing systems (Vol. 21, pp. 937-944).
36. Liang, P., & Klein, D. (2009). Online EM for unsupervised models. In Proceedings of human language technologies: The 2009 annual conference of the North American chapter of the association for computational linguistics (pp. 611-619).
37. Luce R.D. Detection and recognition. Handbook of mathematical psychology 1963, Wiley, New York. R.D. Luce, R.R. Bush, E. Galanter (Eds.).
38. MacKay D.J.C. Information theory, inference, and learning algorithms 2003, Cambridge University Press.
39. MacKay D.J.C., Peto L.C.B. A hierarchical Dirichlet language model. Natural Language Engineering 1994, 1:1-19.
40. Manning C., Schütze H. Foundations of statistical natural language processing 1999, MIT Press, Cambridge, MA.
41. Miller G. The magic number seven, plus or minus two. Psychological Review 1965, 63:81-97.
42. Newport E. Maturational constraints on language learning. Cognitive Science 1990, 14:11-28.
43. Newport E., Aslin R. Learning at a distance I. Statistical learning of non-adjacent dependencies. Cognitive Psychology 2004, 48(2):127-162.
44. Orbán G., Fiser J., Aslin R.N., Lengyel M. Bayesian learning of visual chunks by human observers. Proceedings of the National Academy of Sciences 2008, 105:2745-2750.
45. Perruchet P., Vinter A. PARSER: A model for word segmentation. Journal of Memory and Language 1998, 39:246-263.
46. Perruchet P., Vinter A. The self-organizing consciousness as an alternative model of the mind. Behavioral and Brain Sciences 2002, 25(03):360-380.
47. Posner M., Keele S. On the genesis of abstract ideas. Journal of Experimental Psychology 1968, 77(3):353.
48. Richtsmeier P.T., Gerken L.A., Ohala D.K. Induction of phonotactics from word-types and word-tokens. Proceedings of the 33rd boston university conference on language development 2009, Cascadilla Press, Somerville, MA. J. Chandlee, M. Franchini, S. Lord, M. Rheiner (Eds.).
49. Saffran J.R., Aslin R., Newport E. Statistical learning by 8-month-old infants. Science 1996, 274(5294):1926.
50. Saffran J.R., Johnson E.K., Aslin R.N., Newport E.L. Statistical learning of tone sequences by human infants and adults. Cognition 1999, 70(1):27-52.
51. Saffran J.R., Newport E.L., Aslin R.N. Word segmentation: The role of distributional cues. Journal of Memory and Language 1996, 35(4):606-621.
52. Sanborn, A., Griffiths, T., & Navarro, D. (2006). A more rational model of categorization. In Proceedings of the 28th annual conference of the cognitive science society (pp. 726-731).
53. Swingley D. Statistical clustering and the contents of the infant vocabulary. Cognitive Psychology 2005, 50:86-132.
54. Teh, Y. (2006). A hierarchical Bayesian language model based on Pitman-Yor processes. In Proceedings of the 21st international conference on computational linguistics and the 44th annual meeting of the association for computational linguistics (pp. 985-992).
55. Toro J.M., Trobalon J.B. Statistical computations over a speech stream in a rodent. Perception and Psychophysics 2005, 67(5):867-875.
56. Vul, E., Frank, M., Alvarez, G., & Tenenbaum, J. (2009). Explaining human multiple object tracking as resource-constrained approximate inference in a dynamic probabilistic model. In Y. Bengio, D. Schuurmans, J. Lafferty, C. K. I. Williams, A. Culotta (Eds.), Advances in neural information processing systems (Vol. 22, pp. 1955-1963).