Learning diphone-based segmentation

Cognitive Science

Volumn 35, Issue 1, 2011, Pages 119-155

  Daland, Robert ^a   Pierrehumbert, Janet B ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b NORTHWESTERN UNIVERSITY   (United States)

Author keywords

Bayesian; Computational model; Language acquisition; Unsupervised learning; Word segmentation

Indexed keywords

ADULT; ARTICLE; BAYES THEOREM; CHILD; COMPUTER SIMULATION; HUMAN; INFANT; LANGUAGE DEVELOPMENT; LEARNING; PHONETICS; PSYCHOLOGICAL MODEL; SPEECH; STATISTICAL MODEL;

ADULT; BAYES THEOREM; CHILD; COMPUTER SIMULATION; HUMANS; INFANT; LANGUAGE DEVELOPMENT; LEARNING; MODELS, PSYCHOLOGICAL; MODELS, STATISTICAL; PHONETICS; SPEECH;

EID: 79960929759     PISSN: 03640213     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1551-6709.2010.01160.x     Document Type: Article

References (99)

1. Akhtar, N., & Tomasello, M. (1997). Young children's productivity with word order and verb morphology. Developmental Psychology, 33, 952-965.
2. Albright, A. (2009). Feature-based generalization as a source of gradient acceptability. Phonology, 26, 9-41.
3. Albright, A., & Hayes, B. (2003). Rules vs. analogy in English past tenses: A computational/experimental study. Cognition, 90, 119-161.
4. Anderson, J., Morgan, J., & White, K. (2003). A statistical basis for speech sound discrimination. Language and Speech, 46, 155-182.
5. Arnon, I., & Clark, V. E. (2009). Words in frames: Why on your feet is better than feet. Presented at the 83rd Annual Meeting of the Linguistic Society of America, San Francisco, CA.
6. Arnon, I., & Ramscar, M. (2009). How order-of-acquisition shapes learning: The case of grammatical gender. Presented at the 33rd Boston University Conference on Language Development, Boston, MA.
7. Aslin, R. N., Saffran, J. R., & Newport, E. L. (1998). Computation of conditional probability statistics by 8-month-old infants. Psychological Science, 9, 321-324.
8. Aslin, R. N., Woodward, J., LaMendola, N., & Bever, T. G. (1996). Models of word segmentation in fluent maternal speech to infants. In J. L. Morgan & K. Demuth (Eds.), Signal to syntax: Bootstrapping from speech to grammar in early acquisition (pp. 117-134). Mahwah, NJ: Erlbaum.
9. Baayen, R. H. (2001). Word frequency distributions. Dordrecht, The Netherlands: Kluwer.
10. Baayen, R. H., Piepenbrock, R., & Gulikers, L. (1995). The CELEX lexical database (Release 2). Philadelphia, PA: Linguistic Data Consortium.
11. Baayen, R. H., Schreuder, R., & Sproat, R. (2000). Morphology in the mental lexicon: A computational model for visual word recognition. In F. Van Eynde & D. Gibbon (Eds.), Lexicon development for speech and language processing (pp. 267-293). Dordrecht, The Netherlands: Kluwer.
12. Bailey, T. M., & Hahn, U. (2001). Determinants of wordlikeness: Phonotactics or lexical neighborhoods? Journal of Memory and Language, 44, 568-591.
13. Batchelder, E. O. (2002). Bootstrapping the lexicon: A computational model of infant speech segmentation. Cognition, 83, 167-206.
14. Beckman, M. E., Munson, B., & Edwards, J. (2007). Vocabulary growth and developmental expansion of types of phonological knowledge. In J. Cole & J. I. Hualde (Eds.), Laboratory Phonology 9 (pp. 241-264). Berlin: Mouton de Gruyter.
15. Best, C. T., McRoberts, G. W., & Sithole, N. M. (1988). Examination of perceptual reorganization for nonnative speech contrasts: Zulu click discrimination by English-speaking adults and infants. Journal of Experimental Psychology: Human Perception and Performance, 14, 345-360.
16. Blanchard, D., & Heinz, J. (2008). Improving word segmentation by simultaneously learning phonotactics. In A. Clark & K. Toutanova (Eds.), Proceedings of the Conference on Natural Language Learning (CoNLL) (pp. 65-72). Stroudsberg, PA: Association for Computational Linguistics.
17. Booth, A. E., & Waxman, S. R. (2003). Mapping words to the world in infancy: Infants' expectations for count nouns and adjectives. Journal of Cognition and Development, 4, 357-381.
18. Bortfeld, H., Morgan, J., Golinkoff, R., & Rathbun, K. (2005). Mommy and me: Familiar names help launch babies into speech stream segmentation. Psychological Science, 16, 298-304.
19. Brent, M. (1999). An efficient, probabilistically sound algorithm for segmentation and word discovery. Machine Learning, 34, 71-105.
20. Brent, M., & Cartwright, T. (1996). Distributional regularity and phonotactic constraints are useful for segmentation. Cognition, 61, 93-125.
21. Brent, M. R., & Siskind, J. M. (2001). The role of exposure to isolated words in early vocabulary development. Cognition, 81, B33-B44.
22. Cairns, P., Shillcock, R. C., Chater, N., & Levy, J. (1997). Bootstrapping word boundaries: A bottom-up corpus-based approach to speech segmentation. Cognitive Psychology, 33, 111-153.
23. Chomsky, N., & Halle, M. (1965). Some controversial questions in phonological theory. Journal of Linguistics, 1, 97-138.
24. Christiansen, M. H., Allen, J., & Seidenberg, M. S. (1998). Learning to segment speech using multiple cues: A connectionist model. Language and Cognitive Processes, 13, 221-268.
25. Christophe, A., Gout, A., Peperkamp, S., & Morgan, J. L. (2003). Discovering words in the continuous speech stream: The role of prosody. Journal of Phonetics, 31, 585-598.
26. Cutler, A., & Carter, D. M. (1987). The predominance of strong initial syllables in the English vocabulary. Computer Speech and Language, 2, 133-142.
27. Cutler, A., McQueen, J. M., Butterfield, S., & Norris, D. (2008). Prelexically-driven perceptual retuning of phoneme boundaries. In Proceedings of Interspeech 2008 (p. 2056). Brisbane, Australia: 9th Annual Conference of the International Speech Communication Association.
28. Dale, P. S., & Fenson, L. (1996). Lexical development norms for young children. Behavior Research Methods, Instruments, & Computers, 28, 125-127.
29. Davis, M. H. (2004). Connectionist modelling of lexical segmentation and vocabulary acquisition. In P. Quinlan (Ed.), Connectionist models of development: Developmental processes in real and artificial neural networks (pp. 151-187). Hove, UK: Psychology Press.
30. Dupoux, E., Kakehi, K., Hirose, Y., Pallier, C., & Mehler, J. (1999). Epenthetic vowels in Japanese: A perceptual illusion? Journal of Experimental Psychology: Human Perception and Performance, 25, 1568-1578.
31. Edwards, J., Fox, R. A., & Rogers, C. (2002). Final consonant discrimination in children: Effects of phonological disorder, vocabulary size, and articulatory accuracy. Journal of Speech, Language, and Hearing Research, 45, 231-242.
32. Elman, J. L. (1990). Finding structure in time. Cognitive Science, 14, 179-211.
33. Fleck, M. M. (2008). Lexicalized phonotactic word segmentation. In Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies (pp. 130-138). Madison, WI: Omnipress.
34. Friederici, A. D., & Wessels, J. M. I. (1993). Phonotactic knowledge of word boundaries and its use in infant speech-perception. Perception & Psychophysics, 54, 287-295.
35. Ganong, W. F. (1980). Phonetic categorization in auditory word perception. Journal of Experimental Psychology: Human Perception and Performance, 6, 110-125.
36. Gathercole, V. C. M., Sebastian, E., & Soto, P. (1999). The early acquisition of Spanish verbal morphology: Across-the-board or piecemeal knowledge? International Journal of Bilingualism, 3, 138-182.
37. Goldwater, S. (2006). Nonparametric Bayesian models of lexical acquisition. Unpublished dissertation, Brown University.
38. Goldwater, S., Griffiths, T. L., & Johnson, M. (2009). A Bayesian framework for word segmentation: Exploring the effects of context. Cognition, 112, 21-54.
39. Graf Estes, K., Evans, J. L., Alibali, M. W., & Saffran, J. R. (2007). Can infants map meaning to newly segmented words? Statistical segmentation and word learning. Psychological Science, 18, 254-260.
40. Hayes, B., & Wilson, C. (2008). A maximum entropy model of phonotactics and phonotactic learning. Linguistic Inquiry, 39, 379-440.
41. Hockema, S. A. (2006). Finding words in speech: An investigation of American English. Language Learning and Development, 2, 119-146.
42. Itô, J., & Mester, R. A. (1995). Japanese phonology. In John. A. Goldsmith (Ed.), The Handbook of Phonological Theory (pp. 817-838). Cambridge, MA: Blackwell Handbooks in Linguistics, Blackwell Publishers.
43. Johnson, K. (2004). Massive reduction in conversational American English. In K. Yoneyama & K. Maekawa (Eds.), Spontaneous speech: Data and analysis. Proceedings of the 1st Session of the 10th International Symposium (pp. 29-54). Tokyo, Japan: The National International Institute for Japanese Language.
44. Johnson, M., & Goldwater, S. (2009). Improving nonparametric Bayesian inference: Experiments on unsupervised word segmentation with adaptor grammars. Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the ACL, pp. 317-325. Boulder, Colorado, June 2009.
45. Jurafsky, D. (2003). Probabilistic modeling in psycholinguistics: Linguistic comprehension and production. In R. Bod, J. Hay & S. Jannedy (Eds.), Probabilistic linguistics (pp. 39-96). Cambridge, MA: MIT Press.
46. Jusczyk, P. W., Friederici, A. D., Wessels, J. M. I., Svenkerud, V. Y., & Jusczyk, A. M. (1993). Infants' sensitivity to the sound pattern of native language words. Journal of Memory and Language, 32, 402-420.
47. Jusczyk, P. W., Hohne, E. A., & Bauman, A. (1999). Infants' sensitivity to allophonic cues for word segmentation. Perception and Psychophysics, 61, 1465-1476.
48. Jusczyk, P. W., Houston, D. M., & Newsome, M. (1999). The beginnings of word segmentation in English-learning infants. Cognitive Psychology, 39, 159-207.
49. Jusczyk, P. W., Luce, P. A., & Charles-Luce, J. (1994). Infants' sensitivity to phonotactic patterns in the native language. Journal of Memory and Language, 33, 630-645.
50. Kuhl, P. K., Andruski, J. E., Chistovich, I. A., Chistovich, L. A., Kozhevnikova, E. V., Ryskina, V. L., Stolyarova, E. I., Sundberg, U., & Lacerda, F. (1997). Cross-language analysis of phonetic units in language addressed to Infants. Science, 277, 684-686.
51. Kuhl, P. K., Stevens, E., Hayashi, A., Deguchi, T., Kiritani, S., & Iverson, P. (2006). Infants show a facilitation effect for native language phonetic perception between 6 and 12months. Developmental Science, 9, F13-F21.
52. Kuhl, P. K., Williams, K. A., Lacerda, F., Stevens, K. N., & Lindblom, B. (1992). Linguistic experience alters phonetic perception in infants by 6months of age. Science, 255, 606-608.
53. Lehiste, I. (1960). An acoustic-phonetic study of open juncture. Phonetica, Supplementum ad, 5, 1-54.
54. Levy, R. (2008). A noisy-channel model of rational human sentence comprehension under uncertain input. In Proceedings of the 2008 Conference on Empirical Methods in Natural Language Processing (EMNLP) (pp. 234-243). Madison, WI: Omnipress.
55. Lieven, E. V. M., Pine, J. M., & Baldwin, G. (1997). Lexically-based learning and early grammatical development. Journal of Child Language, 24, 187-219.
56. Lohr, S. L. (1999). Sampling: Design and analysis. Pacific Grove, CA: Duxbury Press.
57. Luce, P., & Large, N. R. (2001). Phonotactics, density, and entropy in spoken word recognition. Language and Cognitive Processes, 16, 565-581.
58. Luce, P. A., & Pisoni, D. B. (1998). Recognizing spoken words: The neighborhood activation model. Ear & Hearing, 19, 1-36.
59. MacWhinney, B. (2000). The CHILDES project: Tools for analyzing talk (3rd ed.). Mahwah, NJ: Lawrence Erlbaum Associates.
60. Manning, C., & Schütze, H. (1999). Foundations of statistical natural language processing. Cambridge, MA: MIT.
61. Massaro, D. W., & Cohen, M. M. (1983). Integration of visual and auditory information in speech perception. Journal of Experimental Psychology: Human Perception and Performance, 9, 753-771.
62. Mattys, S. L., & Jusczyk, P. W. (2001). Phonotactic cues for segmentation of fluent speech by infants. Cognition, 78, 91-121.
63. Mattys, S. L., Jusczyk, P. W., Luce, P. A., & Morgan, J. L. (1999). Phonotactic and prosodic effects on word segmentation in infants. Cognitive Psychology, 38, 465-494.
64. Mattys, S. L., White, L., & Melhorn, J. F. (2005). Integration of multiple speech segmentation cues: A hierarchical framework. Journal of Experimental Psychology: General, 134, 477-500.
65. McCarthy, J., & Prince, A. (1986). Prosodic Morphology 1986 (Technical Report No. 32). New Brunswick, NJ: Rutgers University Center for Cognitive Science.
66. McClelland, J. L., & Elman, J. L. (1986). The TRACE model of speech perception. Cognitive Psychology, 18, 1-86.
67. Mehl, M. R., Vazire, S., Ramirez-Esparza, N., Slatcher, R. B., & Pennebaker, J. W. (2007). Are women really more talkative than men? Science, 317, 82.
68. Mintz, T. H. (2003). Frequent frames as a cue for grammatical categories in child directed speech. Cognition, 90, 91-117.
69. Mitterer, H., Yoneyama, K., & Ernestus, M. (2008). How we hear what is hardly there: Mechanisms underlying compensation for /t/-reduction in speech comprehension. Journal of Memory and Language, 59, 133-152.
70. Miyawaki, K., Strange, W., Verbrugge, R. R., Liberman, A. M., Jenkins, J. J., & Fujimura, O. (1975). An effect of linguistic experience: The discrimination of [r] and [l] by native speakers of Japanese and English. Perception and Psychophysics, 18, 331-340.
71. Moreton, E. (1997). Phonotactic rules in speech perception. Journal of the Acoustical Society of America, 102, 3091-3092.
72. Munson, B. (2001). Relationships between vocabulary size and spoken word recognition in children aged 3 to 7. Contemporary Issues in Communication Science and Disorders, 28, 20-29.
73. Nespor, M., & Vogel, I. (1986). Prosodic phonology. Dordrecht: Foris.
74. Norris, D., & McQueen, J. M. (2008). Shortlist B: A Bayesian model of continuous speech recognition. Psychological Review, 115, 357-395.
75. Peperkamp, S., Le Calvez, R., Nadal, J.-P., & Dupoux, E. (2006). The acquisition of allophonic rules: Statistical learning with linguistic constraints. Cognition, 101, B31-B41.
76. Peterson-Hicks, J. (2006). The impact of function words on the processing and acquisition of syntax. Unpublished dissertation, Northwestern University.
77. Pierrehumbert, J. B. (2001). Why phonological constraints are so coarse-grained. Language and Cognitive Processes, 16, 691-698.
78. Pierrehumbert, J. B. (2002). Word-specific phonetics. In C. Gussenhoven & N. Warner (Eds.), Laboratory phonology 7 (pp. 101-139). Berlin: Mouton de Gruyter.
79. Pitt, M. A., Dilley, L., Johnson, K., Kiesling, S., Raymond, W., Hume, E., & Fosler-Lussier, E. (2007). Buckeye corpus of conversational speech (2nd release) [http://buckeyecorpus.osu.edu]. Columbus, OH: Department of Psychology, Ohio State University (Distributor).
80. Polka, L., Colantonio, C., & Sundara, M. (2001). Cross-language perception of/d -{eth}/: Evidence for a new developmental pattern. Journal of the Acoustical Society of America, 109, 2190-2200.
81. Rubino, R., & Pine, J. (1998). Subject-verb agreement in Brazilian Portuguese: What low error rates hide. Journal of Child Language, 25, 35-60.
82. Saffran, J. R., Aslin, R. N., & Newport, E. L. (1996). Statistical learning by 8-month-old infants. Science, 274, 1926-1928.
83. Selkirk, E. O. (1984). Phonology and syntax: The relation between sound and structure. Cambridge, MA: MIT Press.
84. Soderstrom, M., Kemler-Nelson, D. G., & Jusczyk, P. W. (2005). Six-month-olds recognize clauses embedded in different passages of fluent speech. Infant Behavior and Development, 28, 87-94.
85. Storkel, H. L., Armbruster, J., & Hogan, T. P. (2006). Differentiating phonotactic probability and neighborhood density in adult word learning. Journal of Speech, Language, and Hearing Research, 49, 1175-1192.
86. Storkel, H. L., & Maekawa, J. (2005). A comparison of homonym and novel word learning: The role of phonotactic probability and word frequency. Journal of Child Language, 32 (4), 827-853.
87. Swingley, D. (2005). Statistical clustering and the contents of the infant vocabulary. Cognitive Psychology, 50, 86-132.
88. Thiessen, E. D., & Saffran, J. R. (2003). When cues collide: Use of statistical and stress cues to word boundaries by 7- and 9-month-old infants. Developmental Psychology, 39, 706-716.
89. Thorn, A. S. C., & Frankish, C. R. (2005). Long-term knowledge effects on serial recall of nonwords are not exclusively lexical. Journal of Experimental Psychology: Learning, Memory, and Cognition, 31, 729-735.
90. Tomasello, M. (2004). The item-based nature of children's early syntactic development. Trends in Cognitive Science, 4, 156-163.
91. Tomasello, M., & Brooks, P. (1998). Young children's earliest transitive and intransitive constructions. Cognitive Linguistics, 9, 379-395.
92. Tomasello, M., & Farrar, J. M. (1986). Joint attention and early language. Child Development, 57, 1454-1463.
93. Tomasello, M., Mannle, S., & Kruger, A. (1986). Linguistic environment of 1- to 2-year-old twins. Developmental Psychology, 22, 169-176.
94. Trehub, S. E. (1976). The discrimination of foreign speech contrasts by infants and adults. Child Development, 47, 466-472.
95. Tsao, F.-M., Liu, H.-M., & Kuhl, P. K. (2006). Perception of native and non-native affricate-fricative contrasts: Cross-language tests on adults and infants. Journal of the Acoustical Society of America, 120, 2285-2294.
96. van de Weijer, J. (1998). Language input for word discovery. Unpublished dissertation, Nijmegen: Max Planck Institute for Psycholinguistics.
97. Venkataraman, A. (2001). A statistical model for word discovery in transcribed speech Computational Linguistics, 27(3), 351-372.
98. Werker, J., & Tees, R. (1984). Cross-language speech perception evidence for perceptual reorganization during the first year of life. Infant Behavior and Development, 7, 49-63.
99. Xanthos, A. (2004). Combining utterance-boundary and predictability approaches to speech segmentation. In W. G. Sakas (Ed.), Proceedings of the First Workshop on Psycho-computational Models of Language Acquisition at COLING 2004 (pp. 93-100). Geneva, Switzerland.