Bridging the gap between speech segmentation and word-to-world mappings: Evidence from an audiovisual statistical learning task

Journal of Memory and Language

Volumn 63, Issue 3, 2010, Pages 295-305

  Cunillera, Toni ^b,c   Laine, Matti ^c   Càmara, Estela ^b   Rodríguez Fornells, Antoni ^a,b  

^a INSTITUCIÓ CATALANA DE RECERCA I ESTUDIS AVANÇATS ICREA   (Spain)

^b UNIVERSITY OF BARCELONA   (Spain)

^c ÅBO AKADEMI UNIVERSITY   (Finland)

Author keywords

Audio visual speech; Language learning; Speech segmentation; Statistical learning; Word to world mapping

Indexed keywords

EID: 77956056941     PISSN: 0749596X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jml.2010.05.003     Document Type: Article

References (63)

1. Abla D., Katahira K., Okanoya K. On-line assessment of statistical learning by event-related potentials. Journal of Cognitive Neuroscience 2008, 20:952-964.
2. Altmann G.T. Statistical learning in infants. Proceedings of the National Academy of Sciences of the United States of America 2002, 99:15250-15251.
3. Aslin R.N., Saffran J.R., Newport E.L. Computation of conditional probability statistics by 8-month-old infants. Psychological Science 1998, 9:321-324.
4. Baldwin D.A. Infants' ability to consult the speaker for clues to word reference. Journal of Child Language 1993, 20:395-418.
5. Ballem K.D., Plunkett K. Phonological specificity in children at 1;2. Journal of Child Language 2005, 32:159-173.
6. Bloom P. How children learn the meanings of words 2000, MIT Press, Cambridge, MA.
7. Brent M.R., Siskind J.M. The role of exposure to isolated words in early vocabulary development. Cognition 2001, 81:B33-B44.
8. Carey S., Barlett E. Acquiring a single new word. Papers and Reports on Child Language Development 1978, 15:17-29.
9. Cunillera T., Càmara E., Laine M., Rodríguez-Fornells A. Speech segmentation is facilitated by visual cues. The Quarterly Journal of Experimental Psychology 2010, 63:260-274.
10. Cunillera T., Càmara E., Toro J.M., Marco-Pallares J., Sebastian-Galles N., Ortiz H., et al. Time course and functional neuroanatomy of speech segmentation in adults. Neuroimage 2009, 43:541-553.
11. Cunillera T., Toro J.M., Sebastian-Galles N., Rodríguez-Fornells A. The effects of stress and statistical cues on continuous speech segmentation: An event-related brain potential study. Brain Research 2006, 1123:168-178.
12. Davis C., Kim J. Repeating and remembering foreign language words: Implications for language teaching systems. Artificial Intelligence Review 2001, 16:37-47.
13. De Diego-Balaguer R., Toro J.M., Rodríguez-Fornells A., Bachoud-Levi A.C. Different neurophysiological mechanisms underlying word and rule extraction from speech. PLoS ONE 2007, 2:e1175.
14. Dodd B. The role of vision in the perception of speech. Perception 1977, 6:31-40.
15. Dutoit, T., Pagel, N., Pierret, F., Bataille, O., & van der Vreken, O. (1996). The MBROLA project: Towards a set of high-quality speech synthesizers free of use for non-commercial purposes. In: Proc. ICSLP'96, Philadelphia (Vol. 3, pp. 1393-1396).
16. Endress A.D., Mehler J. The surprising power of statistical learning: When fragment knowledge leads to false memories of unheard words. Journal of Memory and Language 2009, 60:353-369.
17. Fennell, C. T. (2004). Infants attention to phonemic details in word forms: Knowledge and familiarity effects. Unpublished doctoral dissertation, University of British Columbia, Vancouver.
18. Fennell C.T., Werker J.F. Early word learners' ability to access phonetic detail in well-known words. Language and Speech 2003, 46:245-264.
19. Fennell C.T., Werker J.F. Infant attention to phonetic detail: Knowledge and familiarity effects. Proceedings of the 27th annual Boston University conference on language development 2004, 165-176. Cascadilla Press, Somerville, MA. B. Beachley, A. Brown, F. Conlin (Eds.).
20. Gaskell M.G., Dumay N. Lexical competition and the acquisition of novel words. Cognition 2003, 89:105-132.
21. Gleitman L. The structural sources of verb meanings. Language Acquisition 1990, 1:3-55.
22. Gleitman L., Cassidy K., Nappa R., Papafragou A., Trueswell J. Hard words. Language Learning and Development 2005, 1:23-64.
23. Goldinger S.D. Echoes of echoes? An episodic theory of lexical access. Psychological Reviews 1998, 105:251-279.
24. Gomez R.L., Gerken L. Artificial grammar learning by 1-year-olds leads to specific and abstract knowledge. Cognition 1999, 70:109-135.
25. Graf-Estes K., Evans J.L., Alibali M.W., Saffran J.R. Can infants map meaning to newly segmented words? Statistical segmentation and word learning. Psychological Science 2007, 18:254-260.
26. Hollich G. Combining techniques to reveal emergent effects in infants' segmentation, word learning, and grammar. Language and Speech 2006, 49:3-19.
27. Hollich G.J., Hirsh-Pasek K., Golinkoff R.M., Brand R.J., Brown E., Chung H.L., et al. Breaking the language barrier: An emergentist coalition model for the origins of word learning. Monographs of the Society for Research in Child Development 2000, 65:i-123.
28. Hollich G., Newman R.S., Jusczyk P.W. Infants' use of synchronized visual information to separate streams of speech. Child Development 2005, 76:598-613.
29. Jusczyk P.W. How infants begin to extract words from speech. Trends in Cognitive Sciences 1999, 3:323-328.
30. Jusczyk P.W., Aslin R.N. Infant's detection of the sound patterns of words in fluent speech. Cognitive Psychology 1995, 29:1-23.
31. Kutas M., Federmeier K.D. Electrophysiology reveals semantic memory use in language comprehension. Trends in Cognitive Sciences 2000, 4:463-470.
32. MacNamara J. Names for things: A study of human learning 1982, MIT Press, Cambridge.
33. Mani N., Plunkett K. Fourteen-month-olds pay attention to vowels in novel words. Developmental Science 2008, 11:53-59.
34. Markman E.M. Constraints children place on word meanings. Cognitive Science 1990, 14:57-77.
35. Markman E.M., Wachtel G.F. Children's use of mutual exclusivity to constrain the meanings of words. Cognitive Psychology 1988, 20:121-157.
36. Mirman D., Magnuson J.S., Graf-Estes K., Dixon J.A. The link between statistical segmentation and word learning in adults. Cognition 2008, 108:271-280.
37. Nazzi T., Bertoncini J. Before and after the vocabulary spurt: Two modes of word acquisition?. Developmental Science 2003, 6:136-142.
38. Pinker S. Learnability and Cognition 1989, MIT Press, Cambridge, MA.
39. Plunkett K. Theories of early language acquisition. Trends in Cognitive Sciences 1997, 1:146-153.
40. Quine W.V.O. Word and object 1960, MIT Press, Cambridge, MA.
41. Reisberg D., McLean J., Goldfield A. Easy to hear but hard to understand: A lip-reading advantage with intact auditory stimuli. Hearing by eye: The psychology of lip-reading 1987, 97-114. Lawrence Erlbaum Associates Inc., Hillsdale, NJ. B. Dodd, R. Campbell (Eds.).
42. Richards D., Goldfarb J. The episodic memory model of conceptual development: An integrative viewpoint. Cognitive Development 1986, 1:183-219.
43. Roy D.K., Pentland A.P. Learning words from sights and sounds: A computational model. Cognitive Science 2002, 26:113-146.
44. Saffran J.R. Words in a sea of sounds: The output of infant statistical learning. Cognition 2001, 81:149-169.
45. Saffran J.R. Statistical language learning: Mechanisms and constraints. Current Directions in Psychological Science 2003, 12:110-114.
46. Saffran J.R., Aslin R.N., Newport E.L. Statistical learning by 8-month-old infants. Science 1996, 274:1926-1928.
47. Saffran J.R., Graf-Estes K.M. Mapping sound to meaning: Connections between learning about sounds and learning about words. Advances in child development and behavior 2006, 1-38. Elsevier, New York. R. Kail (Ed.).
48. Saffran J.R., Johnson E.K., Aslin R.N., Newport E.L. Statistical learning of tone sequences by human infants and adults. Cognition 1999, 70:27-52.
49. Saffran J.R., Newport E.L., Aslin R.N. Word segmentation: The role of distributional cues. Journal of Memory and Language 1996, 35:606-621.
50. Saffran J.R., Wilson D.P. From syllables to syntax: Multi-level statistical learning by 12-month-old infants. Infancy 2003, 4:273-284.
51. Sanders D.A., Goodrich S.J. The relative contribution of visual and auditory components of speech to speech intelligibility as a function of three conditions of frequency distortion. Journal of Speech, Language, and Hearing Research 1971, 14:154-159.
52. Sanders L.D., Newport E.L., Neville H.J. Segmenting nonsense: An event-related potential index of perceived onsets in continuous speech. Nature Neuroscience 2002, 5:700-703.
53. Siskind J.M. A computational study of cross-situational techniques for learning word-to-meaning mappings. Cognition 1996, 61:39-91.
54. Smith L.B. How to learn words: An associative crane. Breaking the word learning barrier 2000, 51-81. Oxford University Press, Oxford, England. R. Golinkoff, K. Hirsh-Pasek (Eds.).
55. Snodgrass J.G., Vanderwart M. Standardized set of 260 pictures - Norms for name agreement, image agreement, familiarity, and visual complexity. Journal of Experimental Psychology: Human Learning and Memory 1980, 6:174-215.
56. Tamminen J., Gaskell M.G. Newly learned spoken words show long-term lexical competition effects. Quarterly Journal of Experimental Psychology 2008, 61:361-371.
57. Thompson L.A., Ogden W.C. Visible speech improves human language understanding: Implications for speech processing systems. Artificial Intelligence Review 1995, 9:347-358.
58. Tomasello M. The social bases of language acquisition. Social Development 1992, 1:67-87.
59. Vouloumanos A. Fine-grained sensitivity to statistical information in adult word learning. Cognition 2008, 107:729-742.
60. Weijer, J. van de (1998). Language input for word discovery. MPI Series in Psycholinguistics 9. Nijmegen: Max Planck Institute of Psycholinguistics.
61. Yu C., Ballard D.H., Aslin R.N. The role of embodied intention in early lexical acquisition. Cognitive Science 2005, 29:961-1005.
62. Yu C., Smith L.B. Rapid word learning under uncertainty via cross-situational statistics. Psychological Science 2007, 18:414-420.
63. Yu C., Smith L.B. Infants rapidly learn word-referent mapping via cross-situational statistics. Cognition 2008, 106:1558-1568.