iMinerva: A mathematical model of distributional statistical learning

Cognitive Science

Volumn 37, Issue 2, 2013, Pages 310-343

  Thiessen, Erik D ^a   Pavlik, Philip I ^b  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b University of Memphis   (United States)

Author keywords

Computational modeling; Language; Memory; Statistical learning

Indexed keywords

EID: 84874703758     PISSN: 03640213     EISSN: None     Source Type: Journal    
DOI: 10.1111/cogs.12011     Document Type: Article

References (88)

1. Aslin, R. N., Saffran, J. R., & Newport, E. L. (1998). Computation of conditional probability statistics by 8-month-old infants. Psychological Science, 9(4), 321-324. doi:10.1111/1467-9280.00063
2. Bomba, P. C., & Siqueland, E. R. (1983). The nature and structure of infant form categories. Journal of Experimental Child Psychology, 35(2), 294-328. doi:10.1016/0022-0965(83)90085-1
3. Caselli, M. C., Bates, E., Casadio, P., Fenson, J., Fenson, L., Sanderl, L., & Weir, J. (1995). A cross-linguistic study of early lexical development. Cognitive Development, 10(2), 159-199. doi:10.1016/0885-2014(95)90008-x
4. Chang, F., Dell, G. S., & Bock, K. (2006). Becoming syntactic. Psychological Review, 113, 234-272.
5. Chomsky, N. (1959). A review of B. F. Skinner's verbal behavior. Language, 35(1), 26-58. doi:citeulike-article-id:263746
6. Clayards, M., Tanenhaus, M. K., Aslin, R. N., & Jacobs, R. A. (2008). Perception of speech reflects optimal use of probabilistic speech cues. Cognition, 108(3), 804-809. doi:10.1016/j.cognition.2008.04.004
7. Cohen, L. B. (1991). Infant attention: An information processing approach. In M. J. Weiss & P. R. Zalazo (Eds.), Newborn attention: Biological constraints and the influence of experience (pp. 1-21). Norwood, NJ: Ablex Publishing Corporation.
8. Cohen, L. B. (1998). An information-processing approach to infant perception and cognition. In F. Simion & G. Butterworth (Eds.), The development of sensory, motor, and cognitive capacities in early infancy (pp. 277-300). East Sussex, England: Psychology Press.
9. Conway, C. M., & Christiansen, M. H. (2005). Modality-constrained statistical learning of tactile, visual, and auditory sequences. Journal of Experimental Psychology: Learning, Memory, and Cognition, 31(1), 24-39. doi:10.1016/s0278-7393(05)80004-7
10. Creel, S. C., Newport, E. L., & Aslin, R. N. (2004). Distant melodies: Statistical learning of nonadjacent dependencies in tone sequences. Journal of Experimental Psychology: Learning, Memory, and Cognition, 30(5), 1119-1130.
11. Endress, A. D., & Bonatti, L. L. (2007). Rapid learning of syllable classes from a perceptually continuous speech stream. Cognition, 105(2), 247-299. doi:10.1016/j.cognition.2006.09.010
12. Endress, A. D., & Mehler, J. (2009). The surprising power of statistical learning: When fragment knowledge leads to false memories of unheard words. Journal of Memory and Language, 60(3), 351-367. doi:10.1016/j.jml.2008.10.003
13. Estes, K. G., Evans, J. L., Alibali, M. W., & Saffran, J. R. (2007). Can infants map meaning to newly segmented words?Psychological Science, 18(3), 254-260. doi:10.1111/j.1467-9280.2007.01885.x
14. Feldman, N. H., Griffiths, T. L., & Morgan, J. L. (2009). Learning phonetic categories by learning a lexicon. Proceedings of the 31st Annual Conference of the Cognitive Science Society, 2208-2213.
15. Fiser, J., & Aslin, R. N. (2002). Statistical learning of new visual feature combinations by infants. Proceedings of the National Academy of Sciences of the United States of America, 99(24), 15822-15826. doi:10.1073/pnas.232472899
16. Fiser, J., & Aslin, R. N. (2005). Encoding multielement scenes: Statistical learning of visual feature hierarchies. Journal of Experimental Psychology: General, 134(4), 521-537. doi:10.1037/0096-3445.134.4.521
17. Frank, M. C., Goldwater, S., Griffiths, T. L., & Tenenbaum, J. B. (2010). Modeling human performance in statistical word segmentation. Cognition, 117(2), 107-125.
18. Gibson, E. J. (1940). A systematic application of the concepts of generalization and differentiation to verbal learning. Psychological Review, 47(3), 196-229. doi:10.1037/h0060582
19. Giroux, I., & Rey, A. (2009). Lexical and sublexical units in speech perception. Cognitive Science, 33(2), 260-272. doi:10.1111/j.1551-6709.2009.01012.x
20. Goldinger, S. D. (1998). Echoes of echoes? An episodic theory of lexical access. Psychological Review, 105(2), 251-279.
21. Gomez, R. L. (2002). Variability and detection of invariant structure. Psychological Science, 13(5), 431-436. doi:10.1111/1467-9280.00476
22. Gomez, R. L., & Maye, J. (2001). Developmental trends in acquiring non-adjacent dependencies. Unpublished manuscript. Tucson: University of Arizona.
23. Gottlieb, J. (2007). From thought to action: The parietal cortex as a bridge between perception, action, and cognition. Neuron, 53(1), 9-16. doi:10.1016/j.neuron.2006.12.009
24. Graf Estes, K., Evans, J. L., & Else-Quest, N. M. (2007). Differences in the nonword repetition performance of children with and without specific language impairment: A meta-analysis. Journal of Speech, Language, and Hearing Research, 50(1), 177-195. doi:10.1044/1092-4388(2007/015)
25. Hall, G., & Honey, R. C. (1989). Contextual effects in conditioning, latent inhibition, and habituation: Associative and retrieval functions of contextual cues. Journal of Experimental Psychology: Animal Behavior Processes, 15(3), 232-241.
26. Hauser, M. D., Newport, E. L., & Aslin, R. N. (2001). Segmentation of the speech stream in a non-human primate: Statistical learning in cotton-top tamarins. Cognition, 78(3), B53-B64. doi:10.1016/s0010-0277(00)00132-3
27. Hayes, J. R., & Clark, H. H. (1970). Experiments in the segmentation of an artificial speech analog. In J. R. Hayes (Ed.), Cognition and the development of language (pp. 221-234). New York: Wiley.
28. Hintzman, D. L. (1984). Episodic versus semantic memory: A distinction whose time has come-and gone?Behavioral and Brain Sciences, 7(2), 240-241. doi:10.1017/S0140525X00044435
29. Hintzman, D. L. (1986). "Schema Abstraction" in a multiple-trace memory model. Psychological Review, 93(4), 411-428. doi:10.1037/0033-295x.93.4.411
30. Hintzman, D. L. (1988). Judgments of frequency and recognition memory in a multiple-trace memory model. Psychological Review, 95(4), 528-551.
31. Hudson Kam, C. L., & Newport, E. L. (2009). Getting it right by getting it wrong: When learners change languages. Cognitive Psychology, 59(1), 30-66. doi:10.1016/j.cogpsych.2009.01.001
32. Hunt, R. H., & Aslin, R. N. (2010). Category induction via distributional analysis: Evidence from a serial reaction time task. Journal of Memory and Language, 62(2), 98-112. doi:10.1016/j.jml.2009.10.002
33. Johnson, E. K., & Jusczyk, P. W. (2001). Word segmentation by 8-month-olds: When speech cues count more than statistics. Journal of Memory and Language, 44(4), 548-567. doi:10.1006/jmla.2000.2755
34. Johnson, E. K., & Seidl, A. (2008). Clause segmentation by 6-month-old infants: A crosslinguistic perspective. Infancy, 13(5), 440-455.
35. Jusczyk, P. W. (1993). From general to language-specific capacities: The WRAPSA model of how speech perception develops. Journal of Phonetics, 21, 3-28.
36. Kirkham, N. Z., Slemmer, J. A., & Johnson, S. P. (2002). Visual statistical learning in infancy: Evidence for a domain general learning mechanism. Cognition, 83(2), B35-B42. doi:10.1016/s0010-0277(02)00004-5
37. Kuhl, P. K., Andruski, J. E., Chistovich, I. A., Chistovich, L. A., Kozhevnikova, E. V., Ryskina, V. L., & Lacerda, F. (1997). Cross-language analysis of phonetic units in language addressed to infants. Science, 277(5326), 684-686. doi:10.1126/science.277.5326.684
38. Kuhl, P. K., Stevens, E., Hayashi, A., Deguchi, T., Kiritani, S., & Iverson, P. (2006). Infants show a facilitation effect for native language phonetic perception between 6 and 12months. Developmental Science, 9(2), F13-F21. doi:10.1111/j.1467-7687.2006.00468.x
39. Kuhl, P. K., Williams, K., Lacerda, F., Stevens, K., & Lindblom, B. (1992). Linguistic experience alters phonetic perception in infants by 6months of age. Science, 255(5044), 606-608. doi:10.1126/science.1736364
40. Lidz, J., Gleitman, H., & Gleitman, L. (2003). Understanding how input matters: Verb learning and the footprint of universal grammar. Cognition, 87(3), 151-178. doi:10.1016/s0010-0277(02)00230-5
41. Marcus, G. F., Fernandes, K. J., & Johnson, S. P. (2007). Infant rule learning facilitated by speech. Psychological Science, 18(5), 387-391. doi:10.1111/j.1467-9280.2007.01910.x
42. Marcus, G. F., Vijayan, S., Bandi Rao, S., & Vishton, P. M. (1999). Rule learning by seven-month-old infants. Science, 283(5398), 77-80. doi:10.1126/science.283.5398.77
43. Maye, J., Weiss, D. J., & Aslin, R. N. (2008). Statistical phonetic learning in infants: Facilitation and feature generalization. Developmental Science, 11(1), 122-134. doi:10.1111/j.1467-7687.2007.00653.x
44. Maye, J., Werker, J. F., & Gerken, L. (2002). Infant sensitivity to distributional information can affect phonetic discrimination. Cognition, 82(3), B101-B111. doi:10.1016/s0010-0277(01)00157-3
45. McClelland, J. L., & Plaut, D. C. (1999). Does generalization in infant learning implicate abstract algebra-like rules?Trends in Cognitive Sciences, 3(5), 166-168.
46. McClelland, J. L., & Rumelhart, D. E. (1985). Distributed memory and the representation of general and specific information. Journal of Experimental Psychology: General, 114(2), 159-188. doi:10.1037/0096-3445.114.2.159
47. McMurray, B., & Aslin, R. N. (2005). Infants are sensitive to within-category variation in speech perception. Cognition, 95, B15-B26.
48. McMurray, B., Aslin, R. N., & Toscano, J. C. (2009). Statistical learning of phonetic categories: Insights from a computational approach. Developmental Science, 12, 369-378.
49. Miller, G. A. (1956). The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychological Review, 63(2), 81-97.
50. Mintz, T. H. (2002). Category induction from distributional cues in an artificial language. Memory and Cognition, 30(5), 678-686. doi:10.3758/bf03196424
51. Mintz, T. H. (2003). Frequent frames as a cue for grammatical categories in child directed speech. Cognition, 90(1), 91-117. doi:10.1016/s0010-0277(03)00140-9
52. Misyak, J. B., Christiansen, M. H., & Tomblin, J. B. (2010). Sequential expectations: The role of prediction-based learning in language. Topics in Cognitive Science, 2(1), 138-153. doi:10.1111/j.1756-8765.2009.01072.x
53. Newport, E. L., & Aslin, R. N. (2004). Learning at a distance. I. Statistical learning of non-adjacent dependencies. Cognitive Psychology, 48(2), 127-162. doi:10.1016/s0010-0285(03)00128-2
54. Onishi, K. H., Chambers, K. E., & Fisher, C. (2002). Learning phonotactic constraints from brief auditory experience. Cognition, 83(1), B13-B23. doi:10.1016/s0010-0277(01)00165-2
55. Orbán, G., Fiser, J., Aslin, R. N., & Lengyel, M. (2008). Bayesian learning of visual chunks by human observers. Proceedings of the National Academy of Sciences, 105(7), 2745-2750. doi:10.1073/pnas.0708424105
56. Pater, J., Stager, C., & Werker, J. F. (2004). The lexical acquisition of phonological contrasts. Language, 80(3), 361-379.
57. Perruchet, P., & Tillmann, B. (2010). Exploiting multiple sources of information in learning an artificial language: Human data and modeling. Cognitive Science, 34(2), 255-285. doi:10.1111/j.1551-6709.2009.01074.x
58. Perruchet, P., Tyler, M. D., Galland, N., & Peereman, R. (2004). Learning nonadjacent dependencies: No need for algebraic-like computations. Journal of Experimental Psychology: General, 133(4), 573-583.
59. Perruchet, P., & Vinter, A. (1998). Feature creation as a byproduct of attentional processing. Behavioral and Brain Sciences, 21(1), 33-34.
60. Romberg, A. R., & Saffran, J. R. (2010). Statistical learning and language acquisition. Wiley Interdisciplinary Reviews: Cognitive Science, 1(6), 906-914. doi:10.1002/wcs.78
61. Rubin, D. C., & Wenzel, A. E. (1996). One hundred years of forgetting: A quantitative description of retention. Psychological Review, 103(4), 734-760.
62. Saffran, J. R., Aslin, R. N., & Newport, E. L. (1996). Statistical learning by 8-month-old infants. Science, 274(5294), 1926-1928.
63. Saffran, J. R., & Thiessen, E. D. (2003). Pattern induction by infant language learners. Developmental Psychology, 39(3), 484-494. doi:citeulike-article-id:933733
64. Salton, G. (1989). Automatic text processing: The transformation, analysis, and retrieval of information by computer. Boston, MA: Addison-Wesley Longman Publishing Co. Inc.
65. Seidenberg, M. S., & McClelland, J. L. (1989). A distributed, developmental model of word recognition and naming. Psychological Review, 96(4), 523-568.
66. Shi, L., Griffiths, T. L., Feldman, N. H., & Sanborn, A. N. (2010). Exemplar models as a mechanism for performing Bayesian inference. Psychological Bulletin and Review, 17, 443-464.
67. Shvachkin, N. K. (1973). The development of phonemic speech perception in early childhood. In C. Ferguson & D. Slobin (Eds.), Studies of child language (pp. 91-127). Newyork: Holt.
68. Sloutsky, V. M. (2009). From perceptual categories to concepts: What develops?Cognitive Science, 34, 1244-1286.
69. Stager, C. L., & Werker, J. F. (1997). Infants listen for more phonetic detail in speech perception than in word-learning tasks. Nature, 388(6640), 381-382.
70. Thiessen, E. D. (2007). The effect of distributional information on children's use of phonemic contrasts. Journal of Memory and Language, 56(1), 16-34. doi:10.1016/j.jml.2006.07.002
71. Thiessen, E. D. (2009). Statistical learning. In E. Bavin (Ed.), Cambridge handbook of child language (pp. 35-50). Cambridge, England: Cambridge University Press.
72. Thiessen, E. D. (2011). Domain general constraints on statistical learning. Child Development, 82(2), 462-470. doi:10.1111/j.1467-8624.2010.01522.x
73. Thiessen, E. D., Kronstein, A. T., & Hufnagle, D. G. (in press). The extraction and integration framework: A two-process account of statistical learning. Psychological Bulletin.
74. Thiessen, E. D., & Saffran, J. R. (2003). When cues collide: Use of stress and statistical cues to word boundaries by 7- to 9-month-old infants. Developmental Psychology, 39(4), 706-716.
75. Thiessen, E. D., & Saffran, J. R. (2007). Learning to learn: Infants' acquisition of stress-based strategies for word segmentation. Language Learning and Development, 3(1), 73-100. doi:10.1207/s15473341lld0301_3
76. Thiessen, E. D., & Yee, M. N. (2010). Dogs, bogs, labs, and lads: What phonemic generalizations indicate about the nature of children's early word-form representations. Child Development, 81(4), 1287-1303. doi:10.1111/j.1467-8624.2010.01468.x
77. Thompson, S. P., & Newport, E. L. (2007). Statistical learning of syntax: The role of transitional probability. Language Learning and Development, 3(1), 1-42.
78. Toro, J. M., Nespor, M., Mehler, J., & Bonatti, L. L. (2008). Finding words and rules in a speech stream. Psychological Science, 19(2), 137-144. doi:10.1111/j.1467-9280.2008.02059.x
79. Toro, J. M., & Trobalon, J. B. (2005). Statistical computations over a speech stream in a rodent. Perception & Psychophysics, 67(5), 867-875.
80. Vallabha, G. K., McClelland, J. L., Pons, F., Werker, J. F., & Amano, S. (2007). Unsupervised learning of vowel categories from infant-directed speech. Proceedings of the National Academy of Sciences, 104(33), 13273-13278. doi:10.1073/pnas.0705369104
81. Van Rijn, H., & Anderson, J. (2003). Modeling lexical decision as ordinary retrieval. In F. Detje, D. Doerner, & H. Schaub (Eds.), Proceedings of the Fifth International Conference on Cognitive Modeling (pp. 207-212). Bamberg, Germany: Universitats-Verlag Bamberg.
82. Vouloumanos, A., & Werker, J. F. (2009). Infants' learning of novel words in a stochastic environment. Developmental Psychology, 45(6), 1611-1617. doi:10.1037/a0016134
83. Warker, J. A., & Dell, G. S. (2006). Speech errors reflect newly learned phonotactic constraints. Journal of Experimental Psychology: Learning, Memory, and Cognition, 32(2), 387-398. doi:10.1037/0278-7393.32.2.387
84. Warker, J. A., Dell, G. S., Whalen, C. A., & Gereg, S. (2008). Limits on learning phonotactic constraints from recent production experience. Journal of Experimental Psychology: Learning, Memory, and Cognition, 34(5), 1289-1295. doi:10.1037/a0013033
85. Werker, J. F., & Curtin, S. (2005). PRIMIR: A developmental framework of infant speech processing. Language Learning and Development, 1(2), 197-234. doi:citeulike-article-id:3937582
86. Werker, J. F., Fennell, C. T., Corcoran, K. M., & Stager, C. L. (2002). Infants' ability to learn phonetically similar words: Effects of age and vocabulary size. Infancy, 3(1), 1-30. doi:10.1207/s15327078in0301_1
87. Werker, J. F., & Tees, R. C. (1984). Cross-language speech perception: Evidence for perceptual reorganization during the first year of life. Infant Behavior and Development, 7(1), 49-63. doi:10.1016/s0163-6383(84)80022-3
88. Winkielman, P., Halberstadt, J., Fazendeiro, T., & Catty, S. (2006). Prototypes are attractive because they are easy on the mind. Psychological Science, 17(9), 799-806.