Relative cue encoding in the context of sophisticated models of categorization: Separating information from categorization

Psychonomic Bulletin and Review

Volumn 22, Issue 4, 2015, Pages 916-943

  Apfelbaum, Keith S ^a   McMurray, Bob ^b  

^a OHIO STATE UNIVERSITY   (United States)

^b UNIVERSITY OF IOWA   (United States)

Author keywords

Categorization; Exemplar models; Expectation relative processing; PDP models; Predictive coding; Speech perception

Indexed keywords

ASSOCIATION; COGNITION; COMPREHENSION; HEARING; HUMAN; PSYCHOLOGICAL MODEL; SPEECH PERCEPTION;

AUDITORY PERCEPTION; COGNITION; COMPREHENSION; CUES; HUMANS; MODELS, PSYCHOLOGICAL; SPEECH PERCEPTION;

EID: 84938965721     PISSN: 10699384     EISSN: 15315320     Source Type: Journal    
DOI: 10.3758/s13423-014-0783-2     Document Type: Article

References (115)

1. Apfelbaum, K. S., Bullock-Rest, N., Rhone, A. E., Jongman, A., & McMurray, B. (2014). Contingent categorization in speech perception. Language, Cognition and Neuroscience, 29(9), 1070–1082. doi:10.1080/01690965.2013.824995
2. Apfelbaum, K. S., & McMurray, B. (2011). Using variability to guide dimensional weighting: Associative mechanisms in early word learning. Cognitive Science, 35(6), 1105–1138. doi:10.1111/j.1551-6709.2011.01181.x
3. Blumstein, S. E., & Stevens, K. N. (1979). Acoustic invariance in speech production: Evidence from measurements of the spectral characteristics of stop consonants. Journal of the Acoustical Society of America, 66(4), 1001–1017.
4. Blumstein, S. E., & Stevens, K. N. (1980). Perceptual invariance and onset spectra for stop consonants in different vowel environments. The Journal of the Acoustical Society of America, 67(2), 648–662.
5. Bradlow, A. R., Nygaard, L. C., & Pisoni, D. B. (1999). Effects of talker, rate, and amplitude variation on recognition memory for spoken words. Perception and Psychophysics, 61(2), 206–219.
6. Carandini, M., & Heeger, D. J. (2011). Normalization as a canonical neural computation. Nature Reviews. Neuroscience, 13, 51–62. doi:10.1038/nrn3136
7. Carden, G., Levitt, A., Jusczyk, P. W., & Walley, A. C. (1981). Evidence for phonetic processing of cues to place of articulation: Perceived manner affects perceived place. Perception and Psychophysics, 29(1), 26–36.
8. Carney, A. E., Widin, G. P., & Viemeister, N. F. (1977). Noncategorical perception of stop consonants differing in VOT. The Journal of the Acoustical Society of America, 62(4), 961–970. doi:10.1121/1.381590
9. Clark, A. (2012). Whatever next? Predictive brains, situated agents, and the future of cognitive science. Behavioral and Brain Sciences, 1–86.
10. Clark, A. (2013). Expecting the World: Perception, Prediction, and the Origins of Human Knowledge. Journal of Philosophy, CX(9), 469–496.
11. Coady, J. A., Kluender, K. R., & Rhode, W. S. (2003). Effects of contrast between onsets of speech and other complex spectra. The Journal of the Acoustical Society of America, 114(4), 2225–2235. doi:10.1121/1.1608955
12. Cole, J. S., Linebaugh, G., Munson, C., & McMurray, B. (2010). Unmasking the acoustic effects of vowel-to-vowel coarticulation: A statistical modeling approach. Journal of Phonetics, 38(2), 167–184. doi:10.1016/j.wocn.2009.08.004
13. Connine, C. M., Blasko, D. G., & Hall, M. (1991). Effects of subsequent sentence context in auditory word recognition: Temporal and linguistic constrainst. Journal of Memory and Language, 30(2), 234–250. doi:10.1016/0749-596X(91)90005-5
14. Creel, S. C., Aslin, R. N., & Tanenhaus, M. K. (2008). Heeding the voice of experience: The role of talker variation in lexical access. Cognition, 106(2), 633–664. doi:10.1016/j.cognition.2007.03.013
15. Drager, K. (2011). Speaker age and vowel perception. Language and Speech, 54(1), 99–121. doi:10.1177/0023830910388017
16. Elman, J. L., & Zipser, D. (1988). Learning the hidden structure of speech. The Journal of the Acoustical Society of America, 83(4), 1615–1626.
17. Fowler, C. A. (1986). An event approach to the study of speech perception from a direct-realist perspective. Journal of Phonetics, 14, 3–28.
18. Fowler, C. A., & Brown, J. M. (2000). Perceptual parsing of acoustic consequences of velum lowering from information for vowels. Perception and Psychophysics, 62(1), 21–32.
19. Fowler, C. A., & Smith, M. (1986). Speech perception as “vector analysis”: An approach to the problems of segmentation and invariance. In J. S. Perkell & D. Klatt (Eds.), Invariance and Variability in Speech Processes (pp. 126–136). Hillsdale, NJ: Erlbaum.
20. Frye, R. E., Fisher, J. M., Coty, A., Zarella, M., Liederman, J., & Halgren, E. (2007). Linear coding of voice onset time. Journal of Cognitive Neuroscience, 19(9), 1476–1487. doi:10.1162/jocn.2007.19.9.1476
21. Gagnepain, P., Henson, R. N., & Davis, M. H. (2012). Temporal predictive codes for spoken words in auditory cortex. Current Biology, 22(7), 615–621. doi:10.1016/j.cub.2012.02.015
22. Galle, M. (2014). Integration of asynchronous cues in fricative perception in real-time and developmental-time: Evidence for sublexical memory/integration systems. (PhD), University of Iowa.
23. Ganong, W. F. (1980). Phonetic categorization in auditory word perception. Journal of Experimental Psychology: Human Perception and Performance, 6(1), 110–125.
24. Gerrits, E., & Schouten, M. E. H. (2004). Categorical perception depends on the discrimination task. Perception and Psychophysics, 66(3), 363–376.
25. Goldinger, S. D. (1998). Echoes of echoes? An episodic theory of lexical access. Psychological Review, 105(2), 251–279.
26. Goldstone, R. L., Steyvers, M., & Rogosky, B. J. (2003). Conceptual interrelatedness and caricatures. Memory & Cognition, 31(2), 169–180.
27. Grossberg, S. (2003). Resonant neural dynamics of speech perception. Journal of Phonetics, 31(3–4), 423–445. doi:10.1016/S0095-4470(03)00051-2
28. Grossberg, S., & Myers, C. (2000). The resonant dynamics of speech perception: Interword integration and duration-dependent backward effects. Psychological Review, 107(4), 735–767.
29. Hawkins, S. (2003). Roles and representations of systematic fine phonetic detail in speech understanding. Journal of Phonetics, 31(3–4), 373–405. doi:10.1016/j.wocn.2003.09.006
30. Hay, J., & Drager, K. (2010). Stuffed toys and speech perception. Linguistics, 4(2010), 865–892. doi:10.1515/LING.2010.027
31. Hillenbrand, J. M., Clark, M. J., & Nearey, T. M. (2001). Effects of consonant environment on vowel formant patterns. The Journal of the Acoustical Society of America, 109(2), 748–763. doi:10.1121/1.1337959
32. Hillenbrand, J. M., Getty, L. A., Clark, M. J., & Wheeler, K. (1995). Acoustic characteristics of American English vowels. The Journal of the Acoustical Society of America, 97(5), 3099–3111. doi:10.1121/1.411872
33. Holt, L. L. (2006). The mean matters: Effects of statistically defined nonspeech spectral distributions on speech categorization. The Journal of the Acoustical Society of America, 120(5), 2801–2817. doi:10.1121/1.2354071
34. Hornik, K., Stinchcombe, M., & White, H. (1989). Multilayer feedforward networks are universal approximators. Neural Networks, 2, 359–366.
35. Houde, J. F., Nagarajan, S. S., Sekihara, K., & Merzenich, M. M. (2002). Modulation of the auditory cortex during speech: An MEG study. Journal of Cognitive Neuroscience, 14(8), 1125–1138. doi:10.1162/089892902760807140
36. Johnson, K., Strand, E. A., & D’Imperio, M. (1999). Auditory–visual integration of talker gender in vowel perception. Journal of Phonetics, 27(4), 359–384. doi:10.1006/jpho.1999.0100
37. Jongman, A., Wayland, R., & Wong, S. (2000). Acoustic characteristics of English fricatives. The Journal of the Acoustical Society of America, 108(3 Pt 1), 1252–1263.
38. Juneja, A., & Espy-Wilson, C. (2008). A probabilistic framework for landmark detection based on phonetic features for automatic speech recognition. The Journal of the Acoustical Society of America, 123(2), 1154–1168. doi:10.1121/1.2823754
39. Kiefte, M., & Kluender, K. R. (2008). Absorption of reliable spectral characteristics in auditory perception. The Journal of the Acoustical Society of America, 123(1), 366–376. doi:10.1121/1.2804951
40. Kluender, K. R., Coady, J. A., & Kiefte, M. (2003). Sensitivity to change in perception of speech. Speech Communication, 41(1), 59–69. doi:10.1016/S0167-6393(02)00093-6
41. Kruschke, J. K. (1992). ALCOVE: An exemplar-based connectionist model of category learning. Psychological Review, 99(1), 22–44.
42. Ladefoged, P., & Broadbent, D. (1957). Information conveyed by vowels. The Journal of the Acoustical Society of America, 29(1), 98–104.
43. Lahiri, A., Gewirth, L., & Blumstein, S. E. (1984). A reconsideration of acoustic invariance for place of articulation in diffuse stop consonants: Evidence from a cross-language study. The Journal of the Acoustical Society of America, 76(2), 391–404.
44. Liberman, A. M., & Cooper, F. (1967). Perception of the speech code. Psychological Review, 74(6), 431–461.
45. Liberman, A. M., Harris, K. S., Hoffman, H. S., & Griffith, B. C. (1957). The discrimination of speech sounds within and across phoneme boundaries. Journal of Experimental Psychology, 54(5), 358–368.
46. Liberman, A. M., & Mattingly, I. G. (1985). The motor theory of speech perception revised. Cognition, 21(1), 1–36.
47. Lindblom, B. (1996). Role of articulation in speech perception: Clues from production. The Journal of the Acoustical Society of America, 99(3), 1683–1692. doi:10.1121/1.414691
48. Lisker, L. (1986). “Voicing” in English: A catalogue of acoustic features signaling /b/ versus /p/ in trochees. Language and Speech, 29, 3–11. doi:10.1177/002383098602900102
49. Lotto, A. J., & Kluender, K. R. (1998). General contrast effects in speech perception: Effect of preceding liquid on stop consonant identification. Perception and Psychophysics, 60(4), 602–619.
50. Lotto, A. J., Kluender, K. R., & Holt, L. L. (1997). Perceptual compensation for coarticulation by Japanese quail (Coturnix coturnix japonica). The Journal of the Acoustical Society of America, 102(2), 1134–1140. doi:10.1121/1.419865
51. Love, B. C., Medin, D. L., & Gureckis, T. M. (2004). SUSTAIN: A network model of category learning. Psychological Review, 111(2), 309–332. doi:10.1037/0033-295X.111.2.309
52. Maddox, W. T., Bohil, C. J., & Ing, A. D. (2004). Evidence for a procedural-learning-based system in perceptual category learning. Psychonomic Bulletin & Review, 11(5), 945–952.
53. Magnuson, J. S., & Nusbaum, H. C. (2007). Acoustic differences, listener expectations, and the perceptual accommodation of talker variability. Journal of Experimental Psychology: Human Perception and Performance, 33(2), 391–409. doi:10.1037/0096-1523.33.2.391
54. Massaro, D. W., & Cohen, M. (1983). Categorical or continuous speech perception: A new test. Speech Communication, 2, 15–35.
55. McClelland, J. L., & Elman, J. L. (1986). The TRACE model of speech perception. Cognitive Psychology, 18(1), 1–86.
56. McClelland, J. L., Mirman, D., & Holt, L. L. (2006). Are there interactive processes in speech perception? Trends in Cognitive Sciences, 10(8), 363–369. doi:10.1016/j.tics.2006.06.007
57. McLennan, C. T., & Luce, P. A. (2005). Examining the time course of indexical specificity effects in spoken word recognition. Journal of Experimental Psychology: Learning, Memory, and Cognition, 31(2), 306–321. doi:10.1037/0278-7393.31.2.306
58. McMurray, B., Clayards, M. A., Tanenhaus, M. K., & Aslin, R. N. (2008). Tracking the time course of phonetic cue integration during spoken word recognition. Psychonomic Bulletin & Review, 15(6), 1064–1071. doi:10.3758/PBR.15.6.1064
59. McMurray, B., Cole, J. S., & Munson, C. (2011). Features as an emergent product of computing perceptual cues relative to expectations. In R. Ridouane & N. Clement (Eds.), Where Do Features Come From? (pp. 197–236). Amsterdam: Benjamins.
60. McMurray, B., & Farris-Trimble, A. (2012). Emergent information-level coupling between perception and production. In A. Cohn, C. Fougeron, & M. Huffman (Eds.), The Oxford Handbook of Laboratory Phonology. Oxford: Oxford University Press.
61. McMurray, B., & Jongman, A. (2011). What information is necessary for speech categorization? Harnessing variability in the speech signal by integrating cues computed relative to expectations. Psychological Review, 118(2), 219–246. doi:10.1037/a0022325
62. McMurray, B., Rhone, A. E., & Hannaway, K. (2015). Relativity in speech perception: From locus equations to predictive coding. In A. Agwuele & A. Lotto (Eds.), Essays in speech processes: Language production and perception. Equinox: Sheffield, UK.
63. Medin, D. L., & Schaffer, M. M. (1978). Context theory of classification learning. Psychological Review, 85(3), 207–238.
64. Mermelstein, P. (1978). On the relationship between vowel and consonant identification when cued by the same acoustic information. Perception & Psychophysics, 23(4), 331–336.
65. Miller, J. L., & Dexter, E. R. (1988). Effects of speaking rate and lexical status on phonetic perception. Journal of Experimental Psychology: Human Perception and Performance, 14(3), 369–378.
66. Miller, J. L., Green, K. P., & Reeves, A. (1986). Speaking rate and segments: A look a the relation between speech production and speech perception for the voicing contrast. Phonetica, 43, 106–115.
67. Minda, J. P., & Smith, J. D. (2002). Comparing prototype-based and exemplar-based accounts of category learning and attentional allocation. Journal of Experimental Psychology: Learning, Memory, and Cognition, 28(2), 275–292.
68. Myers, E. B., Blumstein, S. E., Walsh, E., & Eliassen, J. (2009). Inferior frontal regions underlie the perception of phonetic category invariance. Psychological Science, 20(7), 895–903. doi:10.1111/j.1467-9280.2009.02380.x
69. Nearey, T. M. (1989). Static, dynamic, and relational properties in vowel perception. The Journal of the Acoustical Society of America, 85(5), 2088–2113. doi:10.1121/1.397861
70. Nearey, T. M. (1990). The segment as a unit of speech perception. Journal of Phonetics, 18, 347–373.
71. Nearey, T. M. (1997). Speech perception as pattern recognition. The Journal of the Acoustical Society of America, 101(6), 3241–3254.
72. Nearey, T. M., & Hogan, J. T. (1986). Phonological contrast in experimental phonetics: Relating distributions of production data to perceptual categorization curves. Experimental Phonology, 141–161.
73. Niedzielski, N. (1999). The effect of social information on the perception of sociolinguistic variables. Journal of Language and Social Psychology, 18(1), 62–85. doi:10.1177/0261927X99018001005
74. Norris, D., McQueen, J. M., & Cutler, A. (2000). Merging information in speech recognition: Feedback is never necessary. Behavioral and Brain Sciences, 23(3).
75. Nosofsky, R. M. (1986). Attention, similarity, and the identification-categorization relationship. Journal of Experimental Psychology: General, 115(1), 39–61.
76. Nosofsky, R. M. (1988). Similarity, frequency, and category representations. Journal of Experimental Psychology: Learning, Memory, and Cognition, 14(1), 54–65.
77. Nosofsky, R. M., Kruschke, J. K., & McKinley, S. C. (1992). Combining exemplar-based category representations and connectionist learning rules. Journal of Experimental Psychology: Learning, Memory, and Cognition, 18(2), 211–233.
78. Nygaard, L. C., & Pisoni, D. B. (1998). Talker-specific learning in speech perception. Perception and Psychophysics, 60(3), 355–376.
79. Nygaard, L. C., Sommers, M. S., & Pisoni, D. B. (1994). Speech perception as a talker-contingent process. Psychological Science, 5(1), 42–46. doi:10.1111/j.1467-9280.1994.tb00612.x
80. Oden, G. C., & Massaro, D. W. (1978). Integration of featural information in speech perception. Psychological Review, 85(3), 172–191.
81. Ohala, J. J. (1996). Speech perception is hearing sounds, not tongues. The Journal of the Acoustical Society of America, 99(3), 1718–1725.
82. Pickering, M. J., & Garrod, S. (2004). Toward a mechanistic psychology of dialogue. Behavioral and Brain Sciences, 27(2), 169–190. discussion 190–226.
83. Pierrehumbert, J. B. (2003). Phonetic diversity, statistical learning, and acquisition of phonology. Language and Speech, 46(2–3), 115–154. doi:10.1177/00238309030460020501
84. Pind, J. (1995). Speaking rate, voice-onset time, and quantity: The search for higher-order invariants for two Icelandic speech cues. Attention, Perception, & Psychophysics, 57(3), 291–304.
85. Pisoni, D. B., & Tash, J. (1974). Reaction times to comparisons within and across phonetic categories. Perception and Psychophysics, 15(2), 285–290.
86. Pitt, M. A., Kim, W., Navarro, D. J., & Myung, J. I. (2006). Global model analysis by parameter space partitioning. Psychological Review, 113(1), 57–83. doi:10.1037/0033-295X.113.1.57
87. Port, R. F., & Dalby, J. (1982). Consonant/vowel ratio as a cue for voicing in English. Perception and Psychophysics, 32(2), 141–152.
88. Posner, M. I., & Keele, S. W. (1968). On the genesis of abstract ideas. Journal of Experimental Psychology, 77(3), 353–363.
89. Reinisch, E., & Sjerps, M. J. (2013). The uptake of spectral and temporal cues in vowel perception is rapidly influenced by context. Journal of Phonetics, 41(2), 101–116. doi:10.1016/j.wocn.2013.01.002
90. Reynolds, J. H., & Heeger, D. J. (2009). The Normalization Model of Attention. Neuron, 61(2), 168–185. doi:10.1016/j.neuron.2009.01.002
91. Rhone, A. E., & Jongman, A. (2012). Modified locus equations categorize stop place in a perceptually realistic time frame. The Journal of the Acoustical Society of America, 131(6), EL487–EL491. doi:10.1121/1.4722169
92. Riesenhuber, M., & Poggio, T. (2000). Models of object recognition. Nature Neuroscience, 3(Suppl), 1199–1204. doi:10.1038/81479
93. Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986). Learning representations by back-propagating errors. Nature, 323, 533–536.
94. Schouten, B., Gerrits, E., & van Hessen, A. (2003). The end of categorical perception as we know it. Speech Communication, 41(1), 71–80. doi:10.1016/S0167-6393(02)00094-8
95. Smith, J. D. (2002). Exemplar theory’s predicted typicality gradient can be tested and disconfirmed. Psychological Science, 13(5), 437–442.
96. Smith, J. D., & Minda, J. P. (1998). Prototypes in the mist: The early epochs of category learning. Journal of Experimental Psychology: Learning, Memory, and Cognition, 24(6), 1411–1436.
97. Smits, R. (2001a). Evidence for hierarchical categorization of coarticulated phonemes. Journal of Experimental Psychology: Human Perception and Performance, 27(5), 1145–1162.
98. Smits, R. (2001b). Hierarchical categorization of coarticulated phonemes: A theoretical analysis. Perception and Psychophysics, 63(7), 1109–1139.
99. Soto, F. A., & Wasserman, E. A. (2010). Error-driven learning in visual categorization and object recognition: A common-elements model. Psychological Review, 117(2), 349–381. doi:10.1037/a0018695
100. Stevens, K. N. (2002). Toward a model for lexical access based on acoustic landmarks and distinctive features. The Journal of the Acoustical Society of America, 111(4), 1872–1891. doi:10.1121/1.1458026
101. Stevens, K. N., & Keyser, S. J. (2010). Quantal theory, enhancement and overlap. Journal of Phonetics, 38(1), 10–19. doi:10.1016/j.wocn.2008.10.004
102. Strand, E. A. (1999). Uncovering the role of gender stereotypes in speech perception. Journal of Language and Social Psychology, 18(1), 86–100. doi:10.1177/0261927X99018001006
103. Summerfield, Q. (1981). Articulatory rate and perceptual constancy in phonetic perception. Journal of Experimental Psychology: Human Perception and Performance, 7(5), 1074–1095.
104. Sussman, H. M., Fruchter, D., Hilbert, J., & Sirosh, J. (1998). Linear correlates in the speech signal: The orderly output constraint. Behavioral and Brain Sciences, 21(02), 241–299. doi:10.1017/S0140525X98001174
105. Toscano, J. C., & McMurray, B. (2010). Cue integration with categories: Weighting acoustic cues in speech using unsupervised learning and distributional statistics. Cognitive Science, 34(3), 434–464. doi:10.1111/j.1551-6709.2009.01077.x
106. Toscano, J. C., & McMurray, B. (2012). Cue-integration and context effects in speech: Evidence against speaking-rate normalization. Attention, Perception, & Psychophysics, 74(6), 1284–1301. doi:10.3758/s13414-012-0306-z
107. Toscano, J. C., & McMurray, B. (2014). The time-course of speaking rate compensation: Effects of sentential rate and vowel length on voicing judgments. Language, Cognition and Neuroscience. doi:10.1080/23273798.2014.946427
108. Toscano, J. C., McMurray, B., Dennhardt, J., & Luck, S. J. (2010). Continuous perception and graded categorization: Electrophysiological evidence for a linear relationship between the acoustic signal and perceptual encoding of speech. Psychological Science, 21(10), 1532–1540. doi:10.1177/0956797610384142
109. Viswanathan, N., Fowler, C. A., & Magnuson, J. S. (2009). A critical examination of the spectral contrast account of compensation for coarticulation. Psychonomic Bulletin & Review, 16(1), 74–79. doi:10.3758/PBR.16.1.74
110. Von Kriegstein, K., Smith, D. R. R., Patterson, R. D., Kiebel, S. J., & Griffiths, T. D. (2010). How the human brain recognizes speech in the context of changing speakers. The Journal of Neuroscience, 30(2), 629–638. doi:10.1523/JNEUROSCI. 2742-09.2010
111. Whalen, D. H. (1989). Vowel and consonant judgments are not independent when cues by the same information. Attention, Perception, & Psychophysics, 46(3), 284–292.
112. Whalen, D. H. (1992). Perception of overlapping segments: Thoughts on Nearey’s model. Journal of Phonetics, 20, 493–496.
113. Yu, C., & Smith, L. B. (2012). Modeling cross-situational word-referent learning: Prior questions. Psychological Review, 119(1), 21–39. doi:10.1037/a0026182
114. Zacks, J. M., Speer, N. K., Swallow, K. M., Braver, T. S., & Reynolds, J. R. (2007). Event perception: A mind-brain perspective. Psychological Bulletin, 133(2), 273–293. doi:10.1037/0033-2909.133.2.273
115. Zaki, S. R., & Nosofsky, R. M. (2007). A high-distortion enhancement effect in the prototype-learning paradigm: Dramatic effects of category learning during test. Memory & Cognition, 35(8), 2088–2096.