Tracing the emergence of categorical speech perception in the human auditory system

NeuroImage

Volumn 79, Issue , 2013, Pages 201-212

  Bidelman, Gavin M ^a   Moreno, Sylvain ^b   Alain, Claude ^b,c  

^a UNIVERSITY OF MEMPHIS   (United States)

^b ROTMAN RESEARCH INSTITUTE   (Canada)

^c UNIVERSITY OF TORONTO   (Canada)

Author keywords

Auditory event related potentials (ERP); Brainstem response; Categorical perception; Neural computation; Speech perception

Indexed keywords

ADULT; ANALYTICAL MODEL; ARTICLE; AUDITORY NERVOUS SYSTEM; AUDITORY STIMULATION; BRAIN CORTEX; BRAIN MAPPING; BRAIN STEM; CATEGORICAL SPEECH PERCEPTION; CONTROLLED STUDY; EVOKED BRAIN STEM AUDITORY RESPONSE; FEMALE; HUMAN; HUMAN EXPERIMENT; MALE; NERVOUS SYSTEM ELECTROPHYSIOLOGY; NERVOUS SYSTEM FUNCTION; NEUROELECTRIC ACTIVITY; NEUROMETRIC FUNCTION; NEUROMODULATION; NEUROPHYSIOLOGY; NONBIOLOGICAL MODEL; NONLINEAR SYSTEM; NORMAL HUMAN; PHONETICS; PREDICTIVE VALUE; PRIMARY AUDITORY CORTEX; PRIORITY JOURNAL; SIGNAL TRANSDUCTION; SPEECH PERCEPTION; SUBCORTEX; THALAMUS;

AUDITORY CORTEX; BRAIN MAPPING; BRAIN STEM; EVOKED POTENTIALS, AUDITORY; FEMALE; HUMANS; MALE; NERVE NET; SPEECH PERCEPTION; YOUNG ADULT;

EID: 84878184717     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2013.04.093     Document Type: Article

References (95)

1. Agung K., Purdy S.C., McMahon C.M., Newall P. The use of cortical auditory evoked potentials to evaluate neural encoding of speech sounds in adults. J. Am. Acad. Audiol. 2006, 17:559-572.
2. Aiken S.J., Picton T.W. Envelope following responses to natural vowels. Audiol. Neurootol. 2006, 11:213-232.
3. Aiken S.J., Picton T.W. Envelope and spectral frequency-following responses to vowel sounds. Hear. Res. 2008, 245:35-47.
4. Alain C., Arnott S.R. Selectively attending to auditory objects. Front. Biosci. 2000, 202-212.
5. Beale J.M., Keil F.C. Categorical effects in the perception of faces. Cognition 1995, 57:217-239.
6. Bidelman G.M., Krishnan A. Neural correlates of consonance, dissonance, and the hierarchy of musical pitch in the human brainstem. J. Neurosci. 2009, 29:13165-13171.
7. Bidelman G.M., Krishnan A. Effects of reverberation on brainstem representation of speech in musicians and non-musicians. Brain Res. 2010, 1355:112-125.
8. Bidelman G.M., Gandour J.T., Krishnan A. Musicians and tone-language speakers share enhanced brainstem encoding but not perceptual benefits for musical pitch. Brain Cogn. 2011, 77:1-10.
9. Borg I., Groenen P.J.F. Modern Multidimensional Scaling: Theory and Applications 2005, Springer, New York. 2nd ed.
10. Campbell T., Kerlin J.R., Bishop C.W., Miller L.M. Methods to eliminate stimulus transduction artifact from insert earphones during electroencephalography. Ear Hear. 2012, 33:144-150.
11. Carandini M. From circuits to behavior: a bridge too far?. Nat. Neurosci. 2012, 15:507-509.
12. Carcagno S., Plack C.J. Subcortical plasticity following perceptual learning in a pitch discrimination task. J. Assoc. Res. Otolaryngol. 2011, 12:89-100.
13. Carlyon R.P. How the brain separates sounds. Trends Cogn. Sci. 2004, 8:465-471.
14. Chang E.F., Rieger J.W., Johnson K., Berger M.S., Barbaro N.M., Knight R.T. Categorical speech representation in human superior temporal gyrus. Nat. Neurosci. 2010, 13:1428-1432.
15. Chechik G., Anderson M.J., Bar-Yosef O., Young E.D., Tishby N., Nelken I. Reduction of information redundancy in the ascending auditory pathway. Neuron 2006, 51:359-368.
16. Delorme A., Makeig S. EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics. J. Neurosci. Methods 2004, 134:9-21.
17. Efron B., Tibshirani R. An Introduction to the Bootstrap 1993, Chapman & Hall, New York.
18. Eimas P.D., Siqueland E.R., Jusczyk P., Vigorito J. Speech perception in infants. Science 1971, 171:303-306.
19. Eulitz C., Diesch E., Pantev C., Hampson S., Elbert T. Magnetic and electric brain activity evoked by the processing of tone and vowel stimuli. J. Neurosci. 1995, 15:2748-2755.
20. Franklin A., Drivonikou G.V., Clifford A., Kay P., Regier T., Davies I.R. Lateralization of categorical perception of color changes with color term acquisition. Proc. Natl. Acad. Sci. U. S. A. 2008, 105:18221-18225.
21. Galbraith G.C., Kane J.M. Brainstem frequency-following responses and cortical event-related potentials during attention. Percept. Mot. Skills 1993, 76:1231-1241.
22. Galbraith G., Olfman D.M., Huffman T.M. Selective attention affects human brain stem frequency-following response. Neuroreport 2003, 14:735-738.
23. Gockel H.E., Carlyon R.P., Mehta A., Plack C.J. The frequency following response (FFR) may reflect pitch-bearing information but is not a direct representation of pitch. J. Assoc. Res. Otolaryngol. 2011, 12:767-782.
24. Greenberg S., Marsh J.T., Brown W.S., Smith J.C. Neural temporal coding of low pitch. I. Human frequency-following responses to complex tones. Hear. Res. 1987, 25:91-114.
25. Harnad S.R. Categorical Perception: The Groundwork of Cognition 1987, Cambridge University Press, New York.
26. Hickok G., Poeppel D. Dorsal and ventral streams: a framework for understanding aspects of the functional anatomy of language. Cognition 2004, 92:67-99.
27. Hillyard S.A., Picton T.W. Event-related brain potentials and selective information processing in man. Progress in Clinical Neurophysiology 1979, 1-52. Karger, Basel. J.E. Desmedt (Ed.).
28. Hillyard S.A., Hink R.F., Schwent V.L., Picton T.W. Electrical signs of selective attention in the human brain. Science 1973, 182:177-180.
29. Hornickel J., Skoe E., Nicol T., Zecker S., Kraus N. Subcortical differentiation of stop consonants relates to reading and speech-in-noise perception. Proc. Natl. Acad. Sci. 2009, 106:13022-13027.
30. Iverson P., Kuhl P.K. Mapping the perceptual magnet effect for speech using signal detection theory and multidimensional scaling. J. Acoust. Soc. Am. 1995, 97:553-562.
31. Klatt D.H., Klatt L.C. Analysis, synthesis, and perception of voice quality variations among female and male talkers. J. Acoust. Soc. Am. 1990, 87:820-857.
32. Klein M.E., Zatorre R.J. A role for the right superior temporal sulcus in categorical perception of musical chords. Neuropsychologia 2011, 49:878-887.
33. Kraus N., Chandrasekaran B. Music training for the development of auditory skills. Nat. Rev. Neurosci. 2010, 11:599-605.
34. Krishnan A. Human frequency-following responses: representation of steady-state synthetic vowels. Hear. Res. 2002, 166:192-201.
35. Krishnan A., Bidelman G.M., Gandour J.T. Neural representation of pitch salience in the human brainstem revealed by psychophysical and electrophysiological indices. Hear. Res. 2010, 268:60-66.
36. Krishnan A., Bidelman G.M., Smalt C.J., Ananthakrishnan S., Gandour J.T. Relationship between brainstem, cortical and behavioral measures relevant to pitch salience in humans. Neuropsychologia 2012, 50:2849-2859.
37. Krizman J., Marian V., Shook A., Skoe E., Kraus N. Subcortical encoding of sound is enhanced in bilinguals and relates to executive function advantages. Proc. Natl. Acad. Sci. U. S. A. 2012, 109:7877-7881.
38. Kuhl P.K., Williams K.A., Lacerda F., Stevens K.N., Lindblom B. Linguistic experience alters phonetic perception in infants by 6months of age. Science 1992, 255:606-608.
39. Ley A., Vroomen J., Hausfeld L., Valente G., De Weerd P., Formisano E. Learning of new sound categories shapes neural response patterns in human auditory cortex. J. Neurosci. 2012, 32:13273-13280.
40. Liberman A.M., Mattingly I.G. A specialization for speech perception. Science 1989, 243:489-494.
41. Liberman A.M., Cooper F.S., Shankweiler D.P., Studdert-Kennedy M. Perception of the speech code. Psychol. Rev. 1967, 74:431-461.
42. Liu L.F., Palmer A.R., Wallace M.N. Phase-locked responses to pure tones in the inferior colliculus. J. Neurophysiol. 2006, 95:1926-1935.
43. Maiste A.C., Wiens A.S., Hunt M.J., Scherg M., Picton T.W. Event-related potentials and the categorical perception of speech sounds. Ear Hear. 1995, 16:68-90.
44. Markel J.E., Gray A.H. Linear Prediction of Speech 1976, Springer-Verlag, New York.
45. May J. Acoustic factors that may contribute to categorical perception. Lang. Speech 1981, 24:273-284.
46. Mesgarani N., Chang E.F. Selective cortical representation of attended speaker in multi-talker speech perception. Nature 2012, 485:233-236.
47. Miller E.K., Nieder A., Freedman D.J., Wallis J.D. Neural correlates of categories and concepts. Curr. Opin. Neurobiol. 2003, 13:198-203.
48. Mody M., Studdert-Kennedy M., Brady S. Speech perception deficits in poor readers: auditory processing or phonological coding?. J. Exp. Child Psychol. 1997, 64:199-231.
49. Monahan P.J., Idsardi W.J. Auditory sensitivity to formant ratios: toward an account of vowel normalization. Lang. Cognit. Process. 2010, 25:808-839.
50. Musacchia G., Strait D., Kraus N. Relationships between behavior, brainstem and cortical encoding of seen and heard speech in musicians and non-musicians. Hear. Res. 2008, 241:34-42.
51. Myers E.B., Swan K. Effects of category learning on neural sensitivity to non-native phonetic categories. J. Cogn. Neurosci. 2012, 24:1695-1708.
52. Näätänen R., Picton T. The N1 wave of the human electric and magnetic response to sound: a review and an analysis of the component structure. Psychophysiology 1987, 24:375-425.
53. Obleser J., Elbert T., Lahiri A., Eulitz C. Cortical representation of vowels reflects acoustic dissimilarity determined by formant frequencies. Brain Res. Cogn. Brain Res. 2003, 15:207-213.
54. Okamoto H., Stracke H., Bermudez P., Pantev C. Sound processing hierarchy within human auditory cortex. J. Cogn. Neurosci. 2011, 23:1855-1863.
55. Parbery-Clark A., Skoe E., Kraus N. Musical experience limits the degradative effects of background noise on the neural processing of sound. J. Neurosci. 2009, 29:14100-14107.
56. Pasley B.N., David S.V., Mesgarani N., Flinker A., Shamma S.A., Crone N.E., Knight R.T., Chang E.F. Reconstructing speech from human auditory cortex. PLoS Biol. 2012, 10:e1001251.
57. Perez C.A., Engineer C.T., Jakkamsetti V., Carraway R.S., Perry M.S., Kilgard M.P. Different timescales for the neural coding of consonant and vowel sounds. Cereb. Cortex 2013, 23:670-683.
58. Peterson G.E., Barney H.L. Control methods used in a study of vowels. J. Acoust. Soc. Am. 1952, 24:175-184.
59. Phillips C. Levels of representation in the electrophysiology of speech perception. Cogn. Sci. 2001, 25:711-731.
60. Phillips C., Pellathy T., Marantz A., Yellin E., Wexler K., Poeppel D., McGinnis M., Roberts T. Auditory cortex accesses phonological categories: an MEG mismatch study. J. Cogn. Neurosci. 2000, 12:1038-1055.
61. Picton T.W., Hillyard S.A. Human auditory evoked potentials. II. Effects of attention. Electroencephalogr. Clin. Neurophysiol. 1974, 36:191-199.
62. Picton T.W., Hillyard S.A., Galambos R., Schiff M. Human auditory attention: a central or peripheral process?. Science 1971, 173:351-353.
63. Picton T.W., Woods D.L., Baribaeu-Braun J., Healy T.M.G. Evoked potential audiometry. J. Otolaryngol. 1977, 6:90-119.
64. Picton T.W., Campbell K.B., Baribeau-Braun J., Proulx G.B. The neurophysiology of human attention - a tutorial review. Attention and Performance VII 1978, 429-467. Lawrence Erlbaum, New Jersey. J. Requin (Ed.).
65. Picton T.W., Woods D.L., Proulx G.B. Human auditory sustained potentials. II. Stimulus relationships. Electroencephalogr. Clin. Neurophysiol. 1978, 45:198-210.
66. Picton T.W., Alain C., Woods D.L., John M.S., Scherg M., Valdes-Sosa P., Bosch-Bayard J., Trujillo N.J. Intracerebral sources of human auditory-evoked potentials. Audiol. Neurootol. 1999, 4:64-79.
67. Pisoni D.B. Auditory and phonetic memory codes in the discrimination of consonants and vowels. Percept. Psychophys. 1973, 13:253-260.
68. Pisoni D.B., Luce P.A. Acoustic-phonetic representations in word recognition. Cognition 1987, 25:21-52.
69. Poeppel D., Yellin E., Phillips C., Roberts T.P., Rowley H.A., Wexler K., Marantz A. Task-induced asymmetry of the auditory evoked M100 neuromagnetic field elicited by speech sounds. Brain Res. Cogn. Brain Res. 1996, 4:231-242.
70. Poeppel D., Phillips C., Yellin E., Rowley H.A., Roberts T.P., Marantz A. Processing of vowels in supratemporal auditory cortex. Neurosci. Lett. 1997, 221:145-148.
71. Pollack I., Pisoni D.B. On the comparison between identification and discrimination tests in speech perception. Psychon. Sci. 1971, 24:299-300.
72. Prather J.F., Nowicki S., Anderson R.C., Peters S., Mooney R. Neural correlates of categorical perception in learned vocal communication. Nat. Neurosci. 2009, 12:221-228.
73. Purushothaman G., Bradley D.C. Neural population code for fine perceptual decisions in area MT. Nat. Neurosci. 2005, 8:99-106.
74. Rauschecker J.P. Parallel processing in the auditory cortex of primates. Audiol. Neurootol. 1998, 3:86-103.
75. Riecke L., Esposito F., Bonte M., Formisano E. Hearing illusory sounds in noise: the timing of sensory-perceptual transformations in auditory cortex. Neuron 2009, 64:550-561.
76. Rosenblatt F. The perceptron: a probabilistic model for information storage and organization in the brain. Psychol. Rev. 1958, 65:386-408.
77. Scharinger M., Idsardi W.J., Poe S. A comprehensive three-dimensional cortical map of vowel space. J. Cogn. Neurosci. 2011, 23:3972-3982.
78. Scherg M., Vajsar J., Picton T.W. A source analysis of the late human auditory evoked potentials. J. Cogn. Neurosci. 1989, 1:336-355.
79. Sharma A., Dorman M.F. Cortical auditory evoked potential correlates of categorical perception of voice-onset time. J. Acoust. Soc. Am. 1999, 106:1078-1083.
80. Shepard R.N. Multidimensional scaling, tree-fitting and clustering. Science 1980, 210:390-398.
81. Shestakova A., Brattico E., Soloviev A., Klucharev V., Huotilainen M. Orderly cortical representation of vowel categories presented by multiple exemplars. Brain Res. Cogn. Brain Res. 2004, 21:342-350.
82. Skoe E., Kraus N. Auditory brain stem response to complex sounds: a tutorial. Ear Hear. 2010, 31:302-324.
83. Smith J.C., Marsh J.T., Brown W.S. Far-field recorded frequency-following responses: evidence for the locus of brainstem sources. Electroencephalogr. Clin. Neurophysiol. 1975, 39:465-472.
84. Sohmer H., Pratt H., Kinarti R. Sources of frequency-following responses (FFR) in man. Electroencephalogr. Clin. Neurophysiol. 1977, 42:656-664.
85. Song J., Skoe E., Banai K., Kraus N. Perception of speech in noise: neural correlates. J. Cogn. Neurosci. 2010, 23:2268-2279.
86. Steinschneider M., Volkov I.O., Noh M.D., Garell P.C., Howard M.A. Temporal encoding of the voice onset time phonetic parameter by field potentials recorded directly from human auditory cortex. J. Neurophysiol. 1999, 82:2346-2357.
87. Steinschneider M., Fishman Y.I., Arezzo J.C. Representation of the voice onset time (VOT) speech parameter in population responses within primary auditory cortex of the awake monkey. J. Acoust. Soc. Am. 2003, 114:307-321.
88. Suga N., Gao E., Zhang Y., Ma X., Olsen J.F. The corticofugal system for hearing: recent progress. Proc. Natl. Acad. Sci. U. S. A. 2000, 97:11807-11814.
89. Tzounopoulos T., Kraus N. Learning to encode timing: mechanisms of plasticity in the auditory brainstem. Neuron 2009, 62:463-469.
90. Vihman M. Phonological Development: The Origins of Language in the Child 1996, Wiley-Blackwell, Cambridge.
91. Werker J.F., Tees R.C. Speech perception in severely disabled and average reading children. Can. J. Psychol. 1987, 41:48-61.
92. Wood C.C. Auditory and phonetic levels of processing in speech perception: neurophysiological and information-processing analyses. J. Exp. Psychol. Hum. Percept. Perform. 1975, 104:3-20.
93. Wood C.C., Goff W.R., Day R.S. Auditory evoked potentials during speech perception. Science 1971, 173:1248-1251.
94. Woods D.L., Hillyard S.A. Attention at the cocktail party: brainstem evoked responses reveal no peripheral gating. Multidisciplinary Perspectives in Event-related Brain Potential Research 1978, 230-233. U.S. Government Printing Office, (EPA 600/9-77-043). D.A. Otto (Ed.).
95. Zhang L., Xi J., Wu H., Shu H., Li P. Electrophysiological evidence of categorical perception of Chinese lexical tones in attentive condition. Neuroreport 2012, 23:35-39.