Different timescales for the neural coding of consonant and vowel sounds

Cerebral Cortex

Volumn 23, Issue 3, 2013, Pages 670-683

  Perez, Claudia A ^a   Engineer, Crystal T ^a   Jakkamsetti, Vikram ^a   Carraway, Ryan S ^a   Perry, Matthew S ^a   Kilgard, Michael P ^a  

^a UNIVERSITY OF TEXAS AT DALLAS   (United States)

Author keywords

multiplexed temporal coding; processing streams; rate code; spatiotemporal activity pattern

Indexed keywords

ANIMAL EXPERIMENT; ARTICLE; AUDITORY FEEDBACK; CONSONANT; CONTROLLED STUDY; FEMALE; INFERIOR COLLICULUS; LANGUAGE PROCESSING; NERVE CELL; NONHUMAN; PRIMARY AUDITORY CORTEX; PRIORITY JOURNAL; RAT; SOUND ANALYSIS; SPEECH; TASK PERFORMANCE; VOWEL;

EID: 84861850467     PISSN: 10473211     EISSN: 14602199     Source Type: Journal    
DOI: 10.1093/cercor/bhs045     Document Type: Article

References (95)

1. Anderson SE, Kilgard MP, Sloan AM, Rennaker RL. 2006. Response to broadband repetitive stimuli in auditory cortex of the unanesthetized rat. Hear Res. 213:107-117.
2. Binder JR, Frost JA, Hammeke TA, Bellgowan PS, Springer JA, Kaufman JN, Possing ET. 2000. Human temporal lobe activation by speech and nonspeech sounds. Cereb Cortex. 10:512-528.
3. Boatman D, Hall C, Goldstein MH, Lesser R, Gordon B. 1997. Neuroperceptual differences in consonant and vowel discrimination: as revealed by direct cortical electrical interference. Cortex. 33:83-98.
4. Boatman D, Lesser R, Gordon B. 1995. Auditory speech processing in the left temporal lobe: an electrical interference study. Brain Lang. 51:269-290.
5. Boatman D, Lesser R, Hall C, Gordon B. 1994. Auditory perception of segmental features: a functional neuroanatomic study. J Neurolinguistics. 8:225-234.
6. Boemio A, Fromm S, Braun A, Poeppel D. 2005. Hierarchical and asymmetric temporal sensitivity in human auditory cortices. Nat Neurosci. 8:389-395.
7. Bonatti LL, Pena M, Nespor M, Mehler J. 2005. Linguistic constraints on statistical computations: the role of consonants and vowels in continuous speech processing. Psychol Sci. 16:451-459.
8. Britten KH, Shadlen MN, Newsome WT, Movshon JA. 1992. The analysis of visual motion: a comparison of neuronal and psychophysical performance. J Neurosci. 12:4745-4765.
9. Buonomano DV, Maass W. 2009. State-dependent computations: spatiotemporal processing in cortical networks. Nat Rev Neurosci. 10:113-125.
10. Caramazza A, Chialant D, Capasso R, Miceli G. 2000. Separable processing of consonants and vowels. Nature. 403:428-430.
11. Cariani P. 1995. As if time really mattered.temporal strategies for neural coding of sensory information. In: Pribram K, editor. Origins: brain and self-organization. Hillsdale (NJ): Erlbaum. p. 161-229.
12. Carney LH, Geisler CD. 1986. A temporal analysis of auditory-nerve fiber responses to spoken stop consonant-vowel syllables. J Acoust Soc Am. 79:1896.
13. Carreiras M, Price CJ. 2008. Brain activation for consonants and vowels. Cereb Cortex. 18:1727-1735.
14. Chechik G, Anderson MJ, Bar-Yosef O, Young ED, Tishby N, Nelken I. 2006. Reduction of information redundancy in the ascending auditory pathway. Neuron. 51:359-368.
15. Chen GD, Nuding SC, Narayan SS, Sinex DG. 1996. Responses of single neurons in the chinchilla inferior colliculus to consonant-vowel syllables differing in voice-onset time. Audit Neurosci. 3:179-198.
16. Christensen TA, Antonucci SM, Lockwood JL, Kittleson M, Plante E. 2008. Cortical and subcortical contributions to the attentive processing of speech. Neuroreport. 19:1101-1105.
17. Cunningham J, Nicol T, King C, Zecker SG, Kraus N. 2002. Effects of noise and cue enhancement on neural responses to speech in auditory midbrain, thalamus and cortex. Hear Res. 169:97-111.
18. Delattre P, Liberman AM, Cooper FS, Gerstman LJ. 1952. An experimental study of the acoustic determinants of vowel color; observations on one-and two-formant vowels synthesized from spectrographic patterns. Word. 8:195-210.
19. Delgutte B, Kiang NY. 1984a. Speech coding in the auditory nerve: I. Vowel-like sounds. J Acoust Soc Am. 75:866-878.
20. Delgutte B, Kiang NY. 1984b. Speech coding in the auditory nerve: III. Voiceless fricative consonants. J Acoust Soc Am. 75:887-896.
21. Deng L, Geisler CD. 1987. Responses of auditory-nerve fibers to nasal consonant-vowel syllables. J Acoust Soc Am. 82:1977-1988.
22. DeWeese MR, Hromadka T, Zador AM. 2005. Reliability and representational bandwidth in the auditory cortex. Neuron. 48:479-488.
23. Eggermont JJ. 1995. Representation of a voice onset time continuum in primary auditory cortex of the cat. J Acoust Soc Am. 98:911-920.
24. Engineer CT, Perez CA, Chen YH, Carraway RS, Reed AC, Shetake JA, Jakkamsetti V, Chang Q, Kilgard MP. 2008. Cortical activity patterns predict speech discrimination ability. Nat Neurosci. 11:603-608.
25. Fiez JA, Raichle ME, Miezin FM, Petersen SE, Tallal P, Katz WF. 1995. PET studies of auditory and phonological processing: effects of stimulus characteristics and task demands. J Cogn Neurosci. 7:357-375.
26. Foffani G, Morales-Botello ML, Aguilar J. 2009. Spike timing, spike count, and temporal information for the discrimination of tactile stimuli in the rat ventrobasal complex. J Neurosci. 29:5964-5973.
27. Foffani G, Moxon KA. 2004. PSTH-based classification of sensory stimuli using ensembles of single neurons. J. Neurosci Methods. 135:107-120.
28. Fry DB, Abramson AS, Eimas PD, Liberman AM. 1962. The identification and discrimination of synthetic vowels. Lang Speech. 5:171-189.
29. Gawne TJ, Kjaer TW, Richmond BJ. 1996. Latency: another potential code for feature binding in striate cortex. J. Neurophysiol. 76:1356-1360.
30. Grady CL, Van Meter JW, Maisog JM, Pietrini P, Krasuski J, Rauschecker JP. 1997. Attention-related modulation of activity in primary and secondary auditory cortex. Neuroreport. 8:2511-2516.
31. Green DM, Swets JA. 1966. Signal detection theory and psychophysics. New York: Wiley.
32. Hernandez A, Nacher V, Luna R, Zainos A, Lemus L, Alvarez M, Vazquez Y, Camarillo L, Romo R. 2010. Decoding a perceptual decision process across cortex. Neuron. 66:300-314.
33. Holt LL, Lotto AJ, Kluender KR. 2000. Neighboring spectral content influences vowel identification. J Acoust Soc Am. 108:710-722.
34. Hugdahl K, Thomsen T, Ersland L, Rimol LM, Niemi J. 2003. The effects of attention on speech perception: an fMRI study. Brain Lang. 85:37-48.
35. Jacobs AL, Fridman G, Douglas RM, Alam NM, Latham PE, Prusky GT, Nirenberg S. 2009. Ruling out and ruling in neural codes. Proc Natl Acad Sci U S A. 106:5936-5941.
36. Kasturi K, Loizou PC, Dorman M, Spahr T. 2002. The intelligibility of speech with ''holes'' in the spectrum. J Acoust Soc Am. 112: 1102-1111.
37. Kawahara H. 1997. Speech representation and transformation using adaptive interpolation of weighted spectrum: vocoder revisited. Proc 1997 IEEE Int Conf Acoust Speech Signal Process. 2:1303-1306.
38. Kudoh M, Nakayama Y, Hishida R, Shibuki K. 2006. Requirement of the auditory association cortex for discrimination of vowel-like sounds in rats. Neuroreport. 17:1761-1766.
39. Lemus L, Hernandez A, Romo R. 2009. Neural codes for perceptual discrimination of acoustic flutter in the primate auditory cortex. Proc Natl Acad Sci U S A. 106:9471-9476.
40. Lie geois-Chauvel C, de Graaf JB, Laguitton V, Chauvel P. 1999. Specialization of left auditory cortex for speech perception in man depends on temporal coding. Cereb Cortex. 9:484-496.
41. Liu J, Newsome WT. 2005. Correlation between speed perception and neural activity in the middle temporal visual area. J Neurosci. 25:711-722.
42. Lomber SG, Malhotra S. 2008. Double dissociation of 'what' and 'where' processing in auditory cortex. Nat Neurosci. 11:609-616.
43. Malone BJ, Scott BH, Semple MN. 2010. Temporal codes for amplitude contrast in auditory cortex. J Neurosci. 30:767-784.
44. Mesgarani N, David SV, Fritz JB, Shamma SA. 2008. Phoneme representation and classification in primary auditory cortex. J Acoust Soc Am. 123:899-909.
45. Middlebrooks JC, Clock AE, Xu L, Green DM. 1994. A panoramic code for sound location by cortical neurons. Science. 264:842-844.
46. Miller GA, Nicely PE. 1955. An analysis of perceptual confusions among some English consonants. J Acoust Soc Am. 27:338-352.
47. Miller MI, Sachs MB. 1983. Representation of stop consonants in the discharge patterns of auditory-nerve fibers. J Acoust Soc Am. 74:502-517.
48. Obleser J, Boecker H, Drzezga A, Haslinger B, Hennenlotter A, Roettinger M, Eulitz C, Rauschecker JP. 2006. Vowel sound extraction in anterior superior temporal cortex. Hum Brain Mapp. 27:562-571.
49. Ohl FW, Scheich H. 1997. Orderly cortical representation of vowels based on formant interaction. Proc Natl Acad Sci U S A. 94:9440-9444.
50. Palmer AR. 1990. The representation of the spectra and fundamental frequencies of steady-state single-and double-vowel sounds in the temporal discharge patterns of guinea pig cochlear-nerve fibers. J Acoust Soc Am. 88:1412-1426.
51. Palombi PS, Caspary DM. 1996. Physiology of the young adult Fischer 344 rat inferior colliculus: responses to contralateral monaural stimuli. Hear Res. 100:41-58.
52. Panzeri S, Brunel N, Logothetis NK, Kayser C. 2010. Sensory neural codes using multiplexed temporal scales. Trends Neurosci. 33:111-120.
53. Parker AJ, Newsome WT. 1998. Sense and the single neuron: probing the physiology of perception. Annu Rev Neurosci. 21:227-277.
54. Peterson GE, Barney HL. 1952. Control methods used in a study of the vowels. J Acoust Soc Am. 24:175-184.
55. Pisoni DB. 1973. Auditory and phonetic memory codes in the discrimination of consonants and vowels. Percept Psychophys. 13:253-260.
56. Poeppel D. 2003. The analysis of speech in different temporal integration windows: cerebral lateralization as 'asymmetric sampling in time'. Speech Commun. 41:245-255.
57. Polka L, Werker JF. 1994. Developmental changes in perception of nonnative vowel contrasts. J Exp Psychol Hum Percept Perform. 20:421-435.
58. Porter BA, Rosenthal TR, Ranasinghe KG, Kilgard MP. 2011. Discrimination of brief speech sounds is impaired in rats with auditory cortex lesions. Behav Brain Res. 219:68-74.
59. Pruett JR Jr, Sinclair RJ, Burton H. 2001. Neural correlates for roughness choice in monkey second somatosensory cortex (SII). J Neurophysiol. 86:2069-2080.
60. Rauschecker JP, Scott SK. 2009. Maps and streams in the auditory cortex: nonhuman primates illuminate human speech processing. Nat Neurosci. 12:718-724.
61. Rauschecker JP, Tian B. 2000. Mechanisms and streams for processing of ''what'' and ''where'' in auditory cortex. Proc Natl Acad Sci U S A. 97:11800-11806.
62. Recanzone GH, Cohen YE. 2010. Serial and parallel processing in the primate auditory cortex revisited. Behav Brain Res. 206:1-7.
63. Rennaker RL, Carey HL, Anderson SE, Sloan AM, Kilgard MP. 2007. Anesthesia suppresses nonsynchronous responses to repetitive broadband stimuli. Neuroscience. 145:357-369.
64. Romo R, Salinas E. 2003. Flutter discrimination: neural codes, perception, memory and decision making. Nat Rev Neurosci. 4:203-218.
65. Sachs MB, Young ED. 1979. Encoding of steady-state vowels in the auditory nerve: representation in terms of discharge rate. J Acoust Soc Am. 66:470-479.
66. Schnupp JW, Hall TM, Kokelaar RF, Ahmed B. 2006. Plasticity of temporal pattern codes for vocalization stimuli in primary auditory cortex. J Neurosci. 26:4785-4795.
67. Schwartz J, Tallal P. 1980. Rate of acoustic change may underlie hemispheric specialization for speech perception. Science. 207:1380-1381.
68. Scott SK, Johnsrude IS. 2003. The neuroanatomical and functional organization of speech perception. Trends Neurosci. 26:100-107.
69. Seifritz E, Esposito F, Hennel F, Mustovic H, Neuhoff JG, Bilecen D, Tedeschi G, Scheffler K, Di Salle F. 2002. Spatiotemporal pattern of neural processing in the human auditory cortex. Science. 297: 1706-1708.
70. Shadlen MN, Newsome WT. 1994. Noise, neural codes and cortical organization. Curr Opin Neurobiol. 4:569-579.
71. Shankweiler D, Studdert-Kennedy M. 1967. Identification of consonants and vowels presented to left and right ears. Q J Exp Psychol. 19:59-63.
72. Shannon RV, Zeng FG, Kamath V, Wygonski J, Ekelid M. 1995. Speech recognition with primarily temporal cues. Science. 270: 303-304.
73. Shetake JA, Wolf JT, Cheung RJ, Engineer CT, Ram SK, Kilgard MP. 2011. Cortical activity patterns predict robust speech discrimination ability in noise. Eur J Neurosci. 34:1823-1838.
74. Sinex DG, Chen GD. 2000. Neural responses to the onset of voicing are unrelated to other measures of temporal resolution. J Acoust Soc Am. 107:486-495.
75. Soli SD. 1981. Second formants in fricatives: acoustic consequences of fricative-vowel coarticulation. J Acoust Soc Am. 70:976-984.
76. Steinschneider M, Arezzo J, Vaughan HG Jr. 1982. Speech evoked activity in the auditory radiations and cortex of the awake monkey. Brain Res. 252:353-365.
77. Steinschneider M, Arezzo JC, Vaughan HG Jr. 1990. Tonotopic features of speech-evoked activity in primate auditory cortex. Brain Res. 519:158-168.
78. Steinschneider M, Reser D, Schroeder CE, Arezzo JC. 1995. Tonotopic organization of responses reflecting stop consonant place of articulation in primary auditory cortex (A1) of the monkey. Brain Res. 674:147-152.
79. Steinschneider M, Volkov IO, Fishman YI, Oya H, Arezzo JC, Howard MA 3rd. 2005. Intracortical responses in human and monkey primary auditory cortex support a temporal processing mechanism for encoding of the voice onset time phonetic parameter. Cereb Cortex. 15:170-186.
80. Steinschneider M, Volkov IO, Noh MD, Garell PC, Howard MA 3rd. 1999. Temporal encoding of the voice onset time phonetic parameter by field potentials recorded directly from human auditory cortex. J. Neurophysiol. 82:2346-2357.
81. Strange W. 1989. Dynamic specification of coarticulated vowels spoken in sentence context. J Acoust Soc Am. 85:2135-2153.
82. Toro JM, Nespor M, Mehler J, Bonatti LL. 2008. Finding words and rules in a speech stream: functional differences between vowels and consonants. Psychol Sci. 19:137-144.
83. Tsunada J, Lee JH, Cohen YE. 2011. Representation of speech categories in the primate auditory cortex. J Neurophysiol. 105: 2634-2646.
84. Versnel H, Shamma SA. 1998. Spectral-ripple representation of steadystate vowels in primary auditory cortex. J Acoust Soc Am. 103: 2502-2514.
85. Victor JD. 2000. How the brain uses time to represent and process visual information. Brain Res. 886:33-46.
86. Walker KM, Bizley JK, King AJ, Schnupp JW. 2011. Multiplexed and robust representations of sound features in auditory cortex. J Neurosci. 31:14565-14576.
87. Wallace AB, Blumstein SE. 2009. Temporal integration in vowel perception. J Acoust Soc Am. 125:1704-1711.
88. Wang X, Lu T, Snider RK, Liang L. 2005. Sustained firing in auditory cortex evoked by preferred stimuli. Nature. 435:341-346.
89. Wang X, Merzenich MM, Beitel R, Schreiner CE. 1995. Representation of a species-specific vocalization in the primary auditory cortex of the common marmoset: temporal and spectral characteristics. J Neurophysiol. 74:2685-2706.
90. Watanabe T. 1978. Responses of the cat's collicular auditory neuron to human speech. J Acoust Soc Am. 64:333-337.
91. WongSW, Schreiner CE. 2003. Representation ofCV-sounds in cat primary auditory cortex: intensity dependence. Speech Commun. 41:93-106.
92. Xu L, Thompson CS, Pfingst BE. 2005. Relative contributions of spectral and temporal cues for phoneme recognition. J Acoust Soc Am. 117:3255-3267.
93. Young ED. 2010. Level and spectrum. In: Rees A, Palmer A, editors. The Oxford handbook of auditory science: the auditory brain. Oxford: Oxford University Press. p. 93-Rees A, Palmer A, editors. The Oxford handbook of auditory science: the auditory brain. Oxford: Oxford University Press. p. 93.
94. Young ED, Sachs MB. 1979. Representation of steady-state vowels in the temporal aspects of the discharge patterns of populations of auditory-nerve fibers. J Acoust Soc Am. 66:1381-1403.
95. Zatorre R, Belin P, Penhune V. 2002. Structure and function of auditory cortex: music and speech. Trends Cogn Sci. 6:37-46.