A Neurophysiological Perspective on Speech Processing in "The Neurobiology of Language"

Neurobiology of Language

Volumn , Issue , 2015, Pages 463-478

  Arnal, Luc H ^a,b   Poeppel, David ^b,c   Giraud, Anne Lise ^a  

^a UNIVERSITY OF GENEVA   (Switzerland)

^b NEW YORK UNIVERSITY   (United States)

^c MAX PLANCK INSTITUTE FOR EMPIRICAL AESTHETICS   (Germany)

Author keywords

Auditory cortex; Cortical oscillations; Multiple timescales processing; Neurophysiology; Speech perception

Indexed keywords

EID: 84992688999     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1016/B978-0-12-407794-2.00038-9     Document Type: Chapter

References (117)

1. Ahissar E., Nagarajan S., Ahissar M., Protopapas A., Mahncke H., Merzenich M.M. Speech comprehension is correlated with temporal response patterns recorded from auditory cortex. Proceedings of the National Academy of Sciences of the United States of America 2001, 98:13367-13372.
2. Allen J.B. Articulation and intelligibility. Synthesis Lectures on Speech and Audio Processing 2005, 1(1):1-124.
3. Arnal L.H. Predicting "when" using the motor system's beta-band oscillations. Frontiers in Human Neuroscience 2012, 6:225.
4. Arnal L.H., Giraud A.L. Cortical oscillations and sensory predictions. Trends in Cognitive Sciences 2012, 16:390-398.
5. Arnal L.H., Morillon B., Kell C.A., Giraud A.-L. Dual neural routing of visual facilitation in speech processing. The Journal of Neuroscience 2009, 29:13445-13453.
6. Arnal L.H., Wyart V., Giraud A.L. Transitions in neural oscillations reflect prediction errors generated in audiovisual speech. Nature Neuroscience 2011, 14:797-801.
7. Bastos A.M., Usrey W.M., Adams R.A., Mangun G.R., Fries P., Friston K.J. Canonical microcircuits for predictive coding. Neuron 2012, 76:695-711.
8. Boemio A., Fromm S., Braun A., Poeppel D. Hierarchical and asymmetric temporal sensitivity in human auditory cortices. Nature Neuroscience 2005, 8:389-395.
9. Borgers C., Epstein S., Kopell N.J. Background gamma rhythmicity and attention in cortical local circuits: A computational study. Proceedings of the National Academy of Sciences of the United States of America 2005, 102:7002-7007.
10. Borgers C., Epstein S., Kopell N.J. Gamma oscillations mediate stimulus competition and attentional selection in a cortical network model. Proceedings of the National Academy of Sciences of the United States of America 2008, 105:18023-18028.
11. Britvina T., Eggermont J.J. A markov model for interspike interval distributions of auditory cortical neurons that do not show periodic firings. Biological Cybernetics 2007, 96:245-264.
12. Brugge J.F., Nourski K.V., Oya H., Reale R.A., Kawasaki H., Steinschneider M., et al. Coding of repetitive transients by auditory cortex on Heschl's gyrus. Journal of Neurophysiology 2009, 102:2358-2374.
13. Busch N.A., Dubois J., VanRullen R. The phase of ongoing EEG oscillations predicts visual perception. The Journal of Neuroscience 2009, 29:7869-7876.
14. Canolty R.T., Edwards E., Dalal S.S., Soltani M., Nagarajan S.S., Kirsch H.E., et al. High gamma power is phase-locked to theta oscillations in human neocortex. Science 2006, 313:1626-1628.
15. Canolty R.T., Knight R.T. The functional role of cross-frequency coupling. Trends in Cognitive Sciences 2010, 14:506-515.
16. Chi T., Ru P., Shamma S.A. Multiresolution spectrotemporal analysis of complex sounds. The Journal of the Acoustical Society of America 2005, 118:887-906.
17. Csicsvari J., Jamieson B., Wise K.D., Buzsaki G. Mechanisms of gamma oscillations in the hippocampus of the behaving rat. Neuron 2003, 37:311-322.
18. Dau T., Kollmeier B., Kohlrausch A. Modeling auditory processing of amplitude modulation. II. Spectral and temporal integration. The Journal of the Acoustical Society of America 1997, 102:2906-2919.
19. Ding N., Simon J.Z. Neural coding of continuous speech in auditory cortex during monaural and dichotic listening. Journal of Neurophysiology 2012, 107:78-89.
20. Doelling K.B., Arnal L.H., Ghitza O., Poeppel D. Acoustic landmarks drive delta-theta oscillations to enable speech comprehension by facilitating perceptual parsing. Neuroimage 2014, 85:761-768.
21. Drullman R., Festen J.M., Plomp R. Effect of reducing slow temporal modulations on speech reception. The Journal of the Acoustical Society of America 1994, 95:2670-2680.
22. Drullman R., Festen J.M., Plomp R. Effect of temporal envelope smearing on speech reception. The Journal of the Acoustical Society of America 1994, 95:1053-1064.
23. Edwards E., Chang E.F. Syllabic (~2-5Hz) and fluctuation (~1-10Hz) ranges in speech and auditory processing. Hearing research 2013, 305:113-134.
24. Elhilali M., Fritz J.B., Klein D.J., Simon J.Z., Shamma S.A. Dynamics of precise spike timing in primary auditory cortex. The Journal of Neuroscience 2004, 24:1159-1172.
25. Elliott T.M., Theunissen F.E. The modulation transfer function for speech intelligibility. PLoS Computational Biology 2009, 5:e1000302.
26. Faulkner A., Rosen S., Smith C. Effects of the salience of pitch and periodicity information on the intelligibility of four-channel vocoded speech: Implications for cochlear implants. The Journal of the Acoustical Society of America 2000, 108:1877-1887.
27. Fishman Y.I., Reser D.H., Arezzo J.C., Steinschneider M. Complex tone processing in primary auditory cortex of the awake monkey. II. Pitch versus critical band representation. The Journal of the Acoustical Society of America 2000, 108:247-262.
28. Fontolan L., Morillon B., Liegeois-Chauvel C., Giraud A.-L. The contribution of frequency-specific activity to hierarchical information processing in the human auditory cortex. Nature Communications 2014, 5:4694.
29. Friston K. A theory of cortical responses. Philosophical transactions of the Royal Society of London Series B, Biological sciences 2005, 360:815-836.
30. Friston K The free-energy principle: A unified brain theory?. Nature Reviews Neuroscience 2010, 11:127-138.
31. Fujioka T., Trainor L.J., Large E.W., Ross B. Internalized timing of isochronous sounds is represented in neuromagnetic beta oscillations. The Journal of Neuroscience 2012, 32:1791-1802.
32. Fukushima M., Saunders R.C., Leopold D.A., Mishkin M., Averbeck B.B. Spontaneous high-gamma band activity reflects functional organization of auditory cortex in the awake macaque. Neuron 2012, 74:899-910.
33. Gagnepain P., Henson R.N., Davis M.H. Temporal predictive codes for spoken words in auditory cortex. Current Biology 2012, 22:615-621.
34. Ghitza O. Linking speech perception and neurophysiology: Speech decoding guided by cascaded oscillators locked to the input rhythm. Front Psychology 2011, 2:130.
35. Ghitza O., Greenberg S. On the possible role of brain rhythms in speech perception: Intelligibility of time-compressed speech with periodic and aperiodic insertions of silence. Phonetica 2009, 66:113-126.
36. Giraud A.L., Kell C., Thierfelder C., Sterzer P., Russ M.O., Preibisch C., et al. Contributions of sensory input, auditory search and verbal comprehension to cortical activity during speech processing. Cerebral Cortex 2004, 14:247-255.
37. Giraud A.L., Lorenzi C., Ashburner J., Wable J., Johnsrude I., Frackowiak R., et al. Representation of the temporal envelope of sounds in the human brain. Journal of Neurophysiology 2000, 84:1588-1598.
38. Giraud A.L., Poeppel D. Cortical oscillations and speech processing: Emerging computational principles. Nature Neuroscience 2012, 15:511-517.
39. Giraud A.L., Price C.J. The constraints functional neuroimaging places on classical models of auditory word processing. Journal of Cognitive Neuroscience 2001, 13:754-765.
40. Goswami U. A temporal sampling framework for developmental dyslexia. Trends in Cognitive Sciences 2011, 15:3-10.
41. Greenberg, S., & Arai, T. (2001). The relation between speech intelligibility and the complex modulation spectrum. Proceedings of the 7th Eurospeech Conference on Speech Communication and Technology (Eurospeech-2001) (pp. 473-476). Aalborg, Denmark.
42. Grothe B., Pecka M., McAlpine D. Mechanisms of sound localization in mammals. Physiological Reviews 2010, 90:983-1012.
43. Henry M.J., Obleser J. Frequency modulation entrains slow neural oscillations and optimizes human listening behavior. Proceedings of the National Academy of Sciences of the United States of America 2012, 109:20095-20100.
44. Hickok G., Poeppel D. Towards a functional neuroanatomy of speech perception. Trends in Cognitive Sciences 2000, 4:131-138.
45. Hickok G., Poeppel D. Dorsal and ventral streams: A framework for understanding aspects of the functional anatomy of language. Cognition 2004, 92:67-99.
46. Hickok G., Poeppel D. The cortical organization of speech processing. Nature Reviews Neuroscience 2007, 8:393-402.
47. Hochstein S., Ahissar M. View from the top: Hierarchies and reverse hierarchies in the visual system. Neuron 2002, 36:791-804.
48. Holcombe A.O. Seeing slow and seeing fast: Two limits on perception. Trends in Cognitive Sciences 2009, 13:216-221.
49. Howard M.F., Poeppel D. Discrimination of speech stimuli based on neuronal response phase patterns depends on acoustics but not comprehension. Journal of Neurophysiology 2011, 104:2500-2511.
50. Howard M.F., Poeppel D. The neuromagnetic response to spoken sentences: Co-modulation of theta band amplitude and phase. NeuroImage 2012, 60:2118-2127.
51. Hyafil A., Fontolan L., Gutkin B., Giraud A.-L. A theoretical exploration of speech/neural oscillation alignment for speech parsing. FENS Abstract 2012, 6:S4704.
52. Joris P.X., Schreiner C.E., Rees A. Neural processing of amplitude-modulated sounds. Physiological Reviews 2004, 84:541-577.
53. Kanedera N., Arai T., Hermansky H., Pavel M. On the relative importance of various components of the modulation spectrum for automatic speech recognition. Speech Communication 1999, 28:43-55.
54. Kayser C., Ince R.A., Panzeri S. Analysis of slow (theta) oscillations as a potential temporal reference frame for information coding in sensory cortices. PLoS Computational Biology 2012, 8:e1002717.
55. Kiebel S.J., Daunizeau J., Friston K.J. A hierarchy of time-scales and the brain. PLoS Computational Biology 2008, 4:e1000209.
56. Kingsbury B.E.D., Morgan N., Greenberg S. Robust speech recognition using the modulation spectrogram. Speech Communication 1998, 25:117-132.
57. Lakatos P., Chen C.M., O'Connell M.N., Mills A., Schroeder C.E. Neuronal oscillations and multisensory interaction in primary auditory cortex. Neuron 2007, 53:279-292.
58. Lakatos P., Karmos G., Mehta A.D., Ulbert I., Schroeder C.E. Entrainment of neuronal oscillations as a mechanism of attentional selection. Science 2008, 320:110-113.
59. Lakatos P., Shah A.S., Knuth K.H., Ulbert I., Karmos G., Schroeder C.E. An oscillatory hierarchy controlling neuronal excitability and stimulus processing in the auditory cortex. Journal of Neurophysiology 2005, 94:1904-1911.
60. Lehongre K., Ramus F., Villiermet N., Schwartz D., Giraud A.L. Altered low-gamma sampling in auditory cortex accounts for the three main facets of dyslexia. Neuron 2011, 72:1080-1090.
61. Loebach J.L., Wickesberg R.E. The psychoacoustics of noise vocoded speech: A physiological means to a perceptual end. Hearing Research 2008, 241:87-96.
62. Luo H., Boemio A., Gordon M., Poeppel D. The perception of FM sweeps by Chinese and English listeners. Hearing Research 2007, 224:75-83.
63. Luo H., Liu Z.X., Poeppel D. Auditory cortex tracks both auditory and visual stimulus dynamics using low-frequency neuronal phase modulation. PLoS Biology 2010, 8:13.
64. Luo H., Poeppel D. Phase patterns of neuronal responses reliably discriminate speech in human auditory cortex. Neuron 2007, 54:1001-1010.
65. Mantini D., Perrucci M.G., Del Gratta C., Romani G.L., Corbetta M. Electrophysiological signatures of resting state networks in the human brain. Proceedings of the National Academy of Sciences of the United States of America 2007, 104:13170-13175.
66. McDermott J.H., Simoncelli E.P. Sound texture perception via statistics of the auditory periphery: Evidence from sound synthesis. Neuron 2011, 71:926-940.
67. Mesgarani N., Chang E.F. Selective cortical representation of attended speaker in multi-talker speech perception. Nature 2012, 485:233-236.
68. Miller G.A. Language and communication 1951, McGraw-Hill, New York, NY.
69. Moerel M., De Martino F., Santoro R., Ugurbil K., Goebel R., Yacoub E., et al. Processing of natural sounds: Characterization of multipeak spectral tuning in human auditory cortex. The Journal of Neuroscience 2013, 33:11888-11898.
70. Morillon B., Lehongre K., Frackowiak R.S., Ducorps A., Kleinschmidt A., Poeppel D., et al. Neurophysiological origin of human brain asymmetry for speech and language. Proceedings of the National Academy of Sciences of the United States of America 2010, 107:18688-18693.
71. Morillon B., Liegeois-Chauvel C., Arnal L.H., Benar C.G., Giraud A.L. Asymmetric function of theta and gamma activity in syllable processing: An intra-cortical study. Front Psychology 2012, 3:248.
72. Nahum M., Nelken I., Ahissar M. Low-level information and high-level perception: The case of speech in noise. PLoS Biology 2008, 6:e126.
73. Ng B.S., Schroeder T., Kayser C. A precluding but not ensuring role of entrained low-frequency oscillations for auditory perception. The Journal of Neuroscience 2012, 32:12268-12276.
74. Nourski K.V., Brugge J.F. Representation of temporal sound features in the human auditory cortex. Reviews in the Neurosciences 2011, 22:187-203.
75. Nourski K.V., Reale R.A., Oya H., Kawasaki H., Kovach C.K., Chen H., et al. Temporal envelope of time-compressed speech represented in the human auditory cortex. The Journal of Neuroscience 2009, 29:15564-15574.
76. Panzeri S., Brunel N., Logothetis N.K., Kayser C. Sensory neural codes using multiplexed temporal scales. Trends in Neurosciences 2010, 33:111-120.
77. Pasley B.N., David S.V., Mesgarani N., Flinker A., Shamma S.A., Crone N.E., et al. Reconstructing speech from human auditory cortex. PLoS Biology 2012, 10:e1001251.
78. Peelle J.E., Gross J., Davis M.H. Phase-locked responses to speech in human auditory cortex are enhanced during comprehension. Cerebral Cortex 2013, 23:1378-1387.
79. Plack C.J., Oxenham A.J., Fay R.R., Popper A.N. Pitch: Neural coding and perception 2005, Springer, New York, NY.
80. Poeppel D. New approaches to the neural basis of speech sound processing: Introduction to special section on brain and speech. Cognitive Science 2001, 25:659-661.
81. Poeppel D. The analysis of speech in different temporal integration windows: Cerebral lateralization as "asymmetric sampling in time". Speech Communication 2003, 41:245-255.
82. Poeppel D., Idsardi W.J., van Wassenhove V. Speech perception at the interface of neurobiology and linguistics. Philosophical Transactions of the Royal Society of London Series B, Biological Sciences 2008, 363:1071-1086.
83. Pöppel E., Artin T.T. Mindworks: Time and conscious experience 1988, Harcourt Brace Jovanovich.
84. Ramus F., Szenkovits G. What phonological deficit?. Quarterly Journal of Experimental Psychology 2008, 61:129-141.
85. Rauschecker J.P., Scott S.K. Maps and streams in the auditory cortex: Nonhuman primates illuminate human speech processing. Nature Neuroscience 2009, 12:718-724.
86. Remez R.E., Rubin P.E., Pisoni D.B., Carrell T.D. Speech perception without traditional speech cues. Science 1981, 212:947-949.
87. Roberts B., Summers R.J., Bailey P.J. The intelligibility of noise-vocoded speech: Spectral information available from across-channel comparison of amplitude envelopes. Proceedings Biological Sciences/The Royal Society 2011, 278:1595-1600.
88. Rosen S. Temporal information in speech: Acoustic, auditory and linguistic aspects. Philosophical Transactions of the Royal Society of London Series B, Biological Sciences 1992, 336:367-373.
89. Saberi K., Perrott D.R. Cognitive restoration of reversed speech. Nature 1999, 398:760.
90. Saenz M., Langers D.R. Tonotopic mapping of human auditory cortex. Hearing Research 2014, 307:42-52.
91. Sauseng P., Klimesch W., Gruber W.R., Hanslmayr S., Freunberger R., Doppelmayr M. Are event-related potential components generated by phase resetting of brain oscillations? A critical discussion. Neuroscience 2007, 146:1435-1444.
92. Sayers B.M., Beagley H.A. Objective evaluation of auditory evoked EEG responses. Nature 1974, 251:608-609.
93. Schroeder C.E., Lakatos P. Low-frequency neuronal oscillations as instruments of sensory selection. Trends in Neurosciences 2009, 32:9-18.
94. Schroeder C.E., Lakatos P. The gamma oscillation: Master or slave?. Brain Topography 2009, 22:24-26.
95. Schroeder C.E., Lakatos P., Kajikawa Y., Partan S., Puce A. Neuronal oscillations and visual amplification of speech. Trends in Cognitive Sciences 2008, 12:106-113.
96. Scott S.K., Johnsrude I.S. The neuroanatomical and functional organization of speech perception. Trends in Neurosciences 2003, 26:100-107.
97. Scott S.K., Rosen S., Lang H., Wise R.J. Neural correlates of intelligibility in speech investigated with noise vocoded speech-A positron emission tomography study. The Journal of the Acoustical Society of America 2006, 120:1075-1083.
98. Shamir M., Ghitza O., Epstein S., Kopell N. Representation of time-varying stimuli by a network exhibiting oscillations on a faster time scale. PLoS Computational Biology 2009, 5:e1000370.
99. Shannon R.V., Zeng F.G., Kamath V., Wygonski J., Ekelid M. Speech recognition with primarily temporal cues. Science 1995, 270:303-304.
100. Smith Z.M., Delgutte B., Oxenham A.J. Chimaeric sounds reveal dichotomies in auditory perception. Nature 2002, 416:87-90.
101. Souza P., Rosen S. Effects of envelope bandwidth on the intelligibility of sine- and noise-vocoded speech. The Journal of the Acoustical Society of America 2009, 126:792-805.
102. Steeneken H.J., Houtgast T. A physical method for measuring speech-transmission quality. The Journal of the Acoustical Society of America 1980, 67:318-326.
103. Stevens K.N. Toward a model for lexical access based on acoustic landmarks and distinctive features. The Journal of the Acoustical Society of America 2002, 111:1872-1891.
104. Thorne J.D., De Vos M., Viola F.C., Debener S. Cross-modal phase reset predicts auditory task performance in humans. The Journal of Neuroscience 2011, 31:3853-3861.
105. Tiesinga P., Sejnowski T.J. Cortical enlightenment: Are attentional gamma oscillations driven by ING or PING?. Neuron 2009, 63:727-732.
106. VanRullen R., Koch C. Is perception discrete or continuous?. Trends in Cognitive Sciences 2003, 7:207-213.
107. van Wassenhove V., Grant K.W., Poeppel D. Visual speech speeds up the neural processing of auditory speech. Proceedings of the National Academy of Sciences of the United States of America 2005, 102:1181-1186.
108. Wang X.J. Neurophysiological and computational principles of cortical rhythms in cognition. Physiological Reviews 2010, 90:1195-1268.
109. Warrier C., Wong P., Penhune V., Zatorre R., Parrish T., Abrams D., et al. Relating structure to function: Heschl's gyrus and acoustic processing. The Journal of Neuroscience 2009, 29:61-69.
110. Womelsdorf T., Schoffelen J.M., Oostenveld R., Singer W., Desimone R., Engel A.K., et al. Modulation of neuronal interactions through neuronal synchronization. Science 2007, 316:1609-1612.
111. Wyart V., de Gardelle V., Scholl J., Summerfield C. Rhythmic fluctuations in evidence accumulation during decision making in the human brain. Neuron 2012, 76:847-858.
112. Zatorre R.J., Belin P., Penhune V.B. Structure and function of auditory cortex: Music and speech. Trends in Cognitive Sciences 2002, 6:37-46.
113. Zatorre R.J., Gandour J.T. Neural specializations for speech and pitch: Moving beyond the dichotomies. Philosophical Transactions of the Royal Society of London Series B, Biological Sciences 2008, 363:1087-1104.
114. Zeng F.G. Temporal pitch in electric hearing. Hearing Research 2002, 174:101-106.
115. Ziegler J.C., Pech-Georgel C., George F., Lorenzi C. Speech-perception-in-noise deficits in dyslexia. Developmental Science 2009, 12:732-745.
116. Zion Golumbic E., Cogan G.B., Schroeder C.E., Poeppel D. Visual input enhances selective speech envelope tracking in auditory cortex at a "cocktail party". The Journal of Neuroscience 2013, 33:1417-1426.
117. Zion Golumbic E.M., Ding N., Bickel S., Lakatos P., Schevon C.A., McKhann G.M., et al. Mechanisms underlying selective neuronal tracking of attended speech at a "cocktail party". Neuron 2013, 77:980-991.