The cortical analysis of speech-specific temporal structure revealed by responses to sound quilts

Nature Neuroscience

Volumn 18, Issue 6, 2015, Pages 903-911

  Overath, Tobias ^a,b   McDermott, Josh H ^c   Zarate, Jean Mary ^b   Poeppel, David ^b,d  

^a DUKE UNIVERSITY SCHOOL OF MEDICINE   (United States)

^b NEW YORK UNIVERSITY   (United States)

^c MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^d MAX PLANCK INSTITUTE FOR EMPIRICAL AESTHETICS   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ALGORITHM; ANATOMICAL VARIATION; ARTICLE; BOLD SIGNAL; BRAIN REGION; BRAIN SIZE; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; MALE; NUCLEAR MAGNETIC RESONANCE SCANNER; PRIMARY AUDITORY CORTEX; PRIORITY JOURNAL; QUILTING ALGORITHM; SPEECH ANALYSIS; SPEECH PERCEPTION; STRUCTURE ANALYSIS; SUPERIOR TEMPORAL SULCUS; ADOLESCENT; ANATOMY AND HISTOLOGY; AUDITORY CORTEX; AUDITORY STIMULATION; BLOOD; BRAIN MAPPING; HEARING; HEMISPHERIC DOMINANCE; NOISE; NUCLEAR MAGNETIC RESONANCE IMAGING; PHYSIOLOGY; PROCEDURES; PSYCHOMOTOR PERFORMANCE; YOUNG ADULT;

OXYGEN;

ACOUSTIC STIMULATION; ADOLESCENT; ADULT; ALGORITHMS; AUDITORY CORTEX; AUDITORY PERCEPTION; BRAIN MAPPING; FEMALE; FUNCTIONAL LATERALITY; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; NOISE; OXYGEN; PSYCHOMOTOR PERFORMANCE; SPEECH PERCEPTION; YOUNG ADULT;

EID: 84929957914     PISSN: 10976256     EISSN: 15461726     Source Type: Journal    
DOI: 10.1038/nn.4021     Document Type: Article

References (57)

1. Stevens, K.N. Acoustic Phonetics (MIT Press, 2000).
2. Poeppel, D., Idsardi, W.J. & van Wassenhove, V. Speech perception at the interface of neurobiology and linguistics. Phil. Trans. R. Soc. Lond. B 363, 1071-1086 (2008).
3. Scott, S.K., Blank, C.C., Rosen, S. & Wise, R.J. Identification of a pathway for intelligible speech in the left temporal lobe. Brain 123, 2400-2406 (2000).
4. Hickok, G. & Poeppel, D. The cortical organization of speech processing. Nat. Rev. Neurosci. 8, 393-402 (2007).
5. Rauschecker, J.P. & Scott, S.K. Maps and streams in the auditory cortex: nonhuman primates illuminate human speech processing. Nat. Neurosci. 12, 718-724 (2009).
6. Binder, J.R. et al. Human temporal lobe activation by speech and non-speech sounds. Cereb. Cortex 10, 512-528 (2000).
7. Liebenthal, E., Binder, J.R., Spitzer, S.M., Possing, E.T. & Medler, D.A. Neural substrates of phonemic perception. Cereb. Cortex 15, 1621-1631 (2005).
8. Obleser, J., Zimmermann, J., Van Meter, J. & Rauschecker, J.P. Multiple stages of auditory speech perception reflected in event-related fMRI. Cereb. Cortex 17, 2251-2257 (2007).
9. Wild, C.J., Davis, M.H. & Johnsrude, I.S. Human auditory cortex is sensitive to the perceived clarity of speech. Neuroimage 60, 1490-1502 (2012).
10. Giraud, A.L. et al. Contributions of sensory input, auditory search and verbal comprehension to cortical activity during speech processing. Cereb. Cortex 14, 247-255 (2004).
11. Obleser, J., Eisner, F. & Kotz, S.A. Bilateral speech comprehension reflects differential sensitivity to spectral and temporal features. J. Neurosci. 28, 8116-8123 (2008).
12. Zatorre, R.J. & Belin, P. Spectral and temporal processing in human auditory cortex. Cereb. Cortex 11, 946-953 (2001).
13. Schönwiesner, M., Rubsamen, R. & von Cramon, D.Y. Hemispheric asymmetry for spectral and temporal processing in the human antero-lateral auditory belt cortex. Eur. J. Neurosci. 22, 1521-1528 (2005).
14. Boemio, A., Fromm, S., Braun, A. & Poeppel, D. Hierarchical and asymmetric temporal sensitivity in human auditory cortices. Nat. Neurosci. 8, 389-395 (2005).
15. Overath, T., Kumar, S., von Kriegstein, K. & Griffiths, T.D. Encoding of spectral correlation over time in auditory cortex. J. Neurosci. 28, 13268-13273 (2008).
16. Overath, T., Zhang, Y., Sanes, D.H. & Poeppel, D. Sensitivity to temporal modulation rate and spectral bandwidth in the human auditory system: fMRI evidence. J. Neurophysiol. 107, 2042-2056 (2012).
17. Greenberg, S. A multi-Tier framework for understanding spoken language. in Listening to Speech: An Auditory Perspective (eds. S. Greenberg & W.A. Ainsworth) 411-433 (Lawrence Erlbaum, 2006).
18. Rosen, S. Temporal information in speech: acoustic, auditory and linguistic aspects. Phil. Trans. R. Soc. Lond. B 336, 367-373 (1992).
19. Efros, A.A. & Leung, T.K. Texture synthesis by non-parametric sampling. in IEEE Int. Conf. Comp. Vis. 1033-1038 (1999).
20. Grill-Spector, K. et al. A sequence of object-processing stages revealed by fMRI in the human occipital lobe. Hum. Brain Mapp. 6, 316-328 (1998).
21. Lerner, Y., Honey, C.J., Silbert, L.J. & Hasson, U. Topographic mapping of a hierarchy of temporal receptive windows using a narrated story. J. Neurosci. 31, 2906-2915 (2011).
22. Pallier, C., Devauchelle, A.-D. & Dehaene, S. Cortical representation of the constituent structure of sentences. Proc. Natl. Acad. Sci. USA 108, 2522-2527 (2011).
23. Abrams, D.A. et al. Decoding temporal structure in music and speech relies on shared brain resources but elicits different fine-scale spatial patterns. Cereb. Cortex 21, 1507-1518 (2011).
24. Giraud, A.L. et al. Representation of the temporal envelope of sounds in the human brain. J. Neurophysiol. 84, 1588-1598 (2000).
25. Harms, M.P., Guinan, J.J., Sigalovsky, I.S. & Melcher, J.R. Short-Term sound temporal envelope characteristics determine multisecond time patterns of activity in human auditory cortex as shown by fMRI. J. Neurophysiol. 93, 210-222 (2005).
26. McDermott, J.H. & Simoncelli, E.P. Sound texture perception via statistics of the auditory periphery: evidence from sound synthesis. Neuron 71, 926-940 (2011).
27. Shannon, R.V., Zeng, F.G., Kamath, V., Wygonski, J. & Ekelid, M. Speech recognition with primarily temporal cues. Science 270, 303-304 (1995).
28. Davis, M.H. & Johnsrude, I. Hierarchical processing in spoken language comprehension. J. Neurosci. 23, 3423-3431 (2003).
29. Fedorenko, E., Hsieh, P.J., Nieto-Castanon, A., Whitfield-Gabrieli, S. & Kanwisher, N. New method for fMRI investigations of language: defining ROIs functionally in individual subjects. J. Neurophysiol. 104, 1177-1194 (2010).
30. Lashkari, D., Vul, E., Kanwisher, N.G. & Golland, P. Discovering structure in the space of fMRI selectivity profiles. Neuroimage 50, 1085-1098 (2010).
31. Formisano, E., De Martino, F., Bonte, M. & Goebel, R. 'Who' is saying 'what'? Brain-based decoding of human voice and speech. Science 322, 970-973 (2008).
32. Mesgarani, N., Cheung, C., Johnson, K. & Chang, E.F. Phonetic feature encoding in human superior temporal gyrus. Science 343, 1006-1010 (2014).
33. Kanwisher, N., McDermott, J. & Chun, M.M. The fusiform face area: a module in human extrastriate cortex specialized for face perception. J. Neurosci. 17, 4302-4311 (1997).
34. Price, C., Thierry, G. & Griffiths, T. Speech-specific auditory processing: where is it? Trends Cogn. Sci. 9, 271-276 (2005).
35. Schirmer, A., Fox, M.P. & Grandjean, D. On the spatial organization of sound processing in the human temporal lobe: a meta-Analysis. Neuroimage 63, 137-147 (2012).
36. Ghitza, O. On the role of theta-driven syllabic parsing in decoding speech: intelligibility of speech with a manipulated modulation spectrum. Front. Psychol. 3, 238 (2012).
37. Rauschecker, J.P. Cortical processing of complex sounds. Curr. Opin. Neurobiol. 8, 516-521 (1998).
38. Norman-Haignere, S., Kanwisher, N. & McDermott, J.H. Cortical pitch regions in humans respond primarily to resolved harmonics and are located in specific tonotopic regions of anterior auditory cortex. J. Neurosci. 33, 19451-19469 (2013).
39. Belin, P., Zatorre, R.J., Lafaille, P., Ahad, P. & Pike, B. Voice-selective areas in human auditory cortex. Nature 403, 309 (2000).
40. Liebenthal, E., Desai, R.H., Humphries, C., Sabri, M. & Desai, A. The functional organization of the left STS: a large scale meta-Analysis of PET and fMRI studies of healthy adults. Front. Neurosci. 8, 289 (2014).
41. Peelle, J.E. The hemispheric lateralization of speech processing depends on what 'speech' is: a hierarchical perspective. Front. Hum. Neurosci. 6, 309 (2012).
42. Cogan, G.B. et al. Sensory-motor transformations for speech occur bilaterally. Nature 507, 94-98 (2014).
43. McGettigan, C. et al. An application of univariate and multivariate approaches in FMRI to quantifying the hemispheric lateralization of acoustic and linguistic processes. J. Cogn. Neurosci. 24, 636-652 (2012).
44. Voss, R.F. & Clarke, J. 1/f noise in music and speech. Nature 258, 317-318 (1975).
45. Attias, H. & Schreiner, C.E. Temporal low-order statistics of natural sounds. in Advances in Neural Information Processing Systems, Vol. 9 (eds. M.C. Mozer, M.J. Jordan, & T. Petsche) 27-33 (MIT Press, 1997).
46. Meyer, M., Alter, K., Friederici, A.D., Lohmann, G. & von Cramon, D.Y. fMRI reveals brain regions mediating slow prosodic modulations in spoken sentences. Hum. Brain Mapp. 17, 73-88 (2002).
47. Humphries, C., Sabri, M., Lewis, K. & Liebenthal, E. Hierarchical organization of speech perception in human auditory cortex. Front. Neurosci. 8, 406 (2014).
48. Turken, A.U. & Dronkers, N.F. The neural architecture of the language comprehension network: converging evidence from lesion and connectivity analyses. Front. Syst. Neurosci. 5, 1 (2011).
49. Lau, E.F., Phillips, C. & Poeppel, D. A cortical network for semantics: (de)constructing the N400. Nat. Rev. Neurosci. 9, 920-933 (2008).
50. Petkov, C.I., Logothetis, N. & Obleser, J. Where are the human speech and voice regions, and do other animals have anything like them? Neuroscientist 15, 419-429 (2009).
51. Desmond, J.E. & Glover, G.H. Estimating sample size in functional MRI (fMRI) neuroimaging studies: Statistical power analyses. J. Neurosci. Methods 118, 115-128 (2002).
52. Moulines, E. & Charpentier, F. Pitch-synchronous waveform processing techniques for text-To-speech synthesis using diphones. Speech Commun. 9, 453-467 (1990).
53. Brainard, D.H. The psychophysics toolbox. Spat. Vis. 10, 433-436 (1997).
54. Friston, K.J. et al. Statistical parametric maps in functional imaging: a general linear approach. Hum. Brain Mapp. 2, 189-210 (1995).
55. Rademacher, J. et al. Probabilistic mapping and volume measurement of human primary auditory cortex. Neuroimage 13, 669-683 (2001).
56. Westbury, C.F., Zatorre, R.J. & Evans, A.C. Quantifying variability in the planum temporale: a probability map. Cereb. Cortex 9, 392-405 (1999).
57. Brett, M., Anton, J.-L., Valabregue, R. & Poline, J.-B. Region of interest analysis using an SPM toolbox (abstract). Neuroimage 16 (suppl. 2), (2002).