Hierarchical organization of auditory and motor representations in speech perception: Evidence from searchlight similarity analysis

Cerebral Cortex

Volumn 25, Issue 12, 2015, Pages 4772-4788

  Evans, Samuel ^a,b   Davis, Matthew H ^a  

^a MRC COGNITION AND BRAIN SCIENCES UNIT   (United Kingdom)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

fMRI; Hierarchical processing; Multivoxel pattern analysis; Representational similarity analysis; Speech perception

Indexed keywords

ACOUSTIC ANALYSIS; ADULT; ANALYSIS; ARTICLE; BRAIN CORTEX; BRAIN REGION; CEREBELLUM; FEMALE; FOLLOW UP; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HEARING; HUMAN; INFERIOR FRONTAL GYRUS; INFERIOR PARIETAL CORTEX; INFERIOR TEMPORAL GYRUS; LEFT HEMISPHERE; MALE; MIDDLE TEMPORAL GYRUS; NORMAL HUMAN; PARIETAL CORTEX; POSTCENTRAL GYRUS; PRIMARY AUDITORY CORTEX; PRIMARY MOTOR CORTEX; PRIMARY SOMATOSENSORY CORTEX; PRIORITY JOURNAL; REPRESENTATIONAL SIMILARITY ANALYSIS; SOMATOMOTOR CORTEX; SPEECH ANALYSIS; SPEECH ARTICULATION; SPEECH PERCEPTION; SUPERIOR TEMPORAL GYRUS; TEMPORAL CORTEX; ADOLESCENT; AUDITORY THRESHOLD; FRONTAL LOBE; MULTIVARIATE ANALYSIS; NERVE TRACT; NOISE; PHYSIOLOGY; SENSORIMOTOR CORTEX; SPEECH; STATISTICAL ANALYSIS; TEMPORAL LOBE; YOUNG ADULT;

ADOLESCENT; ADULT; AUDITORY THRESHOLD; DATA INTERPRETATION, STATISTICAL; FEMALE; FRONTAL LOBE; HUMANS; MALE; MULTIVARIATE ANALYSIS; NEURAL PATHWAYS; NOISE; SENSORIMOTOR CORTEX; SPEECH; SPEECH PERCEPTION; TEMPORAL LOBE; YOUNG ADULT;

EID: 84959387594     PISSN: 10473211     EISSN: 14602199     Source Type: Journal    
DOI: 10.1093/cercor/bhv136     Document Type: Article

References (86)

1. Adank P, Devlin JT. 2010. On-line plasticity in spoken sentence comprehension: adapting to time-compressed speech. Neuroimage. 49:1124-1132.
2. Arsenault JS, Buchsbaum BR. 2015. Distributed neural representations of phonological features during speech perception. J Neurosci. 35:634-642.
3. Binder JR, Frost JA, Hammeke TA, Bellgowan PSF, Springer JA, Kaufman JN, Possing ET. 2000. Human temporal lobe activation by speech and nonspeech sounds. Cereb Cortex. 10:512-528.
4. Binder JR, Liebenthal E, Possing ET, Medler DA, Ward BD. 2004. Neural correlates of sensory and decision processes in auditory object identification. Nat Neurosci. 7:295-301.
5. Bonte M, Hausfeld L, Scharke W, Valente G, Formisano E. 2014. Task-dependent decoding of speaker and vowel identity from auditory cortical response patterns. J Neurosci. 34:4548-4557.
6. Brungart DS. 2001. Informational and energetic masking effects in the perception of two simultaneous talkers. J Acoust Soc Am. 109:1101-1109.
7. Burton MW, Small SL, Blumstein SE. 2000. The role of segmentation in phonological processing: an fMRI investigation. J Cogn Neurosci. 12:679-690.
8. Chang EF, Rieger JW, Johnson K, Berger MS, Barbaro NM, Knight RT. 2010. Categorical speech representation in human superior temporal gyrus. Nat Neurosci. 13:1428-1432.
9. Chevillet Ma, Jiang X, Rauschecker JP, Riesenhuber M. 2013. Automatic phoneme category selectivity in the dorsal auditory stream. J Neurosci. 33:5208-5215.
10. Correia JM. 2015. Neural codingofspeech and language:fMRI and EEG studies. PhD Thesis. Maastricht University.
11. D'Ausilio A, Pulvermüller F, Salmas P, Bufalari I, Begliomini C, Fadiga L. 2009. The motor somatotopy of speech perception. Curr Biol. 19:381-385.
12. Davis MH, Johnsrude IS. 2003. Hierarchical processing in spoken language comprehension. J Neurosci. 23:3423-3431.
13. Davis MH, Johnsrude IS. 2007. Hearing speech sounds: top-down influences on the interface between audition and speech perception. Hear Res. 229:132-147.
14. Davis MH, Johnsrude IS, Hervais-Adelman A, Taylor K, McGettigan C. 2005. Lexical information drives: perceptual learning of distorted speech: evidence from the comprehension of noise-vocoded sentences. J Exp Psychol. 134:222-241.
15. Dehaene S, Pallier C, Serniclaes W, Sprenger-Charolles L, Jobert A, Dehaene S. 2005. Neural correlates of switching from auditory to speech perception. Neuroimage. 24:21-33.
16. Desai R, Liebenthal E, Waldron E, Binder JR. 2008. Left posterior temporal regions are sensitive to auditory categorization. J Cogn Neurosci. 20:1174-1188.
17. Devlin JT, Watkins KE. 2007. Stimulating language: insights from TMS. Brain. 130:610-622.
18. Du Y, Buchsbaum BR, Grady CL, Alain C. 2014. Noise differentially impacts phoneme representations in the auditory and speech motor systems. Proc Natl Acad Sci USA. 111:7126-7131.
19. Dupoux E, Green K. 1997. Perceptual adjustment to highly compressed speech: Effects of talker and rate changes. J Exp Psychol Percept Perform. 23:914-927.
20. Eisner F, McGettigan C, Faulkner A, Rosen S, Scott SK. 2010. Inferior frontal gyrus activation predicts individual differences in perceptual learning of cochlear-implant simulations. J Neurosci. 30:7179-7186.
21. Erb J, Henry MJ, Eisner F, Obleser J. 2013. The brain dynamics of rapid perceptual adaptation to adverse listening conditions. J Neurosci. 33:10688-10697.
22. Esterman M, Tamber-Rosenau BJ, Chiu Y-C, Yantis S. 2010. Avoiding non-independence in fMRI data analysis: leave one subject out. Neuroimage. 50:572-576.
23. Evans S, Kyong JS, Rosen S, Golestani N, Warren JE, McGettigan C, Mourão-Miranda J, Wise RJS, Scott SK. 2014. The pathways for intelligible speech: multivariate and univariate perspectives. Cereb Cortex. 24:2350-2361.
24. Formisano E, De Martino F, Bonte M, Goebel R. 2008. "Who" is saying "what"? Brain-based decoding of human voice and speech. Science. 322:970-973.
25. Greenwood DD. 1990. A cochlear frequency-position function for several species-29 years later. J Acoust Soc Am. 87:2592-2605.
26. Guenther FH, Ghosh SS, Tourville Ja. 2006. Neural modeling and imaging of the cortical interactions underlying syllable production. Brain Lang. 96:280-301.
27. Haynes JD, Rees G 2006. Decoding mental states from brain activity in humans. Nat Rev Neurosci. 7:523-534.
28. Heinrich A, Carlyon RP, Davis MH, Johnsrude IS. 2008. Illusory vowels resulting from perceptual continuity: a functional magnetic resonance imaging study. J Cogn Neurosci. 20:1737-1752.
29. Hervais-Adelman AG, Carlyon RP, Johnsrude IS, Davis MH. 2012. Brain regions recruited for the effortful comprehension of noise-vocoded words. Lang Cogn Process. 27:1145-1166.
30. Hickok G, Houde J, Rong F. 2011. Sensorimotor integration in speech processing: computational basis and neural organization. Neuron. 69:407-422.
31. Jacquemot C, Pallier C, LeBihan D, Dehaene S, Dupoux E. 2003. Phonological grammar shapes the auditory cortex: a functional magnetic resonance imaging study. J Neurosci. 23: 9541-9546.
32. Joanisse MF, Zevin JD, McCandliss BD. 2007. Brain mechanisms implicated in the preattentive categorization of speech sounds revealed using fMRI and a short-interval habituation trial paradigm. Cereb Cortex. 17:2084-2093.
33. Kaas JH, Hackett TA. 2000. Subdivisions of auditory cortex and processing streams in primates. Proc Natl Acad Sci USA. 97:11793-11799.
34. Kilian-Hutten N, Valente G, Vroomen J, Formisano E. 2011. Auditory cortex encodes the perceptual interpretation of ambiguous sound. J Neurosci. 31:1715-1720.
35. Krieger-Redwood K, Gaskell MG, Lindsay S, Jefferies E. 2013. The selective role of premotor cortex in speech perception: a contribution to phoneme judgements but not speech comprehension. J Cogn Neurosci. 25:2179-2188.
36. Kriegeskorte N, Goebel R, Bandettini P. 2006. Information-based functional brain mapping. Proc Natl Acad Sci USA. 103: 3863-3868.
37. Kriegeskorte N, Mur M, Bandettini P. 2008. Representational similarity analysis-connecting the branches of systems neuroscience. Front Syst Neurosci. 2:4.
38. Latinus M, McAleer P, Bestelmeyer PEG, Belin P. 2013. Norm-based coding of voice identity in human auditory cortex. Curr Biol. 23:1075-1080.
39. Lee Y-S, Turkeltaub P, Granger R, Raizada RDS. 2012. Categorical speech processing in Broca's area: an fMRI study using multivariate pattern-based analysis. J Neurosci. 32:3942-3948.
40. Leech R, Holt LL, Devlin JT, Dick F. 2009. Expertise with artificial nonspeech sounds recruits speech-sensitive cortical regions. J Neurosci. 29:5234-5239.
41. Liberman AM, Whalen DH. 2000. On the relation of speech to language. Trends Cogn Sci. 4:187-196.
42. Liebenthal E, Binder JR, Spitzer SM, Possing ET, Medler DA. 2005. Neural substrates of phonemic perception. Cereb Cortex. 15:1621-1631.
43. Loftus GR, Masson ME. 1994. Using confidence intervals in within-subject designs. Psychon Bull Rev. 1:476-490.
44. Lotto AJ, Hickok GS, Holt LL. 2009. Reflections on mirror neurons and speech perception. Trends Cogn Sci. 13:110-114.
45. McGettigan C, Agnew ZK, Scott SK. 2010. Are articulatory commands automatically and involuntarily activated during speech perception? Proc Natl Acad Sci USA. 107:E42; author reply E43.
46. McGettigan C, Evans S, Rosen S, Agnew ZA, Shah P, Scott SK. 2012. An application of univariate and multivariate approaches in FMRI to quantifying the hemispheric lateraliza-tion of acoustic and linguistic processes. J Cogn Neurosci. 24:636-652.
47. Meister IG, Wilson SM, Deblieck C, Wu AD, Iacoboni M. 2007. The essential role of premotor cortex in speech perception. Curr Biol. 17:1692-1696.
48. Misaki M, Kim Y, Bandettini PA, Kriegeskorte N. 2010. Comparison of multivariate classifiers and response normalizations for pattern-information fMRI. Neuroimage. 53:103-118.
49. Morosan P, Rademacher J, Schleicher A, Amunts K, Schormann T, Zilles K. 2001. Human primary auditory cortex: Cytoarchitec-tonic subdivisions and mapping into a spatial reference system. Neuroimage. 13:684-701.
50. Möttönen R, Calvert Ga, Jääskeläinen IP, Matthews PM, Thesen T, Tuomainen J, Sams M. 2006. Perceiving identical sounds as speech or non-speech modulates activity in the left posterior superior temporal sulcus. Neuroimage. 30: 563-569.
51. Möttönen R, Watkins KE. 2009. Motor representations of articula-tors contribute to categorical perception of speech sounds. J Neurosci. 29:9819-9825.
52. Mur M, Bandettini PA, Kriegeskorte N. 2009. Revealing representational content with pattern-information fMRIan introductory guide. Soc Cogn Affect Neurosci. 4:101-109.
53. Myers EB, Blumstein SE, Walsh E, Eliassen J. 2009. Inferior frontal regions underlie the perception of phonetic category invari-ance. Psychol Sci. 20:895-903.
54. Nichols T, Brett M, Andersson J, Wager T, Poline JB. 2005. Valid conjunction inference with the minimum statistic. Neuroimage. 25:653-660.
55. Nili H, Wingfield C, Walther A, Su L, Marslen-Wilson W, Kriegeskorte N. 2014. A toolbox for representational similarity analysis. PLoS Comput Biol. 10:e1003553.
56. Obleser J, Boecker H, Drzezga A, Haslinger B, Hennenlotter A, Roettinger M, Eulitz C, Rauschecker JP. 2006a. Vowel sound extraction in anterior superior temporal cortex. Hum Brain Mapp. 27:562-571.
57. Obleser J, Scott SK, Eulitz C. 2006b. Now you hear it, now you don't: transient traces of consonants and their non-speech analogues in the human brain. Cereb Cortex. 16: 1069-1076.
58. Obleser J, Eisner F, Kotz SA. 2008. Bilateral speech comprehension reflects differential sensitivity to spectral and temporal features. J Neurosci. 28:8116-8123.
59. Obleser J, Lahiri A, Eulitz C. 2004. Magnetic brain response mirrors extraction of phonological features from spoken vowels. J Cogn Neurosci. 16:31-39.
60. Obleser J, Leaver AM, Vanmeter J, Rauschecker JP. 2010. Segregation of vowels and consonants in human auditory cortex: evidence for distributed hierarchical organization. Front Psychol. 1:232.
61. Okada K, Rong F, Venezia J, Matchin W, Hsieh IH, Saberi K, Serences JT, Hickok G. 2010. Hierarchical organization of human auditory cortex: evidence from acoustic invariance in the response to intelligible speech. Cereb Cortex. 20:2486-2495.
62. Osnes B, Hugdahl K, Specht K. 2011. Effective connectivity analysis demonstrates involvement of premotor cortex during speech perception. Neuroimage. 54:2437-2445.
63. Peelle JE, Johnsrude I, Davis MH. 2010. Hierarchical processing for speech in human auditory cortex and beyond. Front Hum Neurosci. 4:1-3.
64. Poeppel D, Monahan PJ. 2011. Feedforward and feedback in speech perception: revisiting analysis by synthesis. Lang Cogn Process. 26:935-951.
65. Pulvermüller F, Fadiga L. 2010. Active perception: sensorimotor circuits as a cortical basis for language. Nat Rev Neurosci. 11:351-360.
66. Pulvermüller F, Huss M, Kherif F, Moscoso del Prado Martin F, Hauk O, Shtyrov Y. 2006. Motor cortex maps articulatory features of speech sounds. Proc Natl Acad Sci USA. 103: 7865-7870.
67. Raizada RDS, Poldrack RA. 2007. Selective amplification of stimulus differences during categorical processing of speech. Neuron. 56:726-740.
68. Rauschecker JP. 1998. Cortical processing of complex sounds. Curr Opin Neurobiol. 8:516-521.
69. Remez RE, Dubowski KR, Davids ML, Thomas EF, Paddu NU, Grossman YS, Moskalenko M. 2011. Estimating speech spectra for copy synthesis by linear prediction and by hand. J Acoust Soc Am. 130:2173-2178.
70. Remez RE, Rubin PE, Pisoni DB, Carrell TD. 1981. Speech-perception without traditional speech cues. Science. 212:947-950.
71. Sato M, Tremblay P, Gracco VL. 2009. A mediating role of the premotor cortex in phoneme segmentation. Brain Lang. 111:1-7.
72. Scott SK, Blank CC, Rosen S, Wise RJS. 2000. Identification of a pathway for intelligible speech in the left temporal lobe. Brain. 123:2400-2406.
73. Scott SK, McGettigan C, Eisner F. 2009. OPINION a little more conversation, a little less action-candidate roles for the motor cortex in speech perception. Nat Rev Neurosci. 10:295-302.
74. Scott SK, Rosen S, Lang H, Wise RJS. 2006. Neural correlates of intelligibility in speech investigated with noise vocoded speech-a positron emission tomography study. J Acoust Soc Am. 120:1075-1083.
75. Shannon RV, Zeng FG, Kamath V, Wygonski J, Ekelid M. 1995. Speech recognition with primarily temporal cues. Science. 270:303-304.
76. Sohoglu E, Peelle JE, Carlyon RP, Davis MH. 2012. Predictive top-down integration of prior knowledge during speech perception. J Neurosci. 32:8443-8453.
77. Studdert-Kennedy M, Liberman AM, Harris KS, Cooper FS. 1970. Motor theory of speech perception: a reply to Lane's critical review. Psychol Rev. 77:234-249.
78. Studebaker GA. 1985. A "rationalized" arcsine transform. J Speech Hear Res. 28:455-462.
79. Uddin LQ, Molnar-Szakacs I, Zaidel E, Iacoboni M. 2006. rTMS to the right inferior parietal lobule disrupts self-other discrimination. Soc Cogn Affect Neurosci. 1:65-71.
80. Uppenkamp S, Johnsrude IS, Norris D, Marslen-Wilson W, Patterson RD. 2006. Locating the initial stages of speech-sound processing in human temporal cortex. Neuroimage. 31:1284-1296.
81. Von Kriegstein K, Eger E, Kleinschmidt A, Giraud AL. 2003. Modulation of neural responses to speech by directing attention to voices or verbal content. Cogn Brain Res. 17:48-55.
82. Weber MJ, Thompson-schill SL. 2010. Functional neuroimaging can support causal claims about brain function. J Cogn Neurosci. 22:2415-2416.
83. Wessinger CM, VanMeter J, Tian B, Van Lare J, Pekar J, Rauschecker JP. 2001. Hierarchical organization of the human auditory cortex revealed by functional magnetic resonance imaging. J Cogn Neurosci. 13:1-7.
84. Wild CJ, Yusuf A, Wilson DE, Peelle JE, Davis MH, Johnsrude IS. 2012. Effortful listening: the processing of degraded speech depends critically on attention. J Neurosci. 32:14010-14021.
85. Wilson SM, Saygin AP, Sereno MI, Iacoboni M. 2004. Listening to speech activates motor areas involved in speech production. Nat Neurosci. 7:701-702.
86. Zevin J, McCandliss B. 2004. Dishabituation to phonetic stimuli in a "silent" event-related fMRI design. Int J Psychol. 39:102.