Decoding articulatory features from fmri responses in dorsal speech regions

Journal of Neuroscience

Volumn 35, Issue 45, 2015, Pages 15015-15025

  Correia, Joao M ^a   Jansma, Bernadette M B ^a   Bonte, Milene ^a  

^a MAASTRICHT UNIVERSITY   (Netherlands)

Author keywords

Articulatory gestures; Auditory cortex; FMRI; MVPA; Sensorimotor; Speech perception

Indexed keywords

ADULT; ARTICLE; AUDITORY STIMULATION; BOLD SIGNAL; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; LEARNING; MALE; NORMAL HUMAN; PRIORITY JOURNAL; SENSORIMOTOR INTEGRATION; SPEECH ARTICULATION; SPEECH PERCEPTION; VISUAL STIMULATION; AUDITORY CORTEX; AUDITORY NERVOUS SYSTEM; BRAIN MAPPING; NUCLEAR MAGNETIC RESONANCE IMAGING; PHYSIOLOGY; PROCEDURES; SPEECH;

ACOUSTIC STIMULATION; ADULT; AUDITORY CORTEX; AUDITORY PATHWAYS; BRAIN MAPPING; FEMALE; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; SPEECH; SPEECH PERCEPTION;

EID: 84946943929     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.0977-15.2015     Document Type: Article

References (63)

1. Arsenault JS, Buchsbaum BR (2015) Distributed neural representations of phonological features during speech perception. J Neurosci 35:634–642. CrossRef Medline
2. Baddeley A, Gathercole S, Papagno C (1998) The phonological loop as a language learning device. Psychol Rev 105:158-173. CrossRef Medline
3. Belin P, Zatorre RJ, Lafaille P, Ahad P, Pike B (2000) Voice-selective areas in human auditory cortex. Nature 403:309-312. CrossRef Medline
4. Boersma P, Weenink D (2001) Praat: doing phonetics by computer. Glot Int 5:341–347.
5. Bonte M, Hausfeld L, Scharke W, Valente G, Formisano E (2014) Taskdependent decoding of speaker and vowel identity from auditory cortical response patterns. J Neurosci 34:4548–4557. CrossRef Medline
6. Bouchard KE, Chang EF (2014) Control of spoken vowel acoustics and the influence of phonetic context in human speech sensorimotor cortex. J Neurosci 34:12662–12677. CrossRef Medline
7. Bouchard KE, Mesgarani N, Johnson K, Chang EF (2013) Functional organization of human sensorimotor cortex for speech articulation. Nature 495:327–332. CrossRef Medline
8. Buchsbaum BR, Baldo J, Okada K, Berman KF, Dronkers N, D’Esposito M, Hickok G (2011) Conduction aphasia, sensory-motor integration, and phonological short-term memory: an aggregate analysis of lesion and fMRI data. Brain Lang 119:119-128. CrossRef Medline
9. Buchweitz A, Shinkareva SV, Mason RA, Mitchell TM, Just MA (2012) Identifying bilingual semantic neural representations across languages. Brain Lang 120:282–289. CrossRef Medline
10. Caplan D, Waters GS (1995) Onthe nature of the phonological output planning processes involved in verbal rehearsal: evidence from aphasia. Brain Lang 48:191–220. CrossRef Medline
11. Chen Y, Namburi P, Elliott LT, Heinzle J, Soon CS, Chee MW, Haynes JD (2011) Cortical surface-based searchlight decoding. Neuroimage 56: 582–592. CrossRef Medline
12. Cogan GB, Thesen T, Carlson C, Doyle W, Devinsky O, Pesaran B (2014) Sensory-motor transformations for speech occur bilaterally. Nature 507: 94–98. CrossRef Medline
13. Correia JM, Jansma B, Hausfeld L, Kikkert S, Bonte M (2015) EEG decoding of spoken words in bilingual listeners: from words to language invariant semantic-conceptual representations. Front Psychol 6:1–10. CrossRef Medline
14. Correia J, Formisano E, Valente G, Hausfeld L, Jansma B, Bonte M (2014) Brain-based translation: fMRI decoding of spoken words in bilinguals reveals language-independent semantic representations in anterior temporal lobe. J Neurosci 34:332–338. CrossRef Medline
15. D’Ausilio A, Pulvermüller F, Salmas P, Bufalari I, Begliomini C, Fadiga L (2009) The motor somatotopy of speech perception. Curr Biol 19: 381–385. CrossRef Medline
16. De Martino F, Valente G, Staeren N, Ashburner J, Goebel R, Formisano E (2008) Combining multivariate voxel selection and support vector machines for mapping and classification of fMRI spatial patterns. Neuroimage 43:44-58. CrossRef Medline
17. Dick AS, Bernal B, Tremblay P (2014) The language connectome: new pathways, new concepts. Neuroscientist 20:453-467. CrossRef Medline
18. Du Y, Buchsbaum BR, Grady CL, Alain C (2014) Noise differentially impacts phoneme representations in the auditory and speech motor systems. Proc Natl Acad Sci U S A 111:7126-7131. CrossRef Medline
19. Etzel JA, Zacks JM, Braver TS (2013) Searchlight analysis: promise, pitfalls, and potential. Neuroimage 78:261–269. CrossRef Medline
20. Evans S, Davis MH (2015) Hierarchical organization of auditory and motor representations in speech perception: evidence from searchlight similarity analysis. Cereb Cortex. Advance online publication. Retrieved Jul. 8, 2015. doi: 10.1093/cercor/bhv136. CrossRef Medline
21. Forman SD, Cohen JD, Fitzgerald M, Eddy WF, Mintun MA, Noll DC (1995) Improved assessment of significant activation in functional magnetic resonance imaging (fMRI): use of a cluster size threshold. Magn Reson Med 33:636–647. CrossRef Medline
22. Formisano E, De Martino F, Bonte M, Goebel R (2008) “Who” is saying “what?” Brain-based decoding of human voice and speech. Science 322: 970–973. CrossRef Medline
23. Frost MA, Goebel R (2012) Measuring structural-functional correspondence: spatial variability of specialised brain regions after macroanatomical alignment. Neuroimage 59:1369-1381. CrossRef Medline
24. Galantucci B, Fowler CA, Turvey MT (2006) The motor theory of speech perception reviewed. Psychon Bull Rev 13:361–377. CrossRef Medline
25. Glasser MF, Rilling JK (2008) DTI tractography of the human brain’s language pathways. Cereb. Cortex 18:2471–2482. CrossRef Medline
26. Goebel R, Esposito F, Formisano E (2006) Analysis of functional image analysis contest (FIAC) data with brainvoyager QX: from single-subject to cortically aligned group general linear model analysis and self-organizing group independent component analysis. Hum. Brain Mapp 27:392-401. CrossRef Medline
27. Guenther FH, Vladusich T (2012) A neural theory of speech acquisition and production. J Neurolinguistics 25:408–422. CrossRef Medline
28. Hagler DJ Jr, Saygin AP, Sereno MI (2006) Smoothing and cluster thresholding for cortical surface-based group analysis of fMRI data. Neuroimage 33:1093–1103. CrossRef Medline
29. Hervais-Adelman AG, Carlyon RP, Johnsrude IS, Davis MH (2012) Brain regions recruited for the effortful comprehension of noise-vocoded words. Lang Cogn Process 27:1145–1166. CrossRef
30. Hickok G (2009) Eight problems for the mirror neuron theory of action understanding in monkeys and humans. J Cogn Neurosci 21:1229-1243. CrossRef Medline
31. Hickok G, Poeppel D (2007) The cortical organization of speech processing. Nat Rev Neurosci 8:393-402. CrossRef Medline
32. Hickok G, Buchsbaum B, Humphries C, Muftuler T (2003) Auditorymotor interaction revealed by fMRI: speech, music, and working memory in area Spt. J Cogn Neurosci 15:673-682. CrossRef Medline
33. Hickok G, Okada K, Serences JT (2009) Area Spt in the human planum temporale supports sensory-motor integration for speech processing. J Neurophysiol 101:2725–2732. CrossRef Medline
34. Hickok G, Houde J, Rong F (2011) Sensorimotor integration in speech processing: computational basis and neural organization. Neuron 69:407–422. CrossRef Medline
35. Houde JF, Nagarajan SS (2011) Speech production as state feedback control. Front Hum Neurosci 5:82. CrossRef Medline
36. Jacquemot C, Scott S (2006) What is the relationship between phonological short-term memory and speech processing? Trends Cogn Sci 10:480–486. CrossRef Medline
37. Kilian-Hütten N, Valente G, Vroomen J, Formisano E (2011) Auditory cortex encodes the perceptual interpretation of ambiguous sound. J Neurosci 31:1715–1720. CrossRef Medline
38. Krieger-Redwood K, Gaskell MG, Lindsay S, Jefferies E (2013) The selective role of premotor cortex in speech perception: a contribution to phoneme judgments but not speech comprehension. J Cogn Neurosci 25:2179–2188. CrossRef Medline
39. Kriegeskorte N, Goebel R, Bandettini P (2006) Information-based functional brain mapping. Proc Natl Acad Sci U S A 103:3863–3868. CrossRef Medline
40. Ladefoged P, Johnson K (2010) A course in phonetics, Ed 6. Boston: Cengage Learning.
41. Lee YS, Turkeltaub P, Granger R, Raizada RD (2012) Categorical speech processing in Broca’s area: an fMRI study using multivariate patternbased analysis. J Neurosci 32:3942–3948. CrossRef Medline
42. Ley A, Vroomen J, Hausfeld L, Valente G, De Weerd P, Formisano E (2012) Learning of new sound categories shapes neural response patterns in human auditory cortex. J Neurosci 32:13273–13280. CrossRef Medline
43. Liberman AM, Mattingly IG (1985) The motor theory of speech perception revised. Cognition 21:1–36. CrossRef Medline
44. Makris N, Preti MG, Asami T, Pelavin P, Campbell B, Papadimitriou GM, Kaiser J, Baselli G, Westin CF, Shenton ME, Kubicki M (2013) Human middle longitudinal fascicle: variations in patterns of anatomical connections. Brain Struct Funct 218:951–968. CrossRef Medline
45. Meister I, Wilson S, Deblieck C, Wu A, Locoboni M (2007) The essential role of premotor cortex in speech perception. Curr Biol 17:1692–1696. CrossRef Medline
46. Merrill J, Sammler D, Bangert M, Goldhahn D, Lohmann G, Turner R, Friederici AD (2012) Perception of words and pitch patterns in song and speech. Front Psychol 3:1–13. CrossRef Medline
47. Mesgarani N, Cheung C, Johnson K, Chang EF (2014) Phonetic feature encoding in human superior temporal gyrus. Science 343:1006-1010. CrossRef Medline
48. Moser D, Baker JM, Sanchez CE, Rorden C, Fridriksson J (2009) Temporal order processing of syllables in the left parietal lobe. J Neurosci 29:12568–12573. CrossRef Medline
49. Nestor A, Plaut DC, Behrmann M (2011) Unraveling the distributed neural code of facial identity through spatiotemporal pattern analysis. Proc Natl Acad Sci U S A 108:9998-10003. CrossRef Medline
50. Norman KA, Polyn SM, Detre GJ, Haxby JV (2006) Beyond mind-reading: multi-voxel pattern analysis of fMRI data. Trends Cogn Sci 10:424–430. CrossRef Medline
51. Oosterhof NN, Wiestler T, Downing PE, Diedrichsen J (2011) A comparison of volume-based and surface-based multi-voxel pattern analysis. Neuroimage 56:593-600. CrossRef Medline
52. Petkov CI, Kayser C, Steudel T, Whittingstall K, Augath M, Logothetis NK (2008) A voice region in the monkey brain. Nat Neurosci 11:367–374. CrossRef Medline
53. Pulvermüller F, Fadiga L (2010) Active perception: sensorimotor circuits as a cortical basis for language. Nat Rev Neurosci 11:351–360. CrossRef Medline
54. Pulvermüller F, Huss M, Kherif F, Moscoso del Prado Martin F, Hauk O, Shtyrov Y (2006) Motor cortex maps articulatory features of speech sounds. Proc Natl Acad Sci U S A 103:7865–7870. CrossRef Medline
55. Raizada RD, Poldrack RA (2007) Selective amplification of stimulus differences during categorical processing of speech. Neuron 56:726-740. CrossRef Medline
56. Rietveld ACM, van Heuven VJJP (2001) Algemene Fonetiek, Ed 2. Bussum, The Netherlands: Coutinho.
57. Schomers MR, Kirilina E, Weigand A, Bajbouj M, Pulvermüller F (2014) Causal influence of articulatory motor cortex on comprehending single spoken words: TMSevidence. Cereb. Cortex 25:3894–3902. CrossRef Medline
58. Seltzer B, Pandya DN (1984) Further observations on parieto-temporal connections in the rhesus monkey. Exp Brain Res 55:301–312. Medline
59. Shinkareva SV, Malave VL, Mason RA, Mitchell TM, Just MA (2011) Commonality of neural representations of words and pictures. Neuroimage 54:2418-2425. CrossRef Medline
60. Simanova I, Hagoort P, Oostenveld R, van Gerven MAJ (2014) Modalityindependent decoding of semantic information from the human brain. Cereb Cortex 24:26–434. CrossRef Medline
61. Talairach J, Tournoux P (1988) Co-planar stereotaxic atlas of the human brain. Stuttgart: Thieme.
62. Wilson S, Saygin A, Sereno M, Lacoboni M (2004) Listening to speech activates motor areas involved in speech production. Nat Neurosci 7:701–702. CrossRef Medline
63. Zatorre RJ, Evans AC, Meyer E, Gjedde A (1992) Lateralization of phonetic and pitch discrimination in speech processing. Science 256:846–849. CrossRef Medline