Task-dependent decoding of speaker and vowel identity from auditory cortical response patterns

Journal of Neuroscience

Volumn 34, Issue 13, 2014, Pages 4548-4557

  Bonte, Milene ^a   Hausfeld, Lars ^a   Scharke, Wolfgang ^a   Valente, Giancarlo ^a   Formisano, Elia ^a  

^a MAASTRICHT UNIVERSITY   (Netherlands)

Author keywords

Auditory cortex; fMRI decoding; Speech; Voice; Vowels

Indexed keywords

ADULT; ARTICLE; AUDITORY CORTEX; AUDITORY RESPONSE; CHILD; EVOKED CORTICAL RESPONSE; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; MALE; NORMAL HUMAN; PRIORITY JOURNAL; QUESTIONNAIRE; RECOGNITION; REGRESSION ANALYSIS; SCHOOL CHILD; SPEECH; SPEECH DISCRIMINATION; SPEECH PERCEPTION; SUPERIOR TEMPORAL GYRUS; SUPERIOR TEMPORAL SULCUS; TASK PERFORMANCE; TEMPORAL CORTEX; VOWEL; YOUNG ADULT;

AUDITORY CORTEX; FMRI DECODING; SPEECH; VOICE; VOWELS;

ACOUSTIC STIMULATION; ADULT; AUDITORY CORTEX; BRAIN MAPPING; FEMALE; FUNCTIONAL LATERALITY; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; OXYGEN; PHONETICS; PSYCHOACOUSTICS; SOUND SPECTROGRAPHY; SPEECH PERCEPTION; YOUNG ADULT;

EID: 84897890094     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.4339-13.2014     Document Type: Article

References (48)

1. Andics A, McQueen JM, Petersson KM, Gál V, Rudas G, Vidnyánszky Z (2010) Neural mechanisms for voice recognition. Neuroimage 52:1528-1540. CrossRef Medline
2. Annett M (1979) Family handedness in three generations predicted by the right shift theory. Ann Hum Genet 42:479-491. CrossRef Medline
3. Atiani S, Elhilali M, David SV, Fritz JB, Shamma SA (2009) Task difficulty and performance induce diverse adaptive patterns in gain and shape of primary auditory cortical receptive fields. Neuron 61:467-480. CrossRef Medline
4. Baumann O, Belin P (2010) Perceptual scaling of voice identity: common dimensions for different vowels and speakers. Psychol Res 74:110-120. CrossRef Medline
5. Belin P, Zatorre RJ (2003) Adaptation to speaker's voice in right anterior temporal lobe. Neuroreport 14:2105-2109. CrossRef Medline
6. Belin P, Zatorre RJ, Lafaille P, Ahad P, Pike B (2000) Voice-selective areas in human auditory cortex. Nature 403:309-312. CrossRef Medline
7. Bennett S, Weinberg B (1979) Acoustic correlates of perceived sexual identity in preadolescent children's voices. J Acoust Soc Am 66:989-1000. CrossRef Medline
8. Binder JR, Frost JA, Hammeke TA, Bellgowan PS, Springer JA, Kaufman JN, Possing ET (2000) Human temporal lobe activation by speech and nonspeech sounds. Cereb Cortex 10:512-528. CrossRef Medline
9. Boersma P, Weenink D (2002) Praat 4.0: a system for doing phonetics with the computer [Computer software]. Amsterdam: Universiteit van Amsterdam.
10. Bonte M, Valente G, Formisano E (2009) Dynamic and task-dependent encoding of speech and voice by phase reorganization of cortical oscillations. J Neurosci 29:1699-1706. CrossRef Medline
11. Bonte M, Frost MA, Rutten S, Ley A, Formisano E, Goebel R (2013) Development from childhood to adulthood increases morphological and functional inter-individual variability in the right superior temporal cortex. Neuroimage 83:739-750. CrossRef Medline
12. Brechmann A, Scheich H (2005) Hemispheric shifts of sound representation in auditory cortex with conceptual listening. Cereb Cortex 15:578-587. CrossRef Medline
13. Davis MH, Johnsrude IS (2003) Hierarchical processing in spoken language comprehension. J Neurosci 23:3423-3431. Medline
14. Duncan J, Owen AM (2000) Common regions of the human frontal lobe recruited by diverse cognitive demands. Trends Neurosci 23:475-483. CrossRef Medline
15. Eisner F, McGettigan C, Faulkner A, Rosen S, Scott SK (2010) Inferior frontal gyrus activation predicts individual differences in perceptual learning of cochlear-implant simulations. J Neurosci 30:7179-7186. CrossRef Medline
16. Euston DR, Gruber AJ, McNaughton BL (2012) The role of medial prefrontal cortex in memory and decision making. Neuron 76:1057-1070. CrossRef Medline
17. Forman SD, Cohen JD, Fitzgerald M, Eddy WF, Mintun MA, Noll DC (1995) Improved assessment of significant activation in functional magnetic resonance imaging (f MRI): use of a cluster-size threshold. Magn Reson Med 33:636-647. CrossRef Medline
18. Formisano E, De Martino F, Bonte M, Goebel R (2008) "Who" is saying "what"? Brain-based decoding of human voice and speech. Science 322: 970-973. CrossRef Medline
19. Fritz J, Shamma S, Elhilali M, Klein D (2003) Rapid task-related plasticity of spectrotemporal receptive fields in primary auditory cortex. Nat Neurosci 6:1216-1223. CrossRef Medline
20. Frost MA, Goebel R (2012) Measuring structural-functional correspondence: spatial variability of specialised brain regions after macroanatomical alignment. Neuroimage 59:1369-1381. CrossRef Medline
21. Goebel R, Esposito F, Formisano E (2006) Analysis of functional image analysis contest (FIAC) data with brainvoyager QX: From single-subject to cortically aligned group general linear model analysis and selforganizing group independent component analysis. Hum Brain Mapp 27:392-401. CrossRef Medline
22. Good P (2000) Permutation tests: a practical guide to resampling methods for testing hypotheses. New York: Springer.
23. Hausfeld L, De Martino F, Bonte M, Formisano E (2012) Pattern analysis of EEG responses to speech and voice: influence of feature grouping. Neuroimage 59:3641-3651. CrossRef Medline
24. Hickok G, Poeppel D (2007) The cortical organization of speech processing. Nat Rev Neurosci 8:393-402. CrossRef Medline
25. Jäncke L, Wüstenberg T, Scheich H, Heinze HJ (2002) Phonetic perception and the temporal cortex. Neuroimage 15:733-746. CrossRef Medline
26. Kilian-Hütten N, Valente G, Vroomen J, Formisano E (2011a) Auditory cortex encodes the perceptual interpretation of ambiguous sound. J Neurosci 31:1715-1720. CrossRef Medline
27. Kilian-Hütten N, Vroomen J, Formisano E (2011b) Brain activation during audiovisual exposure anticipates future perception of ambiguous speech. Neuroimage 57:1601-1607. CrossRef Medline
28. Kohonen T (2001) Self-organizing maps. Berlin: Springer.
29. Latinus M, McAleer P, Bestelmeyer PE, Belin P (2013) Norm-based coding of voice identity in human auditory cortex. Curr Biol 23:1075-1080. CrossRef Medline
30. Lattner S, Meyer ME, Friederici AD (2005) Voice perception: Sex, pitch, and the right hemisphere. Hum Brain Mapp 24:11-20. CrossRef Medline
31. Lee YS, Turkeltaub P, Granger R, Raizada RD (2012) Categorical speech processing in Broca's area: an f MRI study using multivariate patternbased analysis. J Neurosci 32:3942-3948. CrossRef Medline
32. Ley A, Vroomen J, Hausfeld L, Valente G, De Weerd P, Formisano E (2012) Learning of new sound categories shapes neural response patterns in human auditory cortex. J Neurosci 32:13273-13280. CrossRef Medline
33. Linke AC, Vicente-Grabovetsky A, Cusack R (2011) Stimulus-specific suppression preserves information in auditory short-term memory. Proc Natl Acad Sci U S A 108:12961-12966. CrossRef Medline
34. McCulloch CE, Searle SR (2001) Generalized, linear, and mixed models. New York: Wiley.
35. Mesgarani N, Chang EF (2012) Selective cortical representation of attended speaker in multi-talker speech perception. Nature 485:233-236. CrossRef Medline
36. Moerel M, De Martino F, Formisano E (2012) Processing of natural sounds in human auditory cortex: tonotopy, spectral tuning, and relation to voice sensitivity. J Neurosci 32:14205-14216. CrossRef Medline
37. Murry T, Singh S (1980) Multidimensional analysis of male and female voices. J Acoust Soc Am 68:1294-1300. CrossRef Medline
38. Naumer MJ, Doehrmann O, Müller NG, Muckli L, Kaiser J, Hein G (2009) Cortical plasticity of audio-visual object representations. Cereb Cortex 19:1641-1653. CrossRef Medline
39. Obleser J, Eisner F (2009) Pre-lexical abstraction of speech in the auditory cortex. Trends Cogn Sci 13:14-19. CrossRef Medline
40. Obleser J, Kotz SA (2010) Expectancy constraints in degraded speech modulate the language comprehension network. Cereb Cortex 20:633-640. CrossRef Medline
41. Perry TL, Ohde RN, Ashmead DH (2001) The acoustic bases for gender identification from children's voices. J Acoust Soc Am 109:2988-2998. CrossRef Medline
42. Rauschecker JP, Scott SK (2009) Maps and streams in the auditory cortex: nonhuman primates illuminate human speech processing. Nat Neurosci 12:718-724. CrossRef Medline
43. Scott SK, Blank CC, Rosen S, Wise RJ (2000) Identification of a pathway for intelligible speech in the left temporal lobe. Brain 123:2400-2406. CrossRef Medline
44. Staeren N, Renvall H, De Martino F, Goebel R, Formisano E (2009) Sound categories are represented as distributed patterns in the human auditory cortex. Curr Biol 19:498-502. CrossRef Medline
45. van Atteveldt N, Formisano E, Goebel R, Blomert L (2004) Integration of letters and speech sounds in the human brain. Neuron 43:271-282. CrossRef Medline
46. Vapnik VN (1995) The nature of statistical learning theory. New York: Springer.
47. von Kriegstein K, Eger E, Kleinschmidt A, Giraud AL (2003) Modulation of neural responses to speech by directing attention to voices or verbal content. Brain Res Cogn Brain Res 17:48-55. CrossRef Medline
48. von Kriegstein K, Smith DR, Patterson RD, Kiebel SJ, Griffiths TD (2010) Howthe human brain recognizes speech in the context of changing speakers. J Neurosci 30:629-638. CrossRef Medline