How the human brain recognizes speech in the context of changing speakers

Journal of Neuroscience

Volumn 30, Issue 2, 2010, Pages 629-638

  Von Kriegstein, Katharina ^a,b,c   Smith, David R R ^d,e   Patterson, Roy D ^e   Kiebel, Stefan J ^a,c   Griffiths, Timothy D ^a,b  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b NEWCASTLE UNIVERSITY   (United Kingdom)

^c MAX PLANCK INSTITUTE FOR HUMAN COGNITIVE AND BRAIN SCIENCES   (Germany)

^d UNIVERSITY OF HULL   (United Kingdom)

^e UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; AUDITORY CORTEX; BRAIN; BRAIN CORTEX; CINGULATE GYRUS; FEMALE; HUMAN; INFORMATION PROCESSING; LEFT HEMISPHERE; MALE; NUCLEAR MAGNETIC RESONANCE IMAGING; PRIORITY JOURNAL; RIGHT HEMISPHERE; SPEECH; SPEECH DISCRIMINATION; SUBICULUM; VOCALIZATION;

ACOUSTIC STIMULATION; ADULT; ANALYSIS OF VARIANCE; BRAIN; BRAIN MAPPING; ECHO-PLANAR IMAGING; FUNCTIONAL LATERALITY; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; NEURAL PATHWAYS; OXYGEN; REACTION TIME; RECOGNITION (PSYCHOLOGY); SPEECH; SPEECH PERCEPTION; YOUNG ADULT;

EID: 74949119753     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.2742-09.2010     Document Type: Article

References (72)

1. Abercrombie D (1967) Elements of general phonetics. Edinburgh: Edinburgh UP.
2. Abrams DA, Nicol T, Zecker S, Kraus N (2008) Right-hemisphere auditory cortex is dominant for coding syllable patterns in speech. J Neurosci 28:3958-3965.
3. Adank P, Devlin JT (2010) On-line plasticity in spoken sentence comprehension: adapting to time-compressed speech. Neuroimage 49:1124-1132.
4. Adank P, van Hout R, Smits R (2004) An acoustic description of the vowels of Northern and Southern Standard Dutch. J Acoust Soc Am 116: 1729-1738.
5. Ames H, Grossberg S (2008) Speaker normalization using cortical strip maps: a neural model for steady-state vowel categorization. J Acoust Soc Am 124:3918-3936.
6. Balaguer-Ballester E, Clark NR, Coath M, Krumbholz K, Denham SL (2009) Understanding pitch perception as a hierarchical process with top-down modulation. PLoS Comput Biol 5:e1000301.
7. Belin P, Fecteau S, Bédard C (2004) Thinking the voice: neural correlates of voice perception. Trends Cogn Sci 8:129-135.
8. Bendor D, Wang X (2005) The neuronal representation of pitch in primate auditory cortex. Nature 436:1161-1165.
9. Bizley JK, Walker KM, Silverman BW, King AJ, Schnupp JW (2009) Interdependent encoding of pitch, timbre, and spatial location in auditory cortex. J Neurosci 29:2064-2075.
10. BoatmanD (2004) Cortical bases of speech perception: evidence from functional lesion studies. Cognition 92:47-65.
11. Boatman D, Hart J Jr, Lesser RP, Honeycutt N, Anderson NB, Miglioretti D, Gordon B (1998) Right hemisphere speech perception revealed by amobarbital injection and electrical interference. Neurology 51:458-464.
12. Boatman DF, Lesser RP, Crone NE, Krauss G, Lenz FA, Miglioretti DL (2006) Speech recognition impairments in patients with intractable right temporal lobe epilepsy. Epilepsia 47:1397-1401.
13. Boemio A, Fromm S, Braun A, Poeppel D (2005) Hierarchical and asymmetric temporal sensitivity in human auditory cortices. Nat Neurosci 8:389-395.
14. Bonte M, Parviainen T, Hytönen K, Salmelin R (2006) Time course of topdown and bottom-up influences on syllable processing in the auditory cortex. Cereb Cortex 16:115-123.
15. Creelman CD (1957) Case of the unknown talker. J Acoust Soc Am 29:655-655.
16. Deng L, Dong Y, Acero A (2006) Structured speech modeling. IEEE Trans Audio Speech Lang Processing 14:1492-1504.
17. Desai R, Liebenthal E, Waldron E, Binder JR (2008) Left posterior temporal regions are sensitive to auditory categorization. J Cogn Neurosci 20:1174-1188.
18. Evans AC, Collins DL, Mills SR, Brown ED, Kelly RL, Phinney RE (1993) 3D statistical neuroanatomical models from 305 MRI volumes. Proc IEEE Nucl Sci Symp Med Imag Conf 3:1813-1817.
19. Friederici AD (2002) Towards a neural basis of auditory sentence processing. Trends Cogn Sci 6:78-84.
20. Friston K (2005) A theory of cortical responses. Philos Trans R Soc Lond B Biol Sci 360:815-836.
21. Friston KJ, Ashburner J, Frith CD, Poline JB, Heather JD, Frackowiak RSJ (1995a) Spatial registration and normalisation of images. Hum Brain Mapp 2:165-189.
22. Friston KJ, Holmes AP, Worsley KJ, Poline JP, Frith CD, Frackowiak RSJ (1995b) Statistical parametric maps in functional imaging: a general linear approach. Hum Brain Mapp 2:189-210.
23. Friston KJ, Buechel C, Fink GR, Morris J, Rolls E, Dolan RJ (1997) Psychophysiological and modulatory interactions in neuroimaging. Neuroimage 6:218-229.
24. Fujimura O, Lindqvist J (1971) Sweep-tone measurements of vocal-tract characteristics. J Acoust Soc Am 49:Suppl 2:541+.
25. Giraud AL, Kleinschmidt A, Poeppel D, Lund TE, Frackowiak RS, Laufs H (2007) Endogenous cortical rhythms determine cerebral specialization for speech perception and production. Neuron 56:1127-1134.
26. Goldinger SD (1996) Words and voices: episodic traces in spoken word identification and recognition memory. J Exp Psychol Learn Mem Cogn 22:1166-1183.
27. Griffiths TD, Uppenkamp S, Johnsrude I, Josephs O, Patterson RD (2001) Encoding of the temporal regularity of sound in the human brainstem. Nat Neurosci 4:633-637.
28. Hall DA, Haggard MP, Akeroyd MA, Palmer AR, Summerfield AQ, Elliott MR, Gurney EM, Bowtell RW (1999) "Sparse" temporal sampling in auditory fMRI. Hum Brain Mapp 7:213-223.
29. Hickok G, PoeppelD (2000) Towards a functional neuroanatomy of speech perception. Trends Cogn Sci 4:131-138.
30. Hickok G, PoeppelD (2007) The cortical organization of speech processing. Nat Rev Neurosci 8:393-402.
31. Johnson K (2005) Speaker normalization in speech perception. In: The handbook of speech perception (Pisoni DB, Remez RE, eds), pp 363-389. Oxford: Blackwell Publishing.
32. Joos M (1948) Acoustic phonetics. Language 24:1-136.
33. Kaas JH, Hackett TA (2000) Subdivisions of auditory cortex and processing streams in primates. Proc Natl Acad Sci U S A 97:11793-11799.
34. Kawahara H, Masuda-Kasuse I, de Cheveigne A (1999) Restructuring speech representations using pitch-adaptive time-frequency smoothing and instantaneous-frequency-based F0 estraction: possible role of repetitive structure in sounds. Speech Commun 27:187-207.
35. Kawahara H, Irino T, Divenyi P (2004) Underlying prinicples of a high-quality speech manipulation system STRAIGHT and its application to speech segregation. In: Speech separation by humans and machines, pp 167-180. Norwell, MA: Kluwer Academic.
36. Kiebel SJ, Daunizeau J, Friston KJ (2008) A hierarchy of time-scales and the brain. PLoS Comput Biol 4:e1000209.
37. Kiebel SJ, von Kriegstein K, Daunizeau J, Friston KJ (2009) Recognizing sequences of sequences. PLoS Comput Biol 5:e1000464.
38. Knill D, Kersten D, Yuille A, Richards W (1998) Introduction: a Bayesian formulation of visual perception. In: Perception as Bayesian inference, pp 1-21. Cambridge, UK: Cambridge UP.
39. Ladefoged P, Broadbent DE (1957) Information conveyed by vowels. J Acoust Soc Am 29:98-104.
40. Lavner Y, Gath I, Rosenhouse J (2000) The effects of acoustic modifications on the identification of familiar voices speaking isolated vowels. Speech Commun 30:9-26.
41. Leff AP, Schofield TM, Stephan KE, Crinion JT, Friston KJ, Price CJ (2008) The cortical dynamics of intelligible speech. J Neurosci 28:13209-13215.
42. Lewis JW, Talkington WJ, Walker NA, Spirou GA, Jajosky A, Frum C, Brefczynski-Lewis JA (2009) Human cortical organization for processing vocalizations indicates representation of harmonic structure as a signal attribute. J Neurosci 29:2283-2296.
43. Morosan P, Rademacher J, Schleicher A, Amunts K, Schormann T, Zilles K (2001) Human primary auditory cortex: cytoarchitectonic subdivisions and mapping into a spatial reference system. Neuroimage 13:684-701.
44. Mullennix JW, Pisoni DB, Martin CS (1989) Some effects of talker variability on spoken word recognition. J Acoust Soc Am 85:365-378.
45. Nearey TM (1989) Static, dynamic, and relational properties in vowel perception. J Acoust Soc Am 85:2088-2113.
46. Nelken I, Bar-Yosef O (2008) Neurons and objects: the case of auditory cortex. Front Neurosci 2:107-113.
47. Obleser J, Eisner F (2009) Pre-lexical abstraction of speech in the auditory cortex. Trends Cogn Sci 13:14-19.
48. O'Shaughnessy D (2008) Invited paper: automatic speech recognition: history, methods and challenges. Pattern Recognit 41:2965-2979.
49. O'Toole AJ, Roark DA, AbdiH (2002) Recognizing moving faces: a psychological and neural synthesis. Trends Cogn Sci 6:261-266.
50. Overath T, Cusack R, Kumar S, von Kriegstein K, Warren JD, Grube M, Carlyon RP, Griffiths TD (2007) An information theoretic characterisation of auditory encoding. PLoS Biol 5:e288.
51. Overath T, Kumar S, von Kriegstein K, Griffiths TD (2008) Encoding of spectral correlation over time in auditory cortex. J Neurosci 28: 13268-13273.
52. Patterson RD, Uppenkamp S, Johnsrude IS, Griffiths TD (2002) The processing of temporal pitch and melody information in auditory cortex. Neuron 36:767-776.
53. Penagos H, Melcher JR, Oxenham AJ (2004) A neural representation of pitch salience in nonprimary human auditory cortex revealed with functional magnetic resonance imaging. J Neurosci 24:6810-6815.
54. Pisoni DB (1997) Some thoughts on "normalization" in speech perception. In: Talker variability in speech processing (Johnson K, Mullenix JW, eds), pp 9-32. San Diego: Academic.
55. Poeppel D (2003) The analysis of speech in different temporal integration windows: cerebral lateralization as "asymmetric sampling in time." Speech Commun 41:245-255.
56. Puce A, Allison T, Bentin S, Gore JC, McCarthy G (1998) Temporal cortex activation in humans viewing eye and mouth movements. J Neurosci 18:2188-2199.
57. Rao RP, Ballard DH (1999) Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nat Neurosci 2:79-87.
58. Scott SK (2005) Auditory processing: speech, space and auditory objects. Curr Opin Neurobiol 15:197-201.
59. Summerfield C, Egner T, Greene M, Koechlin E, Mangels J, Hirsch J (2006) Predictive codes for forthcoming perception in the frontal cortex. Science 314:1311-1314.
60. Sussman HM (1986) A neuronal model of vowel normalization and representation. Brain Lang 28:12-23.
61. Turner RE, Walters TC, Monaghan JJ, Patterson RD (2009) A statistical formant-pattern model for estimating vocal-tract length from formant frequency data. J Acoust Soc Am 125:2374-2386.
62. Vigneau M, Beaucousin V, Hervé PY, Duffau H, Crivello F, Houdé O, Mazoyer B, Tzourio-MazoyerN (2006) Meta-analyzing left hemisphere language areas: phonology, semantics, and sentence processing. Neuro-image 30:1414-1432.
63. von Kriegstein K, Giraud AL (2004) Distinct functional substrates along the right superior temporal sulcus for the processing of voices. Neuroimage 22:948-955.
64. von Kriegstein K, Giraud AL (2006) Implicit multisensory associations influence voice recognition. PLoS Biol 4:e326.
65. von Kriegstein K, Eger E, Kleinschmidt A, Giraud AL (2003) Modulation of neural responses to speech by directing attention to voices or verbal content. Brain Res Cogn Brain Res 17:48-55.
66. von Kriegstein K, Warren JD, Ives DT, Patterson RD, Griffiths TD (2006) Processing the acoustic effect of size in speech sounds. Neuroimage 32:368-375.
67. von Kriegstein K, Smith DR, Patterson RD, Ives DT, Griffiths TD (2007) Neural representation of auditory size in the human voice and in sounds from other resonant sources. Curr Biol 17:1123-1128.
68. von Kriegstein K, Dogan O, Grüter M, Giraud AL, Kell CA, Grüter T, Kleinschmidt A, Kiebel SJ (2008) Simulation of talking faces in the human brain improves auditory speech recognition. Proc Natl Acad Sci U S A 105:6747-6752.
69. Welling L, Ney H, Kanthak S (2002) Speaker adaptive modeling by vocal tract normalization. IEEE Trans Speech Audio Process 10:415-426.
70. Wolpert DM, Ghahramani Z, Jordan MI (1995) An internal model for sensorimotor integration. Science 269:1880-1882.
71. Wong PC, Diehl RL (2003) Perceptual normalization for inter- and intratalker variation in Cantonese level tones. J Speech Lang Hear Res 46:413-421.
72. Wong PC, Nusbaum HC, Small SL (2004) Neural bases of talker normalization. J Cogn Neurosci 16:1173-1184.