Abstract encoding of auditory objects in cortical activity patterns

Cerebral Cortex

Volumn 23, Issue 9, 2013, Pages 2025-2037

  Giordano, Bruno L ^a,b   McAdams, Stephen ^b   Zatorre, Robert J ^c   Kriegeskorte, Nikolaus ^d   Belin, Pascal ^a,e  

^a UNIVERSITY OF GLASGOW   (United Kingdom)

^b MCGILL UNIVERSITY   (Canada)

^c MCGILL UNIVERSITY   (Canada)

^d MRC COGNITION AND BRAIN SCIENCES UNIT   (United Kingdom)

^e UNIVERSITÉ DE MONTRÉAL   (Canada)

Author keywords

categorization; condition rich design; fMRI; multivariate information based mapping; temporal cortex

Indexed keywords

ADRENAL CORTEX; ADULT; ARTICLE; AUDITORY MEMORY; EPISODIC MEMORY; EVOKED AUDITORY RESPONSE; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; LOUDNESS; MALE; MULTIVARIATE ANALYSIS; NORMAL HUMAN; PITCH; PRIORITY JOURNAL; SOUND DETECTION; SOUND INTENSITY; SPATIAL DISCRIMINATION; VOCALIZATION;

CATEGORIZATION; CONDITION-RICH DESIGN; FMRI; MULTIVARIATE INFORMATION-BASED MAPPING; TEMPORAL CORTEX;

ACOUSTIC STIMULATION; ADULT; AUDITORY PERCEPTION; CEREBRAL CORTEX; FEMALE; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; TEMPORAL LOBE; YOUNG ADULT;

EID: 84880936385     PISSN: 10473211     EISSN: 14602199     Source Type: Journal    
DOI: 10.1093/cercor/bhs162     Document Type: Article

References (107)

1. Ahissar M, Nahum M, Nelken I, Hochstein S. 2009. Reverse hierarchies and sensory learning. Philos Trans R Soc B. 364:285-299.
2. Altmann CF, Doehrmann O, Kaiser J. 2007. Selectivity for animal vocalizations in the human auditory cortex. Cereb Cortex. 17:2601-2608.
3. Altmann CF, Júnior CGO, Heinemann L, Kaiser J. 2010. Processing of spectral and amplitude envelope of animal vocalizations in the human auditory cortex. Neuropsychologia. 48:2824-2832.
4. Asari H, Zador A. 2009. Long-lasting context dependence constrains neural encoding models in rodent auditory cortex. J Neurophysiol. 102:2638-2656.
5. Bar-Yosef O, Nelken I. 2007. The effects of background noise on the neural responses to natural sounds in cat primary auditory cortex. Front Comput Neurosci. 1:3.
6. Belin P, Zatorre RJ, Ahad P. 2002. Human temporal-lobe response to vocal sounds. Cogn Brain Res. 13:17-26.
7. Belin P, Zatorre RJ, Lafaille P, Ahad P, Pike B. 2000. Voice-selective areas in human auditory cortex. Nature. 403:309-312.
8. Belin P, Zilbovicius M, Crozier S, Thivard L, Fontaine A, Masure MC, Samson Y. 1998. Lateralization of speech and auditory temporal processing. J Cogn Neurosci. 10:536-540.
9. Bendor D, Wang X. 2006. Cortical representations of pitch in monkeys and humans. Curr Opin Neurobiol. 16:391-399.
10. Bizley J, Walker K. 2010. Sensitivity and selectivity of neurons in auditory cortex to the pitch, timbre, and location of sounds. Neuroscientist. 16:453-469.
11. Bizley J, Walker K, Silverman B, King A, Schnupp J. 2009. Interdependent encoding of pitch, timbre, and spatial location in auditory cortex. J Neurosci. 29:2064-2075.
12. Boemio A, Fromm S, Braun A, Poeppel D. 2005. Hierarchical and asymmetric temporal sensitivity in human auditory cortices. Nat Neurosci. 8:389-395.
13. Boersma P, Weenink D. 2009. Praat: doing phonetics by computer version 5.1.05 [computer program]. http://www.fon.hum.uva.nl/praat/. Last date retrieved 1 May 2009.
14. Brechmann A, Baumgart F, Scheich H. 2002. Sound-level-dependent representation of frequency modulations in human auditory cortex: a low-noise fMRI study. J Neurophysiol. 87:423-433.
15. Chechik G, Anderson M, Bar-Yosef O, Young E, Tishby N, Nelken I. 2006. Reduction of information redundancy in the ascending auditory pathway. Neuron. 51:359-368.
16. Davis M, Johnsrude I. 2003. Hierarchical processing in spoken language comprehension. J Neurosci. 23:3423-3431.
17. De Lucia M, Clarke S, Murray MM. 2010. A temporal hierarchy for conspecific vocalization discrimination in humans. J Neurosci. 30:11210-11221
18. Desai R, Liebenthal E, Waldron E, Binder J. 2008. Left posterior temporal regions are sensitive to auditory categorization. J Cogn Neurosci. 20:1174-1188.
19. Doehrmann O, Naumer MJ, Volz S, Kaiser J, Altmann CF. 2008. Probing category selectivity for environmental sounds in the human auditory brain. Neuropsychologia. 46:2776-2786.
20. Engel L, Frum C, Puce A, Walker N, Lewis J. 2009. Different categories of living and non-living sound-sources activate distinct cortical networks. Neuroimage. 47:1778-1791.
21. Ernst S, Verhey J, Uppenkamp S. 2008. Spatial dissociation of changes of level and signal-to-noise ratio in auditory cortex for tones in noise. Neuroimage. 43:321-328.
22. Ethofer T, Van De Ville D, Scherer K, Vuilleumier P. 2009. Decoding of emotional information in voice-sensitive cortices. Curr Biol. 19:1028-1033.
23. Fecteau S, Armony JL, Joanette Y, Belin P. 2004. Is voice processing species-specific in human auditory cortex? An fMRI study. Neuroimage. 23:840-848.
24. Fecteau S, Armony JL, Joanette Y, Belin P. 2005. Sensitivity to voice in human prefrontal cortex. J Neurophysiol. 94:2251-2254.
25. Formisano E, De Martino F, Bonte M, Goebel R. 2008. "Who" is saying" what"? Brain-based decoding of human voice and speech. Science. 322:970-973.
26. Foster NEV, Zatorre RJ. 2010. A role for the intraparietal sulcus in transforming musical pitch information. Cereb Cortex. 20:1350-1359.
27. Galati G, Committeri G, Spitoni G, Aprile T, Di Russo F, Pitzalis S, Pizzamiglio L. 2008. A selective representation of the meaning of actions in the auditory mirror system. Neuroimage. 40:1274-1286.
28. Gervais H, Belin P, Boddaert N, Leboyer M, Coez A, Sfaello I, Barthélémy C, Brunelle F, Samson Y, Zilbovicius M. 2004. Abnormal cortical voice processing in autism. Nat Neurosci. 7:801-802.
29. Giordano BL, McAdams S. 2006. Material identification of real impact sounds: effects of size variation in steel, glass, wood and plexiglass plates. J Acoust Soc Am. 119:1171-1181.
30. Giordano BL, McDonnell J, McAdams S. 2010. Hearing living symbols and nonliving icons: category-specificities in the cognitive processing of environmental sounds. Brain Cogn. 73:7-19.
31. Giordano BL, Rocchesso D, McAdams S. 2010. Integration of acoustical information in the perception of impacted sound sources: the role of information accuracy and exploitability. J Exp Psychol Hum Percept Perform. 36:462-479.
32. Giusti MA, Bozzacchi C, Pizzamiglio L, Di Russo F. 2010. Sight and sound of actions share a common neural network. Eur J Neurosci. 32:1754-1764.
33. Glasberg BR, Moore BCJ. 2002. A model of loudness applicable to time-varying sounds. J Audio Eng Soc. 50:331-342.
34. Goll JC, Crutch SJ, Warren JD. 2010. Central auditory disorders: toward a neuropsychology of auditory objects. Curr Opin Neurol. 23:617-627.
35. Grandjean D, Sander D, Pourtois G, Schwartz S, Seghier ML, Scherer KR, Vuilleumier P. 2005. The voices of wrath: brain responses to angry prosody in meaningless speech. Nat Neurosci. 8:145-146.
36. Griffiths TD. 2008. Sensory systems: auditory action streams? Curr Biol. 18:R387-R388.
37. Griffiths TD, Warren JD. 2002. The planum temporale as a computational hub. Trends Neurosci. 25:348-353.
38. Gutschalk A, Patterson R, Rupp A, Uppenkamp S, Scherg M. 2002. Sustained magnetic fields reveal separate sites for sound level and temporal regularity in human auditory cortex. Neuroimage. 15:207-216.
39. Gygi B, Kidd GR, Watson CS. 2007. Similarity and categorization of environmental sounds. Percept Psychophys. 69:839-855.
40. Hall D, Plack C. 2009. Pitch processing sites in the human auditory brain. Cereb Cortex. 19:576-585.
41. Hasson U, Skipper J, Nusbaum H, Small S. 2007. Abstract coding of audiovisual speech: beyond sensory representation. Neuron. 56:1116-1126.
42. Haxby J, Gobbini M, Furey M, Ishai A, Schouten J, Pietrini P. 2001. Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science. 293:2425-2430.
43. Hunter M, Eickhoff S, Miller T, Farrow T, Wilkinson I, Woodruff P. 2006. Neural activity in speech-sensitive auditory cortex during silence. Proc Natl Acad Sci USA. 103:189-194.
44. Hyde KL, Peretz I, Zatorre RJ. 2008. Evidence for the role of the right auditory cortex in fine pitch resolution. Neuropsychologia. 46:632-639.
45. ISO. 2004. Acoustics-reference zero for the calibration of audiometric equipment-part 8: reference equivalent threshold sound pressure levels for pure tones and circumaural earphones (ISO 389-8) (Tech. Rep.). Geneva: International Organization for Standardization.
46. Jääskeläinen I, Ahveninen J, Belliveau J, Raij T, Sams M. 2007. Shortterm plasticity in auditory cognition. Trends Neurosci. 30:653-661.
47. Jamison H, Watkins K, Bishop D, Matthews P. 2006. Hemispheric specialization for processing auditory nonspeech stimuli. Cereb Cortex. 16:1266-1275.
48. Johnsrude I, Penhune V, Zatorre RJ. 2000. Functional specificity in the right human auditory cortex for perceiving pitch direction. Brain. 123:155-163.
49. Kaplan JT, Iacoboni M. 2007. Multimodal action representation in human left ventral premotor cortex. Cogn Process. 8:103-113.
50. Kayser C, Petkov CI, Lippert M, Logothetis NK. 2005. Mechanisms for allocating auditory attention: an auditory saliency map. Curr Biol. 15:1943-1947.
51. Kilian-Hütten N, Valente G, Vroomen J, Formisano E. 2011. Auditory cortex encodes the perceptual interpretation of ambiguous sound. J Neurosci. 31:1715-1720.
52. King AJ, Nelken I. 2009. Unraveling the principles of auditory cortical processing: can we learn from the visual system? Nat Neurosci. 12:698-701.
53. Kraut MA, Pitcock JA, Calhoun V, Li J, Freeman T, Hart J, Jr. 2006. Neuroanatomic organization of sound memory in humans. J Cogn Neurosci. 18:1877-1888.
54. Kriegeskorte N, Bandettini P. 2007. Analyzing for information, not activation, to exploit high-resolution fMRI. Neuroimage. 38:649-662.
55. Kriegeskorte N, Goebel R, Bandettini P. 2006. Information-based functional brain mapping. Proc Natl Acad Sci USA. 103:3863-3868.
56. Kriegeskorte N, Mur M, Bandettini P. 2008. Representational similarity analysis-connecting the branches of systems neuroscience. Front Syst Neurosci. 2:4.
57. Kriegeskorte N, Mur M, Ruff D, Kiani R, Bodurka J, Esteky H, Tanaka K, Bandettini PA. 2008. Matching categorical object representations in inferior temporal cortex of man and monkey. Neuron. 60:1126-1141.
58. Kumar S, Stephan KE, Warren JD, Friston KJ, Griffiths TD. 2007. Hierarchical processing of auditory objects in humans. PLoS Comput Biol. 3:e100.
59. Langers D, van Dijk P, Schoenmaker E, Backes W. 2007. fMRI activation in relation to sound intensity and loudness. Neuroimage. 35:709-718.
60. Leaver AM, Rauschecker JP. 2010. Cortical representation of natural complex sounds: effects of acoustic features and auditory object category. J Neurosci. 30:7604-7612.
61. Lewicki MS. 2002. Efficient coding of natural sounds. Nat Neurosci. 5:356-363.
62. Lewis JW. 2006. Cortical networks related to human use of tools. Neuroscientist. 12:211-231.
63. Lewis JW, Brefczynski JA, Phinney RE, Jannik JJ, DeYoe ED. 2005. Distinct cortical pathways for processing tool versus animal sounds. J Neurosci. 25:5148-5158.
64. Lewis JW, Phinney RE, Brefczynski-Lewis JA, DeYoe EA. 2006. Lefties get it "right" when hearing tool sounds. J Cogn Neurosci. 18:1314-1330.
65. Lewis JW, Talkington WJ, Puce A, Engel LR, Frum C. 2010. Cortical networks representing object categories and high-level attributes of familiar real-world action sounds. J Cogn Neurosci. 23:2079-2101.
66. Lewis JW, Talkington WJ, Walker NA, Spirou GA, Jajosky A, Frum C, Brefczynski-Lewis JA. 2009. Human cortical organization for processing vocalizations indicates representation of harmonic structure as a signal attribute. J Neurosci. 29:2283-2296.
67. Liebenthal E, Binder JR, Piorkowski RL, Remez RE. 2003. Short-term reorganization of auditory analysis induced by phonetic experience. J Cogn Neurosci. 15:549-558.
68. Machens C, Wehr M, Zador A. 2004. Linearity of cortical receptive fields measured with natural sounds. J Neurosci. 24:1089-1100.
69. Martin FN, Champlin CA. 2000. Reconsidering the limits of normal hearing. J Am Acad Audiol. 11:64-66.
70. Menon V, Adleman NE, White CD, Glover GH, Reiss AL. 2001. Errorrelated brain activation during a Go/NoGo response inhibition task. Hum Brain Mapp. 12:131-143.
71. Moore BCJ. 2003. An introduction to the psychology of hearing. 5th ed. San Diego (CA): Academic Press.
72. Moore BCJ, Glasberg BR. 1983. Suggested formulae for calculating auditory-filter bandwidths and excitation patterns. J Acoust Soc Am. 74:750-753.
73. Morosan P, Rademacher J, Schleicher A, Amunts K, Schormann T, Zilles K. 2001. Human primary auditory cortex: cytoarchitectonic subdivisions and mapping into a spatial reference system. Neuroimage. 13:684-701.
74. Murray MM, Camen C, Gonzalez Andino SL, Bovet P, Clarke S. 2006. Rapid brain discrimination of sounds of objects. J Neurosci. 26:1293-1302.
75. Nichols T, Brett M, Andersson J, Wager T, Poline JB. 2005. Valid conjunction inference with the minimum statistic. Neuroimage. 25:653-660.
76. Obleser J, Eisner F, Kotz SA. 2008. Bilateral speech comprehension reflects differential sensitivity to spectral and temporal features. J Neurosci. 28:8116-8123.
77. Okada K, Rong F, Venezia J, Matchin W, Hsieh I, Saberi K, Serences JT, Hickok G. 2010. Hierarchical organization of human auditory cortex: evidence from acoustic invariance in the response to intelligible speech. Cereb Cortex. 13:1-7.
78. Oldfield RC. 1971. The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia. 9:97-113.
79. Patterson R, Uppenkamp S, Johnsrude I, Griffiths TD. 2002. The processing of temporal pitch and melody information in auditory cortex. Neuron. 36:767-776.
80. Peelle J, Johnsrude I, Davis M. 2010. Hierarchical processing for speech in human auditory cortex and beyond. Front Hum Neurosci. 4:51.
81. Peeters G, Giordano BL, Susini P, Misdariis N, McAdams S. 2011. The timbre toolbox: extracting acoustic descriptors from musical signals. J Acoust Soc Am. 130:2902-2916.
82. Pizzamiglio L, Aprile T, Spitoni G, Pitzalis S, Bates E, D'Amico S, Di Russo F. 2005. Separate neural systems for processing actionor non-action-related sounds. Neuroimage. 24:852-861.
83. Poeppel D. 2003. The analysis of speech in different temporal integration windows: cerebral lateralization as asymmetric sampling in time. Speech Commun. 41:245-255.
84. Rademacher J, Caviness VS, Steinmetz H, Galaburda AM. 1993. Topographical variation of the human primary cortices: implications for neuroimaging, brain mapping, and neurobiology. Cereb Cortex. 3:313-329.
85. Rauschecker JP, Scott SK. 2009. Maps and streams in the auditory cortex: nonhuman primates illuminate human speech processing. Nat Neurosci. 12:718-724.
86. Rauschecker JP, Tian B. 2000. Mechanisms and streams for processing of "what" and "where" in auditory cortex. Proc Natl Acad Sci USA. 97:11800-11806.
87. Rauschecker JP, Tian B, Hauser M. 1995. Processing of complex sounds in the macaque nonprimary auditory cortex. Science. 268:111-114.
88. Recanzone G, Cohen Y. 2010. Serial and parallel processing in the primate auditory cortex revisited. Behav Brain Res. 206:1-7.
89. Ridderinkhof K, Ullsperger M, Crone E, Nieuwenhuis S. 2004. The role of the medial frontal cortex in cognitive control. Science. 306:443-447.
90. Romanski LM, Tian B, Fritz J, Mishkin M, Goldman-Rakic PS, Rauschecker JP. 1999. Dual streams of auditory afferents target multiple domains in the primate prefrontal cortex. Nat Neurosci. 1999:1131-1136.
91. Sadagopan S, Wang X. 2009. Nonlinear spectrotemporal interactions underlying selectivity for complex sounds in auditory cortex. J Neurosci. 29:11192-11202.
92. Schönwiesner M, Rübsamen R, von Cramon DY. 2005. Hemispheric asymmetry for spectral and temporal processing in the human antero-lateral auditory belt cortex. Eur J Neurosci. 22:1521-1528.
93. Schönwiesner M, Zatorre RJ. 2009. Spectro-temporal modulation transfer function of single voxels in the human auditory cortex measured with high-resolution fMRI. Proc Natl Acad Sci USA. 106:14611-14616.
94. Schulz GM, Varga M, Jeffires K, Ludlow CL, Braun AR. 2005. Functional neuroanatomy of human vocalization: an H215O PET study. Cereb Cortex. 15:1835-1847.
95. Scott SK, Blank CC, Rosen S, Wise RJS. 2000. Identification of a pathway for intelligible speech in the left temporal lobe. Brain. 123:2400-2406.
96. Seeley WW, Menon V, Schatzberg AF, Keller J, Glover GH, Kenna H, Reiss AL, Greicius MD. 2007. Dissociable intrinsic connectivity networks for salience processing and executive control. J Neurosci. 27:2349-2356.
97. Sound Ideas. 2004. Series 6000 DVD Combo Sound Effects Library. Ontario (Canada): Richmond Hill.
98. Staeren N, Renvall H, De Martino F, Goebel R, Formisano E. 2009. Sound categories are represented as distributed patterns in the human auditory cortex. Curr Biol. 19:498-502.
99. Tunik E, Ortigue S, Adamovich SV, Grafton ST. 2008. Differential recruitment of anterior intraparietal sulcus and superior parietal lobule during visually guided grasping revealed by electrical neuroimaging. J Neurosci. 28:13615-13620.
100. Ulanovsky N, Las L, Nelken I. 2003. Processing of low-probability sounds by cortical neurons. Nat Neurosci. 6:391-398.
101. Warren JD, Jennings AR, Griffiths TD. 2005. Analysis of the spectral envelope of sounds by the human brain. Neuroimage. 24:1052-1057.
102. Warren JD, Scott SK, Price CJ, Griffiths TD. 2006. Human brain mechanisms for the early analysis of voices. Neuroimage. 31:1389-1397.
103. Warren WH, Verbrugge RR. 1984. Auditory perception of breaking and bouncing events: a case study in ecological acoustics. J Exp Psychol Hum Percept Perform. 10:704-712.
104. Zatorre RJ. 1988. Pitch perception of complex tones and human temporal-lobe function. J Acoust Soc Am. 84:566-572.
105. Zatorre RJ, Belin P. 2005. Auditory cortex processing streams: where are they and what do they do? In: Josef S, Merzenich MM, editors. Plasticity and signal representation in the auditory system. New York (NY): Springer. p. 277-290.
106. Zatorre RJ, Belin P. 2001. Spectral and temporal processing in human auditory cortex. Cereb Cortex. 11:946-953.
107. Zatorre RJ, Gandour JT. 2008. Neural specializations for speech and pitch: moving beyond the dichotomies. Philos Trans R Soc B. 363:1087-1104.