Encoding of Natural Sounds at Multiple Spectral and Temporal Resolutions in the Human Auditory Cortex

PLoS Computational Biology

Volumn 10, Issue 1, 2014, Pages

  Santoro, Roberta ^a   Moerel, Michelle ^a   De Martino, Federico ^a,b   Goebel, Rainer ^a,c   Ugurbil, Kamil ^b   Yacoub, Essa ^b   Formisano, Elia ^a  

^a MAASTRICHT UNIVERSITY   (Netherlands)

^b UNIVERSITY OF MINNESOTA MEDICAL SCHOOL   (United States)

^c NETHERLANDS INSTITUTE FOR NEUROSCIENCE   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

BRAIN; ECONOMIC AND SOCIAL EFFECTS; ENCODING (SYMBOLS); FUNCTIONAL NEUROIMAGING; MAGNETIC RESONANCE IMAGING; NEURONS; SIGNAL ENCODING; SPECTROGRAPHS;

AUDITORY CORTEX; ENCODINGS; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN BRAIN; NATURAL SOUNDS; NEURONAL POPULATIONS; RESPONSE PATTERNS; SPECTRAL INFORMATION; TEMPORAL PRECISION; TEMPORAL RESOLUTION;

MODULATION;

ACCURACY; ARTICLE; AUDITORY CORTEX; CELL POPULATION; CONTROLLED STUDY; EVOKED CORTICAL RESPONSE; FREQUENCY MODULATION; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN CELL; HUMAN TISSUE; INTERMETHOD COMPARISON; MATHEMATICAL MODEL; NATURAL SOUND; NERVE CELL; PREDICTION; SOUND DETECTION; SPECTROSCOPY; TEMPORAL SUMMATION; TONOTOPY;

ACOUSTIC STIMULATION; AUDITORY CORTEX; AUDITORY PERCEPTION; BRAIN; BRAIN MAPPING; HEARING; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; REPRODUCIBILITY OF RESULTS; SIGNAL-TO-NOISE RATIO; SOFTWARE; SOUND; SPEECH; TIME FACTORS;

EID: 84896709041     PISSN: 1553734X     EISSN: 15537358     Source Type: Journal    
DOI: 10.1371/journal.pcbi.1003412     Document Type: Article

References (60)

1. Alain C, Arnott SR, Hevenor S, Graham S, Grady CL, (2001) "What" and "where" in the human auditory system. Proc Natl Acad Sci U S A 98: 12301-12306 Available: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=59809&tool=pmcentrez&rendertype=abstract.
2. Ahveninen J, Jääskeläinen IP, Raij T, Bonmassar G, Devore S, et al. (2006) Task-modulated "what" and "where" pathways in human auditory cortex. Proc Natl Acad Sci U S A 103: 14608-14613 Available: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=1600007&tool=pmcentrez&rendertype=abstract.
3. Belin P, Zatorre RJ, Lafaille P, Ahad P, Pike B, (2000) Voice-selective areas in human auditory cortex. Nature 403: 309-312 Available: http://www.ncbi.nlm.nih.gov/pubmed/10659849.
4. Lewis JW, Talkington WJ, Walker NA, Spirou GA, Jajosky A, et al. (2009) Human cortical organization for processing vocalizations indicates representation of harmonic structure as a signal attribute. J Neurosci 29: 2283-2296 Available: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=2774090&tool=pmcentrez&rendertype=abstract. Accessed 2 November 2011.
5. Leaver AM, Rauschecker JP, (2010) Cortical representation of natural complex sounds: effects of acoustic features and auditory object category. J Neurosci 30: 7604-7612 Available: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=2930617&tool=pmcentrez&rendertype=abstract. Accessed 9 August 2011.
6. Singh NC, Theunissen FE, (2003) Modulation spectra of natural sounds and ethological theories of auditory processing. J Acoust Soc Am 114: 3394-3411 Available: http://link.aip.org/link/JASMAN/v114/i6/p3394/s1&Agg=doi. Accessed 16 August 2011.
7. Shannon R, Zeng F-G, Wygonski J, Kamath V, Ekelid M, (1995) Speech recognition with primarily temporal cues. Science (80-) 270: 303-304 Available: http://cbt.beckman.uiuc.edu/papers_spring06/shannon95speechrecognition.pdf. Accessed 7 March 2013.
8. Drullman R, Festen J, Plomp R, (1994) Effect of temporal envelope smearing on speech reception. J Acoust Soc Am 95: 1053-1064 Available: http://link.aip.org/link/?JASMAN/95/1053/1. Accessed 7 March 2013.
9. Chi T, Gao Y, Guyton MC, Ru P, Shamma S, (1999) Spectro-temporal modulation transfer functions and speech intelligibility. J Acoust Soc Am 106: 2719-2732 Available: http://www.ncbi.nlm.nih.gov/pubmed/10573888.
10. Elliott TM, Theunissen FE, (2009) The modulation transfer function for speech intelligibility. PLoS Comput Biol 5: e1000302 Available: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=2639724&tool=pmcentrez&rendertype=abstract. Accessed 4 July 2011.
11. Viemeister NF, (1979) Temporal modulation transfer functions based upon modulation thresholds. J Acoust Soc Am 66: 1364-1380 Available: http://www.ncbi.nlm.nih.gov/pubmed/500975.
12. Green D (1986) "Frequency" and the Detection of Spectral Shape Change. In: Moore BJ, Patterson R, editors. Auditory Frequency Selectivity. Springer US, Vol. 119. pp. 351-359. Available: http://dx.doi.org/10.1007/978-1-4613-2247-4_38.
13. Joris PX, Schreiner CE, Rees A, (2004) Neural processing of amplitude-modulated sounds. Physiol Rev 84: 541-577 Available: http://www.ncbi.nlm.nih.gov/pubmed/15044682. Accessed 18 July 2011.
14. Giraud AL, Lorenzi C, Ashburner J, Wable J, Johnsrude I, et al. (2000) Representation of the temporal envelope of sounds in the human brain. J Neurophysiol 84: 1588-1598 Available: http://www.ncbi.nlm.nih.gov/pubmed/10980029.
15. Barton B, Venezia J, (2012) Orthogonal acoustic dimensions define auditory field maps in human cortex. Proc Natl Acad Sci U S A 109: 20738-20743 Available: http://www.pnas.org/content/109/50/20738.short. Accessed 11 March 2013.
16. Shamma S, Versnel H, Kowalski N, (1995) Ripple Analysis in Ferret Primary Auditory Cortex. 1. Response Characteristics of Single Units to Sinusoidally Rippled Spectra. Aud Neurosci 1: 233-254 Available: http://oai.dtic.mil/oai/oai?verb=getRecord&metadataPrefix=html&identifier=ADA452778. Accessed 11 March 2013.
17. Kowalski N, Depireux DA, Shamma SA, (1996) Analysis of dynamic spectra in ferret primary auditory cortex. I. Characteristics of single-unit responses to moving ripple spectra. J Neurophysiol 76: 3503-3523.
18. Depireux DA, Simon JZ, Klein DJ, Shamma SA, Ding N, (2001) Spectro-Temporal Response Field Characterization With Dynamic Ripples in Ferret Primary Auditory Cortex. J Neurophysiol 85: 1220-1234.
19. Woolley SMN, Fremouw TE, Hsu A, Theunissen FE, (2005) Tuning for spectro-temporal modulations as a mechanism for auditory discrimination of natural sounds. Nat Neurosci 8: 1371-1379 Available: http://www.ncbi.nlm.nih.gov/pubmed/16136039. Accessed 7 July 2011.
20. Langers DRM, Backes WH, Dijk P Van, (2003) Spectrotemporal features of the auditory cortex: the activation in response to dynamic ripples. Neuroimage 20: 265-275 Available: http://linkinghub.elsevier.com/retrieve/pii/S1053811903002581. Accessed 10 December 2011.
21. Schönwiesner M, Zatorre RJ, (2009) Spectro-temporal modulation transfer function of single voxels in the human auditory cortex measured with high-resolution fMRI. Proc Natl Acad Sci U S A 106: 14611-14616 Available: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=2732853&tool=pmcentrez&rendertype=abstract.
22. Chi T, Ru P, Shamma S, (2005) Multiresolution spectrotemporal analysis of complex sounds. J Acoust Soc Am 118: 887-906 Available: http://link.aip.org/link/JASMAN/v118/i2/p887/s1&Agg=doi. Accessed 13 December 2010.
23. Elhilali M, Shamma S, (2008) A cocktail party with a cortical twist: how cortical mechanisms contribute to sound segregation. J Acoust Soc Am 124: 3751-3771 Available: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=2676630&tool=pmcentrez&rendertype=abstract.
24. Kay KN, Naselaris T, Prenger RJ, Gallant JL, (2008) Identifying natural images from human brain activity. Nature 452: 352-355 Available: http://www.ncbi.nlm.nih.gov/pubmed/18322462. Accessed 19 July 2011.
25. Schreiner CE, Winer JA, (2007) Auditory cortex mapmaking: principles, projections, and plasticity. Neuron 56: 356-365 Available: http://www.ncbi.nlm.nih.gov/pubmed/17964251.
26. Formisano E, Kim DS, Di Salle F, van de Moortele PF, Ugurbil K, et al. (2003) Mirror-symmetric tonotopic maps in human primary auditory cortex. Neuron 40: 859-869 Available: http://www.ncbi.nlm.nih.gov/pubmed/14622588.
27. Moerel M, De Martino F, Formisano E, (2012) Processing of natural sounds in human auditory cortex: tonotopy, spectral tuning, and relation to voice sensitivity. J Neurosci 32: 14205-14216 Available: http://www.ncbi.nlm.nih.gov/pubmed/23055490. Accessed 11 March 2013.
28. De Martino F, Moerel M, van de Moortele P-F, Ugurbil K, Goebel R, et al. (2013) Spatial organization of frequency preference and selectivity in the human inferior colliculus. Nat Commun 4: 1386 Available: http://dx.doi.org/10.1038/ncomms2379.
29. Moerel M, De Martino F, Santoro R, Ugurbil K, Goebel R, et al. (2013) Processing of natural sounds: characterization of multipeak spectral tuning in human auditory cortex. J Neurosci 33: 11888-11898 Available: http://www.ncbi.nlm.nih.gov/pubmed/23864678. Accessed 19 September 2013.
30. Jepsen ML, Ewert SD, Dau T, (2008) A computational model of human auditory signal processing and perception. J Acoust Soc Am 124: 422-438 Available: http://www.ncbi.nlm.nih.gov/pubmed/18646987. Accessed 10 September 2011.
31. Pasley BN, David S V, Mesgarani N, Flinker A, Shamma S, et al. (2012) Reconstructing Speech from Human Auditory Cortex. PLoS Biol 10: e1001251 Available: http://dx.plos.org/10.1371/journal.pbio.1001251. Accessed 31 January 2012.
32. Sabin AT, Eddins DA, Wright BA, (2012) Perceptual Learning Evidence for Tuning to Spectrotemporal Modulation in the Human Auditory System. J Neurosci 32: 6542-6549 Available: http://www.jneurosci.org/cgi/doi/10.1523/JNEUROSCI.5732-11.2012. Accessed 9 May 2012.
33. Patil K, Pressnitzer D, Shamma S, Elhilali M, (2012) Music in our ears: the biological bases of musical timbre perception. PLoS Comput Biol 8: e1002759 Available: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3486808&tool=pmcentrez&rendertype=abstract. Accessed 11 March 2013.
34. Attias H, Schreiner CE, (1997) Temporal Low-Order Statistics of Natural Sounds. Adv Neural Inf Process Syst 9: 27-33 Available: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.53.201&rep=rep1&type=pdf.
35. Voss RF, Clarke J, (1975) '1/f noise' in music and speech. Nature 258: 317-318 Available: citeulike-article-id:4035033.
36. Escabí MA, Miller LM, Read HL, Schreiner CE, (2003) Naturalistic auditory contrast improves spectrotemporal coding in the cat inferior colliculus. J Neurosci 23: 11489-11504 Available: http://www.ncbi.nlm.nih.gov/pubmed/14684853.
37. Barlow H, (1961) Possible principles underlying the transformation of sensory messages. Sens Commun pp. 217-234 Available: citeulike-article-id:6200793.
38. Wu MC-K, David S V, Gallant JL, (2006) Complete functional characterization of sensory neurons by system identification. Annu Rev Neurosci 29: 477-505 Available: http://www.ncbi.nlm.nih.gov/pubmed/16776594. Accessed 4 July 2011.
39. Theunissen E, Sen K, Doupe AJ, (2000) Spectral-Temporal Receptive Fields of Nonlinear Auditory Neurons. J Neurosci 20: 2315-2331.
40. Bitterman Y, Mukamel R, Malach R, Fried I, Nelken I, (2008) Ultra-fine frequency tuning revealed in single neurons of human auditory cortex. Nature 451: 197-201 Available: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=2676858&tool=pmcentrez&rendertype=abstract. Accessed 13 July 2012.
41. Laudanski J, Edeline J-M, Huetz C, (2012) Differences between Spectro-Temporal Receptive Fields Derived from Artificial and Natural Stimuli in the Auditory Cortex. PLoS One 7: e50539 Available: http://dx.doi.org/10.1371/journal.pone.0050539.
42. David S V, Vinje WE, Gallant JL, (2004) Natural stimulus statistics alter the receptive field structure of v1 neurons. J Neurosci 24: 6991-7006 Available: http://www.ncbi.nlm.nih.gov/pubmed/15295035. Accessed 22 June 2011.
43. Talebi V, Baker CL, (2012) Natural versus Synthetic Stimuli for Estimating Receptive Field Models: A Comparison of Predictive Robustness. J Neurosci 32: 1560-1576 Available: http://www.jneurosci.org/cgi/doi/10.1523/JNEUROSCI.4661-12.2012. Accessed 1 February 2012.
44. Zatorre RJ, Belin P, (2001) Spectral and Temporal Processing in Human Auditory Cortex. Cereb Cortex 11: 946-953 Available: http://cercor.oxfordjournals.org/content/11/10/946.abstract.
45. Samson F, Zeffiro TA, Toussaint A, Belin P, (2011) Stimulus complexity and categorical effects in human auditory cortex: an activation likelihood estimation meta-analysis. Front Psychol 1: 241 Available: http://www.frontiersin.org/Journal/Abstract.aspx?s=86&name=auditory_cognitive_neuroscience&ART_DOI=10.3389/fpsyg.2010.00241.
46. Bendor D, Wang X, (2008) Neural response properties of primary, rostral, and rostrotemporal core fields in the auditory cortex of marmoset monkeys. J Neurophysiol 100: 888-906 Available: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=2525707&tool=pmcentrez&rendertype=abstract. Accessed 13 July 2012.
47. Rodríguez FA, Read HL, Escabí MA, (2010) Spectral and temporal modulation tradeoff in the inferior colliculus. J Neurophysiol 103: 887-903 Available: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=2822687&tool=pmcentrez&rendertype=abstract. Accessed 31 August 2011.
48. Rodríguez FA, Chen C, Read HL, Escabí MA, (2010) Neural modulation tuning characteristics scale to efficiently encode natural sound statistics. J Neurosci 30: 15969-15980 Available: http://www.ncbi.nlm.nih.gov/pubmed/21106835. Accessed 19 June 2011.
49. Simoncelli EP, Olshausen BA, (2001) Natural Image Statistics and Neural Representation. Annu Rev Neurosci 24: 1193-1216 Available: http://dx.doi.org/10.1146/annurev.neuro.24.1.1193.
50. Naselaris T, Prenger RJ, Kay KN, Oliver M, Gallant JL, (2009) Bayesian reconstruction of natural images from human brain activity. Neuron 63: 902-915 Available: http://www.ncbi.nlm.nih.gov/pubmed/19778517. Accessed 31 July 2011.
51. Nishimoto S, Vu AT, Naselaris T, Benjamini Y, Yu B, et al. (2011) Reconstructing Visual Experiences from Brain Activity Evoked by Natural Movies. Curr Biol 21: 1641-1646 Available: http://linkinghub.elsevier.com/retrieve/pii/S0960982211009377. Accessed 23 September 2011.
52. Mitchell TM, Shinkareva SV, Carlson A, Chang K-M, Malave VL, et al. (2008) Predicting human brain activity associated with the meanings of nouns. Science 320: 1191-1195 Available: http://www.ncbi.nlm.nih.gov/pubmed/18511683. Accessed 4 July 2011.
53. Gaab N, Gabrieli JDE, Glover GH, (2007) Assessing the influence of scanner background noise on auditory processing. I. An fMRI study comparing three experimental designs with varying degrees of scanner noise. Hum Brain Mapp 28: 703-720 Available: http://dx.doi.org/10.1002/hbm.20298.
54. Logothetis NK, (2008) What we can do and what we cannot do with fMRI. Nature 453: 869-878 Available: http://dx.doi.org/10.1038/nature06976.
55. Logothetis NK, Pauls J, Augath M, Trinath T, Oeltermann A, (2001) Neurophysiological investigation of the basis of the fMRI signal. Nature 412: 150-157 Available: http://dx.doi.org/10.1038/35084005.
56. Kay KN, David S V, Prenger RJ, Hansen KA, Gallant JL, (2008) Modeling low-frequency fluctuation and hemodynamic response timecourse in event-related fMRI. Hum Brain Mapp 29: 142-156 Available: http://dx.doi.org/10.1002/hbm.20379.
57. Hoerl AE, Kennard RW, (1970) Ridge Regression: Biased Estimation for Nonorthogonal Problems. Technometrics 12: 55-67.
58. Hoerl AE, Kennard RW, (1970) Ridge Regression: Applications to Nonorthogonal Problems. Technometrics 12: 69-82.
59. Goebel R, Esposito F, Formisano E, (2006) Analysis of functional image analysis contest (FIAC) data with brainvoyager QX: From single-subject to cortically aligned group general linear model analysis and self-organizing group independent component analysis. Hum Brain Mapp 27: 392-401 Available: http://dx.doi.org/10.1002/hbm.20249.
60. Frost MA, Goebel R, (2013) Functionally informed cortex based alignment: An integrated approach for whole-cortex macro-anatomical and ROI-based functional alignment. Neuroimage 83: 1002-1010 Available: http://www.sciencedirect.com/science/article/pii/S1053811913008252.