Sound texture perception via statistics of the auditory periphery: Evidence from sound synthesis

Neuron

Volumn 71, Issue 5, 2011, Pages 926-940

  McDermott, Josh H ^a   Simoncelli, Eero P ^a,b  

^a NEW YORK UNIVERSITY   (United States)

^b NEW YORK UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTICS; ALGORITHM; ARTICLE; CONTROLLED STUDY; HEARING; METHODOLOGY; PRIORITY JOURNAL; SOUND FREQUENCY; SOUND MODULATION; SOUND RELATED PHENOMENA; SOUND TEXTURE; STATISTICAL ANALYSIS; STATISTICAL MODEL;

ACOUSTIC STIMULATION; ALGORITHMS; ANIMALS; AUDITORY PATHWAYS; AUDITORY PERCEPTION; HUMANS; MODELS, BIOLOGICAL; MODELS, STATISTICAL; PSYCHOACOUSTICS; RECOGNITION (PSYCHOLOGY); SOUND; SPECTRUM ANALYSIS;

EID: 80052406394     PISSN: 08966273     EISSN: 10974199     Source Type: Journal    
DOI: 10.1016/j.neuron.2011.06.032     Document Type: Article

References (62)

1. Adelson E.H., Bergen J.R. Spatiotemporal energy models for the perception of motion. J. Opt. Soc. Am. A 1985, 2:284-299.
2. Alvarez G.A., Oliva A. Spatial ensemble statistics are efficient codes that can be represented with reduced attention. Proc. Natl. Acad. Sci. USA 2009, 106:7345-7350.
3. Asari H., Pearlmutter B.A., Zador A.M. Sparse representations for the cocktail party problem. J. Neurosci. 2006, 26:7477-7490.
4. Athineos M., Ellis D. Sound texture modelling with linear prediction in both time and frequency domains. Proc. ICASSP-03, Hong Kong. 2003, 10.1109/ASPAA.2003.1285816.
5. Attias H., Schreiner C.E. Coding of naturalistic stimuli by auditory midbrain neurons. Advances in Neural Information Processing Systems 1998, 103-109. MIT Press, Cambridge, MA. M.I. Jordan, M.J. Kearns, S.A. Solla (Eds.).
6. Bacon S.P., Grantham D.W. Modulation masking: effects of modulation frequency, depth, and phase. J. Acoust. Soc. Am. 1989, 85:2575-2580.
7. Barbour D.L., Wang X. Contrast tuning in auditory cortex. Science 2003, 299:1073-1075.
8. Baumann S., Griffiths T.D., Sun L., Petkov C.I., Thiele A., Rees A. Orthogonal representation of sound dimensions in the primate midbrain. Nat. Neurosci. 2011, 14:423-425.
9. Bee M.A., Micheyl C. The cocktail party problem: what is it? How can it be solved? And why should animal behaviorists study it?. J. Comp. Psychol. 2008, 122:235-251.
10. Bell A.J., Sejnowski T.J. Learning the higher-order structure of a natural sound. Network 1996, 7:261-267.
11. Crochiere R.E., Webber S.A., Flanagan J.L. Digital coding of speech in sub-bands. Bell Syst. Tech. J. 1976, 55:1069-1085.
12. Cusack R., Carlyon R.P. Perceptual asymmetries in audition. J. Exp. Psychol. Hum. Percept. Perform. 2003, 29:713-725.
13. Dau T., Kollmeier B., Kohlrausch A. Modeling auditory processing of amplitude modulation. I. Detection and masking with narrow-band carriers. J. Acoust. Soc. Am. 1997, 102:2892-2905.
14. de Cheveigne A. Pitch perception models. Pitch 2004, Springer Verlag, New York. C.J. Plack, A.J. Oxenham (Eds.).
15. Dean I., Harper N.S., McAlpine D. Neural population coding of sound level adapts to stimulus statistics. Nat. Neurosci. 2005, 8:1684-1689.
16. Depireux D.A., Simon J.Z., Klein D.J., Shamma S.A. Spectro-temporal response field characterization with dynamic ripples in ferret primary auditory cortex. J. Neurophysiol. 2001, 85:1220-1234.
17. DiCarlo J.J., Cox D.D. Untangling invariant object recognition. Trends Cogn. Sci. (Regul. Ed.) 2007, 11:333-341.
18. Dubnov S., Bar-Joseph Z., El-Yaniv R., Lischinski D., Werman M. Synthesizing sound textures through wavelet tree learning. IEEE Comput. Graph. Appl. 2002, 22:38-48.
19. Elhilali M., Shamma S.A. A cocktail party with a cortical twist: how cortical mechanisms contribute to sound segregation. J. Acoust. Soc. Am. 2008, 124:3751-3771.
20. Field D.J. Relations between the statistics of natural images and the response profiles of cortical cells. J. Opt. Soc. Am. A. 1987, 4:2379-2394.
21. Garcia-Lazaro J.A., Ahmed B., Schnupp J.W. Tuning to natural stimulus dynamics in primary auditory cortex. Curr. Biol. 2006, 16:264-271.
22. Gardner W.G. Reverberation algorithms. Applications of Digital Signal Processing to Audio and Acoustics 1998, Kluwer Academic Publishers, Norwell, MA. M. Kahrs, K. Brandenburg (Eds.).
23. Ghitza O. On the upper cutoff frequency of the auditory critical-band envelope detectors in the context of speech perception. J. Acoust. Soc. Am. 2001, 110:1628-1640.
24. Glasberg B.R., Moore B.C.J. Derivation of auditory filter shapes from notched-noise data. Hear. Res. 1990, 47:103-138.
25. Gygi B., Kidd G.R., Watson C.S. Spectral-temporal factors in the identification of environmental sounds. J. Acoust. Soc. Am. 2004, 115:1252-1265.
26. Heeger, D.J., and Bergen, J. (1995). Pyramid-based texture analysis/synthesis. Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques, 229-238. doi:10.1145/218380.218446.
27. Irino T., Patterson R.D. Temporal asymmetry in the auditory system. J. Acoust. Soc. Am. 1996, 99:2316-2331.
28. Joris P.X., Schreiner C.E., Rees A. Neural processing of amplitude-modulated sounds. Physiol. Rev. 2004, 84:541-577.
29. Julesz B. Visual pattern discrimination. IRE Trans. Inf. Theory 1962, 8:84-92.
30. Kayser C., Petkov C.I., Lippert M., Logothetis N.K. Mechanisms for allocating auditory attention: an auditory saliency map. Curr. Biol. 2005, 15:1943-1947.
31. Kvale M.N., Schreiner C.E. Short-term adaptation of auditory receptive fields to dynamic stimuli. J. Neurophysiol. 2004, 91:604-612.
32. Lesica N.A., Grothe B. Efficient temporal processing of naturalistic sounds. PLoS One 2008, 3:e1655.
33. Lorenzi C., Berthommier F., Demany L. Discrimination of amplitude-modulation phase spectrum. J. Acoust. Soc. Am. 1999, 105:2987-2990.
34. Lorenzi C., Simpson M.I.G., Millman R.E., Griffiths T.D., Woods W.P., Rees A., Green G.G.R. Second-order modulation detection thresholds for pure-tone and narrow-band noise carriers. J. Acoust. Soc. Am. 2001, 110:2470-2478.
35. McDermott J.H. The cocktail party problem. Curr. Biol. 2009, 19:R1024-R1027.
36. McDermott J.H., Oxenham A.J. Spectral completion of partially masked sounds. Proc. Natl. Acad. Sci. USA 2008, 105:5939-5944.
37. McDermott, J.H., Oxenham, A.J., and Simoncelli, E.P. (2009). Sound texture synthesis via filter statistics. Proceedings of IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, 297-300. doi:10.1109/ASPAA.2009.5346467.
38. McDermott J.H., Wrobleski D., Oxenham A.J. Recovering sound sources from embedded repetition. Proc. Natl. Acad. Sci. USA 2011, 108:1188-1193.
39. Mesgarani N., David S.V., Fritz J.B., Shamma S.A. Influence of context and behavior on stimulus reconstruction from neural activity in primary auditory cortex. J. Neurophysiol. 2009, 102:3329-3339.
40. Miller L.M., Escabí M.A., Read H.L., Schreiner C.E. Spectrotemporal receptive fields in the lemniscal auditory thalamus and cortex. J. Neurophysiol. 2002, 87:516-527.
41. Nelken I., Rotman Y., Bar Yosef O. Responses of auditory-cortex neurons to structural features of natural sounds. Nature 1999, 397:154-157.
42. Olshausen B.A., Field D.J. Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature 1996, 381:607-609.
43. Overath T., Kumar S., von Kriegstein K., Griffiths T.D. Encoding of spectral correlation over time in auditory cortex. J. Neurosci. 2008, 28:13268-13273.
44. Portilla J., Simoncelli E.P. A parametric texture model based on joint statistics of complex wavelet coefficients. Int. J. Comput. Vis. 2000, 40:49-71.
45. Rieke F., Bodnar D.A., Bialek W. Naturalistic stimuli increase the rate and efficiency of information transmission by primary auditory afferents. Proc. Biol. Sci. 1995, 262:259-265.
46. Rodríguez F.A., Chen C., Read H.L., Escabí M.A. Neural modulation tuning characteristics scale to efficiently encode natural sound statistics. J. Neurosci. 2010, 30:15969-15980.
47. Ruggero M.A. Responses to sound of the basilar membrane of the mammalian cochlea. Curr. Opin. Neurobiol. 1992, 2:449-456.
48. Saint-Arnaud, N., and Popat, K. (1995). Analysis and synthesis of sound texture. Proceedings of AJCAI Workshop on Computational Auditory Scene Analysis, pp. 293-308.
49. Schönwiesner M., Zatorre R.J. Spectro-temporal modulation transfer function of single voxels in the human auditory cortex measured with high-resolution fMRI. Proc. Natl. Acad. Sci. USA 2009, 106:14611-14616.
50. Schwartz O., Simoncelli E.P. Natural signal statistics and sensory gain control. Nat. Neurosci. 2001, 4:819-825.
51. Shannon R.V., Zeng F.G., Kamath V., Wygonski J., Ekelid M. Speech recognition with primarily temporal cues. Science 1995, 270:303-304.
52. Singh N.C., Theunissen F.E. Modulation spectra of natural sounds and ethological theories of auditory processing. J. Acoust. Soc. Am. 2003, 114:3394-3411.
53. Slaney M. Pattern playback in the 90's. Advances in Neural Information Processing Systems 7 1995, MIT Press, Cambridge, MA. G. Tesauro, D. Touretsky, T. Leen (Eds.).
54. Smith E.C., Lewicki M.S. Efficient auditory coding. Nature 2006, 439:978-982.
55. Smith Z.M., Delgutte B., Oxenham A.J. Chimaeric sounds reveal dichotomies in auditory perception. Nature 2002, 416:87-90.
56. Strickland E.A., Viemeister N.F. Cues for discrimination of envelopes. J. Acoust. Soc. Am. 1996, 99:3638-3646.
57. Verron, C., Pallone, G., Aramaki, M., and Kronland-Martinet, R. (2009). Controlling a spatialized environmental sound synthesizer. Proceedings of IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, 321-324. doi:10.1109/ASPAA.2009.5346504.
58. Warren R.M., Obusek C.J., Ackroff J.M. Auditory induction: perceptual synthesis of absent sounds. Science 1972, 176:1149-1151.
59. Woolley S.M., Fremouw T.E., Hsu A., Theunissen F.E. Tuning for spectro-temporal modulations as a mechanism for auditory discrimination of natural sounds. Nat. Neurosci. 2005, 8:1371-1379.
60. Zahorik P. Assessing auditory distance perception using virtual acoustics. J. Acoust. Soc. Am. 2002, 111:1832-1846.
61. Zhu, X.L., and Wyse, L. (2004). Sound texture modeling and time-frequency LPC. Proceedings of Conference on Digital Audio Effects, 345-349.
62. Zhu S.C., Wu Y.N., Mumford D.B. Minimax entropy principle and its applications to texture modeling. Neural Comput. 1997, 9:1627-1660.