A cocktail party with a cortical twist: How cortical mechanisms contribute to sound segregation

Journal of the Acoustical Society of America

Volumn 124, Issue 6, 2009, Pages 3751-3771

  Elhilali, Mounya ^a   Shamma, Shihab A ^b  

^a Johns Hopkins University   (United States)

^b UNIVERSITY OF MARYLAND   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUDITORY CORTICES; AUDITORY OBJECTS; AUDITORY SYSTEMS; COCKTAIL PARTIES; COMPUTATIONAL SCHEMES; CORTICAL MECHANISMS; FEATURE ANALYSIS; HUMAN SUBJECTS; PLAUSIBLE MODELS; SENSORY INPUTS; SOUND SEGREGATIONS; SOUND SYSTEMS; SPEECH TECHNOLOGIES; TOP DOWNS; TWO STAGES;

ACOUSTICS; IMAGE SEGMENTATION; SPEECH RECOGNITION;

PHYSIOLOGICAL MODELS;

ACOUSTIC STIMULATION; ATTENTION; AUDITORY CORTEX; AUDITORY PERCEPTION; CLUSTER ANALYSIS; COMPUTER SIMULATION; HUMANS; MODELS, BIOLOGICAL; MUSIC; NOISE; PATTERN RECOGNITION, AUTOMATED; PATTERN RECOGNITION, PHYSIOLOGICAL; PERCEPTUAL MASKING; PITCH PERCEPTION; SOUND SPECTROGRAPHY; SPEECH PERCEPTION; TIME FACTORS;

EID: 60049083307     PISSN: 00014966     EISSN: None     Source Type: Journal    
DOI: 10.1121/1.3001672     Document Type: Article

References (108)

1. Anstis, S., and Saida, S. (1985). " Adaptation to auditory streaming of frequency-modulated tones.," J. Exp. Psychol. Hum. Percept. Perform. 11, 257-271.
2. Aubin, T., and Jouventin, P. (1998). " Cocktail-part effect in king penguin colonies.," Proc. R. Soc. London, Ser. B 265, 1665-1673.
3. Barlow, H. (1994). Large-Scale Neuronal Theories of the Brain (MIT Press, Cambridge, MA), pp. 1-22.
4. Bay, J. S. (1999). Fundamentals of Linear State Space Systems (McGraw-Hill, Boston).
5. Beauvois, M. W., and Meddis, R. (1996). " Computer simulation of auditory stream segregation in alternating-tone sequences.," J. Acoust. Soc. Am. 99, 2270-2280.
6. Becker, S. (1993). Advances in Neural Information Processing Systems (Morgan Kaufmann, San Mateo, CA), Vol. 5, pp. 361-368.
7. Bee, M. A., and Klump, G. M. (2004). " Primitive auditory stream segregation: A neurophysiological study in the songbird forebrain.," J. Neurophysiol. 92, 1088-1104.
8. Bell, A. J., and Sejnowski, T. J. (1995). " An information maximization approach to blind source separation and blind deconvolution.," Neural Comput. 7, 1129-1159.
9. Bregman, A. S. (1978). " Auditory streaming is cumulative.," J. Exp. Psychol. Hum. Percept. Perform. 4, 380-387.
10. Bregman, A. S. (1990). Auditory Scene Analysis: The Perceptual Organization of Sound (MIT Press, Cambridge, MA).
11. Bregman, A. S., and Ahad, P. A. (1990). " Demonstrations of auditory scene analysis: The perceptual organization of sound.," Compact Disk, Department of Psychology, McGill University, Montreal, Canada.
12. Bregman, A. S., and Pinker, S. (1978). " Auditory streaming and the building of timbre.," Can. J. Psychol. 32, 19-31.
13. Carlyon, R. P., Cusack, R., Foxton, J. M., and Robertson, I. H. (2001). " Effects of attention and unilateral neglect on auditory stream segregation.," J. Exp. Psychol. Hum. Percept. Perform. 27, 115-127.
14. Carlyon, R., and Shamma, S. (2003). " An account of monaural phase sensitivity.," J. Acoust. Soc. Am. 114, 333-348.
15. Cherry, E. C. (1953). " Some experiments on the recognition of speech, with one and two ears.," J. Acoust. Soc. Am. 25, 975-979.
16. Chi, T., Ru, P., and Shamma, S. A. (2005). " Multiresolution spectrotemporal analysis of complex sounds.," J. Acoust. Soc. Am. 118, 887-906.
17. Chui, C. K., and Chen, G. (1999). Kalman Filtering With Real Time Applications (Springer-Verlag, New York).
18. Cohen, M. A., Grossberg, S., and Wyse, L. L. (1995). " A spectral network model of pitch perception.," J. Acoust. Soc. Am. 98, 862-879.
19. Colburn, S., Shinn-Cunningham, B., Jr, G. K., and Durlach, N. (2006). " The perceptual consequences of binaural hearing.," Int. J. Audiol. 45, 34-44.
20. Colombo, M., Rodman, H. R., and Gross, C. G. (1996). " The effects of superior temporal cortex lesions on the processing and retention of auditory information in monkeys (cebus apella).," J. Neurosci. 16, 4501-4517.
21. Cristianini, N., and Shawe-Taylor, J. (2000). Introduction to Support Vector Machines and Other Kernel-Based Learning Methods (Cambridge University Press, Cambridge, UK).
22. Dau, T., Püschel, D., and Kohlrausch, A. (1996). " A quantitative model of the effective signal processing in the auditory system.," J. Acoust. Soc. Am. 99, 3615-3622.
23. Denham, S., Coath, M., and Balaguer-Ballester, E. (2007). " Sparse time-frequency representations in auditory processing.," 19th International Congress on Acoustics, Madrid,.
24. Drullman, R. (1995). " Temporal envelope and fine structure cues for speech intelligibility.," J. Acoust. Soc. Am. 97, 585-592.
25. Duifhuis, H., Willems, L. F., and Sluyter, R. J. (1982). " Measurement of pitch in speech: An implementation of Goldstein's theory of pitch perception.," J. Acoust. Soc. Am. 71, 1568-1580.
26. Durbin, J. (2001). Time Series Analysis by State-Space Methods, 3rd ed. (Oxford University Press, New York, NY).
27. Eddins, D. A., and Bero, E. M. (2007). " Spectral modulation detection as a function of modulation frequency, carrier bandwidth, and carrier frequency region.," J. Acoust. Soc. Am. 121, 363-372.
28. Eden, U. T., Frank, L. M., Barbieri, R., Solo, V., and Brown, E. N. (2004). " Dynamic analysis of neural encoding by point process adaptive filtering.," Neural Comput. 16, 971-998.
29. Elhilali, M., Chi, T., and Shamma, S. A. (2003). " A spectro-temporal modulation index (STMI) for assessment of speech intelligibility.," Speech Commun. 41, 331-348.
30. Elhilali, M., Fritz, J. B., Chi, T., and Shamma, S. A. (2007). " Auditory cortical receptive fields: Stable entities with plastic abilities.," J. Neurosci. 27, 10372-10382.
31. Elhilali, M., Fritz, J. B., Klein, D. J., Simon, J. Z., and Shamma, S. A. (2004). " Dynamics of precise spike timing in primary auditory cortex.," J. Neurosci. 24, 1159-1172.
32. Ellis, D. P. W., and Weiss, R. J. (2006). " Model-based monaural source separation using a vector-quantized phase-vocoder representation.," Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, IEEE ICASSP'06, Vol. 5, pp. 957-960.
33. Fay, R. R. (1998). " Auditory stream segregation in goldfish (carassius auratus).," Hear. Res. 120, 69-76.
34. Festen, J. M., and Plomp, R. (1990). " Effects of fluctuating noise and interfering speech on the speech-reception threshold for impaired and normal hearing.," J. Acoust. Soc. Am. 88, 1725-1736.
35. Fishman, Y. I., Reser, D. H., Arezzo, J. C., and Steinschneider, M. (2001). " Neural correlates of auditory stream segregation in primary auditory cortex of the awake monkey.," Hear. Res. 151, 167-187.
36. Foldiak, P. (1991). " Learning invariance from transformation sequences.," Neural Comput. 3, 194-200.
37. Fritz, J. B., Elhilali, M., David, S., and Shamma, S. A. (2007). " Does attention play a role in dynamic receptive field adaptation to changing acoustic salience in a1.," Hear. Res. 229, 186-203.
38. Fritz, J. B., Elhilali, M., and Shamma, S. A. (2005). " Differential receptive field plasticity to salient cues in primary auditory cortex during two-tone frequency discrimination.," J. Neurosci. 25, 7623-7635.
39. Goldstein, J. L. (1973). " An optimum processor theory for the central formation of the pitch of complex tones.," J. Acoust. Soc. Am. 54, 1496-1516.
40. Green, D. M. (1986). Auditory Frequency Selectivity, NATO ASI Series, Series A: Life Sciences (Plenum, New York, NY), pp. 351-359.
41. Griffiths, T. D., Uppenkamp, S., Johnsrude, I., Josephs, O., and Patterson, R. D. (2001). " Encoding of the temporal regularity of sound in the human brainstem.," Nat. Neurosci. 4, 633-637.
42. Grimault, N., Bacon, S. P., and Micheyl, C. (2002). " Auditory stream segregation on the basis of amplitude-modulation rate.," J. Acoust. Soc. Am. 111, 1340-1348.
43. Grossberg, S., Govindarajan, K. K., Wyse, L. L., and Cohen, M. A. (2004). " Artstream: A neural network model of auditory scene analysis and source segregation.," Neural Networks 17, 511-536.
44. Hartman, W. M., and Jonhson, D. (1991). " Stream segregation and peripheral channelling.," Music Percept. 9, 155-184.
45. Haykin, S. (1996). Adaptive Filter Theory (Prentice-Hall, Upper Saddle River, NJ).
46. Herbrich, R. (2001). Learning Kernel Classifiers: Theory and Algorithms (MIT Press, Cambridge, MA).
47. Hughes, H. C., Darcey, T. M., Barkan, H. I., Williamson, P. D., Roberts, D. W., and Aslin, C. H. (2001). " Responses of human auditory association cortex to the omission of an expected acoustic event.," Neuroimage 13, 1073-1089.
48. Hulse, S. H., MacDougall-Shackleton, S. A., and Wisniewski, A. B. (1997). " Auditory scene analysis by songbirds: Stream segregation of birdsong by European starlings (sturnus vulgaris).," J. Comp. Psychol. 111, 3-13.
49. Humphrey, N. (1992). A History of the Mind (Simon and Schuster, New York, NY).
50. Izumi, A. (2001). " Relative pitch perception in Japanese monkeys (macaca fuscata).," J. Comp. Psychol. 115, 127-131.
51. Jang, G., and Lee, T. (2004). " A maximum likelihood approach to single-channel source separation.," J. Mach. Learn. Res. 4, 1365-1392.
52. Jerison, H. J., and Neff, W. D. (1953). " Effect of cortical ablation in the monkey on discrimination of auditory patterns.," Fed. Proc. 12, 73-74.
53. Kanwal, J. A., Medvedev, A., and Micheyl, C. (2003). " Neurodynamics for auditory stream segregation: Tracking sounds in the mustached bat's natural environment.," Network Comput. Neural Syst. 14, 413-435.
54. Kelly, J. B., Rooney, B. J., and Phillips, D. P. (1996). " Effects of bilateral auditory cortical lesions on gap-detection thresholds in the ferret (mustela putorius).," Behav. Neurosci. 110, 542-550.
55. Klein, D. J., König, P., and Körding, K. P. (2003). " Sparse spectrotemporal coding of sounds.," EURASIP J. Appl. Signal Process. 7, 659-667.
56. Kowalski, N., Depireux, D. A., and Shamma, S. A. (1996). " Analysis of dynamic spectra in ferret primary auditory cortex. I. Characteristics of single-unit responses to moving ripple spectra.," J. Neurophysiol. 76, 3503-3523.
57. Kristjansson, T., Hershey, J., Olsen, P., Rennie, S., and Gopinath, R. (2006). " Super-human multi-talker speech recognition: The ibm 2006 speech separation challenge system.," Proceedings of the International Conference of Spoken Language Processing, ICSLP'06.
58. Langner, G. (1992). " Periodicity coding in the auditory system.," Hear. Res. 6, 115-142.
59. Ljung, L. (1999). System Identification: Theory for the User, 2nd ed. (Prentice-Hall, Upper Saddle River, NJ).
60. McCabe, S. L., and Denham, M. J. (1997). " A model of auditory streaming.," J. Acoust. Soc. Am. 101, 1611-1621.
61. Micheyl, C., Tian, B., Carlyon, R. P., and Rauschecker, J. P. (2005). " Perceptual organization of tone sequences in the auditory cortex of awake macaques.," Neuron 48, 139-148.
62. Middlebrooks, J. C., Dykes, R. W., and Merzenich, M. M. (1980). " Binaural response-specific band in primary auditory cortex (ai) of the cat: Topographical organization orthogonal to isofrequency contours.," Brain Res. 181, 31-49.
63. Miller, L. M., Escabi, M. A., Read, H. L., and Schreiner, C. E. (2002). " Spectrotemporal receptive fields in the lemniscal auditory thalamus and cortex.," J. Neurophysiol. 87, 516-527.
64. Miller, G. A., and Taylor, W. G. (1948). " The perception of repeated bursts of noise.," J. Acoust. Soc. Am. 20, 171-182.
65. Moore, B. C. J., Glasberg, B. R., and Peters, R. W. (1986). " Thresholds for hearing mistuned partials as separate tones in harmonic complexes.," J. Acoust. Soc. Am. 80, 479-483.
66. Moore, B., and Gockel, H. (2002). " Factors influencing sequential stream segregation.," Acta. Acust. Acust. 88, 320-332.
67. Näätänen, R. (1992). Attention and Brain Function (Lawrence Erlbaum Associates, Hillsdale, NJ).
68. Nelken, I. (2004). " Processing of complex stimuli and natural scenes in the auditory cortex.," Curr. Opin. Neurobiol. 14, 474-480.
69. Nix, J., and Hohmann, V. (2007). " Combined estimation of spectral envelopes and sound source direction of concurrent voices by multidimensional statistical filtering.," IEEE Trans. Audio, Speech, Lang. Process. 15, 995-1008.
70. Olshausen, B. A., and Field, D. J. (2004). " Sparse coding of sensory inputs.," Curr. Opin. Neurobiol. 14, 481-487.
71. Oppenheim, A., and Shafer, R. (1999). Discrete Time Signal Processing, 2nd ed. (Prentice-Hall, Upper Saddle River, NJ).
72. O'Shaughnessy, D. (2000). Speech Communications: Human and Machine, 2nd ed. (Institute of Electrical and Electronics Engineers, New York, NY).
73. Oxenham, A. J., Bernstein, J. G., and Penagos, H. (2004). " Correct tonotopic representation is necessary for complex pitch perception.," Proc. Natl. Acad. Sci. U.S.A. 101, 1421-1425.
74. Peters, R. W., Moore, B. C., and Baer, T. (1998). " Speech reception thresholds in noise with and without spectral and temporal dips for hearing-impaired and normally hearing people.," J. Acoust. Soc. Am. 103, 577-587.
75. Pickles, J. O. (1988). An Introduction to the Physiology of Hearing (Academic, St Louis, MO).
76. Pollock, D. S. G. (1999). A Handbook of Time-Series Analysis, Signal Processing and Dynamics (Academic, Cambridge, UK).
77. Proakis, J. G., and Manolakis, D. G. (1992). Digital Signal Processing (McMillan, New York, NY).
78. Qin, M. K., and Oxenham, A. J. (2003). " Effects of simulated cochlear-implant processing on speech reception in fluctuating maskers.," J. Acoust. Soc. Am. 114, 446-454.
79. Rauschecker, J. P. (2005). " Neural encoding and retrieval of sound sequences.," Ann. N.Y. Acad. Sci. 1060, 125-135.
80. Roberts, B., and Bregman, A. S. (1991). " Effects of the pattern of spectral spacing on the perceptual fusion of harmonics.," J. Acoust. Soc. Am. 90, 3050-3060.
81. Roweis, S. (2000). " One microphone source separation.," Neural Information Processing Systems (NIPS'00), Vol. 13, pp. 793-799.
82. Sacks, M., and Blackburn, C. (1991). Neurophysiology of Hearing: The Central Auditory System, 15th ed. (Raven, New York, NY).
83. Schreiner, C. (1998). " Spatial distribution of responses to simple and complex sounds in the primary auditory cortex.," Audiol. Neuro-Otol. 3, 104-122.
84. Schreiner, C. E., and Urbas, J. V. (1988). " Representation of amplitude modulation in the auditory cortex of the cat. II. Comparison between cortical fields.," Hear. Res. 32, 49-64.
85. Shamma, S. A. (1998). Methods of Neuronal Modeling, 2nd ed. (MIT Press, Cambridge, MA), pp. 411-460.
86. Shamma, S. A., and Klein, D. J. (2000). " The case of the missing pitch templates: How harmonic templates emerge in the early auditory system.," J. Acoust. Soc. Am. 107, 2631-2644.
87. Shinn-Cunningham, B. G. (2005). " Influences of spatial cues on grouping and understanding sound.," Proceedings of the Forum Acusticum.
88. Srinivasan, L., Eden, U. T., Willsky, A. S., and Brown, E. N. (2006). " A state-space analysis for reconstruction of goal-directed movements using neural signals.," Neural Comput. 18, 2465-2494.
89. Supin, A. Y., Popov, V. V., Milekhina, O. N., and Tarakanov, M. B. (1999). " Ripple depth and density resolution of rippled noise.," J. Acoust. Soc. Am. 106, 2800-2804.
90. Sussman, E. S. (2005). " Integration and segregation in auditory scene analysis.," J. Acoust. Soc. Am. 117, 1285-1298.
91. Sussman, E. S., Horvath, J., Winkler, I., and Orr, M. (2007). " The role of attention in the formation of auditory streams.," Percept. Psychophys. 69, 136-152.
92. Sutter, M. L. (2005). " Spectral processing in the auditory cortex.," Int. Rev. Neurobiol. 70, 253-298.
93. Tougas, Y., and Bregman, A. S. (1985). " The crossing of auditory streams.," J. Exp. Psychol. Hum. Percept. Perform. 11, 788-798.
94. Ulanovsky, N., Las, L., and Nelken, I. (2003). " Processing of low-probability sounds in cortical neurons.," Nat. Neurosci. 6, 391-398.
95. van Noorden, L. P. (1975). " Temporal coherence in the perception of tone sequences.," Ph.D. thesis, Eindhoven University of Technology.
96. Varga, A. P., and Moore, R. K. (1990). " Hidden Markov model decomposition of speech and noise.," Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, IEEE ICASSP'90, Vol. 2, pp. 845-848.
97. Viemeister, N. F. (1979). " Temporal modulation transfer functions based upon modulation thresholds.," J. Acoust. Soc. Am. 66, 1364-1380.
98. von der Malsburg, C., and Schneider, W. (1986). " A neural cocktail-party processor.," Biol. Cybern. 54, 29-40.
99. Wang, D. L., and Brown, G. J. (1999). " Separation of speech from interfering sounds based on oscillatory correlation.," IEEE Trans. Neural Netw. 10, 684-697.
100. Wang, K., and Shamma, S. A. (1994). " Self-normalization and noise-robustness in early auditory representations.," IEEE Trans. Speech Audio Process. 2, 421-435.
101. Wang, K., and Shamma, S. A. (1995). " Spectral shape analysis in the central auditory system.," IEEE Trans. Speech Audio Process. 3, 382-395.
102. Welch, G., and Bishop, G. (2001). " An introduction to the Kalman filter.," ACM SIGGRAPH.
103. Wightman, F. (1973). " A pattern transformation model of pitch.," J. Acoust. Soc. Am. 54, 397-406.
104. Wittkop, T., and Hohmann, V. (2003). " Strategy-selective noise reduction for binaural digital hearing aids.," Speech Commun. 39, 111-138.
105. Woolley, S. M., Fremouw, T. E., Hsu, A., and Theunissen, F. E. (2005). " Tuning for spectro-temporal modulations as a mechanism for auditory discrimination of natural sounds.," Nat. Neurosci. 8, 1371-1379.
106. Wu, W., Gao, Y., Bienenstock, E., Donoghue, J. P., and Black, M. J. (2006). " Bayesian population decoding of motor cortical activity using a Kalman filter.," Neural Comput. 18, 80-118.
107. Yang, X., Wang, K., and Shamma, S. A. (1992). " Auditory representations of acoustic signals.," IEEE Trans. Inf. Theory 38, 824-839.
108. Yin, P., Ma, L., Elhilali, M., Fritz, J. B., and Shamma, S. A. (2007). Hearing: From Basic Research to Applications (Springer Verlag, New York, NY).