ARTSTREAM: A neural network model of auditory scene analysis and source segregation

Neural Networks

Volumn 17, Issue 4, 2004, Pages 511-536

  Grossberg, Stephen ^a   Govindarajan, Krishna K ^b   Wyse, Lonce L ^c   Cohen, Michael A ^a  

^a BOSTON UNIVERSITY   (United States)

^b SpeechWorks   (United States)

^c Lab for Information Technology   (Singapore)

Author keywords

Adaptive resonance theory; Auditory scene analysis; Cocktail party problem; Neural network; Pitch perception; Resonance; Spatial localization; Spectral pitch resonance; Streaming

Indexed keywords

BRAIN; FREQUENCIES; MATHEMATICAL MODELS; NEURAL NETWORKS; RESONANCE;

AUDITORY SYSTEMS; NEURAL NETWORK MODELS;

NEUROLOGY;

ARTICLE; AUDITORY NERVOUS SYSTEM; HEARING; MODEL; NERVE CELL NETWORK; NOISE; PITCH; PRIORITY JOURNAL; SIMULATION; SOUND; SOUND DETECTION;

ACOUSTIC STIMULATION; ALGORITHMS; AUDITORY PATHWAYS; AUDITORY PERCEPTION; CUES; FUNCTIONAL LATERALITY; HUMANS; NEURAL NETWORKS (COMPUTER); NOISE; PITCH DISCRIMINATION; SOUND SPECTROGRAPHY; SPEECH ACOUSTICS;

EID: 1942519356     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neunet.2003.10.002     Document Type: Article

References (81)

1. von Bekesy G. Hearing theories and complex sound. Journal of the Acoustical Society of America. 35:1963;588-601.
2. Bilsen F., Ritsma R. Some parameters influencing the perceptibility of pitch. Journal of the Acoustical Society of America. 47:1970;469-475.
3. deBoer E., deJongh H.R. On cochlear encoding: potentialities and limitations of the reverse correlation technique. Journal of the Acoustical Society of America. 63:1978;115-135.
4. Bregman, A. S. (1990). Auditory scene analysis: the perceptual organization of sound. Cambridge, MA: MIT Press.
5. Bregman A.S., Campbell J. Primary auditory stream segregation and perception of order in rapid sequences of tones. Journal of Experimental Psychology. 89:1971;244-249.
6. Bregman A.S., Dannenbring G. Auditory continuity and amplitude edges. Journal of Psychology. 31:1977;151-159.
7. Bregman A.S., Doehring P. Fusion of simultaneous tonal glides: the role of parallelness and simple frequency relations. Perception and Psychophysics. 36:1984;251-256.
8. Bregman A.S., Pinker S. Auditory streaming and the building of timbre. Canadian Journal of Psychology. 32:1978;19-31.
9. Bregman A.S., Rudnicky A. Auditory segregation: stream or streams? Journal of Experimental Psychology: Human Perception and Performance. 1:1975;263-267.
10. Bregman A.S., Steiger H. Auditory streaming and vertical localization: interdependence of 'what' and 'where' decisions in audition. Perception and Psychophysics. 28:1980;539-546.
11. Broadbent D.E., Ladefoged P. On the fusion of sounds reaching different sense organs. Journal of the Acoustical Society of America. 29:1957;708-710.
12. Brokx J.P.L., Noteboom S.G. Intonation and the perceptual separation of simultaneous voices. Journal of Phonetics. 10:1982;23-26.
13. Brown, G. J (1992). Computational auditory scene analysis: A representational approach. PhD thesis, University of Sheffield.
14. Carlyon R.P. Discriminating between coherent and incoherent frequency modulation of complex tones. Journal of the Acoustical Society of America. 89:1991;329-340.
15. Carlyon R.P. The psychophysics of concurrent sound segregation. Carlyon R.P., Darwin C.J., Russell I.J. Processing of complex sounds by the auditory system. 1992;Clarendon Press, Oxford.
16. Carpenter G.A., Grossberg S. A massively parallel architecture for a self-organizing neural pattern recognition machine. Computer Vision, Graphics, and Image Processing. 37:1987;54-115.
17. Carpenter G.A., Grossberg S. Pattern recognition by self-organizing neural networks. 1991;MIT Press, Cambridge, MA.
18. Carpenter G.A., Grossberg S. Normal and amnesic learning, recognition, and memory by a neural model of cortico-hippocampal interactions. Trends in Neurosciences. 16:1993;131-137.
19. Chalika M.H., Bregman A.S. The perceptual segregation of simultaneous auditory signals: pulse train segregation and vowel segregation. Perception and Psychophysics. 46:1989;487-497.
20. Chey J., Grossberg S., Mingolla E. Neural dynamics of motion grouping: from aperture ambiguity to object speed and direction. Journal of the Optical Society of America A. 14:1997;2570-2594.
21. Chey J., Grossberg S., Mingolla E. Neural dynamics of motion processing and speed discrimination. Vision Research. 38:1998;2769-2786.
22. Cohen M.A., Grossberg S. Neural dynamics of speech and language coding: developmental programs, perceptual grouping, and competition for short term memory. Human Neurobiology. 5:1986;1-22.
23. Cohen M.A., Grossberg S., Wyse L. A spectral network model of pitch perception. Journal of the Acoustical Society of America. 98:1995;862-879.
24. Colburn H.S. Theory of binaural interaction based on auditory-nerve data. I. General strategy and preliminary results on interaural discrimination. Journal of the Acoustical Society of America. 54:1973;1458-1470.
25. Colburn H.S. Theory of binaural interaction based on auditory-nerve data. II. Detection of tones in noise. Journal of the Acoustical Society of America. 61:1977;525-533.
26. Cooke, M. P (1991). Modelling auditory processing and organisation. PhD thesis, University of Sheffield.
27. Dannenbring G.L., Bregman A.S. Streaming vs. fusion of sinusoidal components of complex waves. Perception and Psychophysics. 24:1978;369-376.
28. Darwin C.J. Perceiving vowels in the presence of another sound: constraints on formant perception. Journal of the Acoustical Society of America. 76:1984;1636-1647.
29. Darwin C.J., Bethell-Fox C.E. Pitch continuity and speech source attribution. Journal of Experimental Psychology: Human Perception and Performance. 3:1977;665-672.
30. Darwin C.J., Ciocca V. Grouping in pitch perception: effects of onset asynchrony and ear of presentation of a mistuned component. Journal of the Acoustical Society of America. 91:1992;3381-3390.
31. Darwin C.J., Sutherland N.S. Grouping frequency components of vowels: when is a harmonic not a harmonic? The Quarterly Journal of Experimental Psychology. 36A:1984;193-208.
32. Deutsch D. Two-channel listening to musical scales. Journal of the Acoustical Society of America. 57:1975;1156-1160.
33. Deutsch D. Paradoxes of musical pitch. Scientific American. 264:1992;88-95.
34. Deutsch D. Some new pitch paradoxes and their implications. Philosophical Transactions of the Royal Society of London. 336:1992;391-397.
35. Duifhuis H., Willems L.F., Sluyter R. Measurement of pitch in speech: an implementation of Goldstein's theory of pitch perception. Journal of the Acoustical Society of America. 71:1982;1568-1580.
36. Gardner R.B., Gaskill S.A., Darwin C.J. Perceptual grouping of formants with static and dynamic differences in fundamental frequency. Journal of the Acoustical Society of America. 85:1989;1329-1337.
37. Gjerdingen R.O. Apparent motion in music? Music Perception. 11:1994;335-370.
38. Goldstein J. An optimum processor theory for the central formation of the pitch of complex tones. Journal of the Acoustical Society of America. 54:1973;1496-1515.
39. Grossberg S. Adaptive pattern classification and universal recoding. II. Feedback, expectation, olfaction, and illusions. Biological Cybernetics. 23:1976;187-202.
40. Grossberg S. How does a brain build a cognitive code? Psychological Review. 87:1980;1-51.
41. Grossberg S. How does the cerebral cortex work? Learning, attention, and grouping by the laminar circuits of visual cortex. Spatial Vision. 12:1999;163-185.
42. Grossberg S. The link between brain learning, attention, and consciousness. Consciousness and Cognition. 8:1999;1-44.
43. Grossberg S. How does the cerebral cortex work? Development, learning, attention, and 3D vision by laminar circuits of visual cortex. Behavioral and Cognitive Neuroscience Reviews. 2003;. in press.
44. Grossberg S. Resonant neural dynamics of speech perception. Journal of Phonetics. 2003;. in press.
45. Grossberg S., Boardman I., Cohen M.A. Neural dynamics of variable-rate speech categorization. Journal of Experimental Psychology: Human Perception and Performance. 23:1997;481-503.
46. Grossberg S., Mingolla E., Viswanathan L. Neural dynamics of motion integration and segmentation within and across apertures. Vision Research. 41:2001;2521-2553.
47. Grossberg S., Myers C. The resonant dynamics of conscious speech: interword integration and duration-dependent backward effects. Psychological Review. 107:2000;735-767.
48. Grossberg S., Rudd M.E. A neural architecture for visual motion perception: group and element apparent motion. Neural Networks. 2:1989;421-450.
49. Grossberg S., Rudd M.E. Cortical dynamics of visual motion perception: short-range and long-range apparent motion. Psychological Review. 99:1992;78-121.
50. Grossberg S., Stone G.O. Neural dynamics of word recognition and recall: attentional priming, learning, and resonance. Psychological Review. 93:1986;46-74.
51. Hall J.W., Grose J.H. Comodulation masking release: evidence for multiple cues. Journal of the Acoustical Society of America. 84:1988;1669-1675.
52. Halpern, L (1977). The effect of harmonic ratio relationships on auditory stream segregation. Technical report, Department of Psychology, McGill University.
53. Handel S. Listening. 1989;MIT Press, Cambridge, MA.
54. Kolers, P. A. (1972). Aspects of motion perception. Elmsford, NY: Pergamon Press.
55. McAdams S. Segregation of concurrent sounds. I. Effects of frequency modulation coherence. Journal of the Acoustical Society of America. 86:1989;2148-2159.
56. Meddis R., Hewitt M.J. Modelling the identification of concurrent vowels with different fundamental frequencies. Journal of the Acoustical Society of America. 91:1992;233-245.
57. Miller G.A., Licklider J.C.R. Intelligibility of interrupted speech. Journal of the Acoustical Society of America. 22:1950;167-173.
58. Moore B.C.J. Effects of relative phase of the components on the pitch of three-component complex tones. Evans E., Wilson J. Psychophysics and physiology of hearing. 1977;Academic Press, New York.
59. Moore B.C.J., Glasberg B.R., Peters R.W. Relative dominance of individual partials in determining the pitch of complex tones. Journal of the Acoustical Society of America. 77:1985;1853-1860.
60. Narmour E. The analysis and cognition of basic melodic structures: The implication-realization model. 1990;University of Chicago Press, Chicago.
61. van Noorden, L. P. A. S (1975). Temporal coherence in the perception of tone sequences. PhD thesis, Eindhoven University of Technology.
62. Patterson R., Wightman F. Residue pitch as a function of component spacing. Journal of the Acoustical Society of America. 59:1976;1450-1459.
63. Plomp R. Pitch of complex tones. Journal of the Acoustical Society of America. 41:1967;1526-1533.
64. Raizada R.D.S., Grossberg S. Towards a theory of the laminar architecture of cerebral cortex: computational clues from the visual system. Cerebral Cortex. 13:2003;100-113.
65. Remez R.E., Pardo J.S., Piorkowski R.L., Rubin P.E. On the bistability of sine wave analogues of speech. Psychological Science. 12:2001;24-29.
66. Remez R.E., Rubin P.E., Berns S.M., Pardo J.S., Lang J.M. On the perceptual organization of speech. Psychological Review. 101:1994;129-156.
67. Ritsma R. Frequencies dominant in the perception of the pitch of complex sounds. Journal of the Acoustical Society of America. 42:1967;191-198.
68. Ritsma R., Engel F. Pitch of frequency-modulated signals. Journal of the Acoustical Society of America. 36:1964;1637-1644.
69. Scheffers, M. T. M (1983). Sifting vowels: Auditory pitch analysis and sound segregation. PhD thesis, Groningen University.
70. Schouten J., Ritsma R., Cardozo B. Pitch of the residue. Journal of the Acoustical Society of America. 34:1962;1418-1424.
71. Shackleton T.M., Meddis R., Hewitt M.J. The role of binaural and fundamental frequency difference cues in the identification of concurrently presented vowels. The Quarterly Journal of Experimental Psychology. 47A:1994;545-563.
72. Shepard R. Circularity in judgments of relative pitch. Journal of the Acoustical Society of America. 36:1964;2346-2353.
73. Small A.M., Daniloff R.G. Pitch of noise bands. Journal of the Acoustical Society of America. 41:1967;506-512.
74. Steiger, H (1980). Some informal observations concerning the perceptual organization of patterns containing frequency glides. Technical report, McGill University, Montreal.
75. Steiger H., Bregman A.S. Capturing frequency components of glided tones: frequency separation, orientation, and alignment. Perception and Psychophysics. 30:1981;425-435.
76. Summerfield Q. Roles of harmonicity and coherent frequency modulation in auditory grouping. Schouten M.E.H. Audition, speech, and language. 1992;Mouton, Berlin.
77. Summerfield Q., Culling J.F. Auditory segregation of competing voices: Absence of effects of fm or am coherence. Carlyon R.P., Darwin C.J., Russel I.J. Processing of complex sounds by the auditory system. 1992;Clarendon Press, Oxford.
78. Terhardt E. Zur Tonhohenwahrnehmung von Klangen. Acustica. 26:1972;173-199.
79. Tougas Y., Bregman A.S. The crossing of auditory streams. Journal of Experimental Psychology: Human Perception and Performance. 11:1990;788-798.
80. Wagner H., Takahashi T. Influence of temporal cues on acoustic motion-direction sensitivity of auditory neurons in the owl. Journal of Neurophysiology. 68:1992;2063-2076.
81. Yost W., Hill R., Perez-Falcon T. Pitch and pitch discrimination of broadband signals with rippled power spectra. Journal of the Acoustical Society of America. 63:1978;1166-1173.