Neural and perceptual modeling

Computational Auditory Scene Analysis: Principles, Algorithms, and Applications

Volumn , Issue , 2006, Pages 351-387

  Brown, Guy J ^a   Wang, DeLiang ^b  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

^b Ohio State University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 38849183907     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1109/9780470043387.ch10     Document Type: Chapter

References (105)

1. C. Alain, S. R. Arnott, and T. W. Picton. Bottom-up and top-down influences on auditory scene analysis: Evidence from event-related brain potentials. Journal of Experimental Psychology: Human Perception and Performance, 27(5): 1072-1089, 2001.
2. C. Alain and A. Izenberg. Effects of attentional load on auditory scene analysis. Journal of Cognitive Neuroscience, 15(7): 1063-1073, 2003.
3. C. Alain, B. M. Schuler, and K. L. McDonald. Neural activity associated with distinguishing concurrent auditory objects. Journal of the Acoustical Society of America, 111(2):990-995, 2002.
4. S. Anstis and S. Saida. Adaptation to auditory streaming of frequency-modulated tones. Journal of Experimental Psychology: Human Perception and Performance, 11(3): 257-271, 1985.
5. M. A. Arbib, editor. Handbook of Brain Theory and Neural Networks, 2nd ed. MIT Press, Cambridge, MA, 2003.
6. P. F. Assmann. Modeling the perception of concurrent vowels: Role of formant transitions. Journal of the Acoustical Society of America, 100(2): 1141-1152, 1996.
7. P. F. Assmann and Q. Summerfield. Modeling the perception of concurrent vowels: Vowels with different fundamental frequencies. Journal of the Acoustical Society of America, 88:680-697, 1990.
8. B. Baird. Synchronized auditory and cognitive 40 Hz attentional streams, and the impact of rhythmic expectation on auditory scene analysis. In M. Jordan, M. Keams, and S. Solla, editors, Neural Information Processing Systems, volume 10, pp. 3-10. MIT Press, Cambridge, MA, 1997.
9. H. B. Barlow. Single units and cognition: A neuron doctrine for perceptual psychology. Perception, 1:371-394, 1972.
10. D. S. Barth and K. D. MacDonald. Thalamic modulation of high-frequency oscillating potentials in auditory cortex. Nature, 383:78-81, 1996.
11. E. Basar, C. Basar-Eroglu, S. Karakas, and M. Schurmann. Brain oscillations in perception and memory. International Journal of Psychophysiology, 35(2-3):95-124, 2000.
12. M. Bauer and W. Martienssen. Coupled circle maps as a tool to model synchronization in neural networks. Network, 2:345-351, 1991.
13. M. W. Beauvois and R. Meddis. A computer model of auditory stream segregation. Quarterly Journal of Experimental Psychology, 43 A(3): 517-541, 1991.
14. M. W. Beauvois and R. Meddis. Computer simulation of auditory stream segregation in alternating tone sequences. Journal of the Acoustical Society of America, 99(4): 2270-2280, 1996.
15. F. Berthommier and G. Meyer. Improving amplitude modulation maps for FO-depen-dent segregation of harmonic sounds. In Proceedings of Eurospeech, pp. 2483-2486, Rhodes, Greece, September 1997.
16. A. S. Bregman. Auditory Scene Analysis. MIT Press, Cambridge, MA, 1990.
17. A. S. Bregman and J. Campbell. Primary auditory stream segregation and perception of order in rapid sequences of tones. Journal of Experimental Psychology, 89:244-249, 1971.
18. A. S. Bregman and S. Pinker. Auditory streaming and the building of timbre. Canadian Journal of Psychology, 32:19-31, 1978.
19. A. S. Bregman and A. I. Rudnicky. Auditory segregation: Stream or streams? Journal of Experimental Psychology, 1(3):263-267, 1975.
20. M. Brosch, E. Budinger, and H. Scheich. Stimulus-related gamma oscillations in primate auditory cortex. Journal of Neurophysiology, 87:2715-2725, 2002.
21. G. J. Brown. Computational Auditory Scene Analysis: A Representational Approach. PhD thesis, University of Sheffield, 1992.
22. G. J. Brown and M. P. Cooke. Computational auditory scene analysis. Computer Speech and Language, 8:297-336, 1994.
23. G. J. Brown and M. P. Cooke. Temporal synchronization in a neural oscillator model of primitive auditory stream segregation. In D. F. Rosenthal and H. G. Okuno, editors, Computational Auditory Scene Analysis, pp. 87-101. Lawrence Erlbaum, Mahwah, NJ, 1998.
24. G. J. Brown and D. Wang. Timing is of the essence: Neural oscillator models of auditory grouping. In S. Greenberg and W. A. Ainsworth, editors, Listening to Speech: An Auditory Perspective. Lawrence Erlbaum, Mahwah, NJ, 2005.
25. G. J. Brown and D. L. Wang. Modelling the perceptual segregation of concurrent vowels with a network of neural oscillators. Neural Networks, 10(9): 1547-1558, 1997.
26. G. J. Brown, D. L. Wang, and J. Barker. A neural oscillator sound separator for missing data speech recognition. In Proceedings of the International Joint Conference on Neural Networks, Washington DC, July 2001.
27. P. Cariani. Neural timing nets for auditory computation. In S. Greenberg and M. Slaney, editors, Computational Models of Auditory Function, pp. 235-249. IOS Press, Amsterdam, 2001.
28. P. Cariani. Recurrent timing nets for FO-based speaker separation. In P. Divenyi, editor, Speech Separation by Humans and Machines, pp. 31-53. Springer-Verlag, New York, 2005.
29. R. P. Carlyon, R. Cusack, J. M. Foxton, and I. H. Robertson. Effects of attention and unilateral neglect on auditory stream segregation. Journal of Experimental Psychology: Human Perception and Performance, 27(1): 115-127, 2001.
30. P. Chang. Exploration of Behavioural, Physiological and Computational Approaches to Auditory Scene Analysis. Master’s thesis, The Ohio State University, Department of Computer Science and Engineering. Available at http://www.cse.ohio-state.edu/pnl/theses.html, 2004.
31. M. P. Cooke. Modelling Auditory Processing and Organization. PhD thesis, University of Sheffield, 1991 (also published by Cambridge University Press, Cambridge, UK, 1993).
32. J. Cosp and J. Madrenas. Scene segmentation using neuromorphic oscillatory networks. IEEE Transactions on Neural Networks, 14(5): 1278-1296, 2003.
33. F. Crick. Function of the thalamic reticular complex: The searchlight hypothesis. Proceedings of the National Academy of Sciences USA, 81:4586-4590, 1984.
34. J. F. Culling and C. J. Darwin. Perceptual and computational separation of simultaneous vowels: Cues arising from low-frequency beating. Journal of the Acoustical Society of America, 95(3): 1559-1569, 1994.
35. C. J. Darwin, R. W. Hukin, and B. Y. Al-Khatib. Grouping in pitch perception: Evidence for sequential constraints. Journal of the Acoustical Society of America, 98(2):880-885, 1995.
36. A. de Cheveigne. Separation of concurrent harmonic sounds: Fundamental frequency estimation and a time-domain cancellation model of auditory processing. Journal of the Acoustical Society of America, 93(6):3271-3290, 1993.
37. A. de Cheveigne. Concurrent vowel identification. III. A neural model of harmonic interference cancellation. Journal of the Acoustical Society of America, 101(5):2857-2865, 1997.
38. A. de Cheveigne, H. Kawahara, M. Tsuzaki, and K. Aikawa. Concurrent vowel identification. I. Effects of relative amplitude and FO difference. Journal of the Acoustical Society of America, 101(5):2839-2847, 1996.
39. R. C. deCharms and M. M. Merzenich. Primary cortical representation of sounds by the coordination of action-potential timing. Nature, 381:610-613, 1996.
40. R. Eckhorn, R. Bauer, W. Jordan, M. Brosch, W. Kruse, M. Munk, and H. Reitboeck. Coherent oscillations: A mechanism of feature linking in the visual cortex. Biological Cybernetics, 60:121-130, 1988.
41. R. Fitzhugh. Impulses and physiological states in models of nerve membrane. Biophysical Journal, 1:445-466, 1961.
42. W. J. Freeman. Spatial properties of an EEG event in the olfactory bulb and cortex. Electroencephalography and Clinical Neurophysiology, 44:586-605, 1978.
43. R. Galambos, S. Makeig, and P. J. Talmachoff. A 40-Hz auditory potential recorded from the human scalp. Proceedings of the National Academy of Sciences USA, 78:2643-2647, 1981.
44. J. Grassman. Asymptotic Methods for Relaxation Oscillations and Applications. Springer-Verlag, New York, 1987.
45. C. M. Gray. The temporal correlation hypothesis of visual feature integration: Still alive and well. Neuron, 24:31-47, 1999.
46. C. M. Gray, P. König, A. K. Engel, and W. Singer. Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties. Nature, 338:334-337, 1989.
47. S. Grossberg, K. K. Govindarajan, L. Wyse, and M. A. Cohen. ARTSTREAM: A neural network model of auditory scene analysis and source segregation. Neural Networks, 17:511-536, 2004.
48. R. Hecht-Nielsen. A theory of the cerebral cortex. In Proceedings of the International Conference on Neural Information Processing (ICONIP), pp. 1459-1464, Burke, VA, IOS Press, Amsterdam, 1998.
49. M. J. Hewitt, R. Meddis, and T. M. Shackleton. A computer model of a cochlear-nucle-us stellate cell: Responses to amplitude-modulation and pure tone stimuli. Journal of the Acoustical Society of America, 91(4):2096-2109, 1992.
50. A. L. Hodgkin and A. F. Huxley. A quantitative description of membrane current and its application to conduction and excitation in nerve. Journal of Physiology (London), 117:500-544, 1952.
51. D. H. Hubel and T. N. Wiesel. Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex. Journal of Physiology, 160:106-154, 1962.
52. L. A. Jeffress. A place theory of sound localization. Journal of Comparative and Physiological Psychology, 41:35-39, 1948.
53. M. Joliot, U. Ribary, and R. Llinas. Human oscillatory brain activity near to 40 Hz coexists with cognitive temporal binding. Proceedings of the National Academy of Sciences USA, 91:11748-11741, 1994.
54. M. R. Jones, G. Kidd, and R. Wetzel. Evidence for rhythmic attention. Journal of Experimental Psychology: Human Perception and Performance, 7:1059-1073, 1981.
55. E. R. Kandel, J. H. Schwartz, and T. M. Jessell, Principles of Neural Science, 3rd ed,. Elsevier, New York, 1991.
56. E. W. Large and M. R. Jones. The dynamics of attending: How we track time-varying events. Psychological Review, 106:119-159, 1999.
57. F. Liu, Y. Yamaguchi, and H. Shimizu. Flexible vowel recognition by the generation of dynamic coherence in oscillator neural networks: Speaker-independent vowel recognition. Biological Cybernetics, 71(2): 105-114, 1994.
58. R. Llinas and U. Ribary. Coherent 40-Hz oscillation characterizes dream state in humans. Proceedings of the National Academy of Sciences USA, 90:2078-2082, 1993.
59. D. Marr. Vision. W. H. Freeman, San Francisco, CA, 1982.
60. S. McAdams and A. S. Bregman. Hearing musical streams. Computer Music Journal, 3:26-43, 1979.
61. S. L. McCabe and M. J. Denham. A model of auditory streaming. Journal of the Acoustical Society of America, 101(3):1611-1621, 1997.
62. H. McGurk and J. McDonald. Hearing lips and seeing voices. Nature, 264:746-748, 1976.
63. J. D. McKeown and R. D. Patterson. The time course of auditory segregation: Concurrent vowels that vary in duration. Journal of the Acoustical Society of America, 98(4): 1866-1877, 1995.
64. R. Meddis. Simulation of mechanical to neural transduction in the auditory receptor. Journal of the Acoustical Society of America, 79(3):702-711, 1986.
65. R. Meddis. Simulation of auditory-neural transduction: Further studies. Journal of the Acoustical Society of America, 83(3): 1056-1063, 1988.
66. R. Meddis. Computer models of possible physiological contributions to low-level auditory scene analysis. Journal of the Acoustical Society of America, 115(5):2457, 2004.
67. R. Meddis and M. J. Hewitt. Modeling the identification of concurrent vowels with different fundamental frequencies. Journal of the Acoustical Society of America, 91(1):233-245, 1992.
68. G. A. Miller and G. A. Heise. The trill threshold. Journal of the Acoustical Society of America, 22:637-638, 1950.
69. R. E. Mirollo and S. H. Strogatz. Synchronization of pulse coupled biological oscillators. SI AM Journal on Applied Mathematics, 50:1645-1662, 1990.
70. J. Nagumo, S. Arimoto, and S. Yoshizawa. An active pulse transmission line simulating nerve axon. Proceedings of the IRE, 50:2061-2070, 1962.
71. T. Nishikawa, Y. C. Lai, and F. C. Hoppensteadt. Capacity of oscillatory associative-memory networks with error-free retrieval. Physical Review Letters, 92(10): 108101, 2004.
72. M. Norris. Assessment and Extension of Wang’s Oscillatory Model of Auditory Stream Segregation. PhD thesis, University of Queensland, School of Information Technology and Electrical Engineering, 2003.
73. R. D. Patterson, M. H. Allerhand, and C. Giguere. Time-domain modeling of peripheral auditory processing: A modular architecture and a software platform. Journal of the Acoustical Society of America, 98(4): 1890-1894, 1995.
74. R. D. Patterson and T. Irino. Modeling temporal asymmetry in the auditory system. Journal of the Acoustical Society of America, 104(5):2967-2979, 1998.
75. C. S. Peskin. Mathematical Aspects of Heart Physiology. NYU Courant Institute of Mathematical Sciences, New York, 1975.
76. R. Pichevar and J. Rouat. Cochleotopic/AM topic (CAM) and cochleotopic/spectro-topic (CSM) map based sound separation using relaxation oscillatory neurons. In Proceedings of the IEEE 13th Workshop on Neural Networks for Signal Processing, pp. 657-666, September 2003.
77. R. Pichevar and J. Rouat. Monophonic source separation with an unsupervised network of spiking neurones. Speech Communication, submitted, 2005.
78. A. N. Popper and R. R. Fay, editors. The Mammalian Auditory Pathway: Neurophysiology. Springer-Verlag, New York, 1992.
79. W. S. Rhode and S. Greenberg. Physiology of the cochlear nuclei. In A. N. Popper and R. R. Fay, editors, The Mammalian Auditory Pathway: Neurophysiology. Springer-Verlag, New York, 1992.
80. U. Ribary, A. A. Ioannides, K. D. Singh, R. Hasson, J. P. Bolton, F. Lado, A. Mogilner, and R. Llinäs. Magnetic field tomography of coherent thalamocortical 40-Hz oscillations in humans. Proceedings of the National Academy of Sciences USA, 88(24): 11037-11041, 1991.
81. B. Sagi, S. C. Nemat-Nasser, R. Kerr, R. Hayek, C. Downing, and R. Hecht-Nielsen. A biologically motivated solution to the cocktail party problem. Neural Computation, 13:1575-1602, 2001.
82. W. Singer. Synchronization of cortical activity and its putative role in information processing and learning. Annual Review of Physiology, 55:349-374, 1993.
83. W. Singer and C. M. Gray. Visual feature integration and the temporal correlation hypothesis. Annual Review ofNeuroscience, 18:555-586, 1995.
84. C. J. Spence and J. Driver. Covert spatial orienting in audition: Exogenous and endogenous mechanisms. Journal of Experimental Psychology: Human Perception and Performance, 20(3):555-574, 1994.
85. E. Sussman, W. Ritter, and H. G. Vaughan. An investigation of the auditory streaming effect using event-related brain potentials. Psychophysiology, 36:22-34, 1999.
86. D. Terman and D. L. Wang. Global competition and local cooperation in a network of neural oscillators. Physica D, 81:148-176, 1995.
87. N. Todd. An auditory cortical theory of primitive auditory grouping. Network: Computation in Neural Systems, 7:349-356, 1996.
88. W. M. Usrey and R. C. Reid. Synchronous activity in the visual system. Annual Review of Physiology, 61:435-456, 1999.
89. A. J. W. van der Kouwe, D. L. Wang, and G. J. Brown. A comparison of auditory and blind separation techniques for speech segregation. IEEE Transactions on Speech and Audio Processing, 9:189-195, 2001.
90. B. van der Pol. On “relaxation oscillations.” Philosophical Magazine, 2(11):978-992, 1926.
91. L. P. A. S. van Noorden. Temporal Coherence in the Perception of Tone Sequences. PhD thesis, Eindhoven University of Technology, 1975.
92. F. Varela, J. P. Lachaux, E. Rodriguez, and J. Martinerie. The brainweb: Phase synchronization and large-scale integration. Nature Reviews Neuroscience, 2:229-239, 2001.
93. C. von der Malsburg. The correlation theory of brain function. Technical Report 81-2, Max-Planck-Institute for Biophysical Chemistry, 1981. (Reprinted in Models of Neural Networks II, E. Domany, J. L. van Hemmen, and K. Schulten, editors. Springer-Verlag, Berlin, 1994).
94. C. von der Malsburg and W. Schneider. A neural cocktail-party processor. Biological Cybernetics, 54:29-30, 1986.
95. D. L. Wang. Auditory stream segregation based on oscillatory correlation. In Proceedings of the IEEE International Workshop on Neural Networks for Signal Processing, pp. 624-632, Ermioni, Greece, September 1994.
96. D. L. Wang. Primitive auditory segregation based on oscillatory correlation. Cognitive Science, 20:409-456, 1996.
97. D. L. Wang. Relaxation oscillators and networks. In J. G. Webster, editor, Encyclopedia of Electrical and Electronics Engineering, pp. 396-405. Wiley, New York, 1999. (Available for download from www.cse.ohio-state.edu/~dwang.)
98. D. L. Wang. The time dimension for scene analysis. IEEE Transactions on Neural Networks, 16(6): 1401-1426, 2005.
99. D. L. Wang and G. J. Brown. Separation of speech from interfering sounds using oscillatory correlation. IEEE Transactions on Neural Networks, 10(3):684-697, 1999.
100. D. L. Wang, J. Buhmann, and C. von der Malsburg. Pattern segmentation in associative memory. Neural Computation, 2:94-106, 1990.
101. D. L. Wang and D. Terman. Locally excitatory globally inhibitory oscillator networks. IEEE Transactions on Neural Networks, 6(1):283-286, 1995.
102. L. Wiegrebe and R. Meddis. The representation of periodic sounds in simulated sustained chopper units of the ventral cochlear nucleus. Journal of the Acoustical Society of America, 115(3): 1207-1218, 2004.
103. S. N. Wrigley. A Theory and Computational Model of Auditory Selective Attention. PhD thesis, Department of Computer Science, University of Sheffield, 2002.
104. S. N. Wrigley and G. J. Brown. A computational model of auditory selective attention. IEEE Transactions on Neural Networks, 15:1151-1163, 2004.
105. T. C. T. Yin and J. C. K. Chan. Interaural time sensitivity in medial superior olive of cat. Journal of Neurophysiology, 64(2):465-488, 1990.