Auditory model based direction estimation of concurrent speakers from binaural signals

Speech Communication

Volumn 53, Issue 5, 2011, Pages 592-605

  Dietz, Mathias ^a   Ewert, Stephan D ^a   Hohmann, Volker ^a  

^a UNIVERSITY OF OLDENBURG   (Germany)

Author keywords

Auditory modeling; Binaural processing; Direction estimation

Indexed keywords

AUDITORY MODELING; AUDITORY MODELS; BINAURAL PROCESSING; BINAURAL SIGNALS; COMPUTATIONAL MODEL; DIRECTION ESTIMATION; DIRECTION-OF-ARRIVAL ESTIMATION; DOA ESTIMATION; FINE STRUCTURES; FREE FIELDS; FREQUENCY RANGES; HIGH TEMPORAL RESOLUTION; HUMAN AUDITORY SYSTEM; INTERAURAL TIME DELAYS; SOUND LOCALIZATION; TEMPORAL ENVELOPES; TEMPORAL RESOLUTION; TIME CONSTANTS;

ACOUSTIC FIELDS; AUDITION; DIRECTION OF ARRIVAL; FEATURE EXTRACTION;

FREQUENCY ESTIMATION;

EID: 79953649387     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2010.05.006     Document Type: Article

References (63)

1. Ajmera, J., Lathoud, G., McCowan, L., 2004. Clustering and segmenting speakers and their locations in meetings. In: Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '04)', vol. 1, pp. I-605-8.
2. J.B. Allen, D.A. Berkley, and J. Blauert Multimicrophone signal-processing technique to remove room reverberation from speech signals J Acoust Soc Am 62 4 1977 912 915 (Pubitemid 8199278)
3. L.R. Bernstein, and C. Trahiotis Detection of interaural delay in high-frequency sinusoidally amplitude-modulated tones, two-tone complexes, and bands of noise J. Acoust. Soc. Am. 95 6 1994 3561 3567
4. L.R. Bernstein, and C. Trahiotis Enhancing sensitivity to interaural delays at high frequencies by using transposed stimuli J. Acoust. Soc. Am. 112 3 Pt 1 2002 1026 1036 (Pubitemid 35006660)
5. J. Blauert, and W. Lindemann Auditory spaciousness: some further psychoacoustic analyses J. Acoust. Soc. Am. 80 2 1986 533 542
6. J. Braasch Localization in the presence of a distracter and reverberation in the frontal horizontal plane. II. Model algorithms Acta acustica/Acustica 88 2002 956 969
7. A. Brand, O. Behrend, T. Marquardt, D. McAlpine, and B. Grothe Precise inhibition is essential for microsecond interaural time difference coding Nature 417 6888 2002 543 547 (Pubitemid 34595920)
8. J. Breebaart, S. van de Par, and A. Kohlrausch Binaural processing model based on contralateral inhibition. III. Dependence on temporal parameters J. Acoust. Soc. Am. 110 2 2001 1105 1117 (Pubitemid 32734744)
9. C.E. Cherry Some experiments on the recognition of speech, with one and with two ears J. Acoust. Soc. Am. 25 5 1953 975 979
10. M. Cooke Glimpsing speech J. Phonetics 31 3-4 2003 579 584 Temporal Integration in the Perception of Speech (Pubitemid 37495930)
11. M.P. Cooke, and G.J. Brown Computational auditory scene analysis: exploiting principles of perceived continuity Speech Commun. 13 3-4 1993 391 399
12. J.F. Culling, and H.S. Colburn Binaural sluggishness in the perception of tone sequences and speech in noise J. Acoust. Soc. Am. 107 1 2000 517 527 (Pubitemid 30039176)
13. A. de Cheveigné, and H. Kawahara Multiple period estimation and pitch perception model Speech Commun. 27 1999 175 185
14. A. de Cheveigné, and H. Kawahara YIN, a fundamental frequency estimator for speech and music J. Acoust. Soc. Am. 111 4 2002 1917 1930 (Pubitemid 34297247)
15. M. Dietz, S.D. Ewert, and V. Hohmann Lateralization of stimuli with independent fine-structure and envelope-based temporal disparities J. Acoust. Soc. Am. 125 3 2009 1622 1635
16. M. Dietz, S.D. Ewert, V. Hohmann, and B. Kollmeier Coding of temporally fluctuating interaural timing disparities in a binaural processing model based on phase differences Brain Res. 1220 2008 234 245 (Pubitemid 352004031)
17. R. Drullman, and A.W. Bronkhorst Multichannel speech intelligibility and talker recognition using monaural, binaural, and three-dimensional auditory presentation J. Acoust. Soc. Am. 107 4 2000 2224 2235 (Pubitemid 30194377)
18. S.D. Ewert, and T. Dau Characterizing frequency selectivity for envelope fluctuations J. Acoust. Soc. Am. 108 3 2000 1181 1196
19. C. Faller, and J. Merimaa Source localization in complex listening situations: selection of binaural cues based on interaural coherence J. Acoust. Soc. Am. 116 5 2004 3075 3089 (Pubitemid 39575553)
20. J.S. Garofolo, L.F. Lamel, W.M. Fisher, J.G. Fiscus, D.S. Pallett, and N.L. Dahlgren DARPA TIMIT acoustic-phonetic continuous speech corpus CD-ROM U.S. Dept. of Commerce NTIS, Gaithersburg, MD 1990
21. M.J. Goupell, and W.M. Hartmann Interaural fluctuations and the detection of interaural incoherence: bandwidth effects J. Acoust. Soc. Am. 119 6 2006 3971 3986 (Pubitemid 43886370)
22. G. Grimm, V. Hohmann, and B. Kollmeier Increase and subjective evaluation of feedback stability in hearing aids by a binaural coherence based noise reduction scheme IEEE Trans. Audio, Speech, Language Process. 17 7 2009 1408 1419
23. Hartikainen, J., Särkkä, S., 2008. Optimal filtering with Kalman filters and smoothers - a Manual for Matlab toolbox EKF/UKF, Department of Biomedical Engineering and Computational Science, Helsinki University of Technology, Version 1.2.
24. S. Haykin, and Z. Chen The cocktail party problem Neural Comput. 17 9 2005 1875 1902 (Pubitemid 41053627)
25. P. Heil Coding of temporal onset envelope in the auditory system Speech Commun. 41 1 2003 123 134
26. V. Hohmann Frequency analysis and synthesis using a Gammatone filterbank Acta Acustica/Acustica 88 2002 433 442 (Pubitemid 34732126)
27. P.X. Joris, B. van de Sande, A. Recio-Spinoso, and M. van der Heijden Auditory midbrain and nerve responses to sinusoidal variations in interaural correlation J. Neurosci. 26 1 2006 279 289 (Pubitemid 43089541)
28. H. Kayser, S.D. Ewert, J. Anemüller, T. Rohdenburg, V. Hohmann, and B. Kollmeier Database of multichannel in-ear and behind-the-ear head-related and binaural room impulse responses EURASIP J. Appl. Sig. Proc 2009
29. C.H. Knapp, and G.C. Carter The generalized correlation method for estimation of time delay IEEE Trans. Acoustics, Speech, Signal Process. 24 1976 320 327
30. J. Koehnke, H.S. Colburn, and N.I. Durlach Performance in several binaural-interaction experiments J. Acoust. Soc. Am. 79 5 1986 1558 1562 (Pubitemid 16071709)
31. B. Kollmeier, and R.H. Gilkey Binaural forward and backward masking: evidence for sluggishness in binaural detection J. Acoust. Soc. Am. 87 4 1990 1709 1719 (Pubitemid 20256466)
32. G.F. Kuhn Model for the interaural time differences in the azimuthal plane J. Acoust. Soc. Am. 62 1 1977 157 167 (Pubitemid 8143808)
33. Y. Li, and D. Wang On the optimality of ideal binary time-frequency masks Speech Commun. 51 3 2009 230 239
34. W. Lindemann Extension of a binaural cross-correlation model by contralateral inhibition. I. Simulation of lateralization for stationary signals J. Acoust. Soc. Am. 80 6 1986 1608 1622 (Pubitemid 17208416)
35. C. Liu, B.C. Wheeler, D. William, J. O'Brien, R.C. Bilger, C.R. Lansing, and A.S. Feng Localization of multiple sound sources with two microphones J. Acoust. Soc. Am. 108 4 2000 1888 1905
36. D.H.G. Louage, P.X. Joris, and M. van der Heijden Decorrelation sensitivity of auditory nerve and anteroventral cochlear nucleus fibers to broadband and narrowband noise J. Neurosci. 26 1 2006 96 108 (Pubitemid 43089522)
37. T. Marquardt, and D. McAlpine Hearing - From Sensory Processing to Perception Chapter A Pi-Limit for Coding ITDs: Implications for Binaural Models 2007 pp. 312-318
38. May, T., van de Par, S., Kohlrausch, A., in press. A probabilistic model for robust localization based on a binaural auditory front-end. In: IEEE Trans. Audio, Speech, Language Process, doi: 10.1109/TASL.2010.2042128.
39. D. McAlpine, D. Jiang, and A.R. Palmer A neural code for low-frequency sound localization in mammals Nature Neurosci. 4 2001 396 401 (Pubitemid 32260116)
40. B.C.J. Moore, and B.R. Glasberg Suggested formulae for calculating auditory filter bandwidths and excitation patterns J. Acoust. Soc. Am. 74 1983 750 753 (Pubitemid 13019047)
41. J. Nix, and V. Hohmann Sound source localization in real sound fields based on empirical statistics of interaural parameters J. Acoust. Soc. Am. 119 1 2006 463 479 (Pubitemid 43104728)
42. J. Nix, and V. Hohmann Combined estimation of spectral envelopes and sound source direction of concurrent voices by multidimensional statistical filtering IEEE Trans. Audio, Speech, Language Process. 15 3 2007 995 1008
43. A. Palmer, and I. Russell Phase-locking in the cochlear nerve of the guinea-pig and its relation to the receptor potential of inner hair-cells Hear Res. 24 1 1986 1 15
44. K.J. Palomäki, G.J. Brown, and D. Wang A binaural processor for missing data speech recognition in the presence of noise and small-room reverberation Speech Commun. 43 2004 361 378
45. H.-M. Park, and R.M. Stern Spatial separation of speech signals using amplitude estimation based on interaural comparisons of zero-crossings Speech Commun. 51 1 2009 15 25
46. Patterson, R.D., Nimmo-Smith, I., Holdsworth, J., Rice, P., 1987. An efficient auditory filterbank based on the gammatone function, Paper presented at the Meeting of the IOC Speech Group on Auditory Modeling at RSRE, 14-15 December.
47. J. Peissig, and B. Kollmeier Directivity of binaural noise reduction in spatial multiple noise-source arrangements for normal and impaired listeners J. Acoust. Soc. Am. 101 3 1997 1660 1670 (Pubitemid 27114270)
48. I. Pollack, and W.J. Trittipoe Binaural listening and interaural noise cross correlation J. Acoust. Soc. Am. 31 9 1959 1250 1252
49. S. Puria, W.T. Peake, and J.J. Rosowski Sound-pressure measurements in the cochlear vestibule of human-cadaver ears J. Acoust. Soc. Am. 101 5 1997 2754 2770
50. Rohdenburg, T., Goetze, S., Hohmann, V., Kammeyer, K.-D., Kollmeier, B., 2008. Objective perceptual quality assessment for self-steering binaural hearing aid microphone arrays. In: International Conference on Acoustics, Speech, and Signal Processing (ICASSP 08)', Las Vegas, USA, pp. 2449-2452.
51. N. Roman, and D. Wang Binaural tracking of multiple moving sources IEEE Trans. Audio, Speech, Language Process. 16 4 2008 728 739
52. N. Roman, D. Wang, and G.J. Brown Speech segregation based on sound localization J. Acoust. Soc. Am. 114 4 Pt 1 2003 2236 2252 (Pubitemid 37266649)
53. M.A. Ruggero, and N.C. Rich Furosemide alters organ of corti mechanics: evidence for feedback of outer hair cells upon the basilar membrane J. Neurosci. 11 4 1991 1057 1067
54. S. Särkkä, A. Vehtari, and J. Lampinen Rao-Blackwellized particle filter for multiple target tracking Inform. Fus. 8 1 2007 2 15 (Pubitemid 44751677)
55. B.M. Sayers Acoustic-image lateralization judgments with binaural tones J. Acoust. Soc. Am. 36 5 1964 923 926
56. I. Siveke, S.D. Ewert, B. Grothe, and L. Wiegrebe Psychophysical and physiological evidence for fast binaural processing J. Neurosci. 28 9 2008 2043 2052 (Pubitemid 351317627)
57. S. Srinivasan, N. Roman, and D.L. Wang Binary and ratio time-frequency masks for robust speech recognition Speech Commun. 48 11 2006 1486 1501 (Pubitemid 44634774)
58. B. Supper, T. Brookes, and F. Rumsey An auditory onset detection algorithm for improved automatic source localization IEEE Trans. Audio, Speech, Language Process. 14 2006 1008 1017 (Pubitemid 46547662)
59. S.P. Thompson On the function of the two ears in the perception of space Philos. Mag. 13 1882 406 416
60. S. van de Par, and A. Kohlrausch Dependence of binaural masking level differences on center frequency, masker bandwidth, and interaural parameters J. Acoust. Soc. Am. 106 4 Pt 1 1999 1940 1947
61. D. Wang, G.J. Brown, Computational Auditory Scene Analysis: Principles, Algorithms and Applications 2006 Wiley, Hoboken NJ
62. T. Wittkop, and V. Hohmann Strategy-selective noise reduction for binaural digital hearing aids Speech Commun. 39 1-2 2003 111 138 (Pubitemid 35412365)
63. M. Wu, D. Wang, and G.J. Brown A multipitch tracking algorithm for noisy speech IEEE Trans. Audio, Speech, Language Process. 11 3 2003 229 241