Binaural dereverberation

The Technology of Binaural Listening

Volumn , Issue , 2013, Pages 359-396

  Tsilfidis, A ^a   Westermann, A ^b   Buchholz, J M ^b   Georganti, E ^a   Mourjopoulos, J ^a  

^a UNIVERSITY OF PATRAS   (Greece)

^b MACQUARIE UNIVERSITY   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

ARCHITECTURAL ACOUSTICS; AUDITION; DIGITAL DEVICES; HEARING AIDS; REVERBERATION; SPEECH INTELLIGIBILITY;

AMPLITUDE DIFFERENCE; AUTOMATIC SPEECH RECOGNITION SYSTEM; DIGITAL HEARING AIDS; MULTIPLE-INPUT CHANNELS; PERCEPTUAL EVALUATION; REVERBERATION EFFECTS; SOUND SOURCE LOCALIZATION; SPECTRAL SUBTRACTIONS;

SPEECH RECOGNITION;

EID: 85030992772     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1007/978-3-642-37762-4_14     Document Type: Chapter

References (130)

1. 3GPP TS26.073. ANSI-C code for the Adaptive Multi Rate (AMR) speech codec. Technical report, 3rd Generation Partnership Project, Valbonne, France, 2008.
2. J. B. Allen, D. A. Berkley, and J. Blauert. Multimicrophone signal-processing technique to remove room reverberation from speech signals. J. Acoust. Soc. Amer., 62: 912-915, 1977.
3. J. B. Allen and L. R. Rabiner. A unified approach to short-time fourier analysis and synthesis. In Proc. of the IEEE, volume 65, pages 1558-1564, 1977.
4. I. Arweiler and J. M. Buchholz. The influence of spectral and spatial characteristics of early reflections on speech intelligibility. J. Acoust. Soc. Am., 130: 996-1005, 2011.
5. C. Avendano and H. Hermansky. Study on the dereverberation of speech based on temporal processing. In Proc. ICSLP, 1996.
6. M. Barron and A. Marshall. Spatial impression due to early lateral reflections in concert halls: The derivation of a physical measure. J. Sound Vibr., 77: 211-232, 1981.
7. S. Bech and N. Zacharov. Perceptual Audio Evaluation: Theory, method and application, pages 39-96. Wiley and Sons Ltd., West Sussex, Great Britain, 2006.
8. D. Bees, M. Blostein, and P. Kabal. Reverberant speech enhancement using cepstral processing. In Proc. IEEE-ICASSP, volume 2, pages 977-980, 1991.
9. M. Berouti, R. Schwartz, and J. Makhoul. Enhancement of speech corrupted by acoustic noise. In Proc. IEEE-ICASSP, volume 4, pages 208-211, 1979.
10. S. Bharitkar, P. Hilmes, and C. Kyriakakis. Robustness of spatial average equalization: A statistical reverberation model approach. J. Acoust. Soc. Am., 116: 3491-3497, 2004.
11. F. A. Bilsen and R. J. Ritsma. Repetition pitch and its implications for hearing theory. Acustica, 22: 63-73, 1969/70.
12. J. Bitzer, K. U. Simmer, and K.-D. Kammeyer. Theoretical noise reduction limits of the generalized sidelobe canceller (GSC) for speech enhancement. In Proc. IEEE-ICASSP, volume 5, pages 2965-2968, 1999.
13. J. Blauert. Spatial Hearing. MIT Press, 1997.
14. J. P. Bloom. Evaluation of a dereverberation process by normal and impaired listeners. In Proc. IEEE-ICASSP, volume 5, pages 500-503, 1980.
15. P. Bloom and G. Cain. Evaluation of two-input speech dereverberation techniques. In Proc. IEEE-ICASSP, volume 7, pages 164-167, 1982.
16. S. Boll. Suppression of acoustic noise in speech using spectral subtraction. IEEE Trans. Acoust. Speech, Signal Process., 27: 113-120, 1979.
17. J. S. Bradley, H. Sato, and M. Picard. On the importance of early reflections for speech in rooms. J. Acoust. Soc. Amer., 113: 3233-3244, 2003.
18. J. S. Bradley and G. A. Soulodre. The influence of late arriving energy on spatial impression. J. Acoust. Soc. Am., 97: 263-271, 1995.
19. E. Brandewie and P. Zahorik. Prior listening in rooms improves speech intelligibility. J. Acoust. Soc. Am., 128: 291-299, 2010.
20. A. Bronkhorst and R. Plomp. The effect of head-induced interaural time and level differences on speech intelligility in noise. J. Acoust. Soc. Am., 83: 1508-1516, 1988.
21. J. Buchholz and J. Mourjopoulos. A computational auditory masking model based on signaldependent compression. I. Model description and performance analysis. Acta Acust./Acustica, 90: 873-886, 2004.
22. J. M. Buchholz. Characterizing the monaural and binaural processes underlying reflection masking. Hearing Research, 232: 52-66, 2007.
23. J. M. Buchholz. A quantitative evaluation of spectral mechanisms involved in auditory detection of coloration by a single wall reflection. Hearing Research, 277: 192-203, 2011.
24. J. M. Buchholz, J. Mourjopoulos, and J. Blauert. Room masking: understanding andmodelling themasking of room reflections. In Proc. 110th Conv. Audio Eng. Soc., Amsterdam, NL, 2001.
25. O. Cappe. Elimination of the musical noise phenomenon with the Ephraim and Malah noise suppressor. IEEE Trans. Speech and Audio Process., 2: 345-349, 1994.
26. L. Danilenko. Binaurales Hören im nichtstationären diffusen Schallfeld (Binaural hearing in a nonstationary, diffuse sound field). Kybernetik, 6: 50-57, 1969.
27. A. A. de Lima, T. de M. Prego, S. L. Netto, B. Lee, A. Said, R. W. Schafer, T. Kalker, and M. Fozunbal. On the quality-assessment of reverberated speech. Speech Communication, 54: 393-401, 2012.
28. M. Delcroix, T. Hikichi, and M. Miyoshi. Precise Dereverberation Using Multichannel Linear Prediction. IEEE Trans. Audio, Speech and Language Process., 15: 430-440, 2007.
29. J. Deller, J. Hansen, and J. Proakis. Discrete-time processing of speech signals. Wiley-IEEE Press, 1999.
30. S. Doclo and M. Moonen. Combined frequency-domain dereverberation and noise reduction technique for multi-microphone speech enhancement. In Proc. IEEE IWAENC, pages 31-34, Darmstadt, Germany, 2001.
31. S. Elliott and P. Nelson. Multiple-point equalization in a room using adaptive digital filters. J. Audio Eng. Soc., 37: 899-907, 1989.
32. K. Eneman and M. Moonen. Multimicrophone Speech Dereverberation: Experimental Validation. EURASIP J. Audio Speech and Music Process., pages 1-20, 2007.
33. Y. Ephraim and D. Malah. Speech enhancement using a minimum-mean square error shorttime spectral amplitude estimator. IEEE Trans. Acoust., Speech and, Signal Process., 32: 1109-1121, 1984.
34. J. S. Erkelens and R. Heusdens. Correlation-Based and Model-Based Blind Single-Channel Late-Reverberation Suppression in Noisy Time-Varying Acoustical Environments. IEEE Trans. Audio, Speech and Language Process., 18: 1746-1765, 2010.
35. T. Falk, C. Zheng, and W.-Y. Chan. A non-intrusive quality and intelligibility measure of reverberant and dereverberated speech. IEEE Trans. Audio, Speech and Language Process., 18: 1766-1774, 2010.
36. C. Faller and J. Merimaa. Source localization in complex listening situations: Selection of binaural cues based on interaural coherence. J. Acoust. Soc. Am., 116: 3075-3089, 2004.
37. J. L. Flanagan and R. Lummis. Signal processing to reduce multipath distortion in small rooms. J. Acoust. Soc. Am., 47: 1475-1481, 1970.
38. K. Furuya and A. Kataoka. Robust speech dereverberation using multichannel blind deconvolution with spectral subtraction. IEEE Trans. Audio, Speech and Language Process., 15: 1571-1579, 2007.
39. S. Gannot and M. Moonen. Subspace Methods for Multimicrophone Speech Dereverberation. EURASIP J. Advances in, Signal Process., pp. 1074-1090, 2003.
40. N. Gaubitch, P. Naylor, and D. Ward. On the use of linear prediction for dereverberation of speech. In Proc. of the IEEE IWAENC, pages 99-102, 2003.
41. N. D. Gaubitch and P. A. Naylor. Analysis of the Dereverberation Performance of Microphone Arrays. In Proc. IEEE-IWAENC, 2005.
42. E. Georganti, T. May, S. van de Par, and J. Mourjopoulos. Extracting sound-source-distance information from binaural signals. In J. Blauert, editor, The technology of binaural listening, chapter 7. Springer, Berlin-Heidelberg-New York NY, 2013.
43. B. W. Gillespie, H. S. Malvar, and D. A. F. Florencio. Speech dereverberation via maximumkurtosis subband adaptive filtering. In Proc. IEEE-ICASSP, volume 6, pages 3701-3704, 2001.
44. S. Goetze, E. Albertin, M. Kallinger, A. Mertins, and K.-D. Kammeyer. Quality assessment for listening-room compensation algorithms. In Proc. IEEE-ICASSP, pages 2450-2453, 2010.
45. S. Griebel and M. Brandstein. Wavelet Transform Extrema Clustering For Multi-Channel Speech Dereverberation. In Proc. of the IEEE-IWAENC, pages 27-30, 1999.
46. D. Griesinger. The psychoacoustics of apparent source width, spaciousness and envelopment in performance spaces. Acta Acust./Acustica, 83: 721-731, 1997.
47. E. Habets. Single-and multi-microphone speech dereverberation using spectral enhancement. PhD thesis, Technische Univ. Eindhoven, 2007.
48. E. Habets, S. Gannot, and I. Cohen. Late reverberant spectral variance estimation based on a statistical model. Signal Process. Letters, IEEE, 16(9): 770-773, 2009.
49. V. Hamacher, J. Chalupper, J. Eggers, E. Fischer, U. Kornagel, H. Puder, U. Rass. Signal Processing in High-End Hearing Aids: State of the Art, Challenges, and Future Trends. EURASIP J. Applied, Signal Process., pp. 2915-2929, 2005.
50. Y. Haneda, S. Makino, and Y. Kaneda. Common acoustical pole and zero modeling of Room Transfer Functions. IEEE Trans. Speech and Audio Process., 2: 320-328, 1994.
51. V. Hansen and G. Munch. Making recordings for simulation tests in the Archimedes project. J. Audio Eng. Soc., 39: 768-774, 1991.
52. A. Härmä, M. Karjalainen, L. Savioja, V. Valimaki, U. Laine, and J. Huopaniemi. Frequencywarped signal processing for audio applications. J. Audio Eng. Soc., 48: 1011-1031, 2000.
53. A. Härmä and U. K. Laine. Acomparison ofwarped and conventional linear predictive coding. IEEE Trans. Speech and Audio Process., 9: 579-588, 2001.
54. P. Hatziantoniou and J. Mourjopoulos. Generalized fractional-octave smoothing of audio and acoustic responses. J. Audio Eng. Soc., 48: 259-280, 2000.
55. P. Hatziantoniou and J. Mourjopoulos. Errors in real-time room acoustics dereverberation. J. Audio Eng. Soc., 52: 883-899, 2004.
56. P. Hatziantoniou, J. Mourjopoulos, and J. Worley. Subjective assessments of real-time room dereverberation and loudspeaker equalization. In Proc. 118th Conv. Audio Eng. Soc., 2005.
57. P. D. Hatziantoniou and J. N. Mourjopoulos. Generalized fractional-octave smoothing of audio and acoustic responses. J. Audio Eng. Soc., 48: 259-280, 2000.
58. T. Hidaka, Y. Yamada, and T. Nakagawa. A new definition of boundary point between early reflections and late reverberation in room impulse responses. J. Acoust. Soc. Am., 122(1): 326-332, 2007.
59. J. Hopgood. Nonstationary Signal Processing with Application to Reverberation Cancellation in Acoustic Environments. PhD thesis, University of Cambridge, 2001.
60. J. Hopgood, C. Evers, and J. Bell. Bayesian single channel blind speech dereverberation using Monte Carlo methods. J. Acoust. Soc. Am., 123: 3586, 2008.
61. T. Houtgast, H. Steeneken, and R. Plomp. Predicting speech intelligibility in rooms from the modulation transfer function. i. general room acoustics. Acustica, 61: 60-72, 1980.
62. T. Houtgast and H. J. M. Steeneken. A review of the MTF concept in room acoustics and its use for estimating speech intelligibility in auditoria. J. Acoust. Soc. Am., 77: 1069-1077, 1984.
63. Y. Hu and P. Loizou. Evaluation of objective quality measures for speech enhancement. IEEE Trans. Audio, Speech and Language Processing, 16, 2008.
64. Y. Hu and P. C. Loizou. Subjective comparison and evaluation of speech enhancement algorithms. Speech Communication, 49: 588-601, 2007.
65. International Telecommunications Union, Geneva, Switzerland. Perceptual evaluation of speech quality (PESQ), and objective method for end-to-end speech quality assessment of narrowband telephone networks and speech codecs, 2000.
66. International Telecommunications Union (ITU-T, P.835), Geneva, Switzerland. Subjective test methodology for evaluating speech communication systems that include noise suppression algorithm, 2003.
67. M. Jeub, M. Schaefer, and P. Vary. A Binaural Room Impulse Response Database for the Evaluation of Dereverberation Algorithms. In Proc. 17th Digital Signal Process. Conf., DSP, Santorini, Greece, 2009.
68. M. Jeub, M. Schafer, T. Esch, and P. Vary. Model-based dereverberation preserving binaural cues. IEEE Trans. Audio, Speech, and Lang. Process., 18(7): 1732-1745, 2010.
69. M. Jeub and P. Vary. Binaural dereverberation based on a dual-channel Wiener filter with optimized noise field coherence. In Proc. IEEE-ICASSP, pages 4710-4713, 2010.
70. M. Kallinger and A. Mertins. Impulse response shortening for acoustic listening room compensation. In Proc. IEEE-IWAENC, 2005.
71. M. Karjalainen and T. Paatero. Equalization of loudspeaker and room responses using Kautz filters: direct least squares design. EURASIP J. Appl. Signal Process., 2007.
72. J. M. Kates. Digital Hearing Aids, pages 221-262. Plural Publishing, San Diego, CA, USA, 2008.
73. H. Kayser, S. D. Ewert, J. Anemuller, T. Rohdenburg, V. Hohmann, and B. Kollmeier. Database of Multichannel In-Ear and Behind-the-Ear Head-Related and Binaural Room Impulse Responses. EURASIP J. Appl. Signal Process., 2009: 1-10, 2009.
74. K. Kinoshita, M. Delcroix, T. Nakatani, and M. Miyoshi. Suppression of Late Reverberation Effect on Speech Signal Using Long-Term Multiple-step Linear Prediction. IEEE Trans. Audio, Speech and Language Process., 17: 534-545, 2009.
75. O. Kirkeby and P. Nelson. Digital filter design for inversion problems in sound reproduction. J. Audio Eng. Soc., 47: 583-595, 1999.
76. C. Knapp and G. Carter. The generalized correlation method for estimation of time delay. IEEE Trans. Acoust., Speech and, Signal Process., ASSP-24: 320-327, 1976.
77. A. Koening, J. Allen, D. Berkley, and C. T. Determination of masking level differences in a reverberant environment. J. Acoust. Soc. Am., 61: 1374-1376, 1977.
78. K. Kokkinakis and P. C. Loizou. Evaluation of objective measures for quality assessment of reverberant speech. In Proc. IEEE-ICASSP, pages 2420-2423, 2011.
79. E. Kokkinis, A. Tsilfidis, E. Georganti, and J. Mourjopoulos. Joint noise and reverberation suppression for speech applications. In Proc. 130th Conv. Audio Eng. Soc., London, UK, 2011.
80. B. Köllmeier, J. Peissig, and V. Hohmann. Binaural noise-reduction hearing aid scheme with real-time processing in the frequency domain. Scandinavian Audiol. Suppl., 38: 28-38, 1993.
81. P. Krishnamoorthy and S. R. Mahadeva Prasanna. Reverberant speech enhancement by temporal and spectral processing. IEEE Trans. Audio, Speech and Language Process., 17: 253-266, 2009.
82. D. Kundur and D. Hatzinakos. Blind image deconvolution. IEEE Signal Process. Mag., 13: 43-64, 1996.
83. H. Kuttruff. Room acoustics, 4th Edition. Taylor & Francis, 2000.
84. T. Langhans and H. Strube. Speech enhancement by nonlinear multiband envelope filtering. In Proc. IEEE-ICASSP, 1982.
85. K. Lebart, J. Boucher, and P. Denbigh. A binaural system for the suppression of late reverberation. In Proc. European Signal Process. Conf., pages 1-4, 1998.
86. K. Lebart, J. Boucher, and P. Denbigh. A new method based on spectral subtraction for speech dereverberation. Acta Acust./Acustica, 87: 359-366, 2001.
87. J. H. Lee, S. H. Oh, and S. Y. Lee. Binaural semi-blind dereverberation of noisy convoluted speech signals. Neurocomputing, 72: 636-642, 2008.
88. R. Y. Litovsky, S. H. Colburn, W. A. Yost, and S. J. Guzman. The precedence effect. J. Acoust. Soc. Amer., 106: 1633-1654, 1999.
89. P. Loizou. Speech enhancement: theory and practice. CRC Press, 1st edition, 2007.
90. P. Loizou and G. Kim. Reasons why current speech-enhancement algorithms do not improve speech intelligibility and suggested solutions. IEEE Trans. Audio, Speech, and Lang. Process., 19: 47-56, 2011.
91. H. W. Löllmann and P. Vary. Low delay noise reduction and dereverberation for hearing aids. EURASIP J. Advances in Signal Process., 2009: 1-9, 2009.
92. G. Lorho. Perceived Quality Evaluation-An application to Sound reproduction over headphones. PhD thesis, Aalto University, School of Science and Technology, Department of Signal Processing and Acoustics, Finland, 2010.
93. I. McCowan and H. Bourlard. Microphone array post-filter based on noise field coherence. IEEE Trans. Speech and Audio Process., 11: 709-716, 2003.
94. A. Mertins, T. Mei, M. Kallinger. Room impulse response shortening/reshaping with infinityand p-norm optimization. IEEE Trans. in Acoust., Speech and, Signal Process., 18: 249-259, 2010.
95. O. M. M. Mitchell and D. A. Berkley. Reduction of long time reverberation by a center clipping process. J. Acoust. Soc. Am., 47: 84, 1970.
96. M. Miyoshi and Y. Kaneda. Inverse filtering of room acoustics. IEEE Trans. Acoustics, Speech and, Signal Processing, 36: 145-152, 1988.
97. J. Mourjopoulos. On the variation and invertibility of room impulse response functions. J. Sound and Vibr., 102: 217-228, 1985.
98. J. Mourjopoulos. Digital equalization methods for audio systems. In Proc. 84th Conv. Audio Eng. Soc., 1988.
99. J. Mourjopoulos. Digital equalization of room acoustics. J. Audio Eng. Soc., 42: 884-900, 1994.
100. J. Mourjopoulos, P. Clarkson, and J. Hammond. A comparative study of least-squares and homomorphic techniques for the inversion of mixed phase signals. In Proc. IEEE-ICASSP, 1982.
101. J. Mourjopoulos and J. K. Hammond. Modelling and enhancement of reverberant speech using an envelope convolution method. In Proc. IEEE-ICASSP, 1983.
102. P. A. Naylor and N. D. Gaubitch. Speech Dereverberation, pages 57-387. Springer, London, Great Britain, 2010.
103. P. A. Naylor, N. D. Gaubitch, and E. A. P. Habets. Signal-based performance evaluation of dereverberation algorithms. J. Electrical and Computer Eng., 2010: 1-5, 2010.
104. S. Neely and J. B. Allen. Invertibility of room impulse response. J. Acoust. Soc. Am., 66: 165-169, 1979.
105. S. Norcross, G. Soulodre, and M. Lavoie. Subjective investigations of inverse filtering. J. Audio Eng. Soc., 52: 1003-1028, 2004.
106. A. V. Oppenheim. Applications of digital signal processing. Prentice-Hall, 1978.
107. T. Paatero and M. Karjalainen. Kautz Filters and Generalized Frequency Resolution: Theory and Audio Applications. J. Audio Eng. Soc., 51: 27-44, 2003.
108. A. P. Petropulu and S. Subramaniam. Cepstrum based deconvolution for speech dereverberation. In Proc. IEEE-ICASSP, pages I/9-I12, 1994.
109. I. RBS. 1534-2001: Method for the subjective assessment of intermediate quality levels of coding systems. 2003.
110. W. C. Sabine. Collected Papers on Acoustics. Peninsula Publishing, Los Altos, 1993.
111. L. Savioja and V. Valimaki. Multiwarping for enhancing the frequency accuracy of digital waveguide mesh simulations. IEEE Signal Process. Letters, 8: 134-136, 2001.
112. K. Simmer, S. Fischer, and A. Wasiljeff. Suppression of coherent and incoherent noise using a microphone array. Ann. Telecommunications, 49: 439-446, 1994.
113. T. Stockham, T. M. Cannon, and R. B. Ingebretsen. Blind deconvolution through digital signal processing. In Proc. IEEE, volume 63, pages 678-692, 1975.
114. M. Triki and D. T. M. Slock. Delay and Predict Equalization for Blind Speech Dereverberation. In Proc. IEEE-ICASSP, volume 5, 2006.
115. A. Tsilfidis, E. Georganti, and J. Mourjopoulos. Binaural extension and performance of singlechannel spectral subtraction dereverberation algorithms. In Proc. IEEE-ICASSP, Prague, Czech Republic, 2011.
116. A. Tsilfidis, E. Georganti, and J. Mourjopoulos. Abinaural framework for spectral subtraction dereverberation. In Forum Acusticum 2011, Aalborg, Denmark, 2011.
117. A. Tsilfidis, K. E. Kokkinis, and J. Mourjopoulos. Suppression of late reverberation atmultiple speaker positions utilizing a single impulse responsemeasurement. In Forum Acusticum 2011, Aalborg, Denmark, 2011.
118. A. Tsilfidis and J. Mourjopoulos. Signal-dependent constraints for perceptually motivated suppression of late reverberation. Signal Processing, 90: 959-965, 2010.
119. A. Tsilfidis and J. Mourjopoulos. Blind single-channel suppression of late reverberation based on perceptual reverberation modeling. J. Acoust. Soc. Am., 129: 1439-1451, 2011.
120. D. Tsoukalas, J. Mourjopoulos, and G. Kokkinakis. Speech enhancement based on audible noise suppression. IEEE Trans. Speech and Audio Process., 5: 497-513, 1997.
121. H. L. Van Trees. Optimum array processing, volume 4. Wiley-Interscience. New York, NY, USA, 2002.
122. J. Wen, N. Gaubitch, E. Habets, T. Myatt, and P. Naylor. Evaluation of speech dereverberation algorithms using the MARDY database. In Proc. IEEE-IWAENC, 2006.
123. A. Westermann, J. Buchholz, and T. Dau. Using long-term coherence estimates for binaural dereverberation. In Forum Acusticum 2011, Aalborg, Denmark, 2011.
124. A. Westermann, J. Buchholz, and T. Dau. Binaural dereverberation based on interaural coherence histograms. J. Acoust. Soc. Am., xxx: in press, 2013.
125. T. Wittkop and V. Hohmann. Strategy-selective noise reduction for binaural digital hearing aids. Speech Communication, 39: 111-138, 2003.
126. M. Wu and D. Wang. A two-stage algorithm for one-microphone reverberant speech enhancement. IEEE Trans. Audio, Speech and Language Process., 14: 774-784, 2006.
127. B. Yegnanarayana and P. S. Murthy. Enhancement of reverberant speech using LP residual signal. IEEE Trans. Audio, Speech and Language Process., 8: 267-281, 2000.
128. P. Zahorik. Auditory distance perception in humans: A summary of past and present research. Acta Acust./Acustica, 91: 409-420, 2005.
129. W. Zhang, E. Habets, and P. Naylor. On the use of channel shortening in multichannel acoustic system equalization. In Proc. of the IEEE IWAENC, 2010.
130. P. M. Zurek. Measurements of binaural echo suppression. J. Acoust. Soc. Amer., 66: 1750-1757, 1979.