Variational Bayesian inference for multichannel dereverberation and noise reduction

IEEE Transactions on Audio, Speech and Language Processing

Volumn 22, Issue 8, 2014, Pages 1320-1335

  Schmid, Dominic ^a   Enzner, Gerald ^a   Malik, Sarmad ^a   Kolossa, Dorothea ^a   Martin, Rainer ^a  

^a RUHR UNIVERSITY BOCHUM   (Germany)

Author keywords

Dereverberation; Expectation maximization algorithm; Noise reduction; State space model; Variational bayes

Indexed keywords

ALGORITHMS; ARCHITECTURAL ACOUSTICS; BAYESIAN NETWORKS; FREQUENCY DOMAIN ANALYSIS; IMAGE SEGMENTATION; INFERENCE ENGINES; MARKOV PROCESSES; MAXIMUM PRINCIPLE; MOBILE TELECOMMUNICATION SYSTEMS; NOISE ABATEMENT; REVERBERATION; SPEECH COMMUNICATION; SPEECH ENHANCEMENT; STATE SPACE METHODS;

DEREVERBERATION; EXPECTATION-MAXIMIZATION ALGORITHMS; FIRST-ORDER MARKOV MODEL; MULTICHANNEL DEREVERBERATION; ONLINE EXPECTATION MAXIMIZATIONS; STATE - SPACE MODELS; VARIATIONAL BAYES; VARIATIONAL BAYESIAN INFERENCES;

SPEECH RECOGNITION;

EID: 84911491651     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASLP.2014.2329732     Document Type: Article

References (61)

1. B. D. V. Veen and K. M. Buckley, "Beamforming:A versatile approach to spatial filtering," IEEE ASSP Mag., vol. 5, no. 2, pp. 4-24, Apr. 1988.
2. J. Bitzer and K. U. Simmer, "Superdirective microphone arrays," in Microphone Arrays: Signal Processing Techniques and Applications, M. Brandstein and D. Ward, Eds., 1st ed. Berlin, Germany: Springer, 2001, ch. 2, pp. 19-38.
3. O. L. Frost, III, "An algorithm for linearly constrained adaptive array processing," Proc. IEEE, vol. 60, no. 8, pp. 926-935, Aug. 1972.
4. L. J. Griffiths and C. W. Jim, "An alternative approach to linearly constrained adaptive beamforming," IEEE Trans. Antennas Propag., vol. AP-30, no. 1, pp. 27-34, Jan. 1982.
5. J. L. Flanagan, A. C. Surendran, and E. E. Jan, "Spatially selective sound capture for speech and audio processing," Speech Commun., vol. 13, no. 1-2, pp. 207-222, Oct. 1993.
6. S. Affes and Y. Grenier, "A signal subspace tracking algorithm for microphone array processing of speech," IEEE Trans. Speech Audio Process., vol. 5, no. 5, pp. 425-437, Sep. 1997.
7. S. Gannot, D. Burshtein, and E. Weinstein, "Signal enhancement using beamforming and nonstationarity with applications to speech," IEEE Trans. Signal Process., vol. 49, no. 8, pp. 1614-1626, Aug. 2001.
8. O. Hoshuyama, A. Sugiyama, and A. Hirano, "A robust adaptive beamformer for microphone arrays with a blocking matrix using constrained adaptive filters," IEEE Trans. Signal Process., vol. 47, no. 10, pp. 2677-2684, Oct. 1999.
9. W. Herbordt, H. Buchner, and W. Kellermann, "An acoustic human-machine front-end for multimedia applications," EURASIP J. Appl. Signal Process., vol. 2003, no. 1, pp. 21-31, 2003.
10. A. Spriet, M. Moonen, and J. Wouters, "Spatially pre-processed speech distortion weighted multi-channel Wiener filtering for noise reduction," Signal Process., vol. 84, no. 12, pp. 2367-2387, Dec. 2004.
11. S. Doclo, A. Spriet, J. Wouters, and M. Moonen, "Frequency-domain criterion for the speech distortion weighted multichannel Wiener filter for robust noise reduction," Speech Commun., vol. 49, no. 7-8, pp. 636-656, Jul.-Aug. 2007.
12. K. Kumatani, J. McDonough, B. Rauch, D. Klakow, P. N. Garner, and W. Li, "Beamforming with a maximum negentropy criterion," IEEE Trans. Audio, Speech, Lang. Process., vol. 17, no. 5, pp. 994-1008, Jul. 2009.
13. E. Warsitz and R. Haeb-Umbach, "Blind acoustic beamforming based on generalized eigenvalue decomposition," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 5, pp. 1529-1539, Jul. 2007.
14. K. Lebart, J. M. Boucher, and P. N. Denbigh, "A new method based on spectral subtraction for speech dereverberation," Acta Acust. united with Acust., vol. 87, no. 3, pp. 359-366, May 2001.
15. E. A. P. Habets, S. Gannot, and I. Cohen, "Late reverberant spectral variance estimation based on a statistical model," IEEE Signal Process. Lett., vol. 16, no. 9, pp. 770-773, Sep. 2009.
16. K. Kinoshita, M. Delcroix, T. Nakatani, and M. Miyoshi, "Suppression of late reverberation effect on speech signal using long-term multiple-step linear prediction," IEEE Trans. Audio, Speech, Lang. Process., vol. 17, no. 4, pp. 534-545, May 2009.
17. J. S. Erkelens and R. Heusdens, "Correlation-based and model-based blind single-channel late-reverberation suppression in noisy time-varying acoustical environments," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 7, pp. 1746-1765, Sep. 2010.
18. M. Jeub, M. Schäfer, T. Esch, and P. Vary, "Model-based dereverberation preserving binaural cues," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 7, pp. 1732-1745, Sep. 2010.
19. M. Miyoshi and Y. Kaneda, "Inverse filtering of room acoustics," IEEE Trans. Acoust., Speech, Signal Process., vol. 36, no. 2, pp. 145-152, Feb. 1988.
20. Y. Huang and J. Benesty, "A class of frequency-domain adaptive approaches to blind multichannel identification," IEEE Trans. Signal Process., vol. 51, no. 1, pp. 11-24, Jan. 2003.
21. S. Gannot and M. Moonen, "Subspace methods for multimicrophone speech dereverberation," EURASIP J. Appl. Signal Process., vol. 2003, no. 11, pp. 1074-1090, 2003.
22. D. Schmid and G. Enzner, "Cross-relation-based blind SIMO identifiability in the presence of near-common zeros and noise," IEEE Trans. Signal Process., vol. 60, no. 1, pp. 60-72, Jan. 2012.
23. M. A. Haque, T. Islam, and M. K. Hasan, "Robust speech dereverberation based on blind adaptive estimation of acoustic channels," IEEE Trans. Audio, Speech, Lang. Process., vol. 19, no. 4, pp. 775-787, May 2011.
24. X. Lin, A. W. H. Khong, and P. A. Naylor, "A forced spectral diversity algorithm for speech dereverberation in the presence of near-common zeros," IEEE Trans. Audio, Speech, Lang. Process., vol. 20, no. 3, pp. 888-899, Mar. 2012.
25. K. Furuya and A. Kataoka, "Robust speech dereverberation using multichannel blind deconvolution with spectral subtraction," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 5, pp. 1579-1591, Jul. 2007.
26. H. Buchner and W. Kellermann, "TRINICON for dereverberation of speech and audio signals," in Speech Dereverberation, P. A. Naylor and N. D. Gaubitch, Eds., 1st ed. London, U.K.: Springer, 2010, ch. 10, pp. 311-385.
27. M. Delcroix, T. Hikichi, and M. Miyoshi, "Precise dereverberation using multichannel linear prediction," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 2, pp. 430-440, Feb. 2007.
28. T. Yoshioka, T. Hikichi, and M. Miyoshi, "Dereverberation by using time-variant nature of speech production system," EURASIP J. Adv. Signal Process., vol. 2007, no. 1, pp. 1-15, 2007.
29. T. Nakatani, B.-H. Juang, T. Yoshioka, K. Kinoshita, M. Delcroix, and M. Miyoshi, "Speech dereverberation based on maximum-likelihood estimation with time-varying Gaussian source model," IEEE Trans. Audio, Speech, Lang. Process., vol. 16, no. 8, pp. 1512-1527, Nov. 2008.
30. T. Nakatani, T. Yoshioka, K. Kinoshita, M. Miyoshi, and B.-H. Juang, "Speech dereverberation based on variance-normalized delayed linear prediction," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 7, pp. 1717-1731, Sep. 2010.
31. H. Attias, J. C. Platt, A. Acero, and L. Deng, "Speech denoising and dereverberation using probabilistic models," Adv. Neural Inf. Process. Syst., vol. 13, pp. 758-764, 2001.
32. T. Yoshioka, T. Nakatani, and M. Miyoshi, "Integrated speech enhancement method using noise suppression and dereverberation," IEEE Trans. Audio, Speech, Lang. Process., vol. 17, no. 2, pp. 231-246, Feb. 2009.
33. J. R. Hopgood and P. J. W. Rayner, "Blind single channel deconvolution using nonstationary signal processing," IEEE Trans. Speech Audio Process., vol. 11, no. 5, pp. 476-488, Sep. 2003.
34. C. Evers and J. R. Hopgood, "Parametric modelling for single-channel blind dereverberation of speech from a moving speaker," IET Signal Process., vol. 2, no. 2, pp. 59-74, Jun. 2008.
35. C. Evers and J. R. Hopgood, "Multichannel online blind speech dereverberation with marginalization of static observation parameters in a Rao-Blackwellized particle filter," J. Signal Process. Syst., vol. 63, no. 3, pp. 315-332, 2011.
36. M. J. Beal, "Variational algorithms for approximate Bayesian inference," Ph.D. dissertation, Univ. College London, London, U.K., 2003.
37. C. M. Bishop, Pattern Recognition and Machine Learning, 1st ed. New York, NY: Springer, 2006.
38. D. Schmid, S. Malik, and G. Enzner, "An expectation-maximization algorithm for multichannel adaptive speech dereverberation in the frequency-domain," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Kyoto, Japan, Mar. 2012, pp. 17-20.
39. D. Schmid, S. Malik, and G. Enzner, "A maximum a posteriori approach to multichannel speech dereverberation and denoising," in Proc. Int. Workshop Acoust. Signal Enhanc., Aachen, Germany, Sep. 2012.
40. G. Enzner and P. Vary, "Frequency-domain adaptive Kalman filter for acoustic echo control in hands-free telephones," Signal Process., vol. 86, no. 6, pp. 1140-1156, Jun. 2006.
41. S. Malik, "Bayesian learning of linear and nonlinear acoustic system models in hands-free communication," Ph.D. dissertation, Inst. of Commun. Acoust., Ruhr-Univ. Bochum, Bochum, Germany, 2012.
42. S. Malik and G. Enzner, "A variational Bayesian learning approach for nonlinear acoustic echo control," IEEE Trans. Signal Process., vol. 61, no. 23, pp. 5853-5867, Dec. 2013.
43. D. Schmid, "Multichannel dereverberation and noise reduction for hands-free speech communication systems," Ph.D. dissertation, Inst. of Commun. Acoust., Ruhr-Univ. Bochum, Bochum, Germany, 2014.
44. K. Harada and H. Sakai, "Variational Bayesian blind estimation of SIMO channels," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Dallas, TX, USA, Mar. 2010, pp. 3218-3221.
45. J. J. Shynk, "Frequency-domain andmultirate adaptive filtering," IEEE Signal Process. Mag., vol. 9, no. 1, pp. 14-37, Jan. 1992.
46. D. J. Salmond, "Tracking in uncertain environments," Ph.D. dissertation, Univ. of Sussex, Brighton and Hove, U.K., 1989.
47. E. A. P. Habets, I. Cohen, and S. Gannot, "Generating nonstationary multisensor signals under a spatial coherence constraint," J. Acoust. Soc. Amer., vol. 124, no. 5, pp. 2911-2917, Nov. 2008.
48. S. Malik and G. Enzner, "Online maximum-likelihood learning of time-varying dynamical models in block-frequency-domain," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Dallas, TX, USA, Mar. 2010, pp. 3822-3825.
49. E. A. Lehmann and A. M. Johansson, "Prediction of energy decay in room impulse responses simulated with an image-source model," J. Acoust. Soc. Amer., vol. 124, no. 1, pp. 269-277, Jul. 2008.
50. J. B. Allen and D. A. Berkley, "Image method for efficiently simulating small-room acoustics," J. Acoust. Soc. Amer., vol. 65, no. 4, pp. 943-950, Apr. 1979.
51. P. A. Naylor, E. A. P. Habets, J. Y.-C. Wen, and N. D. Gaubitch, "Models, measurement and evaluation," in Speech Dereverberation, P. A. Naylor and N. D. Gaubitch, Eds., 1st ed. London, U.K.: Springer, 2010, ch. 2, pp. 21-56.
52. J. S. Garofolo, L. F. Lamel, W. M. Fisher, J. G. Fiscus, D. S. Pallett, N. L. Dahlgren, and V. Zue, TIMIT Acoustic-Phonetic Continuous Speech Corpus, Linguistic Data Consortium, Philadelphia, PA, USA, 1993.
53. J. Chen, J. Benesty, and Y. Huang, "Time delay estimation in room acoustic environments: An overview," EURASIP J. Appl. Signal Process., 2006.
54. Y. Hu and P. C. Loizou, "Evaluation of objective quality measures for speech enhancement," IEEE Trans. Audio, Speech, Lang. Process., vol. 16, no. 1, pp. 229-238, Jan. 2008.
55. T. Yoshioka, A. Sehr, M. Delcroix, K. Kinoshita, R. Maas, T. Nakatani, and W. Kellermann, "Making machines understand us in reverberant rooms: Robustness against reverberation for automatic speech recognition," IEEE Signal Process. Mag., vol. 29, no. 6, pp. 114-126, Nov. 2012.
56. J. Garofalo, D. Graff, D. Paul, and D. Pallett, CSR-I (WSJ0) Sennheiser, Linguistic Data Consortium, Philadelphia, PA, USA, 1993.
57. K. Vertanen, "Baseline WSJ acoustic models for HTK and Sphinx: Training recipes and recognition experiments," Univ. of Cambridge, Cambridge, U.K., Tech. Rep., 2006. [Online]. Available: http://www.keithv.com/pub/baselinewsj
58. S. Young, The HTK Book (for HTK Version 3.4), Cambridge Univ. Engineering Dept., Cambridge, U.K., 2006.
59. D. Schmid, P. Thüne, D. Kolossa, and G. Enzner, "Dereverberation preprocessing and training data adjustments for robust speech recognition in reverberant environments," in Proc. ITG Conf. Speech Commun., Braunschweig, Germany, Sep. 2012, pp. 235-238.
60. M. S. Arulampalam, S. Maskell, N. Gordon, and T. Clapp, "A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking," IEEE Trans. Signal Process., vol. 50, no. 2, pp. 174-188, Feb. 2002.
61. J. Benesty, T. Gänsler, D. R. Morgan, M. M. Sondhi, and S. L. Gay, Advances in Network and Acoustic Echo Cancellation, 1st ed. Berlin, Germany: Springer, 2001.