A Real-Time Speech Enhancement Framework in Noisy and Reverberated Acoustic Scenarios

Cognitive Computation

Volumn 5, Issue 4, 2013, Pages 504-516

  Rotili, Rudy ^a   Principi, Emanuele ^a   Squartini, Stefano ^a   Schuller, Björn ^b  

^a UNIVERSITÀ POLITECNICA DELLE MARCHE   (Italy)

^b TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

Blind channel identification; Noisy and reverberated environments; Real time signal processing; Speaker diarization; Speech dereverberation; Speech enhancement

Indexed keywords

BLIND CHANNEL IDENTIFICATION; NOISY AND REVERBERATED ENVIRONMENTS; REAL-TIME SIGNAL PROCESSING; SPEAKER DIARIZATION; SPEECH DEREVERBERATION;

ALGORITHMS; COMPUTER SIMULATION; SIGNAL PROCESSING; SPEECH ENHANCEMENT;

REVERBERATION;

EID: 84890118085     PISSN: 18669956     EISSN: 18669964     Source Type: Journal    
DOI: 10.1007/s12559-012-9176-x     Document Type: Article

References (46)

1. Araki S, Hori T, Fujimoto M, Watanabe S, Yoshioka T, Nakatani T, Nakamura A. Online meeting recognizer with multichannel speaker diarization. In: Signals, systems and computers (ASILOMAR), 2010 conference record of the forty fourth asilomar conference on. 2010. p. 1697-701. IEEE.
2. Benesty J, Chen J, Huang Y, Cohen I. Noise reduction in speech processing. 1st edn. Springer Publishing Company, Incorporated. 2009.
3. Bettarelli F, Ciavattini E, Lattanzi A, Zallocco D, Squartini S, Piazza F. NU-Tech: implementing DSP algorithms in a plug-in based software platform for real time audio applications. In: Proceedings of 118th convention of the AES; 2005. p. 1-12. Paper number 6389.
4. Boakye K, Trueba-Hornero B, Vinyals O, Friedland G. Overlapped speech detection for improved speaker diarization in multiparty meetings. In: Acoustics, speech and signal processing, 2008. ICASSP 2008. IEEE international conference on; 2008. p. 4353-6. IEEE.
5. Bourbakis N, Esposito A, Kavraki D. Extracting and associating meta-features for understanding peoples emotional behaviour: face and speech. Cognit Comput. 2011;3(3): 436-48.
6. Carletta J, Ashby S, Bourban S, Flynn M, Guillemot M, Hain T, et al. The AMI meeting corpus: a pre-announcement. Machine Learning for Multimodal Interaction; 2006. p. 28-39.
7. Chetouani M, Mahdhaoui A, Ringeval F. Time-scale feature extractions for emotional speech characterization. Cognit Comput. 2009;1(2): 194-201.
8. Cohen I, Benesty J, Gannot S. Speech processing in modern communication: challenges and perspectives. Springer Topics in Signal Processing: Springer; 2010.
9. Egger H, Engl H. Tikhonov regularization applied to the inverse problem of option pricing: convergence analysis and rates. Inverse Probl. 2005;21(3): 1027-45.
10. Falk T, Zheng C, Chan W. A non-intrusive quality and intelligibility measure of reverberant and dereverberated speech. IEEE Trans Audio Speech Lang Processing. 2010;18(7): 1766-1774.
11. Fredouille C, Bozonnet S, Evans N. The LIA-EURECOM RT'09 speaker diarization system. In: RT'09, NIST rich transcription workshop. Melbourne, Florida; 2009. p. 1-10.
12. Guillaume M, Grenier Y, Richard G. Iterative algorithms for multichannel equalization in sound reproduction systems. In: Proceedings of IEEE international conference on acoustics, speech, and signal processing. 2005. vol 3, p. iii/269-iii/272.
13. Habets E. Room impulse response (RIR) generator. 2008. http://home. tiscali. nl/ehabets/rirgenerator. html. Accessed 2 Oct 2011.
14. Haque M, Bashar M, Naylor P, Hirose K, Hasan M. Energy constrained frequency-domain normalized lms algorithm for blind channel identification. Signal Image Video Process. 2007;1: 203-213.
15. Haque M, Hasan M. Noise robust multichannel frequency-domain lms algorithms for blind channel identification. IEEE Signal Process Lett. 2008;15: 305-8.
16. Hasan M, Benesty J, Naylor P, Ward D. Improving robustness of blind adaptive multichannel identification algorithms using constraints. In: Proceedings of European signal processing conference (EUSIPCO), Antalya, Turkey; 2005. vol 1, p. 11-4.
17. Hikichi T, Delcroix M, Miyoshi M. Inverse filtering for speech dereverberation less sensitive to noise and room transfer function fluctuations. EURASIP J Adv Signal Process. 2007;1: 1-12.
18. Huang Y, Benesty J. A class of frequency-domain adaptive approaches to blind multichannel identification. IEEE Trans Speech Audio Process. 2003;51(1): 11-24.
19. Huijbregts M, van Leeuwen DA, de Jong FMG. Speech overlap detection in a two-pass speaker diarization system. In: INTERSPEECH'09; 2009. p. 1063-6.
20. Hung H, Huang Y, Friedland G, Gatica-Perez D. Estimating dominance in multi-party meetings using speaker diarization. IEEE Trans Audio Speech Lang Processing. 2011;19(4): 847-60.
21. Hussain A, Campbell D. Intelligibility improvements using binaural diverse sub-band processing applied to speech corrupted with automobile noise. In: Vision, image and signal processing, IEE proceedings-; 2001. vol 148, p. 127-32. IET.
22. Hussain A, Chetouani M, Squartini S, Bastari A, Piazza F. Nonlinear speech enhancement: an overview. In: Progress in non-linear speech processing, Lecture notes in computer science; 2007. vol 4391, p. 217-48. doi: 10. 1007/978-3-540-71505-4_12.
23. Kocinski J. Speech intelligibility improvement using convolutive blind source separation assisted by denoising algorithms. Speech Commun. 2008;50(1): 29-37.
24. Kokkinis EK, Tsilfidis A, Georganti E, Mourjopoulos J. Joint noise and reverberation suppression for speech applications. In: Proceedings of the 130th convention of the audio engineering society; 2011. vol 9, p. 10-62.
25. Loizou P. Speech enhancement: theory and practice (Signal processing and communications). CRC; 2007.
26. Loizou P, Kim G. Reasons why current speech-enhancement algorithms do not improve speech intelligibility and suggested solutions. IEEE Trans Audio Speech Lang Processing. 2011;19(1): 47-56.
27. Miyoshi M, Kaneda Y. Inverse filtering of room acoustics. IEEE Trans Signal Process. 1988;36(2): 145-52.
28. Morgan D, Benesty J, Sondhi M. On the evaluation of estimated impulse responses. IEEE Signal Process Lett. 1998;5(7): 174-76.
29. Naylor P, Gaubitch N. Speech dereverberation. Signals and communication technology. Heidelberg: Springer; 2010.
30. Oppenheim AV, Schafer RW, Buck JR. Discrete-time signal processing, 2 edn. Upper Saddle River: Prentice Hall; 1999.
31. Principi E, Cifani S, Rotili R, Squartini S, Piazza F. Comparative evaluation of single-channel mmse-based noise reduction schemes for speech recognition. J Electr Comput Eng. 2010; p. 1-7. doi: 10. 1155/2010/962103. http://www. hindawi. com/journals/jece/2010/962103. html.
32. Principi E, Rotili R, Wöllmer M, Eyben F, Squartini S, Schuller B. Real-time activity detection in a multi-talker reverberated environment. Cognit Comput. p. 1-12. doi: 10. 1007/s12559-012-9133-8.
33. Principi E, Rotili R, Wöllmer M, Squartini S, Schuller B. Dominance detection in a reverberated acoustic scenario. In: Advances in neural networks-ISNN2012, Lecture notes in computer science, vol 7368. Springer; 2012.
34. Rotili R, Cifani S, Principi E, Squartini S, Piazza F. A robust iterative inverse filtering approach for speech dereverberation in presence of disturbances. In: Proceedings of IEEE APCCAS; 2008. p. 434-7.
35. Rotili R, De Simone C, Perelli A, Cifani A, Squartini S. Joint multichannel blind speech separation and dereverberation: a real-time algorithmic implementation. In: Proceedings of ICIC; 2010. p. 85-93.
36. Rotili R, Principi E, Squartini S, Piazza F. Real-time joint blind speech separation and dereverberation in presence of overlapping speakers. In: Proceedings of ISNN. Berlin: Springer; 2011. p. 437-46.
37. Rotili R, Principi E, Squartini S, Schuller B Real-time speech recognition in a multi-talker reverberated acoustic scenario. In: Huang DS, Gan Y, Gupta P, Gromiha M, editors. Advanced intelligent computing theories and applications. With aspects of artificial intelligence, Lecture notes in computer science. Berlin: Springer; 2012. p. 379-86.
38. Schuller B, Batliner A, Steidl S, Seppi D. Recognising realistic emotions and affect in speech: state of the art and lessons learnt from the first challenge. Speech Commun. (2011);53(9/10): 1062-87.
39. Solé-Casals J, Zaiats V, Monte-Moreno E. Non-linear and non-conventional speech processing: alternative techniques. Cognit Comput. 2010;2(3): 133-4.
40. Squartini S, Principi E, Rotili R, Piazza F. Environmental robust speech and speaker recognition through multi-channel histogram equalization. Neurocomputing. 2012;78(1): 111-120.
41. Vinyals O, Friedland G. Towards semantic analysis of conversations: a system for the live identification of speakers in meetings. In: Proceedings of IEEE international conference on semantic computing; 2008. p. 426 -31.
42. Weninger F, Schuller B, Batliner A, Steidl S, Seppi D Recognition of nonprototypical emotions in reverberated and noisy speech by nonnegative matrix factorization. EURASIP J Adv Signal Process. 2011;11: 1-16.
43. Wöllmer M, Eyben F, Graves A, Schuller B, Rigoll G. Bidirectional lstm networks for context-sensitive keyword detection in a cognitive virtual agent framework. Cognit Comput. 2010;2(3): 180-90.
44. Wöllmer M, Marchi E, Squartini S, Schuller B. Multi-stream LSTM-HMM decoding and histogram equalization for noise robust keyword spotting. Cogn Neurodyn. 2011;5(3): 253-64.
45. Wooters C, Huijbregts M. The ICSI RT07s speaker diarization system. In: Stiefelhagen R, Bowers R, Fiscus J, editors. Multimodal technologies for perception of humans, Lecture notes in computer science. Berlin: Springer; 2008. p. 509-19.
46. Xu G, Liu H, Tong L, Kailath T. A least-squares approach to blind channel identification. IEEE Trans Signal Process. 1995;43(12): 2982-93.