Supervised and unsupervised speech enhancement using nonnegative matrix factorization

IEEE Transactions on Audio, Speech and Language Processing

Volumn 21, Issue 10, 2013, Pages 2140-2151

  Mohammadiha, Nasser ^a   Smaragdis, Paris ^b   Leijon, Arne ^a  

^a ROYAL INSTITUTE OF TECHNOLOGY   (Sweden)

^b University of Illinois ^*  (United States)

Author keywords

Bayesian inference; HMM; nonnegative matrix factorization (NMF); PLCA; speech enhancement

Indexed keywords

BAYESIAN INFERENCE; HMM; MINIMUM MEAN-SQUARE ERROR ESTIMATORS; NOISY SPEECH SIGNALS; NONNEGATIVE MATRIX FACTORIZATION; PLCA; SPEECH ENHANCEMENT METHODS; SPEECH ENHANCEMENT SYSTEM;

ALGORITHMS; BAYESIAN NETWORKS; HIDDEN MARKOV MODELS; INFERENCE ENGINES; SIGNAL RECEIVERS; SPEECH RECOGNITION;

SPEECH ENHANCEMENT;

EID: 84881053943     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2013.2270369     Document Type: Article

References (51)

1. S. Boll, "Suppression of acoustic noise in speech using spectral subtraction," IEEE Trans. Acoust., Speech, Signal Process., vol. ASSP-27, no. 2, pp. 113-120, Apr. 1979. (Pubitemid 9467471)
2. J. S. Lim and V. O. Alan, "Enhancement and bandwidth compression of noisy speech," Proc. IEEE, vol. 67, no. 12, pp. 1586-1604, Dec. 1979. (Pubitemid 10179553)
3. V. Grancharov and J. S. B. Kleijn, "On causal algorithms for speech enhancement," IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 3, pp. 764-773, May 2006. (Pubitemid 46547641)
4. Y. Ephraim and D. Malah, "Speech enhancement using a minimum mean square error short-time spectral amplitude estimator," IEEE Trans. Audio, Speech, Lang. Process., vol. ASSP-32, no. 6, pp. 1109-1121, 1984.
5. R. Martin, "Speech enhancement based on minimum mean-square error estimation and supergaussian priors," IEEE Trans. Audio, Speech, Lang. Process., vol. 13, no. 5, pp. 845-856, Sep. 2005. (Pubitemid 41558900)
6. I. Cohen, "Speech spectral modeling and enhancement based on autoregressive conditional heteroscedasticity models," Signal Process., vol. 86, no. 4, pp. 698-709, Apr. 2006. (Pubitemid 43242967)
7. J. S. Erkelens, R. C. Hendriks, R. Heusdens, and J. Jensen, "Minimum Mean-Square Error estimation of discrete Fourier coefficients with generalized Gamma priors," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 6, pp. 1741-1752, Aug. 2007.
8. B. Chen and P. C. Loizou, "A Laplacian-based MMSE estimator for speech enhancement," Speech Commun., vol. 49, no. 2, pp. 134-143, Feb. 2007. (Pubitemid 46241513)
9. J. R. Jensen, J. Benesty,M. G. Christensen, and S.H. Jensen, "Enhancement of single-channel periodic signals in the time-domain," IEEE Trans. Audio, Speech, Lang. Process., vol. 20, no. 7, pp. 1948-1963, Sep. 2012.
10. R. Martin, "Noise power spectral density estimation based on optimal smoothing and minimum statistics," IEEE Trans. Speech Audio Process., vol. 9, no. 5, pp. 504-512, Jul. 2001. (Pubitemid 32631178)
11. I. Cohen, "Noise spectrum estimation in adverse environments : Improved minima controlled recursive averaging," IEEE Trans. Speech Audio Process., vol. 11, no. 5, pp. 466-475, Sep. 2003.
12. R. C. Hendriks, R. Heusdens, and J. Jensen, "MMSE based noise PSD tracking with low complexity," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), Mar. 2010, pp. 4266-4269.
13. T. Sreenivas and P.Kirnapure, "Codebook constrainedWiener filtering for speech enhancement," IEEE Trans. Speech Audio Process., vol. 4, no. 5, pp. 383-389, Sep. 1996. (Pubitemid 126753026)
14. S. Srinivasan, J. Samuelsson, and W. Kleijn, "Codebook driven shortterm predictor parameter estimation for speech enhancement," IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 1, pp. 163-176, Jan. 2006. (Pubitemid 43863463)
15. Y. Ephraim, "A Bayesian estimation approach for speech enhancement using hidden Markov models," IEEE Trans. Signal Process., vol. 40, no. 4, pp. 725-735, Apr. 1992.
16. H. Sameti, H. Sheikhzadeh, L. Deng, and R. Brennan, "HMM-based strategies for enhancement of speech signals embedded in nonstationary noise," IEEE Trans. Speech Audio Process., vol. 6, no. 5, pp. 445-455, Sep. 1998.
17. D.Y.Zhao andW. B. Kleijn, "HMM-based gainmodeling for enhancement of speech in noise," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 3, pp. 882-892, Mar. 2007.
18. N. Mohammadiha, R. Martin, and A. Leijon, "Spectral domain speech enhancement using HMM state-dependent super-Gaussian priors," IEEE Signal Process. Lett., vol. 20, no. 3, pp. 253-256, Mar. 2013.
19. H. Veisi and H. Sameti, "Speech enhancement using hidden Markov models in Mel-frequency domain," Speech Commun., vol. 55, no. 2, pp. 205-220, Feb. 2013.
20. K. El-Maleh, A. Samouelian, and P. Kabal, "Frame level noise classification in mobile environments," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), Mar. 1999, vol. 1, pp. 237-240.
21. D. D. Lee and H. S. Seung, "Algorithms for non-negative matrix factorization," in Proc. Neural Inf. Process. Syst. Conf. (NIPS), 2000, pp. 556-562.
22. A. Cichocki, R. Zdunek, A. H. Phan, and S. Amari, Nonnegative Matrix and Tensor Factorizations: Applications to Exploratory Multi-way Data Analysis and Blind Source Separation. NewYork,NY,USA: Wiley, 2009.
23. P. Smaragdis, "Convolutive speech bases and their application to supervised speech separation," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 1, pp. 1-12, Jan. 2007.
24. T. Virtanen, "Monaural sound source separation by non-negative matrix factorization with temporal continuity and sparseness criteria," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 3, pp. 1066-1074, Mar. 2007.
25. C. Févotte, N. Bertin, and J. L. Durrieu, "Nonnegative matrix factorization with the Itakura-Saito divergence: With application to music analysis," Neural Comput., vol. 21, pp. 793-830, 2009.
26. N. Mohammadiha and A. Leijon, "Nonnegative HMM for babble noise derived from speech HMM: Application to speech enhancement," IEEE Trans. Audio, Speech, Lang. Process., vol. 21, no. 5, pp. 998-1011, May 2013.
27. K. W. Wilson, B. Raj, and P. Smaragdis, "Regularized non-negative matrix factorization with temporal dependencies for speech denoising," in Proc. Int. Conf. Spoken Lang. Process. (Interspeech), 2008, pp. 411-414.
28. M. Schmidt and J. Larsen, "Reduction of non-stationary noise using a non-negative latent variable decomposition," in Proc. IEEE Workshop Mach. Learn. for Signal Process. (MLSP), Oct. 2008, pp. 486-491.
29. N. Mohammadiha, T. Gerkmann, and A. Leijon, "A new linear MMSE filter for single channel speech enhancement based on nonnegative matrix factorization," in Proc. IEEE Workshop Applicat. Signal Process. Audio Acoust. (WASPAA), 2011, pp. 45-48.
30. G. J.Mysore and P. Smaragdis, "A non-negative approach to semisupervised separation of speech from noise with the use of temporal dynamics," in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Process. (ICASSP), May 2011, pp. 17-20.
31. N. Mohammadiha, J. Taghia, and A. Leijon, "Single channel speech enhancement using Bayesian NMF with recursive temporal updates of prior distributions," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2012, pp. 4561-4564.
32. J.Mairal, F. Bach, J. Ponce, andG. Sapiro, "Online learning for matrix factorization and sparse coding," J. Mach. Learn. Res., vol. 11, pp. 19-60, 2010.
33. A. Lefevre, F. Bach, and C. Févotte, "Online algorithms for nonnegative matrix factorization with the Itakura-Saito divergence," in Proc. IEEE Workshop Applicat. Signal Process. Audio Acoust. (WASPAA), 2011, pp. 313-316.
34. A. T. Cemgil, "Bayesian inference for nonnegativematrix factorisation models," Computat. Intell. Neurosci., vol. 2009, no. Article ID 785152, p. 17 pages, 2009.
35. P. Smaragdis, B. Raj, and M. Shashanka, "A probabilistic latent variable model for acoustic modeling," in Advances inModels for Acoustic Process. Workshop, NIPS, 2006.
36. P. O. Hoyer, "Non-negative matrix factorization with sparseness constraints," J. Mach. Learn. Res., vol. 5, pp. 1457-1469, 2004.
37. N. Mohammadiha, T. Gerkmann, and A. Leijon, "A new approach for speech enhancement based on a constrained nonnegative matrix factorization," in Proc. IEEE Int. Symp. Intell. Signal Process. Commun. Syst. (ISPACS), Dec. 2011, pp. 1-5.
38. N. Mohammadiha, P. Smaragdis, and A. Leijon, "Prediction based filtering and smoothing to exploit temporal dependencies in NMF," in Proc. IEEE Int.Conf. Acoust., Speech, Signal Process. (ICASSP), 2013.
39. B. Raj, R. Singh, and T. Virtanen, "Phoneme-dependent NMF for speech enhancement in monaural mixtures," in Proc. Int. Conf. Spoken Lang. Process. (Interspeech), 2011, pp. 1217-1220.
40. S. M. Kay, Fundamentals of Statistical Signal Processing, Volume I: Estimation Theory. Englewood Cliffs, NJ, USA: Prentice-Hall, 1993.
41. J. A. Bilmes, "A gentle tutorial of the EM algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models," Univ. of California, Berkeley, 1997, Tech. Rep. ICSI-TR-97- 021.
42. E. Vincent, R. Gribonval, and C. Févotte, "Performance measurement in blind audio source separation," IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 4, pp. 1462-1469, Jul. 2006. (Pubitemid 46547636)
43. "Perceptual evaluation of speech quality (PESQ), and objectivemethod for end-to-end speech quality assessment of narrowband telephone networks and speech codecs," Tech. Rep. 2000, I.-T. P.862.
44. C. Kim and R. M. Stern, "Robust signal-to-noise ratio estimation based on waveform amplitude distribution analysis," in Proc. Int. Conf. Spoken Lang. Process. (Interspeech), 2008, pp. 2598-2601.
45. J. S. Garofolo, L. F. Lamel, W. M. Fisher, J. G. Fiscus, D. S. Pallett, and N. L. Dahlgren, TIMIT Acoustic-Phonetic Continuous Speech Corpus. Philadelphia, PA, USA: Linguistic Data Consortium, 1993.
46. N. Mohammadiha and A. Leijon, "Model order selection for nonnegative matrix factorization with application to speech enhancement," Tech. Rep. KTH Royal Inst. of Technol., 2011.
47. A. Varga and H. J. Steeneken, "Assessment for automatic speech recognition: II. NOISEX-92: A database and an experiment to study the effect of additive noise on speech recognition systems," Speech Commun., vol. 12, no. 3, pp. 247-251, Jul. 1993.
48. B. Nimens et al., Sound ideas: Sound effects collection ser. 6000 [Online]. Available: http://www.sound-ideas.com/6000.html
49. P. C. Loizou, Speech Enhancement: Theory and Practice, 1st ed. Boca Raton, FL, USA: CRC, 2007, vol. 30.
50. Y. Ephraim and I. Cohen, "Recent advancements in speech enhancement," in The Electrical Engineering Handbook. Boca Raton, FL, USA: CRC, 2005.
51. D.Malah, R. V. Cox, and A. J. Accardi, "Tracking speech-presence uncertainty to improve speech enhancement in non-stationary noise environments," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), Mar. 1999, vol. 2, pp. 789-792.