Multichannel nonnegative matrix factorization in convolutive mixtures for audio source separation

IEEE Transactions on Audio, Speech and Language Processing

Volumn 18, Issue 3, 2010, Pages 550-563

  Ozerov, Alexey ^a   Fevotte, Cédric ^b  

^a INRIA   (France)

^b INSTITUT TELECOM   (France)

Author keywords

Expectation maximization (EM) algorithm; Multichannel audio; Nonnegative matrix factorization (NMF); Nonnegative tensor factorization (NTF); Underdetermined convolutive blind source separation (BSS)

Indexed keywords

CONVOLUTIVE BLIND SOURCE SEPARATION; EXPECTATION-MAXIMIZATION ALGORITHMS; MULTICHANNEL AUDIO; NONNEGATIVE MATRIX FACTORIZATION; NONNEGATIVE TENSOR FACTORIZATIONS;

APARTMENT HOUSES; AUDIO ACOUSTICS; FACTORIZATION; FREQUENCY BANDS; INDEPENDENT COMPONENT ANALYSIS; LIGHT MEASUREMENT; MATRIX ALGEBRA; MAXIMUM PRINCIPLE; MIXTURES; OPTIMIZATION; SEPARATION; SIGNAL ANALYSIS; SPEECH ANALYSIS; TENSORS;

BLIND SOURCE SEPARATION;

EID: 76949094445     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2009.2031510     Document Type: Article

References (54)

1. D. D. Lee and H. S. Seung, "Learning the parts of objects with nonnegative matrix factorization," Nature, vol.401, pp. 788-791, 1999.
2. P. Smaragdis and J. C. Brown, "Non-negative matrix factorization for polyphonic music transcription," in Proc. IEEE Workshop Applicat. Signal Process. Audio Acoust. (WASPAA), Oct. 2003, pp. 177-180.
3. N. Bertin, R. Badeau, and G. Richard, "Blind signal decompositions for automatic transcription of polyphonic music: NMF and K-SVD on the benchmark," in Proc. Int. Conf. Acoust., Speech, Signal Process. (ICASSP'07), Honolulu, HI, 2007, pp. 65-68.
4. T. Virtanen, "Monaural sound source separation by non-negative matrix factorization with temporal continuity and sparseness criteria," IEEE Trans. Audio, Speech, Lang. Process., vol.15, no.3, pp. 1066-1074, Mar. 2007.
5. P. Smaragdis, "Convolutive speech bases and their application to speech separation," IEEE Trans. Audio, Speech, Lang. Process., vol.15, no.1, pp. 1-12, Jan. 2007.
6. R. M. Parry and I. A. Essa, "Estimating the spatial position of spectral components in audio," in Proc. 6th Int. Conf. Ind. Compon. Anal. Blind Signal Separation (ICA'06), Charleston, SC, Mar. 2006, pp. 666-673.
7. D. FitzGerald, M. Cranitch, and E. Coyle, "Non-negative tensor factorisation for sound source separation," in Proc. Irish Signals Syst. Conf., Dublin, Ireland, Sep. 2005, pp. 8-12. (Pubitemid 43252509)
8. L. Parra and C. Spence, "Convolutive blind source separation of nonstationary sources," IEEE Trans. Speech Audio Process., vol.8, no.3, pp. 320-327, May 2000.
9. L. Benaroya, R. Gribonval, and F. Bimbot, "Non negative sparse representation for Wiener based source separation with a single sensor," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP'03), Hong Kong, 2003, pp. 613-616.
10. C. Févotte, N. Bertin, and J.-L. Durrieu, "Nonnegative matrix factorization with the Itakura-Saito divergence. With application to music analysis," Neural Comput., vol.21, no.3, pp. 793-830, Mar. 2009.
11. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. R. Statist. Soc. Series B (Methodological), vol.39, pp. 1-38, 1977.
12. E. Moulines, J.-F. Cardoso, and E. Gassiat, "Maximum likelihood for blind separation and deconvolution of noisy signals using mixture models," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP'97), Apr. 1997, pp. 3617-3620.
13. H. Attias, "Independent factor analysis," Neural Comput., vol.11, pp. 803-851, 1999.
14. H. Attias, "New EM algorithms for source separation and deconvolution," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP'03), 2003, pp. 297-300.
15. R. J. Weiss, M. I. Mandel, and D. P. W. Ellis, "Source separation based on binaural cues and source model constraints," in Proc. Interspeech' 08, 2008, pp. 419-422.
16. S. Arberet, A. Ozerov, R. Gribonval, and F. Bimbot, "Blind spectral-GMM estimation for underdetermined instantaneous audio source separation," in Proc. Int. Conf. Ind. Compon. Anal. Blind Source Separation (ICA'09), 2009, pp. 751-758.
17. J.-F. Cardoso, H. Snoussi, J. Delabrouille, and G. Patanchon, "Blind separation of noisy Gaussian stationary sources. Application to cosmic microwave background imaging," in Proc. 11th Eur. Signal Process. Conf. (EUSIPCO'02), 2002, pp. 561-564.
18. C. Févotte and J.-F. Cardoso, "Maximum likelihood approach for blind audio source separation using time-frequency Gaussian models," in Proc. IEEE Workshop Applicat. Signal Process. Audio Acoust. (WASPAA'05), Mohonk, NY, Oct. 2005, pp. 78-81.
19. P. Smaragdis, "Efficient blind separation of convolved sound mixtures," in IEEE Workshop Applicat. Signal Process. Audio Acoust. (WASPAA'97), New Paltz, NY, Oct. 1997, 4 pp..
20. H. Sawada, S. Araki, and S. Makino, "Measuring dependence of binwise separated signals for permutation alignment in frequency-domain BSS," in IEEE Int. Symp. Circuits Syst. (ISCAS'07),May 27-30, 2007, pp. 3247-3250.
21. M. I. Mandel, D. P. W. Ellis, and T. Jebara, "An EM algorithm for localizing multiple sound sources in reverberant environments," in Adv. Neural Inf. Process. Syst. (NIPS 19), 2007, pp. 953-960.
22. Y. Izumi, N. Ono, and S. Sagayama, "Sparseness-based 2CH BSS using the EM algorithm in reverberant environment," in Proc. IEEE Workshop Applicat. Signal Process. Audio Acoust. (WASPAA'07), Oct. 2007, pp. 147-150.
23. A. Ozerov and C. Févotte, "Multichannel nonnegative matrix factorization in convolutive mixtures.With application to blind audio source separation," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP'09), Taipei, Taiwan, Apr. 2009, pp. 3137-3140.
24. F. D. Neeser and J. L. Massey, "Proper complex random processes with applications to information theory," IEEE Trans. Inf. Theory, vol.39, no.4, pp. 1293-1302, Jul. 1993.
25. S. A. Abdallah and M. D. Plumbley, "Polyphonic transcription by nonnegative sparse coding of power spectra," in Proc. 5th Int. Symp. Music Inf. Retrieval (ISMIR'04), Oct. 2004, pp. 318-325.
26. A. Cichocki, R. Zdunek, and S. Amari, "Csiszar's divergences for non-negative matrix factorization: Family of new algorithms," in Proc. 6th Int. Conf. Ind. Compon. Anal. Blind Signal Separation (ICA'06), Charleston, SC, 2006, pp. 32-39. (Pubitemid 43998396)
27. D.-T. Pham and J.-F. Cardoso, "Blind separation of instantaneous mixtures of non stationary sources," IEEE Trans. Signal Process., vol.49, no.9, pp. 1837-1848, Sep. 2001.
28. H. Laurberg, M. G. Christensen, M. D. Plumbley, L. K. Hansen, and S. H. Jensen, "Theorems on positive data: On the uniqueness of NMF," Comput. Intell. Neurosci., vol.2008, pp. 1-9, 2008.
29. A. Ozerov, P. Philippe, F. Bimbot, and R. Gribonval, "Adaptation of bayesian models for single-channel source separation and its application to voice/music separation in popular songs," IEEE Trans. Audio, Speech, Lang. Process., vol.15, no.5, pp. 1564-1578, Jul. 2007.
30. S. M. Kay, Fundamentals of Statistical Signal Processing: Estimation Theory. Englewood Cliffs, NJ: Prentice-Hall, 1993.
31. M. Goodwin, "The STFT, sinusoidal models, and speech modification," in Springer Handbook of Speech Processing, J. Benesty,M.M. Sondhi, and Y. Huang, Eds. New York: Springer, 2008, ch. 12, pp. 229-258.
32. R. Bro, "PARAFAC. Tutorial and applications," Chemometrics Intell. Lab. Syst., vol.38, no.2, pp. 149-171, Oct. 1997.
33. M. Welling and M. Weber, "Positive tensor factorization," Pattern Recognition Lett., vol.22, no.12, pp. 1255-1261, 2001.
34. A. Shashua and T. Hazan, "Non-negative tensor factorization with applications to statistics and computer vision," in Proc. 22nd Int. Conf. Mach. Learn., Bonn, Germany, 2005, pp. 792-799, ACM.
35. Example Web Page [Online]. Available: http://www.irisa.fr/metiss/ ozerov/demos.html#ieee-taslp09
36. S. Hurley, Call for Remixes: Shannon Hurley [Online]. Available: http://www.ccmixter.org/shannon-hurley
37. in Signal Separation Evaluation Campaign (SiSEC 2008), 2008 [Online]. Available: http://www.sisec.wiki.irisa.fr
38. E. Vincent, H. Sawada, P. Bofill, S. Makino, and J. P. Rosca, "First stereo audio source separation evaluation campaign: Data, algorithms and results," in Proc. Int. Conf. Ind. Compon. Anal. Blind Source Separation (ICA'07), 2007, pp. 552-559, Springer.
39. D. Campbell, Roomsim Toolbox [Online]. Available: http://www. mathworks.com/matlabcentral/fileexchange/5184
40. E. Vincent, "Complex nonconvex lp norm minimization for underdetermined source separation," in Proc. Int. Conf. Ind. Compon. Anal. Blind Source Separation (ICA'07), 2007, pp. 430-437.
41. S. Arberet, R. Gribonval, and F. Bimbot, "A robust method to count and locate audio sources in a stereophonic linear instantaneous mixture," in Proc. Int. Conf. Ind. Compon. Anal. Blind Source Separation (ICA'06), 2006, pp. 536-543.
42. P. D. O'Grady and P. A. Pearlmutter, "Soft-LOST: EM on a mixture of oriented lines," in Proc. Int. Conf. Ind. Compon. Anal. Blind Source Separation (ICA), 2004, pp. 428-435.
43. in Stereo Audio Source Separation Evaluation Campaign (SASSEC 2007), 2007 [Online]. Available: http://www.sassec.gforge.inria.fr/
44. E. Vincent, S. Araki, and P. Bofilld, "The 2008 signal separation evaluation campaign: A community-based approach to large-scale evaluation," in Proc. Int. Conf. Ind. Compon. Anal. Signal Separation (ICA'09), 2009, pp. 734-741 [Online]. Available: http://www.sassec.gforge.inria.fr/SiSEC-ICA09.pdf
45. in SiSEC 2008 Under-Determined Speech and Music Mixtures Task Results, 2008 [Online]. Available: http://www.sassec.gforge.inria.fr/ SiSEC-underdetermined/
46. P. Smaragdis, B. Raj, and M. V. Shashanka, "Supervised and semi-supervised separation of sounds from single-channel mixtures," in Proc. 7th Int. Conf. Ind. Compon. Anal. Signal Separation (ICA'07), London, U.K., Sep. 2007, pp. 414-421.
47. in SiSEC 2008 Professionally Produced Music Recordings Task Results, 2008 [Online]. Available: http://www.sassec.gforge.inria.fr/ SiSEC-professional/
48. S. Winter, H. Sawada, S. Araki, and S. Makino, "Hierarchical clustering applied to overcomplete BSS for convolutive mixtures," in Proc. ISCA Tutorial Research Workshop Statistical and Perceptual Audio Process. (SAPA 2004), Oct. 2004, pp. 652-660.
49. "Audacity: The Free, Cross-Platform Sound Editor," [Online]. Available: http://www.audacity.sourceforge.net/
50. J.-F. Cardoso and M. Martin, "A flexible component model for precision ICA," in Proc. 7th Int. Conf. Ind. Compon. Anal. Signal Separation (ICA'07), London, U.K., Sep. 2007, pp. 1-8.
51. Y. Lin and D. D. Lee, "Bayesian regularization and nonnegative deconvolution for room impulse response estimation," IEEE Trans. Signal Process., vol.54, no.3, pp. 839-847, Mar. 2006.
52. V. Y. F. Tan and C. Févotte, "Automatic relevance determination in nonnegative matrix factorization," in Proc. Workshop Signal Process. Adaptative Sparse Structured Representations (SPARS'05), Saint-Malo, France, Apr. 2009.
53. A. van den Bos, "Complex gradient and Hessian," IEE Proc. Vision, Image, Signal Process., vol.141, pp. 380-382, 1994.
54. G. McLachlan and T. Krishnan, The EM Algorithm and Extensions. New York: Wiley, 1997