A general flexible framework for the handling of prior information in audio source separation

IEEE Transactions on Audio, Speech and Language Processing

Volumn 20, Issue 4, 2012, Pages 1118-1133

  Ozerov, Alexey ^a   Vincent, Emmanuel ^a   Bimbot, Frédéric ^b  

^a INRIA   (France)

^b CAMPUS DE BEAULIEU   (France)

Author keywords

Audio source separation; Expectation maximization; Local Gaussian model; Nonnegative matrix factorization

Indexed keywords

AUDIO SOURCE SEPARATION; EXPECTATION MAXIMIZATION; EXPECTATION-MAXIMIZATION ALGORITHMS; FLEXIBLE FRAMEWORK; LOCAL GAUSSIAN MODELING; NEW EFFICIENT METHOD; NONNEGATIVE MATRIX FACTORIZATION; SEPARATION PROBLEMS;

ALGORITHMS;

SOURCE SEPARATION;

EID: 84897584695     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2011.2172425     Document Type: Article

References (57)

1. E. Vincent, M. Jafari, S. A. Abdallah, M. D. Plumbley, and M. E. Davies, "Probabilistic modeling paradigms for audio source separation," in Machine Audition: Principles, Algorithms and Systems. Hershey, PA: IGI Global, 2010, ch. 7, pp. 162-185.
2. H. Attias, "New EM algorithms for source separation and deconvolution," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP'03), 2003, pp. 297-300.
3. D.-T. Pham, C. Servière, and H. Boumaraf, "Blind separation of speech mixtures based on nonstationarity," in Proc. 7th Int. Symp. Signal Process. and Its Applicat., 2003, pp. II-73-II-76.
4. S. A. Abdallah and M. D. Plumbley, "Polyphonic transcription by non-negative sparse coding of power spectra," in Proc. 5th Int. Symp. Music Inf. Retrieval (ISMIR'04), Oct. 2004, pp. 318-325.
5. C. Févotte and J.-F. Cardoso, "Maximum likelihood approach for blind audio source separation using time-frequency Gaussian source models," in Proc. IEEE Workshop Applicat. Signal Process. Audio Acoust. (WASPAA'05), Mohonk, NY, Oct. 2005, pp. 78-81.
6. L. Benaroya, F. Bimbot, and R. Gribonval, "Audio source separation with a single sensor," IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 1, pp. 191-199, Jan. 2006. (Pubitemid 43863465)
7. A. Ozerov, P. Philippe, F. Bimbot, and R. Gribonval, "Adaptation of Bayesian models for single-channel source separation and its application to voice/music separation in popular songs," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 5, pp. 1564-1578, Jul. 2007.
8. R. Blouet, G. Rapaport, I. Cohen, and C. Févotte, "Evaluation of several strategies for single sensor speech/music separation," in Proc. Int. Conf. Acoust., Speech, Signal Process. (ICASSP'08), Las Vegas, NV, Apr. 2008, pp. 37-40.
9. C. Févotte, N. Bertin, and J.-L. Durrieu, "Nonnegative matrix factorization with the Itakura-Saito divergence. With application to music analysis," Neural Comput., vol. 21, no. 3, pp. 793-830, Mar. 2009.
10. E. Vincent, S. Arberet, and R. Gribonval, "Underdetermined instantaneous audio source separation via local Gaussian modeling," in Proc. Int. Conf. Ind. Compon. Anal. Blind Source Separat. (ICA'09), 2009, pp. 775-782.
11. S. Arberet, A. Ozerov, R. Gribonval, and F. Bimbot, "Blind spectral- GMM estimation for underdetermined instantaneous audio source separation," in Proc. Int. Conf. Ind. Compon. Anal. Blind Source Separat. (ICA'09), 2009, pp. 751-758.
12. A. Ozerov, C. Févotte, and M. Charbit, "Factorial scaled hidden Markov model for polyphonic audio representation and source separation," in Proc. IEEE Workshop Applicat. Signal Process. Audio Acoust. (WASPAA'09), Oct. 18-21, 2009, pp. 121-124.
13. A. Ozerov and C. Févotte, "Multichannel nonnegative matrix factorization in convolutive mixtures for audio source separation," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 3, pp. 550-563, Mar. 2010.
14. E. Vincent, N. Bertin, and R. Badeau, "Adaptive harmonic spectral decomposition for multiple pitch estimation," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 3, pp. 528-537, Mar. 2010.
15. N. Bertin, R. Badeau, and E. Vincent, "Enforcing harmonicity and smoothness in Bayesian non-negative matrix factorization applied to polyphonic music transcription," IEEE Trans. Trans. Audio, Speech, Lang. Process., vol. 18, no. 3, pp. 538-549, Mar. 2010.
16. J. L. Durrieu, G. Richard, B. David, and C. Févotte, "Source/filter model for unsupervised main melody extraction from polyphonic audio signals," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 3, pp. 564-575, Mar. 2010.
17. S. Arberet, A. Ozerov, N. Duong, E. Vincent, R. Gribonval, F. Bimbot, and P. Vandergheynst, "Nonnegative matrix factorization and spatial covariance model for under-determined reverberant audio source separation," in Proc. 10th Int. Conf. Inf. Sci., Signal Process. their Applicat. (ISSPA'10), 2010, pp. 1-4.
18. N. Q. K. Duong, E. Vincent, and R. Gribonval, "Under-determined reverberant audio source separation using local observed covariance and auditory-motivated time-frequency representation," in Proc. 9th Int. Conf. Latent Variable Anal. Signal Separat. (LVA/ICA'10), Saint-Malo, France, Sep. 27-30, 2010, pp. 73-80.
19. N. Q. K. Duong, E. Vincent, and R. Gribonval, "Under-determined reverberant audio source separation using a full-rank spatial covariance model," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 7, pp. 1830-1840, Sep. 2010.
20. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. R. Statist. Soc., ser. B, vol. 39, Methodological, pp. 1-38, 1977.
21. A. Ozerov, C. Févotte, R. Blouet, and J.-L. Durrieu, "Multichannel non-negative tensor factorization with structured constraints for user-guided audio source separation," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP'11), Prague, Czech Republic, May 2011, pp. 257-260.
22. J.-F. Cardoso, M. Le Jeune, J. Delabrouille, M. Betoule, and G. Patanchon, "Component separation with flexible models - Application to multichannel astrophysical observations," IEEE J. Sel. Topics Signal Process., vol. 2, no. 5, pp. 735-746, Oct. 2008.
23. D. FitzGerald, M. Cranitch, and E. Coyle, "Extended nonnegative tensor factorisation models for musical sound source separation," in Computational Intelligence and Neuroscience. New York: Hindawi., 2008, vol. 2008.
24. A. Ozerov, E. Vincent, and F. Bimbot, "A general modular framework for audio source separation," in Proc. 9th Int. Conf. Latent Variable Anal. Signal Separat. (LVA/ICA'10), Saint-Malo, France, Sep. 27-30, 2010, pp. 33-40.
25. A. Ozerov, E. Vincent, and F. Bimbot, Flexible Audio Source Separation Toolbox (FASST) [Online]. Available: http://bass-db.gforge.inria.fr/fasst/
26. F. Hlawatsch and G. F. Boudreaux-Bartels, "Linear and quadratic time-frequency signal representations," IEEE Signal Process. Mag., vol. 9, no. 2, pp. 21-67, Apr. 1992.
27. O. Yilmaz and S. Rickard, "Blind separation of speech mixtures via time-frequency masking," IEEE Trans. Signal Process., vol. 52, no. 7, pp. 1830-1847, Jul. 2004.
28. H. Sawada, S. Araki, R. Mukai, and S. Makino, "Grouping separated frequency components by estimating propagation model parameters in frequency-domain blind source separation," IEEE Trans. Trans. Audio, Speech, Lang. Process., vol. 15, no. 5, pp. 1592-1604, Jul. 2007.
29. S. Araki, A. Ozerov, V. Gowreesunker, H. Sawada, F. Theis, G. Nolte, D. Lutter, and N. Duong, "The 2010 signal separation evaluation campaign (SiSEC2010): Audio source separation," in Proc. 9th Int. Conf. Latent Variable Anal. Signal Separat. (LVA/ICA'10), Saint-Malo, France, Sep. 2010, pp. 114-122.
30. E. Vincent, S. Araki, and P. Bofilld, "The 2008 signal separation evaluation campaign: A community-based approach to large-scale evaluation," in Proc. Int. Conf. Ind. Compon. Anal. Signal Separat. (ICA'09), 2009, pp. 734-741.
31. E. Moulines, J.-F. Cardoso, and E. Gassiat, "Maximum likelihood for blind separation and deconvolution of noisy signals using mixture models," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP'97), Apr. 1997, pp. 3617-3620.
32. T. Yoshioka, T. Nakatani, M. Miyoshi, and H. Okuno, "Blind separation and dereverberation of speech mixtures by joint optimization," IEEE Trans. Trans. Audio, Speech, Lang. Process., vol. 19, no. 1, pp. 69-84, Jan. 2010.
33. P. Smaragdis, "Non-negative matrix factor deconvolution; extraction of multiple sound sources from monophonic inputs.," in Proc. 5th Int. Conf. Ind. Compon. Anal., Granada, Spain, Sep. 2004, pp. 494-499.
34. T. Virtanen, "Monaural sound source separation by non-negative matrix factorization with temporal continuity and sparseness criteria," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 3, pp. 1066-1074, Mar. 2007.
35. A. Klapuri, "Analysis of musical instrument sounds by source-filter decay model," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP'07), 2007, vol. 1, pp. 53-56.
36. I. Lee, T. Kim, and T.-W. Lee, "Independent vector analysis for convolutive blind speech separation," in Blind Speech Separation. New York: Springer, 2007, pp. 169-192.
37. S. J. Rennie, J. R. Hershey, and P. A. Olsen, "Efficient model-based speech separation and denoising using non-negative subspace analysis," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP'08), 2008, pp. 1833-1836.
38. A. T. Cemgil, "Bayesian inference in non-negative matrix factorization models," Comput. Intell. Neurosci., no. Article ID 785152, 2009.
39. S. T. Roweis, "One microphone source separation," in Advances in Neural Information Processing Systems 13. Cambridge, MA: MIT Press, 2000, pp. 793-799.
40. M. I. Mandel, R. J. Weiss, and D. Ellis, "Model-based expectation-maximization source separation and localization," IEEE Trans. Trans. Audio, Speech, Lang. Process., vol. 18, no. 2, pp. 382-394, Feb. 2010.
41. J.-F. Cardoso, "The three easy routes to independent component analysis; contrasts and geometry," in Proc. Int. Conf. Ind. Compon. Anal. Blind Source Separat. (ICA'01), San Diego, CA, Dec. 2001, pp. 1-6.
42. H. Kameoka, T. Nishimoto, and S. Sagayama, "A multipitch analyzer based on harmonic temporal structured clustering," IEEE Trans. Trans. Audio, Speech, Lang. Process., vol. 15, no. 3, pp. 982-994, Mar. 2007.
43. R. Hennequin, R. Badeau, and B. David, "NMF with time-frequency activations to model nonstationary audio events," IEEE Trans. Trans. Audio, Speech, Lang. Process., vol. 19, no. 4, pp. 744-753, May 2011.
44. Y. Meron and K. Hirose, "Separation of singing and piano sounds," in Proc. Int. Conf. Spoken Lang. Process., 1998.
45. L. R. Rabiner, "A tutorial on hidden Markov models and selected applications in speech recognition," Proc. IEEE, vol. 77, no. 2, pp. 257-286, Feb. 1989.
46. P. O. Hoyer, "Non-negative matrix factorization with sparseness constraints," J. Mach. Learn. Res., vol. 5, pp. 1457-1469, 2004.
47. J. Eggert and E. Körner, "Sparse coding and NMF," in Proc. Int. Joint Conf. Neural Netw. (IJCNN'04), 2004, pp. 2529-2533.
48. E. Vincent, R. Gribonval, and C. Fevotte, "Performance measurement in blind audio source separation," IEEE Trans. Trans. Audio, Speech, Lang. Process., vol. 14, no. 4, pp. 1462-1469, Jul. 2006. (Pubitemid 46547636)
49. S. Arberet, R. Gribonval, and F. Bimbot, "A robust method to count and locate audio sources in a multichannel underdetermined mixture," IEEE Trans. Signal Process., vol. 58, no. 1, pp. 121-133, Jan. 2010.
50. C. Blandin, E. Vincent, and A. Ozerov, "Multi-source TDOA estimation using SNR-based angular spectra," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP'11), Prague, Czech Republic, May 2011, pp. 2616-2619.
51. E. Vincent, "Complex nonconvex lp norm minimization for underdetermined source separation," in Proc. Int. Conf. Ind. Compon. Anal. Blind Source Separat. (ICA'07), 2007, pp. 430-437.
52. O. Gillet and G. Richard, "Transcription and separation of drum signals from polyphonic music," IEEE Trans. Trans. Audio, Speech, Lang. Process., vol. 16, no. 3, pp. 529-540, Mar. 2008.
53. M. Goto, H. Hashiguchi, T. Nishimura, and R. Oka, "RWC music database: Music genre database and musical instrument sound databases," in Proc. 5th Int. Symp. Music Inf. Retrieval (ISMIR), 2004, pp. 229-230 [Online]. Available: http://staff.aist.go.jp/m.goto/RWC-MDB/
54. A. Ozerov and E. Vincent, "Using the FASST source separation toolbox for noise robust speech recognition," in Proc. Int. Workshop Mach. Listening in Multisource Environments (CHiME 2011), Florence, Italy, Sep. 2011, pp. 86-87.
55. R. Weiss and D. Ellis, "Speech separation using speaker-adapted eigenvoice speech models," Comput. Speech Lang., vol. 24, no. 1, pp. 16-29, 2010.
56. G. Grindlay and D. Ellis, "Multi-voice polyphonic music transcription using eigeninstruments," in Proc. IEEEWorkshop Applicat. Signal Process. Audio Acoust. (WASPAA'09), 2009, pp. 53-56.
57. L. Benaroya, R. Blouet, C. Févotte, and I. Cohen, "Single sensor source separation using multiple-window STFT representation," in Proc. Int. Workshop Acoust. Echo Noise Control (IWAENC'06), Paris, France, Sep. 12-14, 2006.