Multi-channel audio source separation using multiple deformed references

IEEE/ACM Transactions on Audio Speech and Language Processing

Volumn 23, Issue 11, 2015, Pages 1775-1787

  Souviraà Labastie, Nathan ^a   Olivero, Anaik ^a   Vincent, Emmanuel ^b   Bimbot, Frédéric ^a  

^a UNIVERSITÉ DE RENNES 1   (France)

^b INRIA   (France)

Author keywords

Generalized expectation maximization (GEM) algorithm; Source separation

Indexed keywords

ALGORITHMS; AUDIO RECORDINGS; IMAGE SEGMENTATION; LINEAR TRANSFORMATIONS; MAXIMUM PRINCIPLE; MIXTURES; PARAMETER ESTIMATION; SEPARATION;

FACTORIZATION ALGORITHMS; GENERALIZED EXPECTATION MAXIMIZATION; GENERALIZED EXPECTATIONMAXIMIZATION ALGORITHM (GEM); MULTICHANNEL AUDIO; NON-NEGATIVE MATRIX; SIGNAL-TO-DISTORTION RATIOS; SOURCES OF INTERESTS; TRANSFORMATION MATRICES;

SOURCE SEPARATION;

EID: 84942604609     PISSN: 23299290     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASLP.2015.2450494     Document Type: Article

References (40)

1. E. Vincent, S. Araki, F. Theis, G. Nolte, P. Bofill, H. Sawada, A. Ozerov, V. Gowreesunker, D. Lutter, and N. Q. K. Duong, "The signal separation evaluation campaign (2007-2010): Achievements and remaining challenges", Signal Process., vol. 92, no. 8, pp. 1928-1936, 2012.
2. A. Liutkus, J.-L. Durrieu, L. Daudet, and G. Richard, "An overview of informed audio source separation", in Proc. Int. Workshop Image Audio Anal. Multimedia Interactive Services (WIAMIS), Paris, France, Jul. 2013, pp. 1-4.
3. E. Vincent, N. Bertin, R. Gribonval, and F. Bimbot, "From blind to guided audio source separation: How models and side information can improve the separation of sound", IEEE Signal Process. Mag., vol. 31, no. 3, pp. 107-115, May 2014.
4. A. Ozerov, A. Liutkus, R. Badeau, and G. Richard, "Coding-based informed source separation: Nonnegative tensor factorization approach", IEEE Trans. Audio, Speech, Lang. Process., vol. 21, no. 8, pp. 1699-1712, Aug, 2013.
5. A. Ozerov, E. Vincent, and F. Bimbot, "A general flexible framework for the handling of prior information in audio source separation", IEEE Trans. Audio, Speech, Lang. Process., vol. 20, no. 4, pp. 1118-1133, May 2012.
6. Y. Salaün, E. Vincent, N. Bertin, N. Souviraà-Labastie, X. Jaureguiberry, D. T. Tran, and F. Bimbot, "The flexible audio source separation toolbox version 2.0", in Proc. Show & Tell IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), Florence, Italy, May 2014.
7. G. J. Mysore and P. Smaragdis, "A non-negative approach to language informed speech separation", in Proc. 10th Int. Conf. Latent Variable Anal. Signal Separat. (LVA/ICA), Tel-Aviv, Israel, 2012, pp. 356-363.
8. A. Casanovas, G. Monaci, P. Vandergheynst, and R. Gribonval, "Blind audiovisual source separation based on sparse redundant representations", IEEE Trans. Multimedia, vol. 12, no. 5, pp. 358-371, Aug. 2010.
9. N. Q. K. Duong, E. Vincent, and R. Gribonval, "Under-determined reverberant audio source separation using a full-rank spatial covariance model", IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 7, pp. 1830-1840, Jul. 2010.
10. U. Simsekli, Y. K. Yilmaz, and A. T. Cemgil, "Score guided audio restoration via generalised coupled tensor factorisation", in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), Kyoto, Japan, Mar. 2012, pp. 5369-5372.
11. C. Joder and B. Schuller, "Score-informed leading voice separation from monaural audio", in Proc. Int. Conf. Music Inf. Retrieval (ISMIR), Porto, Portugal, Oct. 2012, pp. 277-282.
12. J. Fritsch and M. D. Plumbley, "Score informed audio source separation using constrained nonnegative matrix factorization and score synthesis", in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), Vancouver, BC, Canada, May 2013, pp. 888-891.
13. S. Ewert, B. Pardo, M. Müller, and M. D. Plumbley, "Score-informed source separation for musical audio recordings: An overview", IEEE Signal Process. Mag., vol. 31, no. 3, pp. 116-124, May 2014.
14. P. Smaragdis and G. J. Mysore, "Separation by humming: User-guided sound extraction from monophonic mixtures", in Proc. IEEEWorkshop Applicat. Signal Process. Audio Acoust. (WASPAA), New Paltz, NY, USA, Oct. 2009, pp. 69-72.
15. D. Fitz Gerald, "User assisted separation using tensor factorisations", in Proc. 20th Eur. Signal Process. Conf. (EUSIPCO), Bucharest, Romania, Aug. 2012, pp. 2412-2416.
16. L. Le Magoarou, A. Ozerov, and N. Q. K. Duong, "Text-informed audio source separation using nonnegative matrix partial co-factorization", in Proc. IEEE Int. Workshop Mach. Learn. Signal Process. (MLSP'13), Southampton, U. K., Sep. 2013, pp. 1-6.
17. A. Ozerov, C. Févotte, R. Blouet, and J.-L. Durrieu, "Multichannel nonnegative tensor factorization with structured constraints for user-guided audio source separation", in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), Prague, Czech Republic, May 2011, pp. 257-260.
18. J.-L. Durrieu and J.-P. Thiran, "Musical audio source separation based on user-selected F0 track", in Proc. 10th Int. Conf. Latent Variable Anal. Signal Separat. (LVA/ICA), Tel-Aviv, Israel, 2012, pp. 438-445.
19. B. Fuentes, R. Badeau, and G. Richard, "Blind harmonic adaptive decomposition applied to supervised source separation", in Proc. 20th Eur. Signal Process. Conf. (EUSIPCO), Bucharest, Romania, Aug. 2012, pp. 2654-2658.
20. N. J. Bryan and G. J. Mysore, "Interactive refinement of supervised and semi-supervised sound source separation estimates", in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), Vancouver, BC, Canada, May 2013, pp. 883-887.
21. N. Q. K. Duong, A. Ozerov, L. Chevallier, and J. Sirot, "An interactive audio source separation framework based on non-negative matrix factorization", in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), Florence, Italy, May 2014, pp. 1567-1571.
22. N. J. Bryan, G. J. Mysore, and G. Wang, "ISSE: An interactive source separation editor", in Proc. SIGCHI Conf. Human Factors Comput. Syst., 2014, pp. 257-266.
23. A. Liutkus and P. Leveau, "Separation of music+effects sound track from several international versions of the same movie", in Proc. 128th Audio Eng. Society (AES) Conv., London, U. K., May 2010.
24. T. Gerber, M. Dutasta, L. Girin, and C. Févotte, "Professionally-produced music separation guided by covers", in Proc. Int. Conf. Music Inf. Retrieval (ISMIR), Porto, Portugal, Oct. 2012, pp. 85-90.
25. N. Souviraà-Labastie, E. Vincent, and F. Bimbot, "Music separation guided by cover tracks: Designing the joint NMF model", in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), Brisbane, Australia, Apr. 2015, pp. 484-488.
26. R. Hennequin, J. J. Burred, S. Maller, and P. Leveau, "Speech-guided source separation using a pitch-adaptive guide signal model", in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), Florence, Italy, May 2014, pp. 6672-6676.
27. N. Souviraà-Labastie, A. Olivero, E. Vincent, and F. Bimbot, "Audio source separation using multiple deformed references", in Proc. 22nd Eur. Signal Process. Conf. (EUSIPCO), Lisbon, Portugal, Sep. 2014, pp. 311-315.
28. J.-L. Durrieu, A. Ozerov, C. Févotte, and G. Richard, "Main instrument separation from stereophonic audio signals using a source/filter model", in Proc. 17th Eur. Signal Process. Conf. (EUSIPCO), Glasgow, U. K., Aug. 2009, pp. 15-20.
29. N. Ono, K. Miyamoto, H. Kameoka, and S. Sagayama, "A real-time equalizer of harmonic and percussive components in music signals", in Proc. Int. Conf. Music Inf. Retrieval (ISMIR), Philadelphia, PA, USA, Sep. 14-18, 2008, pp. 139-144.
30. L. Le Magoarou, A. Ozerov, and N. Q. K. Duong, "Text-informed audio source separation. Example-based approach using non-negative matrix partial co-factorizationl", J. Signal Process. Syst., pp. 1-15, 2014.
31. C. Févotte, N. Bertin, and J. Durrieu, "Nonnegative matrix factorization with the Itakura-Saito divergence: With application to music analysis", Neural Comput., vol. 21, no. 3, pp. 793-830, 2009.
32. C. Févotte and J. Idier, "Algorithms for nonnegative matrix factorization with the-divergence", Neural Comput., vol. 23, no. 9, pp. 2421-2456, 2011.
33. A. Ozerov, P. Philippe, F. Bimbot, and R. Gribonval, "Adaptation of Bayesian models for single channel source separation and its application to voice/music separation in popular songs", IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 5, pp. 1564-1578, Jul. 2007.
34. L. Catanese, N. Souviraà-Labastie, B. Qu, S. Campion, G. Gravier, E. Vincent, and F. Bimbot, "MODIS: An audio motif discovery software", in Show & Tell - Interspeech'13, Lyon, France, 2013.
35. A. Muscariello, G. Gravier, and F. Bimbot, "Unsupervised motif acquisition in speech via seeded discovery and template matching combination", IEEE Trans. Audio, Speech, Lang. Process., vol. 20, no. 7, pp. 2031-2044, Sep. 2012.
36. Y. Benezeth, G. Bachman, G. Le-Jan, N. Souviraà-Labastie, and F. Bimbot, BL-Database: A french audiovisual database for speech driven lip animation systems INRIA, Tech. Rep. RR-7711, 2011.
37. E. Vincent, R. Gribonval, and C. Févotte, "Performance measurement in blind audio source separation", IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 4, pp. 1462-1469, Jul. 2006.
38. C. Knapp and G. C. Carter, "The generalized correlation method for estimation of time delay", IEEE Trans. Acoust., Speech, Signal Process., vol. ASSP-24, no. 4, pp. 320-327, Aug. 1976.
39. D. P. W. Ellis, Dynamic time warping in Matlab, 2003. [Online]. Available: http://www.ee.columbia.edu/dpwe/resources/matlab/dtw
40. D. P. W. Ellis, PLP and RASTA (and MFCC, and inversion) in Matlab, 2005. [Online]. Available: http://www.ee.columbia.edu/dpwe/resources/matlab/rastamat