Score-informed source separation for musical audio recordings: An overview

IEEE Signal Processing Magazine

Volumn 31, Issue 3, 2014, Pages 116-124

  Ewert, Sebastian ^a   Pardo, Bryan ^b   Mueller, Meinard ^c   Plumbley, Mark D ^d  

^a QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

^b Northwestern University   (United Kingdom)

^c UNIVERSITY OF BONN   (Germany)

^d UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

AUDIO ACOUSTICS; AUDIO RECORDINGS; SEPARATION; SIGNAL PROCESSING;

ADDITIONAL KNOWLEDGE; KARAOKE SYSTEMS; MUSIC SIGNAL PROCESSING; PRIOR KNOWLEDGE; RESEARCH TOPICS; SCORE-INFORMED SOURCE SEPARATIONS; SEPARATION PROCESS; TIME AND FREQUENCIES;

SOURCE SEPARATION;

EID: 85032751380     PISSN: 10535888     EISSN: None     Source Type: Journal    
DOI: 10.1109/MSP.2013.2296076     Document Type: Review

References (35)

1. N. Bertin, R. Badeau, and E. Vincent, Enforcing harmonicity and smoothness in Bayesian non-negative matrix factorization applied to polyphonic music transcription, IEEE Trans. Audio, Speech, Lang. Processing, vol. 18, no. 3, pp. 538-549, 2010.
2. E. Vincent, M. G. Jafari, S. A. Abdallah, M. D. Plumbley, and M. E. Davies, Probabilistic modeling paradigms for audio source separation, in Machine Audition: Principles, Algorithms and Systems, W. Wang, Ed. Hershey: IGI Global, 2010, pp. 162-185.
3. P. Smaragdis and G. J. Mysore, Separation by humming: User guided sound extraction from monophonic mixtures, in Proc. IEEE Workshop Application Signal Processing to Audio Acoustics (WASPAA), 2009, pp. 69-72.
4. A. Lefevre, F. Bach, and C. Fvotte, Semi-supervised NMF with time-frequency annotations for single-channel source separation, in Proc. Int. Society for Music Information Retrieval Conf. (ISMIR), 2012, pp. 115-120.
5. U. Simsekli and A. T. Cemgil, Score guided musical source separation using generalized coupled tensor factorization, in Proc. European Signal Processing Conf. (EUSIPCO), 2012, pp. 2639-2643.
6. A. Ozerov, C. Fvotte, R. Blouet, and J.-L. Durrieu, Multichannel nonnegative tensor factorization with structured constraints for user-guided audio source separation, in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Processing (ICASSP), 2011, pp. 257-260.
7. J. Driedger, H. Grohganz, T. Prtzlich, S. Ewert, and M. Mller, Scoreinformed audio decomposition and applications, in Proc. ACM Int. Conf. Multimedia (ACM-MM), 2013, pp. 541-544.
8. K. Itoyama, M. Goto, K. Komatani, T. Ogata, and H. G. Okuno, Instrument equalizer for query-by-example retrieval: Improving sound source separation based on integrated harmonic and inharmonic models, in Proc. Int. Conf. Music Information Retrieval (ISMIR), 2008, pp. 133-138.
9. R. Hennequin, B. David, and R. Badeau, Score informed audio source separation using a parametric model of non-negative spectrogram, in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Processing (ICASSP), 2011, pp. 45-48.
10. S. Ewert and M. Mller, Estimating note intensities in music recordings, in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Processing (ICASSP), 2011, pp. 385-388.
11. P.-S. Huang, S. D. Chen, P. Smaragdis, and M. Hasegawa-Johnson, Singing- voice separation from monaural recordings using robust principal component analysis, in Proc. IEEE Int. Conf. Acoustics, Speech Signal Processing (ICASSP), 2012, pp. 57-60.
12. J. Herre, H. Purnhagen, J. Koppens, O. Hellmuth, J. Engdegrd, J. Hilper, L. Villemoes, L. Terentiv, C. Falch, A. Hlzer, M. L. Valero, B. Resch, H. Mundt, and H.-O. Oh, MPEG spatial audio object coding-The ISO/MPEG standard for efficient coding of interactive audio scenes, J. Audio Eng. Soc., vol. 60, no. 9, pp. 655-673, 2012.
13. Z. Duan and B. Pardo, Soundprism: An online system for score-informed source separation of music audio, IEEE J. Select. Topics Signal Processing, vol. 5, no. 6, pp. 1205-1215, 2011.
14. S. Ewert and M. Mller, Using score-informed constraints for NMFbased source separation, in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Processing (ICASSP), 2012, pp. 129-132.
15. J. Ganseman, P. Scheunders, G. J. Mysore, and J. S. Abel, Source separation by score synthesis, in Proc. Int. Computer Music Conf. (ICMC), 2010, pp. 462-465.
16. D. D. Lee and H. S. Seung, Algorithms for non-negative matrix factorization, in Proc. Neural Information Processing Systems (NIPS), 2000, pp. 556-562.
17. H. Kameoka, T. Nishimoto, and S. Sagayama, A multipitch analyzer based on harmonic temporal structured clustering, IEEE Trans. Audio, Speech Lang. Processing, vol. 15, no. 3, pp. 982-994, 2007.
18. S. A. Raczynski, N. Ono, and S. Sagayama, Multipitch analysis with harmonic nonnegative matrix approximation, in Proc. Int. Conf. Music Information Retrieval (ISMIR), 2007, pp. 381-386.
19. R. B. Dannenberg and C. Raphael, Music score alignment and computer accompaniment, ACM Commun., vol. 49, no. 8, pp. 38-43, 2006.
20. M. A. Bartsch and G. H. Wakefield, Audio thumbnailing of popular music using chroma-based representations, IEEE Trans. Multimedia, vol. 7, no. 1, pp. 96-104, 2005.
21. C. Joder, S. Essid, and G. Richard, A conditional random field framework for robust and scalable audio-to-score matching, IEEE Trans. Audio, Speech, Lang. Processing, vol. 19, no. 8, pp. 2385-2397, 2011.
22. S. Ewert, M. Mller, and P. Grosche, High resolution audio synchronization using chroma onset features, in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Processing (ICASSP), 2009, pp. 1869-1872.
23. Z. Duan and B. Pardo, A state space model for online polyphonic audioscore alignment, in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Processing (ICASSP), 2011, pp. 197-200.
24. M. Mller and D. Appelt, Path-constrained partial music synchronization, in Proc. Int. Conf. Acoustics, Speech Signal Processing (ICASSP), 2008, pp. 65-68.
25. J.-L. Durrieu, G. Richard, B. David, and C. Fvotte, Source/filter model for unsupervised main melody extraction from polyphonic audio signals, IEEE Trans. Audio, Speech Lang. Processing, vol. 18, no. 3, pp. 564-575, 2010.
26. M. Goto, A real-time music-scene-description system: Predominant-F0 estimation for detecting melody and bass lines in real-world audio signals, Speech Commun. (ISCA J.), vol. 43, no. 4, pp. 311-329, 2004.
27. Y. Han and C. Raphael, Informed source separation of orchestra and soloist, in Proc. Int. Society for Music Information Retrieval Conf. (ISMIR), 2010, pp. 315-320.
28. T. Heittola, A. P. Klapuri, and T. Virtanen, Musical instrument recognition in polyphonic audio using source-filter model for sound separation, in Proc. Int. Society for Music Information Retrieval Conf. (ISMIR), 2009, pp. 327-332.
29. P. Sprechmann, P. Cancela, and G. Sapiro, Gaussian mixture models for score-informed instrument separation, in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Processing (ICASSP), 2012, pp. 49-52.
30. C. Joder and B. Schuller, Score-informed leading voice separation from monaural audio, in Proc. Int. Society for Music Information Retrieval Conf. (ISMIR), 2012, pp. 277-282.
31. M. Shashanka, B. Raj, and P. Smaragdis, Probabilistic latent variable models as nonnegative factorizations (Article ID 947438), Computat. Intell. Neurosci., vol. 2008, p. 9, 2008.
32. J. Fritsch and M. D. Plumbley, Score informed audio source separation using constrained nonnegative matrix factorization and score synthesis, in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Processing (ICASSP), 2013, pp. 888-891.
33. J. Fritsch, J. Ganseman, and M. D. Plumbley, A comparison of two different methods for score-informed source separation, in Proc. Int. Workshop Machine Learning Music (MML), 2012, p. 2.
34. J. Woodruff, B. Pardo, and R. B. Dannenberg, Remixing stereo music with score-informed source separation, in Proc. Int. Conf. Music Information Retrieval (ISMIR), 2006, pp. 314-319.
35. A. Liutkus, S. Gorlow, N. Sturmel, S. Zhang, L. Girin, R. Badeau, L. Daudet, S. Marchand, and G. Richard, Informed audio source separation: A comparative study, in Proc. European Signal Processing Conf. (EUSIPCO), 2012, pp. 2397-2401.