Soundprism: An online system for score-informed source separation of music audio

IEEE Journal on Selected Topics in Signal Processing

Volumn 5, Issue 6, 2011, Pages 1205-1215

  Duan, Zhiyao ^a   Pardo, Bryan ^a  

^a Northwestern University   (United States)

Author keywords

Multi pitch estimation; Online algorithm; Score following; Source separation

Indexed keywords

AUDIO FRAMES; FUNDAMENTAL FREQUENCIES; HARMONIC NUMBER; HARMONIC SOURCES; IN-BUILDINGS; INVERSE PROPORTIONS; MUSICAL SCORE; OBSERVATION MODEL; ON-LINE ALGORITHMS; ON-LINE FASHION; PARTICLE FILTERING; POLYPHONIC MUSIC; SCORE FOLLOWING; SEPARATION PROCESS; SINGLE-CHANNEL; SOURCE SEPARATION; SOURCE SIGNALS; STATE VECTOR; TIME FRAME;

HARMONIC ANALYSIS; REAL TIME SYSTEMS; SEPARATION; SEPARATORS;

AUDIO ACOUSTICS;

EID: 80052999230     PISSN: 19324553     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSTSP.2011.2159701     Document Type: Article

References (39)

1. Z. Duan, Y. Zhang, C. Zhang, and Z. Shi, "Unsupervised single-channel music source separation by average harmonic structure modeling," IEEE Trans. Audio, Speech, Lang. Process., vol. 16, no. 4, pp. 766-778, May 2008.
2. C. Raphael, "A classifier-based approach to score-guided source separation of musical audio," Comput. Music J., vol. 32, no. 1, pp. 51-59, 2008. (Pubitemid 351479759)
3. R. Hennequin, B. David, and R. Badeau, "Score informed audio source separation using a parametric model of non-negative spectrogram," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2011, pp. 45-48.
4. J. Woodruff, B. Pardo, and R. B. Dannenberg, "Remixing stereo music with score-informed source separation," in Proc. Int. Conf. Music Inf. Retrieval (ISMIR), 2006, pp. 314-349.
5. J. Ganseman, G. Mysore, P. Scheunders, and J. Abel, "Source separation by score synthesis," in Proc. Int. Comput. Music Conf. (ICMC), New York, Jun. 2010.
6. S. Dixon, "Live tracking of musical performances using on-line time warping," in Proc. Int. Conf. Digital Audio Effects (DAFx), Madrid, Spain, 2005, pp. 92-97.
7. R. Macrae and S. Dixon, "Accurate real-time windowed time warping," in Proc. Int. Soc. Music Inf. Retrieval Conf. (ISMIR), 2010, pp. 423-428.
8. Z. Duan, B. Pardo, and C. Zhang, "Multiple fundamental frequency estimation by modeling spectral peaks and non-peak regions," IEEE Trans. Audio. Speech. Lang. Process., vol. 18, no. 8, pp. 2121-2133, Nov. 2010.
9. N. Orio and D. Schwarz, "Alignment of monophonic and polyphonic music to a score," in Proc. Int. Comput. Music Conf. (ICMC), 2001, pp. 155-158.
10. N. Hu, R. B. Dannenberg, and G. Tzanetakis, "Polyphonic audio matching and alignment for music retrieval," in Proc. IEEE Workshop Applicat. Signal Process. Audio Acoust. (WASPAA), New Paltz, NY, 2003, pp. 185-188.
11. S. Ewert, M. Müller, and P. Grosche, "High resolution audio synchronization using chroma onset features," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2009, pp. 1869-1872.
12. P. Cano, A. Loscos, and J. Bonada, "Score-performance matching using HMMs," in Proc. Int. Comput. Music Conf. (ICMC), 1999, pp. 441-444.
13. C. Raphael, "Automatic segmentation of acoustic musical signals using hidden markov models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 21, no. 4, pp. 360-370, Apr. 1999.
14. C. Raphael, "Aligning music audio with symbolic scores using a hybrid graphical model," Mach. Learn., vol. 65, pp. 389-409, 2006. (Pubitemid 44836050)
15. C. Joder, S. Essid, and G. Richard, "A conditional random field framework for robust and scalable audio-to-score matching," IEEE Trans. Speech, Audio Lang. Process., to be published.
16. R. B. Dannenberg, "An on-line algorithm for real-time accompaniment," in Proc. Int. Comput. Music Conf. (ICMC), 1984, pp. 193-198.
17. B. Vercoe, "The synthetic performer in the context of live performance," in Proc. Int. Comput. Music Conf. (ICMC), 1984, pp. 199-200.
18. M. Puckette, "Score following using the sung voice," in Proc. Int. Comput. Music Conf. (ICMC), 1995, pp. 199-200.
19. L. Grubb and R. B. Dannenberg, "A stochastic method of tracking a vocal performer," in Proc. Int. Comput. Music Conf. (ICMC), 1997, pp. 301-308.
20. N. Orio and F. Dechelle, "Score following using spectral analysis and hidden markov models," in Proc. Int. Comput. Music Conf. (ICMC), 2001.
21. C. Raphael, "A Bayesian network for real-time musical accompaniment," in Proc. Adv. Neural Inf. Process. Syst. (NIPS), 2001.
22. L. Grubb and R. B. Dannenberg, "Automated accompaniment of musical ensembles," in Proc. 12th National Conf. Artif. Intell. (AAAI), 1994, pp. 94-99.
23. A. Cont, "Realtime audio to score alignment for polyphonic music instruments using sparse non-negative constraints and hierarchical HMMs," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2006, pp. 245-248.
24. A. Cont, "A coupled duration-focused architecture for real-time music-to-score alignment," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 6, pp. 974-987, Jun. 2010.
25. G. E. Poliner and D. P. W. Ellis, "A discriminative model for polyphonic piano transcription," EURASIP J. Adv. Signal Process., vol. 2007, Article ID 48317, 9 pages.
26. A. Klapuri, "Multiple fundamental frequency estimation based on harmonicity and spectral smoothness," IEEE Trans. Speech Audio Process., vol. 11, no. 6, pp. 804-815, Nov. 2003.
27. A. Doucet, N. de Freitas, and N. J. Gordon, Sequential Monte Carlo Methods in Practice. New York: Springer-Verlag, 2001.
28. M. S. Arulampalam, S. Maskell, N. Gordon, and T. Clapp, "A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking," IEEE Trans. Signal Process., vol. 50, no. 2, pp. 174-188, Feb. 2002. (Pubitemid 34291500)
29. Y. Li, J.Woodruff, and D. L. Wang, "Monaural musical sound separation based on pitch and common amplitude modulation," IEEE Trans. Audio, Speech, Lang. Process., vol. 17, no. 7, pp. 1361-1371, Sep. 2009.
30. M. Every and J. Szymanski, "A spectral-filtering approach to music signal separation," in Proc. Int. Conf. Digital Audio Effects (DAFx), 2004, pp. 197-200.
31. T. Virtanen, "Algorithm for the separation of harmonic sounds with time-frequency smoothness constraint," in Proc. Int. Conf. Digital Audio Effects (DAFx), 2003, pp. 35-40.
32. H. Viste and G. Evangelista, "A method for separation of overlapping partials based on similarity of temporal envelopes in multi-channel mixtures," IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 3, pp. 1051-1061, May 2006. (Pubitemid 46547666)
33. C. Yeh, A. Roebel, and X. Rodet, "Multiple fundamental frequency estimation and polyphony inference of polyphonic music signals," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 6, pp. 1116-1126, Aug. 2010.
34. J. Ganseman, P. Scheunders, G. J. Mysore, and J. S. Abel, "Evaluation of a score-informed source separation system," in Proc. Int. Soc. Music Inf. Retrieval (ISMIR), 2010, pp. 219-224.
35. Z. Duan, J. Han, and B. Pardo, "Song-level multi-pitch tracking by heavily constrained clustering," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2010, pp. 57-60.
36. E. Vincent, R. Gribonval, and C. Févotte, "Performance measurement in blind audio source separation," IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 4, pp. 1462-1469, Jul. 2006. (Pubitemid 46547636)
37. E. Vincent, R. Gribonval, and M. D. Plumbley, BSS Oracle Toolbox Version 2.1 [Online]. Available: http://bass-db.gforge.inria.fr/bssoracle/
38. A. Cont, D. Schwarz, N. Schnell, and C. Raphael, "Evaluation of realtime audio-to-score alignment," in Proc. Int. Conf. Music Inf. Retrieval (ISMIR), 2007, pp. 315-316.
39. M. Goto, H. Hashiguchi, T. Nishimura, and R. Oka, "RWCmusic database: Popular, classical, and jazz music databases," in Proc. Int. Conf. Music Inf. Retrieval (ISMIR), 2002, pp. 287-288.