Unsupervised single-channel music source separation by average harmonic structure modeling

IEEE Transactions on Audio, Speech and Language Processing

Volumn 16, Issue 4, 2008, Pages 766-778

  Duan, Zhiyao ^a   Zhang, Yungang ^b   Zhang, Changshui ^a   Shi, Zhenwei ^c  

^a TSINGHUA UNIVERSITY   (China)

^b Shanghai Applied Protein Technology Co Ltd   (China)

^c BEIHANG UNIVERSITY   (China)

Author keywords

Clustering; Harmonic structure; Multipitch estimation; Single channel source separation

Indexed keywords

CLUSTERING; CONCURRENT SOUNDS; HARMONIC STRUCTURE; LISTENING QUALITIES; MIXED SIGNALS; MULTIPITCH ESTIMATION; MUSICAL SIGNALS; NON-NEGATIVE MATRIX FACTORIZATIONS; SIDE EFFECTS; SINGLE-CHANNEL SOURCE SEPARATION; SOURCE SEPARATIONS;

CHANNEL CAPACITY; CHANNEL ESTIMATION; CLUSTERING ALGORITHMS; COMPUTER MUSIC; ESTIMATION; SEPARATION; SIGNAL ANALYSIS;

HARMONIC ANALYSIS;

EID: 64849117345     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2008.919073     Document Type: Article

References (59)

1. A. Hyvärinen and E. Oja, "Independent component analysis: Algorithms and applications," Neural Netw., vol. 13, pp. 411-430, 2000.
2. L. C. Parra and C. V. Alvino, "Geometric source separation: Merging convolutive source separation with geometric beamforming," IEEE Trans. Speech Audio Process., vol. 10, no. 6, pp. 352-362, Sep. 2002.
3. P. Smaragdis, "Blind separation of convolved mixtures in the frequency domain," Neurocomputing, vol. 22, pp. 21-34, 1998.
4. M. Zibulevsky, P. Kisilev, Y. Y. Zeevi, and B. Pearlmutter, "Blind source separation via multinode sparse representation," in Proc. NIPS, 2002, pp. 1049-1056.
5. T.-W. Lee, M. S. Lewicki, M. Girolami, and T. J. Sejnowski, "Blind source separation of more sources than mixtures using overcomplete representations," IEEE Signal Process. Lett., vol. 6, no. 4, pp. 87-90, Jun. 1999.
6. C. Fevotte and S.J. Godsill, "A Bayesian approach for blind separation of sparse sources," IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 6, pp. 2174-2188, Nov. 2006.
7. H. Viste and G. Evangelista, "A method for separation of overlapping partials based on similarity of temporal envelopes in multichannel mixtures," IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 3, pp. 1051-1061, May 2006.
8. M. J. Reyes-Gomez, B. Raj, and D. Ellis, "Multi-channel source separation by factorial HMMs," in Proc. ICASSP, 2003, pp. I-664-I-667.
9. S. T. Roweis, "One microphone source separation," in Proc. NIPS, 2001, pp. 15-19.
10. J. Hersheya and M. Casey, "Audio-visual sound separation via hidden Markov models," in Proc. NIPS, 2002, pp. 1173-1180.
11. G.-J. Jang and T.-W. Lee, "A probabilistic approach to single channel blind signal separation," in Proc. NIPS, 2003, pp. 1173-1180.
12. S. Vembu and S. Baumann, "Separation of vocal from polyphonic audio recordings," in Proc. ISMIR, 2005, pp. 337-344.
13. M. Helen and T. Virtanen, "Separation of drums from polyphonic music using non-negative matrix factorization and support vector machine," in Proc. EUSIPCO, Istanbul, Turkey, 2005, CD-ROM.
14. L. Benaroya, F. Bimbot, and R. Gribonval, "Audio source separation with a single sensor," IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 1, pp. 191-199, Jan. 2006.
15. E. Vincent, "Musical source separation using time-frequency source priors," IEEE Trans. Audio, Speech, Lang., Process., vol. 14, no. 1, pp. 91-98, Jan. 2006.
16. E. Vincent and M. D. Plumbley, "Single-channel mixture decomposition using Bayesian harmonic models," in Proc. ICA, 2006, pp. 722-730.
17. M. Bay and J. W. Beauchamp, "Harmonic source separation using prestored spectra," in Proc. ICA, 2006, pp. 561-568.
18. F. R. Bach and M. I. Jordan, "Blind one-microphone speech separation: A spectral learning approach," in Proc. NIPS, 2005, pp. 65-72.
19. T. Tolonen, "Methods for separation of harmonic sound sources using sinusoidal modeling." presented at the AES 106th Convention, Munich. Germany, 1999, unpublished.
20. T. Virtanen and A. Klapuri, "Separation of harmonic sound sources using sinusoidal modeling," in Proc. ICASSP, 2000, pp. II-765-U-768.
21. T. Virtanen, "Algorithm for the separation of harmonic sounds with time-frequency smoothness constraint," in Proc. DAFx, 2003, pp. 35-40.
22. M. R. Every and J. E. Szymanski, "Separation of synchronous pitched notes by spectral filtering of harmonics," IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 5, pp. 1845-1856, Sep. 2006.
23. Y. Li and D. L. Wang, "Separation of singing voice from music accompaniment for monaural recordings," IEEE Trans. Audio, Speech, Lang., Process., vol. 15, no. 4, pp. 1475-1487, May 2007.
24. A. S. Bregman, Auditory Scene Analysis. Cambridge, MA: MIT Press, 1990.
25. G. J. Brown and M. P. Cooke, "Computational auditory scene analysis," Comput. Speech Lang., vol. 8, pp. 297-336, 1994.
26. B. Wang and M. D. Plumbley. "Musical audio stream separation by non-negative matrix factorization," in Proc. DMRN Summer Conf., Glasgow, U.K., 2005, pp. 23-24.
27. T. Virtanen, "Monaural sound source separation by nonnegative matrix factorization with temporal continuity and sparseness criteria," IEEE Trans. Audio, Speech, Lang., Process., vol. 15, no. 3, pp. 1066-1074, Mar. 2007.
28. S. A. Abdallah and M. D. Plumbley, "Unsupervised analysis of polyphonic music using sparse coding," IEEE Trans. Neural Netw., vol. 17, no. 1, pp. 179-196, 2006.
29. Y. Zhang and C. Zhang, "Separation of music signals by harmonic structure modeling," in Proc. NIPS, 2006, pp. 1617-1624.
30. K. Kashino, K. Nakadai. T. Kinoshita, and H. Tanaka. "Application of Bayesian probability network to music scene analysis," in Working Notes of IJCAI Workshop on CASA, 1995, pp. 52-59.
31. M. A. Casey and A. Westner. "Separation of mixed audio sources by independent subspace analysis," in Proc. ICMC. 2000, pp. 154-161.
32. C. Uhle, C. Dittmar, and T. Sporer, "Extraction of drum tracks from polyphonic music using independent subspace analysis," in Proc. ICA, 2003, pp. 843-848.
33. M. K. 1. Molla and K. Hirose, "Single-mixture audio source separation by subspace decomposistion of Hilbert spectrum," IEEE Trans. Audio, Speech, Lang., Process., vol. 15, no. 3, pp. 893-900, Mar. 2007.
34. D. D. Lee and H. S. Seung, "Learning the parts of objects by nonnegative matrix factorization," Nature, vol. 401, pp. 788-791, 1999.
35. M. Kim and S. Choi, "Monaural music source separation: Non - negativity, sparseness, and shift-invariance," in ICA, 2006, pp. 617-624
36. R. Weiss and D. Ellis, "Estimating single-channel source separation masks: Relevance vector machine classifiers vs. pitch-based masking," in Proc. Workshop Statistical Perceptual Audition (SAPA'06), Oct. 2006, pp. 31-36.
37. E. Vincent, M. G. Jafari, S. A. Abdallah, M. D. Plumbley, and M. E. Davies, "Model-based audio source separation," Queen Mary Univ. of London, London, U.K., Tech. Rep. C4DM-TR-05-01, 2006.
38. J. Marques and P. Moreno, A Study of musical instrument classification using Gaussian mixture models and support vector machines Cambridge Res. Lab. Tech. Rep. Series CRL/4, 1999.
39. D. E. Hall, Musical Acoustics, 3rd ed. Sacramento, CA: Brooks Cole, California State Univ., 2002.
40. T. Kitahara, M. Goto, and H. G. Okuno, "Pitch-dependent musical instrument identification and its application to musical sound ontology," in Developments in Applied Artificial Intelligence. New York: Springer, 2003.
41. V. Välimäki, J. Pakarinen, C. Erkut, and M. Karjalainen, "Discrete - time modelling of musical instruments," Rep. Progress in Phys., vol. 69, pp. 1-78, 2006.
42. L. R. RabinerandB. H. Juang, Fundamentals of Speech Recognition. Englewood Cliffs, NJ: Prentice-Hall, 1993.
43. J. Eggink and G. J. Brown, "Application of missing feature theory to the recognition of musical instruments in polyphonic audio," in Proc. ISMIR, 2003, pp. 125-131.
44. X. Serra, "Musical sound modeling with sinusoids plus noise," in Musical Signal Processing, C. Roads, S. Popea, A. Picialli, and G. D. Poli, Eds. London, U.K.: Swets & Zeitlinger, 1997.
45. "Univ. Iowa Musical Instrument Samples," [Online], Available: http://theremin.music.uiowa.edu/
46. "Sound quality assessment material (SQAM)," [Online], Available: http://www.ebu.ch/en/technical/publications/tech3000-se - ries/tech3253/
47. X. Rodet, "Musical sound signal analysis/synthesis: Sinusoidal+residual and elementary waveform models," presented at the IEEE Time-Frequency and Time-Scale Workshop, 1997 [Online]. Available: http://recherche.ircam.fr/equipes/analyse-synthese/listePublications/ articlesRodet/TFTS97/TFTS97-ASP.ps, unpublished
48. J. O. Smith and X. Sena, "PARSHL: An analysis/synthesis program for non-harmonic sounds based on a sinusoidal representation," in Proc. ICMC, 1987, pp. 290-297.
49. M. Davy, S. Godsill, and J. Idier, "Bayesian analysis of polyphonic Western tonal music," J. Acoust. Soc. Amer., vol. 119, no. 4, pp. 2498-2517, 2006.
50. G. Schwarz. "Estimating the dimension of a model," Ann. Statist., vol. 6, pp. 461-464, 1978.
51. H. Thornburg, R. J. Leistikow, and J. Berger, "Melody extraction and musical onset detection via probabilistic models of framewise STFT peak data," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 4, pp. 1257-1272, May 2007.
52. R. J. Leistikow. H. Thornburg, J. O. Smith, and J. Berger, "Bayesian identification of closely-spaced chords from single-frame STFT peaks," in Proc. 7th Int. Conf. Digital Audio Effects (DAFx-04), Naples, Italy, 2004, pp. 228-233.
53. A. Klapuri, "Multiple fundamental frequency estimation by summing harmonic amplitudes," in Proc. ISMIR, 2006, pp. 216-221.
54. Y. Zhang, C. Zhang, and S. Wang, "Clustering in knowledge embedded space," in Proc. ECML, 2003, pp. 480-491.
55. M. Slaney, D. Naar, and R. F. Lyon, "Auditory model inversion for sound separation," in Proc. ICASSP, 1994, pp. 77-80.
56. E. Vincent, R. Gribonval, and C. Févotte, "Performance measurement in blind audio source separation," IEEE Trans. Audio, Speech, Lang., Process., vol. 14, no. 4, pp. 1462-1469. Jul. 2006.
57. C. Fevotte, R. Gribonval, and E. Vincent, "BSS EVAL Toolbox User Guide," Rennes, France, IR1SA Tech. Rep. 1706, Apr. 2005 [Online], Available: http://www.irisa.fr/metiss/bss eval/
58. E. Vincent and R. Gribonval, "BSS ORACLE Toolbox User Guide Version 1.0, 2005 [Online]. Available: http://www.irisa.fr/metiss/bss oracle/
59. T. Eerola and P. Toiviainen, "MIDI Toolbox: MATLAB tools for music research," Univ. of Jyväskylä. Kopijyvä, Jyväskylä, Finland, 2004 [Online]. Available: http://www.jyu.fi/ musica/miditoolbox/