On the Improvement of Singing Voice Separation for Monaural Recordings Using the MIR-1K Dataset

IEEE Transactions on Audio, Speech and Language Processing

Volumn 18, Issue 2, 2010, Pages 310-319

  Hsu, Chao Ling ^a   Jang, Jyh Shing Roger ^a  

^a NATIONAL TSING HUA UNIVERSITY   (Taiwan)

Author keywords

Computational auditory scene analysis (CASA); singing voice separation; unvoiced sound separation

Indexed keywords

EID: 85008542938     PISSN: 15587916     EISSN: 15587924     Source Type: Journal    
DOI: 10.1109/TASL.2009.2026503     Document Type: Article

References (32)

1. C. K. Wang, R. Y. Lyu, and Y. C. Chiang, “An automatic singing transcription system with multilingual singing lyric recognizer and robust melody tracker,” in Proc. 8th Eur. Conf. Speech Commun. Technol., Geneva, Switzerland, 2003, pp. 1197–1200.
2. T. Zhang, “System and method for automatic singer identification,” in Proc. IEEE Int. Conf. Multimedia and Expo (ICME), 2003, pp. 33–36.
3. D. Yang and W. Lee, “Disambiguating music emotion using software agents,” in Proc. Symp. Music Inf. Retrieval (ISMIR'04), Barcelona, Spain, 2004, pp. 52–57.
4. S. Vembu and S. Baumann, “Separation of vocals from polyphonic audio recordings,” in Proc. Int. Symp. Music Inf. Retrieval (ISMIR'05), 2005, pp. 337–344.
5. Y. Li and D. L. Wang, “Separation of singing voice from music accompaniment for monaural recordings,” IEEE Trans. Audio, Speech, Lang. Process., vol. 15, pp. 1475–1487, 2007.
6. T. Virtanen, A. Mesaros, and M. Ryynanen, “Combining pitch-based inference and non-negative spectrogram factorization in separating vocals from polyphonic music,” in Proc. ISCA Tutorial and Research Workshop on Statistical and Perceptual Audition (SAPA'08), Brisbane, Australia, Sep. 2008, pp. 17–20.
7. A. Ozerov, P. Philippe, F. Bimbot, and R. Gribonval, “Adaptation of Bayesian models for single channel source separation and its application to voice/music separation in popular songs,” IEEE Trans. Audio, Speech, Lang. Proc., Special Iss. Blind Signal Process Speech Audio Applicat., vol. 15, no. 5, pp. 1564–1578, Jul. 2007.
8. B. Raj, P. Smaragdis, M. V. Shashanka, and R. Singh, “Separating a foreground singer from background music,” in Proc. Int Symp. Frontiers Res. Speech Music (FRSM), Mysore, India, Jan. 2007.
9. G. J. Brown and D. L. Wang, S. Greenberg and W. Ainsworth, Eds., “Timing is of the essence: Neural oscillator models of auditory grouping,” in Listening to Speech: An Auditory Perspective. Lawrence Erlbaum, NJ: Mahwah, 2006, pp. 375–392.
10. G. Hu and D. L. Wang, E. Hansler and G. Schmidt, Eds., “An auditory scene analysis approach to monaural speech segregation,” in Acoustic Echo and Noise Control. Heidelberg, Germany: Springer, 2006, pp. 485–515.
11. D. L. Wang, P. Divenyi, Ed., “On ideal binary mask as the computational goal of auditory scene analysis,” in Speech Separation by Humans and Machines. Norwell, MA: Kluwer, 2005, pp. 181–197.
12. G. Hu and D. L. Wang, “Segregation of unvoiced speech from non-speech interference,” J. Acoust. Soc. Amer., vol. 124, pp. 1306–1319, 2008.
13. G. Hu and D. L. Wang, “Monaural speech segregation based on pitch tracking and amplitude modulation,” IEEE Trans. Neural Netw., vol. 15, no. 5, pp. 1135–1150, Sep. 2004.
14. Y. E. Kim, “Singing voice analysis/synthesis” Ph.D. dissertation, Media Lab., Mass. Inst. Technol., Cambridge, MA, 2003.
15. H. Fujihara, M. Goto, O. Jun, K. Komatani, T. Ogata, and H. G. Okuno, “Automatic synchronization between lyrics and music CD recordings based on viterbi alignment of segregated vocal signals,” in Proc. IEEE Int. Symp. Multimedia (ISM 2006), 2006, pp. 257–264.
16. H. Fujihara and M. Goto, “Three techniques for improving automatic synchronization between music and lyrics: Fricative sound detection, filler model, and novel feature vectors for vocal activity detection,” in Proc. 2008 IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP'08), Las Vegas, NV, Mar.–Apr. 2008, pp. 69–72.
17. M. Ryynanen, T. Virtanen, J. Paulus, and A. Klapuri, “Accompaniment separation and karaoke application based on automatic melody transcription,” in Proc. 2008 IEEE Int. Conf. Multimedia Expo (ICME'08), Hannover, Germany, Jun. 2008, pp. 1417–1420.
18. J. Li and C.-H. Lee, “On designing and evaluating speech event detectors,” in Proc. Inter Speech, Lisbon, Portugal, Sep. 2005, pp. 3365–3368.
19. K. Dressier, “An auditory streaming approach on melody extraction,” in Extended Abstract for ISMIR 2006, Victoria, BC, Canada, Sept. 8–12, 2006.
20. K. Dressier, “Sinusoidal extraction using an efficient implementation of a multi-resolution FFT,” in Proc. Int. Conf Digital Audio Effects (DAFx-06), Montreal, Quebec, Canada, Sep. 18–20, 2006, pp. 247–252.
21. P. Scalart and J. Vieira-Filho, “Speech enhancement based on a priori signal to noise estimation,” in Proc. 21st IEEE Int. Conf. Acoust. Speech Signal Process., Atlanta, GA, May 1996, pp. 629–632.
22. E. Zavarehei, Sample Speech Enhancement Methods, [Online]. Available: http://dea.brunel.ac.uk/cmsp/Home_Esfandiar/Sample wave Files.htm 2005
23. M. Weintraub, “A theory and computational model of auditory monaural sound separation,” Ph.D. dissertation, Dept. Elect. Eng., Stanford Univ., Stanford, CA, 1985.
24. K. N. Stevens, Acoustic Phonetics. Cambridge, MA: MIT Press, 1998.
25. C.-C. Kuo, C.-H. Lee, H. Li, L.-S. Lee, R.-H. Wang, and Q. Huo, Eds., “Phonetic and phonological background of Chinese spoken language,” in Proc. Chinese Spoken Lang. Process., Singapore, 2007, pp. 33–55.
26. S. P. Lloyd “Least squares quantization in PCM,” IEEE Trans. Inf. Theory, vol. IT-28, no. 2, pp. 129–137, Mar. 1982.
27. A. P. Dempster, N. M. Laird, and D. B. Rubin “Maximum likelihood from incomplete data via the EM algorithm,” J. R. Statist. Soc., vol. 39, pp. 1–38, 1977.
28. L. R. Rabiner, “A tutorial on hidden Markov models and selected application in speech recognition,” Proc. IEEE, vol. 77, no. 2, pp. 257–286, Feb. 1989.
29. R. Gribonval, L. Benaroya, E. Vincent, and C. Fevotte, “Proposals for performance measurement in source separation,” in Proc. Int. Symp. ICA BSS, Nara, Apr. 2003, pp. 763–768.
30. A. Ozerov, P. Philippe, R. Gribonval, and F. Bimbot, “One microphone singing voice separation using source-adapted models,” in Proc. IEEE Workshop Applicat. Signal Process. Audio Acoust., New York, 2005, pp. 90–93.
31. N. C. Maddage, C. Xu, and Y. Wang, “A SVM-based classification approach to musical audio,” in Proc. Int. Conf. Music Inform. Retrieval, 2003.
32. A. L. Berenzweig, D. P. W. Ellis, and S. Lawrence, “Using voice segment to improve artist classification of music,” in Proc. AES 22nd Int. Conf. Virtual, Synth. Entertainment Audio, 2002.