REpeating pattern extraction technique (REPET): A simple method for music/voice separation

IEEE Transactions on Audio, Speech and Language Processing

Volumn 21, Issue 1, 2013, Pages 73-84

  Rafii, Zafar ^a   Pardo, Bryan ^a  

^a Northwestern University   (United States)

Author keywords

Melody extraction; music structure analysis; music voice separation; repeating patterns

Indexed keywords

ACOUSTICS; ELECTRICAL ENGINEERING;

MELODY EXTRACTIONS; MUSIC STRUCTURE ANALYSIS; MUSIC/VOICE SEPARATIONS; PITCH DETECTION ALGORITHM; REPEATING PATTERNS; SEGMENT MODELING; SIMPLE APPROACH; TIME-FREQUENCY MASKING;

EXTRACTION;

EID: 84867975114     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2012.2213249     Document Type: Article

References (36)

1. H. Schenker, Harmony. Chicago, IL: Univ. of Chicago Press, 1954.
2. N. Ruwet and M. Everist, "Methods of analysis in musicology," Music Anal., vol. 6, no. 1/2, pp. 3-936, Mar.-Jul. 1987.
3. A. Ockelford, Repetition in Music: Theoretical and Metatheoretical Perspectives. Farnham, U. K.: Ashgate, 2005, vol. 13, Royal Musical Association Monographs.
4. J. Foote, "Visualizing music and audio using self-similarity," in Proc. 7th ACMInt. Conf. Multimedia (Part 1), Orlando, FL, Oct.-Nov. 30-05, 1999, pp. 77-80. (Pubitemid 32262461)
5. M. Cooper and J. Foote, "Automatic music summarization via similarity analysis," in Proc. 3rd Int. Conf. Music Inf. Retrieval, Paris, France, Oct. 13-17, 2002, pp. 81-85.
6. A. Pikrakis, I. Antonopoulos, and S. Theodoridis, "Music meter and tempo tracking from raw polyphonic audio," in Proc. 9th Int. Conf. Music Inf. Retrieval, Barcelona, Spain, Oct. 10-14, 2008.
7. G. Peeters, "Deriving musical structures from signal analysis for music audio summary generation: "Sequence" and "state" approach," in Computer Music Modeling and Retrieval, U. Wiil, Ed. Berlin/Heidelberg, Germany: Springer, 2004, vol. 2771, Lecture Notes in Computer Science, pp. 169-185.
8. J. Foote, "Automatic audio segmentation using a measure of audio novelty," in Proc. IEEE Int. Conf. Multimedia and Expo, New York, Jul.-Aug. 30-02, 2000, vol. 1, pp. 452-455. (Pubitemid 33058981)
9. J. Foote and S. Uchihashi, "The beat spectrum: A new approach to rhythm analysis," in Proc. IEEE Int. Conf. Multimedia and Expo, Tokyo, Japan, Aug. 22-25, 2001, pp. 881-884.
10. M. A. Bartsch, "To catch a chorus using chroma-based representations for audio thumbnailing," in Proc. IEEE Workshop Applicat. Signal Process. Audio Acoust., New Paltz, NY, Oct. 21-24, 2001, pp. 15-18. (Pubitemid 34080583)
11. R. B. Dannenberg and N. Hu, "Pattern discovery techniques for music audio," J. New Music Res., vol. 32, no. 2, pp. 153-164, 2003.
12. K. Jensen, "Multiple scale music segmentation using rhythm, timbre, and harmony," EURASIP J. Adv. Signal Process., vol. 2007, no. 1, pp. 1-11, Jan. 2010.
13. R. B. Dannenberg, "Listening to "Naima": An automated structural analysis of music from recorded audio," in Proc. Int. Comput. Music Conf., Gothenburg, Sweden, Sep. 17-21, 2002, pp. 28-34.
14. R. B. Dannenberg and M. Goto, "Music structure analysis from acoustic signals," in Handbook of Signal Processing in Acoustics, D. Havelock, S. Kuwano, and M. Vorländer, Eds. New York: Springer, 2009, pp. 305-331.
15. J. Paulus, M. Müller, and A. Klapuri, "Audio-based music structure analysis," in Proc. 11th Int. Soc. Music Inf. Retrieval, Utrecht, The Netherlands, Aug. 9-13, 2010, pp. 625-636.
16. S. Vembu and S. Baumann, "Separation of vocals from polyphonic audio recordings," in Proc. 6th Int. Conf. Music Inf. Retrieval, London, U. K., Sep. 11-15, 2005, pp. 337-344.
17. B. Raj, P. Smaragdis, M. Shashanka, and R. Singh, "Separating a foreground singer from background music," in Proc. Int. Symp. Frontiers of Res. Speech and Music, Mysore, India, May 8-9, 2007.
18. A. Ozerov, P. Philippe, F. Bimbot, and R. Gribonval, "Adaptation of Bayesian models for single-channel source separation and its application to voice/music separation in popular songs," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 5, pp. 1564-1578, Jul. 2007.
19. Y. Li and D. Wang, "Separation of singing voice from music accompaniment for monaural recordings," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 4, pp. 1475-1487, May 2007.
20. M. Ryynänen, T. Virtanen, J. Paulus, and A. Klapuri, "Accompaniment separation and karaoke application based on automatic melody transcription," in Proc. IEEE Int. Conf. Multimedia & Expo, Hannover, Germany, Jun. 23-26, 2008, pp. 1417-1420.
21. T. Virtanen, A. Mesaros, and M. Ryynänen, "Combining pitch-based inference and non-negative spectrogram factorization in separating vocals from polyphonic music," in ISCA Tutorial and ResearchWorkshop on Statistical and Perceptual Audition, Brisbane, Australia, Sep. 21, 2008, pp. 17-20.
22. K. Dressler, "An auditory streaming approach on melody extraction," in Proc. 7th Int. Conf. Music Inf. Retrieval (MIREX Eval. ), Victoria, BC, Canada, Oct. 8-12, 2006.
23. C.-L. Hsu and J.-S. R. Jang, "On the improvement of singing voice separation for monaural recordings using the MIR-1K dataset," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 2, pp. 310-319, Feb. 2010.
24. J.-L. Durrieu, B. David, and G. Richard, "A musically motivated mid-level representation for pitch estimation and musical audio source separation," IEEE J. Sel. Topics Signal Process., vol. 5, no. 6, pp. 1180-1191, Oct. 2011.
25. M. Piccardi, "Background subtraction techniques: A review," in Proc. IEEE Int. Conf. Syst., Man, Cybern., The Hague, The Netherlands, Oct. 10-13, 2004, pp. 3099-3104. (Pubitemid 40408308)
26. K. Yoshii, M. Goto, and H. G. Okuno, "Adamast: A drum sound recognizer based on adaptation and matching of spectrogram templates," in Proc. 5th Int. Conf. Music Inf. Retrieval, Barcelona, Spain, Oct. 10-14, 2004, pp. 184-191.
27. B. Widrow, J. R. Glover, J. M. McCool, J. Kaunitz, C. S. Williams, R. H. Hean, J. R. Zeidler, J. E. Dong, and R. C. Goodlin, "Adaptive noise cancelling: Principles and applications," Proc. IEEE, vol. 63, no. 12, pp. 1692-1716, Dec. 1975.
28. J. H. McDermott, D. Wrobleski, and A. J. Oxenham, "Recovering sound sources from embedded repetition," Proc. Natural Acad. Sci. United States of Amer., vol. 108, no. 3, pp. 1188-1193, Jan. 2011.
29. Z. Rafii and B. Pardo, "A simple music/voice separation system based on the extraction of the repeating musical structure," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Prague, Czech Republic, May 22-27, 2011, pp. 221-224.
30. A. Liutkus and P. Leveau, "Separation of music sound track from several international versions of the same movie," in Proc. 128th Audio Eng. Soc. Conv., London, U. K., May 22-25, 2010.
31. C. Févotte, R. Gribonval, and E. Vincent, BSS-EVAL Toolbox User Guide IRISA, Rennes, France, 2005, Tech. Rep. 1706.
32. B. Fox, A. Sabin, B. Pardo, and A. Zopf, "Modeling perceptual similarity of audio signals for blind source separation evaluation," in Proc. 7th Int. Conf. Ind. Compon. Anal., London, U. K., Sep. 09-12, 2007, pp. 454-461.
33. R. J. Weiss and J. P. Bello, "Identifying repeated patterns in music using sparse convolutive non-negative matrix factorization," in Proc. 11th Int. Soc. Music Inf. Retrieval, Utrecht, The Netherlands, Aug. 9-13, 2010.
34. A. Liutkus, Z. Rafii, R. Badeau, B. Pardo, and G. Richard, "Adaptive filtering for music/voice separation exploiting the repeating musical structure," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Kyoto, Japan, Mar. 25-30, 2012, pp. 53-56.
35. A. de Cheveigné, "YIN, A fundamental frequency estimator for speech and music," J. Acoust. Soc. Amer., vol. 111, no. 4, pp. 1917-1930, Apr. 2002. (Pubitemid 34297247)
36. A. Klapuri, "Multiple fundamental frequency estimation by summing harmonic amplitudes," in Proc. 7th Int. Conf. Music Inf. Retrieval, Victoria, BC, Canada, Oct. 8-12, 2006, pp. 216-221.