Melody extraction from polyphonic music signals using pitch contour characteristics

IEEE Transactions on Audio, Speech and Language Processing

Volumn 20, Issue 6, 2012, Pages 1759-1770

  Salamon, Justin ^a   Gomez, Emilia ^a  

^a UNIVERSITAT POMPEU FABRA   (Spain)

Author keywords

Audio content description; multi pitch estimation; music information retrieval; pitch contour; predominant melody estimation

Indexed keywords

AUDIO CONTENT DESCRIPTION; AUDITORY STREAMING; AUTOMATIC EXTRACTION; COMPARATIVE EVALUATIONS; CURRENT LIMITATION; ERROR MINIMIZATION; EXTRACTION SYSTEMS; GLASS CEILING; KEY PARAMETERS; MUSIC INFORMATION RETRIEVAL; PITCH CONTOURS; POLYPHONIC MUSIC; SELECTION TECHNIQUES;

ERROR ANALYSIS;

ALGORITHMS;

EID: 84859735323     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2012.2188515     Document Type: Article

References (37)

1. G. E. Poliner, D. P. W. Ellis, F. Ehmann, E. Gómez, S. Steich, and B. Ong, "Melody transcription from music audio: Approaches and evaluation," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 4, pp. 1247-1256, May 2007.
2. R. Typke, "Music retrieval based on melodic similarity," Ph.D. dissertation, Utrecht Univ., Utrecht, The Netherlands, 2007.
3. M. Ryynänen and A. Klapuri, "Automatic transcription of melody, bass line, and chords in polyphonic music," Comput. Music J., vol. 32, no. 3, pp. 72-86, 2008.
4. M. Goto, "A real-time music-scene-description system: Predominant-f0 estimation for detecting melody and bass lines in real-world audio signals," Speech Commun., vol. 43, pp. 311-329, 2004.
5. R. B. Dannenberg, W. P. Birmingham, B. Pardo, N. Hu, C. Meek, and G. Tzanetakis, "A comparative evaluation of search techniques for query-by-humming usig the MUSART testbed," J. Amer. Soc. Inf. Sci., Technol., vol. 58, no. 5, pp. 687-701, Feb. 2007. (Pubitemid 46447175)
6. J.-L. Durrieu, G. Richard, and B. David, "An iterative approach to monaural musical mixture de-soloing," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), Apr. 2009, pp. 105-108.
7. A. Mesaros, T. Virtanen, and A. Klapuri, "Singer identification in polyphonic music using vocal separation and pattern recognition methods," in Proc. 8th Int. Conf. Music Inf. Retrieval, 2007, pp. 375-378.
8. X. Serra, R. Bresin, and A. Camurri, "Sound and music computing: Challenges and strategies," J. New Music Res., vol. 36, no. 3, pp. 185-190, 2007.
9. R. P. Paiva, T. Mendes, and A. Cardoso, "Melody detection in polyphonic musical signals: Exploiting perceptual rules, note salience, and melodic smoothness," Comput. Music J., vol. 30, pp. 80-98, Dec. 2006. (Pubitemid 44911410)
10. K. Dressler, "Audio melody extraction for mirex 2009," in Proc. 5th Music Inf. Retrieval Evaluation eXchange (MIREX), 2009.
11. A. Klapuri, "Multiple fundamental frequency estimation by summing harmonic amplitudes," in Proc. 7th Int. Conf. Music Inf. Retrieval, Victoria, BC, Canada, Oct. 2006, pp. 216-221.
12. A. Ozerov, P. Philippe, F. Bimbot, and R. Gribonval, "Adaptation of bayesian models for single-channel source separation and its application to voice/music separation in popular songs," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 5, pp. 1564-1578, Jul. 2007.
13. J.-L. Durrieu, "Automatic transcription and separation of the main melody in polyphonic music signals," Ph.D. dissertation, Télécom ParisTech, Paris, France, 2010.
14. M. Lagrange, L. G. Martins, J. Murdoch, and G. Tzanetakis, "Normalized cuts for predominant melodic source separation processing," IEEE Trans. Audio, Speech, Lang. Process., vol. 16, no. 2, pp. 278-290, Feb. 2008.
15. J.-L. Durrieu, A. Ozerov, C. Févotte, G. Richard, and B. D. David, "Main instrument separation from stereophonic audio signals using a source/filter model," in Proc. 17th Eur. Signal Process. Conf. (EUSIPCO), Glasgow, U.K., Aug. 2009, pp. 15-19.
16. G. Poliner and D. Ellis, "A classification approach to melody transcription," in Proc. 6th Int. Conf. Music Inf. Retrieval, London, U.K., Sep. 2005, pp. 161-166.
17. A. Cheveigné, "Pitch perception models," in Pitch, ser. Springer Handbook of Auditory Research, R. R. Fay, A. N. Popper, C. Plack, R. Fay, A. Oxenham, and A. Popper, Eds. New York: Springer, 2005, vol. 24, pp. 169-233.
18. A. Bregman, Auditory Scene Analysis. Cambridge, MA: MIT Press, 1990.
19. D. Huron, "Tone and voice: A derivation of the rules of voice-leading from perceptual principles," Music Percept., vol. 19, no. 1, pp. 1-64, 2001.
20. P. Cancela, "Tracking melody in polyphonic audio," in Proc. 4th Music Inf. Retrieval Eval. eXchange (MIREX), 2008.
21. J. Salamon, E. Gómez, and J. Bonada, "Sinusoid extraction and salience function design for predominant melody estimation," in Proc. 14th Int. Conf. Digital Audio Effects (DAFx-11), Paris, France, Sep. 2011, pp. 73-80.
22. Dec. 2011, Equal loudness filter, [Online]. Available: http://replaygain.org/
23. D. W. Robinson and R. S. Dadson, "A re-determination of the equalloudness relations for pure tones," British J. Appl. Phys., vol. 7, pp. 166-181, 1956.
24. G. Peeters, "A large set of audio features for sound description (similarity and classification) in the Cuidado Project," Institut de Recherche et Coordination Acoustique/Musique (IRCAM), 2004, Tech. Rep..
25. K. Dressler, "Sinusoidal extraction using an efficient implementation of a multi-resolution FFT," in Proc. 9th Int. Conf. Digital Audio Effects (DAFx-06), Montreal, QC, Canada, Sep. 2006, pp. 247-252.
26. J. L. Flanagan and R. M. Golden, "Phase vocoder," Bell Syst. Tech. J., vol. 45, pp. 1493-1509, 1966.
27. V. Rao and P. Rao, "Vocal melody extraction in the presence of pitched accompaniment in polyphonic music," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 8, pp. 2145-2154, Nov. 2010.
28. P. Herrera and J. Bonada, "Vibrato extraction and parameterization in the spectral modeling synthesis framework," in Proc.Workshop Digital Audio Effects (DAFx-98), 1998, pp. 107-110.
29. J. Salamon, B. Rocha, and E. Gómez, "Musical genre classification using melody features extracted from polyphonic music signals," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), Kyoto, Japan, Mar. 2012.
30. A. Klapuri, "A method for visualizing the pitch content of polyphonic music signals," in Proc. 10th Int. Soc. Music Inf. Retrieval Conf., Kobe, Japan, 2009, pp. 615-620.
31. J. S. Downie, "The music information retrieval evaluation exchange (2005-2007): A window into music information retrieval research," Acoust. Sci. Technol., vol. 29, no. 4, pp. 247-255, 2008.
32. C. Hsu and J. R. Jang, "Singing pitch extraction by voice vibrato/ tremolo estimation and instrument partial deletion," in Proc. 11th Int. Soc. for Music Inf. Retrieval Conf., Utrecht, The Netherlands, Aug. 2010, pp. 525-530.
33. H. Tachibana, T. Ono, N. Ono, and S. Sagayama, "Extended abstract for audio melody extraction in mirex 2010," in Proc. 6th Music Inf. Retrieval Eval. eXchange (MIREX), Aug. 2010.
34. S. Joo, S. Jo, and C. D. Yoo, "Melody extraction from polyphonic audio signal mirex2010," in Proc. 6th Music Inf. Retrieval Eval. eXchange (MIREX), Aug. 2010.
35. X. Serra, Musical Sound Modeling With Sinusoids Plus Noise. : Swets & Zeitlinger, 1997, pp. 91-122.
36. P. Iverson, "Auditory stream segregation by musical timbre: Effects of static and dynamic acoustic attributes," J. Exper. Psychol.: Human Percept. Perf., vol. 21, no. 4, pp. 751-763, Aug. 1995.
37. N. Ono, K. Miyamoto, H. Kameoka, J. LeRoux, Y. Uchiyama, E. Tsunoo, T. Nishimoto, and S. Sagayama, "Harmonic and percussive sound separation and its application to mir-related tasks," in Advances in Music Information Retrieval, ser. Studies in Computational Intelligence, Z. Ras and A. Wieczorkowska, Eds. Berlin/Heidelberg, Germany: Springer, 2010, vol. 274, pp. 213-236.