Towards timbre-invariant audio features for harmony-based music

IEEE Transactions on Audio, Speech and Language Processing

Volumn 18, Issue 3, 2010, Pages 649-662

  Müller, Meinard ^a   Ewert, Sebastian ^b  

^a SAARLAND UNIVERSITY   (Germany)

^b UNIVERSITY OF BONN   (Germany)

Author keywords

Audio matching; Chroma feature; Mel frequency cepstral coefficient (MFCC); Music retrieval; Pitch feature; Timbre invariance

Indexed keywords

AUDIO FEATURES; CEPSTRAL COEFFICIENTS; CHROMA FEATURES; MEL-FREQUENCY CEPSTRAL COEFFICIENT (MFCC); MEL-FREQUENCY CEPSTRAL COEFFICIENTS; MUSIC RETRIEVAL; RETRIEVAL APPLICATIONS; SPECTRAL COMPONENTS; STATE OF THE ART;

GESTURE RECOGNITION; SPEECH RECOGNITION;

AUDIO ACOUSTICS;

EID: 76949093273     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2010.2041394     Document Type: Article

References (39)

1. M. A. Bartsch and G. H. Wakefield, "Audio thumbnailing of popular music using chroma-based representations," IEEE Trans. Multimedia, vol.7, no.1, pp. 96-104, Feb. 2005.
2. E. Gómez, "Tonal description of music audio signals," Ph.D. dissertation, Universitat Pompeu Fabra (UPF), Barcelona, Spain, 2006.
3. M. Müller, Information Retrieval for Music and Motion. Berlin, Germany: Springer, 2007.
4. V. Arifi, M. Clausen, F. Kurth, and M. Müller, "Synchronization of music data in score-, MIDI- and PCM-format," Comput. in Musicol., vol.13, pp. 9-33, 2004.
5. R. Dannenberg and C. Raphael, "Music score alignment and computer accompaniment," Commun. ACM, Special Iss., vol.49, no.8, pp. 39-43, 2006.
6. S. Dixon and G.Widmer, "MATCH: A music alignment tool chest," in Proc. Int. Conf. Music Inf. Retrieval (ISMIR), London, U.K., 2005, pp. 492-497.
7. N. Hu, R. Dannenberg, and G. Tzanetakis, "Polyphonic audio matching and alignment for music retrieval," in Proc. IEEE Workshop Applicat. Signal Process. Audio Acoust. (WASPAA), New Paltz, NY, 2003, pp. 185-188.
8. F. Kurth, M. Müller, C. Fremerey, Y. Chang, and M. Clausen, "Automated synchronization of scanned sheet music with audio recordings," in Proc. Int. Conf. Music Inf. Retrieval (ISMIR), Vienna, Austria, 2007, pp. 261-266.
9. W. Chai, "Semantic segmentation and summarization of music: Methods based on tonality and recurrent structure," IEEE Signal Process. Mag., vol.23, no.2, pp. 124-132, Mar. 2006.
10. R. Dannenberg and N. Hu, "Pattern discovery techniques for music audio," in Proc. Int. Conf. Music Inf. Retrieval (ISMIR), Paris, France, 2002, pp. 63-70.
11. M. Goto, "A chorus section detection method for musical audio signals and its application to a music listening station," IEEE Trans. Audio, Speech, Lang. Process., vol.14, no.5, pp. 1783-1794, Sep. 2006.
12. M. Müller and F. Kurth, "Towards structural analysis of audio recordings in the presence of musical variations," EURASIP J. Adv. Signal Process., vol.1, 2007, Article ID 89686.
13. G. Peeters, "Sequence representation of music structure using higherorder similarity matrix and maximum-likelihood approach," in Proc. Int. Conf. Music Inf. Retrieval (ISMIR), Vienna, Austria, 2007, pp. 35-40.
14. C. Rhodes and M. Casey, "Algorithms for determining and labelling approximate hierarchical self-similarity," in Proc. Int. Conf. Music Inf. Retrieval (ISMIR), Vienna, Austria, 2007, pp. 41-46.
15. M. Casey and M. Slaney, "Song intersection by approximate nearest neighbor search," in Proc. Int. Conf. Music Inf. Retrieval (ISMIR), Victoria, BC, Canada, 2006, pp. 144-149.
16. D. Ellis and G. Poliner, "Identifying cover songs with chroma features and dynamic programming beat tracking," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2007, pp. 1429-1432.
17. P. H. J. Serrà, E. Gómez, and X. Serra, "Chroma binary similarity and local alignment applied to cover song identification," IEEE Trans. Audio, Speech, Lang. Process., vol.16, no.6, pp. 1138-1151, Aug. 2008.
18. C. Fremerey, M. Müller, F. Kurth, and M. Clausen, "Automatic mapping of scanned sheet music to audio recordings," in Proc. Int. Conf. Music Inf. Retrieval (ISMIR), Philadelphia, PA, 2008, pp. 413-418.
19. F. Kurth and M. Müller, "Efficient index-based audio matching," IEEE Trans. Audio, Speech, Lang. Process., vol.16, no.2, pp. 382-395, Feb. 2008.
20. J. Pickens, J. P. Bello, G. Monti, T. Crawford, M. Dovey, M. Sandler, and D. Byrd, "Polyphonic score retrieval using polyphonic audio," in Proc. Int. Conf. Music Inf. Retrieval (ISMIR), Paris, France, 2002, pp. 140-149.
21. S. B. Davis and P. Mermelstein, "Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentences," IEEE Trans. Acoust., Speech, Signal Process., vol.ASSP-28, no.4, pp. 357-366, Aug. 1980.
22. J.-J. Aucouturier and F. Pachet, "Improving timbre similarity: How high's the sky," J. Negative Results in Speech Audio Sci., vol.1, 2004.
23. H. Terasawa, M. Slaney, and J. Berger, "The thirteen colors of timbre," in Proc. IEEE Workshop Applicat. Signal Process. Audio Acoust.(WASPAA), New Paltz, NY, 2005, pp. 323-326.
24. M. Müller, F. Kurth, and M. Clausen, "Audio matching via chroma-based statistical features," in Proc. Int. Conf. Music Inf. Retrieval (ISMIR), London, U.K., 2005, pp. 288-295.
25. K. Lee and M. Slaney, "Acoustic chord transcription and key extraction from audio using key-dependent HMMs trained on synthesized audio," IEEE Trans. Audio, Speech, Lang. Process., vol.16, no.2, pp. 291-301, Feb. 2008.
26. J. C. Brown, "Calculation of a constant Q spectral transform," J. Acoust. Soc. Amer., vol.89, no.1, 1991.
27. A. Klapuri, "Multipitch analysis of polyphonic music and speech signals using an auditory model," IEEE Trans. Audio, Speech, Lang. Process., vol.16, no.2, pp. 255-266, Feb. 2008.
28. C. Cannam, C. Landone, M. Sandler, and J. P. Bello, "The sonic visualiser: A visualisation platform for semantic descriptors from musical signals," in Proc. Int. Conf. Music Inf. Retrieval (ISMIR), Victoria, BC, Canada, 2006.
29. O. Lartillot and P. Toiviainen, "MIR in Matlab (II): A toolbox for musical feature extraction from audio," in Proc. Int. Conf. Music Inf. Retrieval (ISMIR), Vienna, Austria, 2007, pp. 127-130.
30. L. R. Rabiner and B. H. Juang, Fundamentals of Speech Recognition. Englewood Cliffs, NJ: Prentice-Hall Signal Processing Series, 1993.
31. B. Logan, "Mel frequency cepstral coefficients for music modeling," in Proc. Int. Conf. Music Inf. Retrieval (ISMIR), Plymouth, MA, 2000, pp. 11-23.
32. G. Tzanetakis and P. Cook, "Musical genre classification of audio signals," IEEE Trans. Speech Audio Process., vol.10, no.4, pp. 293-302, Jul. 2002.
33. A. Eronen and A. Klapuri, "Musical instrument recognition using cepstral coefficients and temporal features," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), Istanbul, Turkey, 2000, pp. 753-756.
34. N. C. Maddage, C. Xu, M. S. Kankanhalli, and X. Shao, "Contentbased music structure analysis with applications to music semantics understanding," in Proc. ACM Int. Conf. Multimedia, New York, 2004, pp. 112-119.
35. J. G. Proakis and D. G. Manolakis, Digital Signal Processing. Englewood Cliffs, NJ: Prentice-Hall, 1996.
36. E. Zwicker and H. Fastl, Psychoacoustics, Facts and Models. Berlin, Germany: Springer-Verlag, 1990.
37. A. P. Klapuri, A. J. Eronen, and J. Astola, "Analysis of the meter of acoustic musical signals," IEEE Trans. Audio, Speech, Lang. Process., vol.14, no.1, pp. 342-355, Jan. 2006.
38. M. Goto, "A chorus-section detecting method for musical audio signals," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), Hong Kong, China, 2003, pp. 437-440.
39. M. Müller and M. Clausen, "Transposition-invariant self-similarity matrices," in Proc. Int. Conf. Music Inf. Retrieval (ISMIR), Vienna, Austria, 2007, pp. 47-50.