Sequential complexity as a descriptor for musical similarity

IEEE/ACM Transactions on Audio Speech and Language Processing

Volumn 22, Issue 12, 2014, Pages 1965-1977

  Foster, Peter ^a   Mauch, Matthias ^a   Dixon, Simon ^a  

^a QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

Music content analysis; Musical similarity measures; Time series complexity

Indexed keywords

FORECASTING; TIME SERIES ANALYSIS;

COMPRESSION RATES; CONTROLLED CONDITIONS; MULTIPLE TIME SCALE; MUSIC CONTENT ANALYSIS; MUSICAL SIMILARITY; PREDICTION ACCURACY; TEMPORAL RESOLUTION; TEMPORAL STRUCTURES;

AUDIO ACOUSTICS;

EID: 84921782371     PISSN: 23299290     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASLP.2014.2357676     Document Type: Article

References (78)

1. M. Casey, R. Veltkamp, M. Goto, M. Leman, C. Rhodes, and M.Slaney, "Content-based music information retrieval: Current directions and future challenges," Proc. IEEE, vol. 96, no. 4, pp. 668-696, Apr. 2008.
2. Z. Fu, G. Lu, K. Ting, and D. Zhang, "A survey of audio-based music classification and annotation," IEEE Trans. Multimedia, vol. 13, no. 2, pp. 303-319, Apr. 2011.
3. O. Celma, "Music recommendation and discovery in the long tail," Ph.D. dissertation, Univ. Pompeu Fabra, Barcelona, Spain, 2009.
4. P. Cano, E. Batlle, T. Kalker, and J. Haitsma, "Areviewof audio fingerprinting," J. VLSI Signal Process. Syst. Signal, Image, Video Technol., vol. 41, no. 3, pp. 271-284, 2005.
5. J. Serrà, "Identification of versions of the same musical composition by processing audio descriptions," Ph.D. dissertation, Univ. Pompeu Fabra, Barcelona, Spain, 2011.
6. N. Scaringella, G. Zoia, and D. Mlynek, "Automatic genre classification of music content: A survey," IEEE Signal Process. Mag., vol. 23, no. 2, pp. 133-141, Mar. 2006.
7. Y. Kim, E. Schmidt, R. Migneco, B. Morton, P. Richardson, J. Scott, J. Speck, and D. Turnbull, "Music emotion recognition: A state of the art review," in Proc. 11th Int. Soc. Music Inf. Retrieval Conf. (ISMIR), 2010, pp. 255-266.
8. J. Aucouturier, B. Defreville, and F. Pachet, "The bag-of-frames approach to audio pattern recognition: A sufficient model for urban soundscapes but not for polyphonic music," J. Acoust. Soc. Amer., vol. 122, p. 881, 2007.
9. F. Barrett, K. Grimm, R. Robins, T. Wildschut, C. Sedikides, and P.Janata, "Music-evoked nostalgia: Affect, memory, and personality," Emotion, vol. 10, no. 3, p. 390, 2010.
10. T. Bertin-Mahieux, D. Ellis, B. Whitman, and P. Lamere, "The million song dataset," in Proc. 12th Int. Soc. Music Inf. Retrieval Conf.(ISMIR), 2011, pp. 591-596.
11. G. Tzanetakis and P. Cook, "Musical genre classification of audio signals," IEEE Trans. Speech Audio Process., vol. 10, no. 5, pp. 293-302, Jul. 2002.
12. T. Li andM.Ogihara, "Toward intelligentmusic information retrieval," IEEE Trans. Multimedia, vol. 8, no. 3, pp. 564-574, Jun. 2006.
13. K.West, S. Cox, and P. Lamere, "Incorporating machine-learning into music similarity estimation," in Proc. 1st ACM Workshop Audio Music Comput. Multimedia, 2006, pp. 89-96.
14. M. Slaney, K.Weinberger, and W. White, "Learning a metric for music similarity," in Proc. 9th Int. Conf. Music Inf. Retrieval (ISMIR), 2008, pp. 313-318.
15. B. Logan and A. Salomon, "A music similarity function based on signal analysis," in Proc. Int. Conf. Multimedia Expo. (ICME), 2001.
16. J. Aucouturier and F. Pachet, "Music similarity measures: What's the use?," in Proc. 3rd Int. Conf. Music Inf. Retrieval (ISMIR), 2002.
17. A. Berenzweig, B. Logan, D. Ellis, and B. Whitman, "A large-scale evaluation of acoustic and subjective music-similarity measures," Comput. Music J., vol. 28, no. 2, pp. 63-76, 2004.
18. M. Mandel and D. Ellis, "Song-level features and support vector machines for music classification," in Proc. 6th Int. Conf. Music Inf. Retrieval (ISMIR), 2005, pp. 594-599.
19. F. Vignoli and S. Pauws, "A music retrieval system based on user driven similarity and its evaluation," in Proc. 6th Int. Conf. Music Inf.Retrieval (ISMIR), 2005, pp. 272-279.
20. M. Levy and M. Sandler, "Lightweight measures for timbral similarity of musical audio," in Proc. 1st ACM Workshop Audio Music Comput.Multimedia, 2006, pp. 27-36.
21. S. McAdams, S. Winsberg, S. Donnadieu, G. De Soete, and J. Krimphoff, "Perceptual scaling of synthesized musical timbres: Common dimensions, specificities, and latent subject classes," Psychol. Res., vol.58, no. 3, pp. 177-192, 1995.
22. K. Seyerlehner, G.Widmer, and T. Pohle, "Fusing block-level features for music similarity estimation," in Proc. 13th Int. Conf. Digital Audio Effects (DAFx-10), 2010, pp. 225-232.
23. F. Mörchen, A. Ultsch, M. Thies, and I. Lohken, "Modeling timbre distance with temporal statistics from polyphonic music," IEEE Trans.Audio, Speech, Lang. Process., vol. 14, no. 1, pp. 81-90, Jan. 2006.
24. P. Hamel, S. Lemieux, Y. Bengio, and D. Eck, "Temporal pooling and multiscale learning for automatic annotation and ranking of music audio," in Proc. 12th Int. Int. Soc. Music Inf. Retrieval Conf. (ISMIR), 2011, pp. 729-734.
25. J. Wülfing andM. Riedmiller, "Unsupervised learning of local features formusic classification," in Proc. 13th Int. Int. Soc. Music Inf. Retrieval Conf. (ISMIR), 2012, pp. 139-144.
26. E. Pampalk, "Computational models of music similarity and their application in music information retrieval," Ph.D. dissertation, Vienna Univ. of Technol., Vienna, Austria, 2006.
27. C. Lee, J. Shih, K. Yu, and H. Lin, "Automatic music genre classification based on modulation spectral analysis of spectral and cepstral features," IEEE Trans. Multimedia, vol. 11, no. 4, pp. 670-682, Jun.2009.
28. A. Meng, P. Ahrendt, J. Larsen, and L. Hansen, "Temporal feature integration for music genre classification," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 5, pp. 1654-1664, Jul. 2007.
29. E. Coviello, Y. Vaizman, A. Chan, and G. Lanckriet, "Multivariate autoregressive mixture models for music auto-tagging," inProc. 13th Int.Int. Soc. Music Inf. Retrieval Conf. (ISMIR), 2012, pp. 547-552.
30. M. Li and R. Sleep, "Genre classification via an LZ78-based string kernel," in Proc. 6th Int. Conf. Music Inf. Retrieval (ISMIR), 2005, pp.252-259.
31. J. Ziv and A. Lempel, "Compression of individual sequences via variable-rate coding," IEEE Trans. Inf. Theory, vol. IT-24, no. 5, pp.530-536, Sep. 1978.
32. J. Reed and C. Lee, "On the importance of modeling temporal information in music tag annotation," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2009, pp. 1873-1876.
33. T. Langlois and G. Marques, "A music classification method based on timbral features," in Proc. 10th Int. Int. Soc. Music Inf. Retrieval Conf.(ISMIR), 2009, pp. 81-86.
34. J. Ren and J. Jang, "Discovering time-constrained sequential patterns for music genre classification," IEEE Trans. Audio, Speech, Lang.Process., vol. 20, no. 4, pp. 1134-1144, May 2012.
35. R. Foucard, S. Essid, M. Lagrange, and G. Richard, "Multi-scale temporal fusion by boosting for music classification," in Proc. 12th Int. Int.Soc. Music Inf. Retrieval Conf. (ISMIR), 2011, pp. 663-668.
36. S. Dieleman and B. Schrauwen, "Multiscale approaches to music audio feature learning," in Proc. 14th Int. Int. Soc. Music Inf. Retrieval Conf.(ISMIR), 2013, pp. 3-8.
37. M. Mauch and M. Levy, "Structural change on multiple time scales as a correlate of musical complexity," in Proc. 12th Int. Int. Soc. Music Inf. Retrieval Conf. (ISMIR), 2011, pp. 489-494.
38. S. Dieleman, P. Brakel, and B. Schrauwen, "Audio-based music classification with a pretrained convolutional network," in Proc. 12th Int.Int. Soc. Music Inf. Retrieval Conf. (ISMIR), 2011, pp. 669-674.
39. M. Slaney and M. Casey, "Locality-sensitive hashing for finding nearest neighbors," IEEE Signal Process. Mag., vol. 25, no. 2, pp.128-131, Feb. 2008.
40. C. Rhodes, T. Crawford, M. Casey, and M. d'Inverno, "Investigating music collections at different scaleswith audioDB," J. NewMusic Res., vol. 39, no. 4, pp. 337-348, 2010.
41. J. Schlüter, "Learning binary codes for efficient large-scale music similarity search," in Proc. 14th Int. Int. Soc. Music Inf. Retrieval Conf.(ISMIR), 2013, pp. 581-586.
42. R. Cilibrasi, P. M. B. Vitányi, and R. Wolf, "Algorithmic clustering of music based on string compression," Comput. Music J., vol. 28, no. 4, pp. 49-67, 2004.
43. S. Dubnov, "Unified view of prediction and repetition structure in audio signals with application to interest point detection," IEEE Trans. Audio, Speech, Lang. Process., vol. 16, no. 2, pp. 327-337, Feb. 2008.
44. S. Abdallah and M. Plumbley, "Information dynamics: Patterns of expectation and surprise in the perception of music," Connection Sci., vol. 21, no. 2-3, pp. 89-117, 2009.
45. R. James, C. Ellison, and J. Crutchfield, "Anatomy of a bit: Information in a time series observation," Chaos: Interdisciplinary J. Nonlinear Sci., vol. 21, no. 3, p. 037109, 2011.
46. S. Streich, "Automatic characterization of music complexity: a multifaceted approach," Ph.D. dissertation, Univ. Pompeu Fabra, Barcelona, Spain, 2006.
47. O. Lartillot and P. Toiviainen, "A Matlab toolbox for musical feature extraction from audio," in Proc. Int. Conf. Digital Audio Effects (DAFx), 2007, pp. 237-244.
48. D. P. W. Ellis and G. Poliner, "Identifying 'cover songs' with chroma features and dynamic programming beat tracking," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2007, pp.1429-1432.
49. R. Plomp and W. Levelt, "Tonal consonance and critical bandwidth," J. Acoust. Soc. Amer., vol. 38, p. 548, 1965.
50. K. Jensen, "Timbre models of musical sounds," Ph.D. dissertation, Univ. of Copenhagen, Copenhagen, Denmark, 1999.
51. M. Slaney, "Auditory Toolbox version 2" Interval Research Corp., Tech. Rep., 1998.
52. P. Masri, "Computer modelling of sound for transformation and synthesis of musical signals," Ph.D. dissertation, Univ. of Bristol, Bristol, U.K., 1996.
53. E. Gómez, "Tonal description of music audio signals," Ph.D. dissertation, Univ. Pompeu Fabra, Barcelona, Spain, 2006.
54. C. Harte, M. Sandler, and M. Gasser, "Detecting harmonic change in musical audio," in Proc. 1st ACM Workshop Audio Music Comput.Multimedia, 2006, pp. 21-26.
55. R. Begleiter, R. El-Yaniv, and G. Yona, "On prediction using variable order markov models," J. Artificial Intelligence Research, vol. 22, pp.385-421, 2004.
56. J. Pressing, "Cognitive complexity and the structure of musical patterns," in Proc. 4th Conf. Australasian Cognitive Sci. Soc., 1999.
57. G. A.Wiggins, D.Müllensiefen, and M. Pearce, "On the non-existence of music: Why music theory is a figment of the imagination," Musicae Sci., vol. 14, no. 1, pp. 231-255, 2010.
58. N. Goodman, "Seven strictures on similarity," in Problems and Projects. Indianapolis, IN: Bobbs-Merrill, 1972.
59. A. Tversky, "Features of similarity," Psychol. Rev., vol. 84, no. 4, p.327, 1977.
60. B. Sturm, "Two systems for automatic music genre recognition: What are they really recognizing?," in Proc. 2nd ACM Int. Workshop Music Inf. Retrieval User-Centered Multimodal Strat., 2012, pp. 69-74.
61. D. Bogdanov, J. Serrà, N. Wack, P. Herrera, and X. Serra, "Unifying low-level and high-levelmusic similaritymeasures," IEEE Trans.Multimedia, vol. 13, no. 4, pp. 687-701, Aug. 2011.
62. J. Downie, A. F. Ehmann, M. Bay, and M. C. Jones, "The music information retrieval evaluation exchange: Some observations and insights," in Advances in Music Information Retrieval. New York, NY, USA: Springer, 2010, pp. 93-115.
63. J. Ollen, "A criterion-related validity test of selected indicators of musical sophistication using expert ratings," Ph.D. dissertation, Ohio State Univ., Columbus, OH, USA, 2006.
64. B. Efron, The Jackknife, the Bootstrap and other Resampling Plans.Philadelphia, PA, USA: SIAM, 1982, vol. 38.
65. J. Serrà, H. Kantz, X. Serra, and R. Andrzejak, "Predictability of music descriptor time series and its application to cover song detection," IEEE Trans. Audio, Speech, Lang. Process., vol. 20, no. 2, pp. 514-525, Feb.2012.
66. F. Takens, "Detecting strange attractors in turbulence," Dynam. Syst.Turb., pp. 366-381, 1981.
67. P. Foster, S.Dixon, andA.Klapuri, "Identification of cover songs using information theoretic measures of similarity," in Proc. IEEE Int. Conf.Acoust., Speech, Signal Process. (ICASSP), 2013, pp. 739-743.
68. J. Cardoso and R. Sousa, "Measuring the performance of ordinal classification," Int. J. Pattern Recogn. Artif. Intell., vol. 25, no. 08, pp.1173-1195, 2011.
69. J. Pinto da Costa, H. Alonso, and J. Cardoso, "The unimodal model for the classification of ordinal data," Neural Netw., vol. 21, no. 1, pp.78-91, 2008.
70. H. Zou and T. Hastie, "Regularization and variable selection via the elastic net," J. R. Statist. Soc.: Ser. B (Statist. Methodol.), vol. 67, no.2, pp. 301-320, 2005.
71. J. Friedman, T. Hastie, and R. Tibshirani, "Regularization paths for generalized linear models via coordinate descent," J. Statist. Software, vol. 33, no. 1, pp. 1-22, Feb. 2010.
72. A. Flexer and D. Schnitzer, "Effects of album and artist filters in audio similarity computed for very large music databases," Comput. Music J., vol. 34, no. 3, pp. 20-28, 2010.
73. G. Kirchgassner, J. Wolters, and U. Hassler, Introduction to modern time series analysis. New York, NY, USA: Springer, 2012.
74. G. Box, G. Jenkins, and G. Reinsel, Time Series Analysis: Forecasting and Control. New York, NY, USA: Wiley, 2013.
75. C. W. Granger and R. Joyeux, "An introduction to long-memory time series models and fractional differencing," J. Time Series Anal., vol. 1, no. 1, pp. 15-29, 1980.
76. M. Effros, "PPM performance with BWT complexity: A new method for lossless data compression," in Proc. Data Compress. Conf, 2000, pp. 203-212.
77. P. Hamel, Y. Bengio, and D. Eck, "Building musically-relevant audio features through multiple timescale representations," in Proc. 13th Int.Int. Soc. Music Inf. Retrieval Conf. (ISMIR), 2012, pp. 553-558.
78. M. Mauch and S. Ewert, "The audio degradation toolbox and its application to robustness evaluation," in Proc. 14th Int. Int. Soc.Music Inf.Retrieval Conf. (ISMIR), 2013, pp. 83-88.