Codebook-based audio feature representation for music information retrieval

IEEE Transactions on Audio, Speech and Language Processing

Volumn 22, Issue 10, 2014, Pages 1483-1493

  Vaizman, Yonatan ^a   McFee, Brian ^b   Lanckriet, Gert ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b Och Spine at New York Presbyterian Hospitals   (United States)

Author keywords

Audio content representations; Music information retrieval; Music recommendation; Sparse coding; Vector quantization

Indexed keywords

ARTIFICIAL INTELLIGENCE; AUDIO SIGNAL PROCESSING; DIGITAL STORAGE; ENCODING (SYMBOLS); INFORMATION RETRIEVAL; VECTOR QUANTIZATION;

AUDIO CONTENT; CONCISE REPRESENTATIONS; CONTENT-BASED METHODS; MANUAL ANNOTATION; MUSIC INFORMATION RETRIEVAL; MUSIC RECOMMENDATION; REAL TIME INTERACTIONS; SPARSE CODING;

AUDIO ACOUSTICS;

EID: 84911417606     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASLP.2014.2337842     Document Type: Article

References (51)

1. G. Tzanetakis and P. Cook, "Musical genre classification of audio signals," IEEE Trans. Speech Audio Process., vol. 10, no. 5, pp. 293-302, Jul. 2002.
2. A. Meng and J. Shawe-Taylor, "An investigation of feature models for music genre classification using the support vector classifier," in Proc. Int. Soc. Music Inf. Retrieval Conf. (ISMIR), 2005, pp. 604-609.
3. J. Reed and C. Lee, "A study on music genre classification based on universal acousticmodels," in Proc. Int. Soc. Music Inf. Retrieval Conf. (ISMIR), 2006, pp. 89-94.
4. D. P. Ellis, "Classifying music audio with timbral and chroma features," in Proc. 8th Int. Conf. Music Inf. Retrieval ISMIR '07, Vienna, Austria, 2007, pp. 339-340, Austrian Computer Soc..
5. R. Grosse, R. Raina, H. Kwong, and A. Y. Ng, "Shift-invariant sparse coding for audio classification," in Proc. Conf. Uncertainty AI, 2007.
6. A. Manzagol, P. T. Bertin-Mahieux, and D. Eck, "On the use of sparse time-relative auditory codes for music," in Proc. Int. Soc. Music Inf. Retrieval Conf. (ISMIR), 2008.
7. M. Mandel and D. Ellis, "Multiple-instance learning for music information retrieval," in Proc. Int. Soc. Music Inf. Retrieval Conf. (ISMIR), 2008, pp. 577-582.
8. C. J. S. Essid and G. Richard, "Temporal integration for audio classification with application to musical instrument classification," IEEE Trans. Audio, Speech, Lang. Process., vol. 17, no. 1, pp. 174-186, Jan. 2009.
9. P. Hamel and D. Eck, "Learning features from music audio with deep belief networks," in Proc. Int. Society Music Inf. Retrieval Conf. (ISMIR), 2010.
10. M. Henaff, K. Jarrett, K. Kavukcuoglu, and Y. LeCun, "Unsupervised learning of sparse features for scalable audio classification," in Proc. Int. Soc. Music Inf. Retrieval Conf. (ISMIR), 2011, pp. 681-686.
11. J. Wulfing and M. Riedmiller, "Unsupervised learning of local features for music classification," in Proc. Int. Soc. Music Inf. Retrieval Conf. (ISMIR), 2012, pp. 139-144.
12. C. Yeh, M. C., and Y. H. Yang, "Supervised dictionary learning for music genre classification," in Proc. ICMR, 2012.
13. C.-C. M. Yeh, L. Su, and Y.-H. Yang, "Dual-layer bag-of-frames model for music genre classification," in Proc. ICASSP, 2013, pp. 246-250.
14. M. Mandel, G. Poliner, and D. Ellis, "Support vector machine active learning for music retrieval," Multimedia Syst., vol. 12, no. 1, pp. 3-13, 2006.
15. D. Turnbull, L. Barrington, D. Torres, and G. Lanckriet, "Semantic annotation and retrieval of music and sound effects," IEEE Trans. Audio, Speech, Lang. Process., vol. 16, no. 2, pp. 467-476, Feb. 2008.
16. D. Eck, P. Lamere, T. Bertin-Mahieux, and S. Green, "Automatic generation of social tags for music recommendation," Adv. Neural Inf. Processing Syst., 2007.
17. T. Bertin-Mahieux, D. Eck, F. Maillet, and P. Lamere, "Autotagger: A model for predicting social tags from acoustic features on large music databases," J. New Music Res., vol. 37, no. 2, pp. 115-135, Jun. 2008.
18. L. Barrington, M. Yazdani, D. Turnbull, and G. Lanckriet, "Combining feature kernels for semantic music retrieval," in Proc. Int. Soc. Music Inf. Retrieval Conf. (ISMIR), 2008, pp. 723-728.
19. B. Tomasik, J. Kim, M. Ladlow, M. Augat, D. Tingle, R. Wicentowski, and D. Turnbull, "Using regression to combine data sources for semantic music discovery," in Proc. Int. Soc. Music Inf. Retrieval Conf. (ISMIR), 2009, pp. 405-410.
20. E. Coviello, A. Chan, and G. Lanckriet, "Time series models for semantic music annotation," IEEE Trans. Audio, Speech, Lang. Process., vol. 19, no. 5, pp. 1343-1359, Jul. 2011.
21. J. Nam, J. Herrera, M. Slaney, and J. Smith, "Learning sparse feature representations for music annotation and retrieval," in Proc. Int. Soc. Music Inf. Retrieval Conf. (ISMIR), 2012, pp. 565-570.
22. K. Ellis, E. Coviello, A. Chan, and G. Lanckriet, "A bag of systems representation for music auto-tagging," IEEE Trans. Audio, Speech, Lang. Process., vol. 21, no. 12, pp. 2554-2569, Dec. 2013.
23. J. T. Foote, "Content-based retrieval of music and audio," in Int. Soc. Opt. Photon., Voice, Video, Data Commun., 1997, pp. 138-147.
24. B. Logan and A. Salomon, "A music similarity function based on signal analysis," in Proc. IEEE Int. Conf. Multimedia Expo, 2001, pp. 745-748.
25. J. Aucouturier and F. Pachet, "Music similarity measures: What's the use?," in Proc. Int. Soc. Music Inf. Retrieval Conf. (ISMIR), 2002, pp. 157-163.
26. M. Slaney, K. Weinberger, and W. White, "Learning a metric for music similarity," in Proc. Int. Soc. Music Inf. Retrieval Conf. (ISMIR), 2008, pp. 313-318.
27. M. Hoffman, D. Blei, and P. Cook, "Content-based musical similarity computation using the hierarchical Dirichlet process," in Proc. Int. Soc. Music Inf. Retrieval Conf. (ISMIR), 2008, pp. 349-354.
28. K. Yoshii, M. Goto, K. Komatani, T. Ogata, and H. G. Okuno, "An efficient hybrid music recommender system using an incrementally trainable probabilistic generative model," IEEE Trans. Audio, Speech, Lang. Process., vol. 16, no. 2, pp. 435-447, Feb. 2008.
29. B. McFee, L. Barrington, and Lanckriet, "Learning content similarity for music recommendation," IEEE Trans. Audio, Speech, Lang. Process., vol. 20, no. 8, pp. 2207-2218, Oct. 2012.
30. B. Logan, "Mel frequency cepstral coefficients for music modeling," in Proc. Int. Soc. Music Inf. Retrieval Conf. (ISMIR), 2000, vol. 28.
31. T. Bertin-Mahieux and D. P. Ellis, "Large-scale cover song recognition using the 2d fourier transform magnitude," in Proc. 13th Int. Conf. Music Inf. Retrieval (ISMIR '12), 2012.
32. P. Hamel, S. Lemieux, Y. Bengio, and D. Eck, "Temporal pooling and multiscale learning for automatic annotation and ranking of music audio," in Proc. Int. Soc. Music Inf. Retrieval Conf. (ISMIR), 2011.
33. M. McKinney and J. Breebaart, "Features for audio and music classification," in Proc. Int. Soc. Music Inf. Retrieval Conf. (ISMIR), 2003, pp. 151-158.
34. A. Flexer, F. Gouyon, S. Dixon, and G. Widmer, "Probabilistic combination of features for music classification," in Proc. Int. Soc. Music Inf. Retrieval Conf. (ISMIR '06), 2006, pp. 111-114.
35. A. Berenzweig, B. Logan, D. P. W. Ellis, and B. Whitman, "A large-scale evaluation of acoustic and subjective music-similarity measures," Comput. Music J., vol. 28, no. 2, pp. 63-76, 2004.
36. E. Coviello, Y. Vaizman, A. B. Chan, and G. Lanckriet, "Multivariate autoregressive mixture models for music autotagging," in Proc. 13th Int. Soc. Music Inf. Retrieval Conf. (ISMIR '12), 2012.
37. E. Coviello, A. B. Chan, and G. Lanckriet, "The variational hierarchical EM algorithm for clustering hidden Markov models," in Neural Inf. Process. Syst. (NIPS '12), 2012.
38. T. Jebara, R. Kondor, and A. Howard, "Probability product kernels," J. Mach. Learn. Res., vol. 5, pp. 819-844, 2004.
39. R. Lyon, M. Rehn, S. Bengio, T. C. Walters, and G. Chechik, "Sound retrieval and ranking using sparse auditory representations," Neural Comput., vol. 22, no. 9, pp. 2390-2416, Sep. 2010.
40. E. C. Smith and M. S. Lewicki, "Efficient auditory coding," Nature, vol. 439, pp. 978-982, 2006.
41. Y. Yang and M. Shah, "Complex events detection using data-driven concepts," in Proc. ECCV, 2012, pp. 722-735.
42. A. Coates and A. Y. Ng, "The importance of encoding versus training with sparse coding and vector quantization," in Proc. Int. Conf. Mach. Learn. (ICML), 2011.
43. A. Coates, H. Lee, and A. Y. Ng, "An analysis of single-layer networks in unsupervised feature learning," J. Mach. Learn. (JMLR), vol. 15, p. 48109, 2010.
44. R. Tibshirani, "Regression shrinkage and selection via the lasso," J. R. Statist. Soc. Seri. B (Methodol.), vol. 58, no. 1, pp. 267-288, 1996.
45. S. Boyd, N. Parikh, E. Chu, B. Peleato, and J. Eckstein, "Distributed optimization and statistical learning via the alternating direction method of multipliers," Foundat. Trends Mach. Learn., vol. 3, no. 1, pp. 1-122, 2010.
46. J. Mairal, F. Bach, J. Ponce, and G. Sapiro, "Online learning for matrix factorization and sparse coding," J. Mach. Learn. Res., vol. 11, pp. 19-60, 2010.
47. B. McFee and G. Lanckriet, "Metric learning to rank," in Proc. 27th Int. Conf. Mach. Learn. (ICML'10), Jun. 2010.
48. D. Tingle, Y. E. Kim, and D. Turnbull, "Exploring automatic music annotation with "acoustically-objective" tags," in Proc. MIR, New York, NY, USA, 2010.
49. O. Celma, Music recommendation and discovery in the long tail, 2010.
50. P. Jaccard, "Etude comparative de la distribution florale dans une portion des alpes et des jura," Bull. del la Soc. Vaudoise des Sci. Naturelles, vol. 37, pp. 547-579, 1901.
51. M. Hong and Z.-Q. Luo, "On the linear convergence of the alternating direction method of multipliers," 2012, arXiv preprint arXiv:1208.3922.