A systematic evaluation of the bag-of-frames representation for music information retrieval

IEEE Transactions on Multimedia

Volumn 16, Issue 5, 2014, Pages 1188-1200

  Su, Li ^a   Yeh, Chin Chia Michael ^a   Liu, Jen Yu ^a   Wang, Ju Chiang ^b   Yang, Yi Hsuan ^a  

^a RESEARCH CENTER FOR INFORMATION TECHNOLOGY INNOVATION   (Taiwan)

^b INSTITUTE OF INFORMATION SCIENCE   (Taiwan)

Author keywords

Bag of frames model; music information retrieval; sparse coding; unsupervised feature learning

Indexed keywords

COMPUTER MUSIC; INFORMATION RETRIEVAL; STATISTICS;

CODEBOOK CONSTRUCTIONS; COMPREHENSIVE EVALUATION; FEATURE REPRESENTATION; INSTRUMENT RECOGNITION; LATENT DIRICHLET ALLOCATION; MUSIC INFORMATION RETRIEVAL; SPARSE CODING; UNSUPERVISED FEATURE LEARNING;

AUDIO ACOUSTICS;

EID: 84904754003     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2014.2311016     Document Type: Article

References (64)

1. E. C. Smith and M. S. Lewicki, "Efficient auditory coding," Nature, vol. 439, no. 7079, pp. 978-982, 2006. (Pubitemid 43292416)
2. P. Manzagol, T. Bertin-Mahieux, and D. Eck, "On the use of sparse time-relative auditory codes for music," in Proc. ISMIR, 2008, pp. 14-18.
3. R. F. Lyon, M. Rehn, S. Bengio, T. C. Walters, and G. Chechik, "Sound retrieval and ranking using sparse auditory representations," Neural Computat., vol. 20, pp. 2390-2416, 2010.
4. M. D. Plumbley, T. Blumensath, L. Daudet, R. Gribonval, and M. E. Davies, "Sparse representations in audio and music: From coding to source separation," Proc. IEEE, vol. 98, no. 6, pp. 995-1005, 2010.
5. H. Lee, Y. Largman, P. Pham, and A. Y. Ng, "Unsupervised feature learning for audio classification using convolutional deep belief networks," in Proc. NIPS, 2009, pp. 1096-1104.
6. P. Hamel and D. Eck, "Learning features from music audio with deep belief networks," in Proc. ISMIR, 2010, pp. 339-344.
7. J. Nam, J. Ngiam, H. Lee, and M. Slaney, "A classification-based polyphonic piano transcription approach using learned feature representations," in Proc. ISMIR, 2011, pp. 175-180.
8. S. Scholler and H. Purwins, "Sparse approximations for drum sound classification," IEEE J. Select. Topics Signal Process., vol. 5, no. 5, pp. 933-940, 2011.
9. S. Dieleman, P. Brakel, and B. Schrauwen, "Audio based music classification with a pre trained convolutional network," in Proc. ISMIR, 2011, pp. 669-674.
10. M. Henaff, K. Jarrett, K. Kavukcuoglu, and Y. LeCun, "Unsupervised learning of sparse features for scalable audio classification," in Proc. ISMIR, 2011, pp. 681-686.
11. E. M. Schmidt, J. Scott, and Y. E. Kim, "Feature learning in dynamic environments: Modeling the acoustic structure of musical emotion," in Proc. ISMIR, 2012, pp. 325-330.
12. P. D. Corey Kereliuk, "Sparse atomic modeling of audio: A review," in Proc. Int. Conf. Digital Audio Effects, 2011, pp. 81-92.
13. C.-C. M. Yeh and Y.-H. Yang, "Supervised dictionary learning for music genre classification," in Proc. ACM ICMR, 2012.
14. J. Nam, J. Herrera, M. Slaney, and J. Smith, "Learning sparse feature representations for music annotation and retrieval," in Proc. ISMIR, 2012, pp. 565-560.
15. E. Battenberg and D. Wessel, "Analyzing drum patterns using conditional deep belief networks," in Proc. ISMIR, 2012, pp. 37-42.
16. C.-T. Lee, Y.-H. Yang, and H. H. Chen, "Multipitch estimation of piano music by exemplar-based sparse representation," IEEE Trans. Multimedia, to be published.
17. E. J. Humphrey, J. P. Bello, and Y. LeCun, "Deep architectures and automatic feature learning in music informatics," in Proc. ISMIR, 2012, pp. 403-408.
18. J. Mairal, F. Bach, J. Ponce, and G. Sapiro, "Online dictionary learning for sparse coding," in Proc. ICML, 2009, pp. 689-696.
19. Y. Bengio, "Learning deep architectures for AI," Found. Trends Mach. Learn., vol. 2, no. 1, pp. 1-127, 2009.
20. J.-J. Aucouturier, B. Defreville, and F. Pachet, "The bag-of-frames approach to audio pattern recognition: A sufficient model for urban soundscapes but not for polyphonic music," J. Acoust. Soc. Amer., vol. 122, no. 2, pp. 881-891, 2007. (Pubitemid 47205542)
21. P. Hamel, S. Lemieux, Y. Bengio, and D. Eck, "Temporal pooling and multiscale learning for automatic annotation and ranking of music audio," in Proc. ISMIR, 2011, pp. 729-734.
22. E. Pampalk, A. Rauber, and D. Merkl, "Content-based organization and visualization of music archives," in Proc. 10th ACM Int. Conf. Multimedia (MULTIMEDIA '02), New York, NY, USA, 2002, pp. 570-579 [Online]. Available: http://doi. acm. org/10. 1145/641007. 641121
23. R. Baeza-Yates and B. Ribeiro-Neto, Modern Information Retrieval. Reading, MA, USA: Addison-Wesley, 1999.
24. A. Berenzweig, B. Logan, D. P. W. Ellis, and B. Whitman, "A largescale evaluation of acoustic and subjective music similarity measures," Comput. Music J., vol. 28, no. 2, pp. 63-76, 2004.
25. G. Tzanetakis and P. Cook, "Musical genre classification of audio signals," IEEE Trans. Speech Audio Process., vol. 10, no. 5, pp. 293-302, 2002. (Pubitemid 34950067)
26. F. Fuhrmann, "Automatic musical instrument recognition from polyphonic music audio signals," Ph. D. dissertation, Univ. Pompeu Fabra, Barcelona, Spain, 2012.
27. D. Turnbull, L. Barrington, D. Torres, and G. Lanckriet, "Towards musical query-by-semantic-description using the CAL500 data set," in Proc. ACM SIGIR, 2007, pp. 439-446. (Pubitemid 350164991)
28. M. Riley, E. Heinen, and J. Ghosh, "A text retrieval approach to content-based audio retrieval," in Proc. ISMIR, 2008, pp. 295-300.
29. K. Aryafar and A. Shokoufandeh, "Music genre classification using explicit semantic analysis," in Proc. ACM Workshop Music Information Retrieval With User-Centered and Multimodal Strategies, 2011, pp. 33-37.
30. Z. Fu, G. Lu, K.-M. Ting, and D. Zhang, "Music classification via the bag-of-features approach," Pattern Recognit. Lett., vol. 32, pp. 1768-1777, 2011.
31. C.-C. M. Yeh, L. Su, and Y.-H. Yang, "Dual-layer bag-of-frames model for music genre classification," in Proc. IEEE ICASSP, 2013.
32. D. M. Blei, A. Y. Ng, and M. I. Jordan, "Latent Dirichlet allocation," J. Mach. Learn. Res., vol. 3, pp. 993-1022, 2003.
33. K. Seyerlehner, G. Widmer, and P. Knees, "Frame level audio similarity: A codebook approach," in Proc. Int. Conf. Digital Audio Effects, 2008.
34. J. Wülfing and M. Riedmiller, "Unsupervised learning of local features for music classification," in Proc. ISMIR, 2012, pp. 139-144.
35. B. McFee, L. Barrington, and G. R. G. Lanckriet, "Learning content similarity for music recommendation," IEEE Trans. Audio, Speech, Lang. Process., vol. 20, no. 8, 2012.
36. R. J. Weiss and J. P. Bello, "Identifying repeated patterns in music using sparse convolutive non-negative matrix factorization," in Proc. ISMIR, 2011, pp. 123-128.
37. J.-C. Wang, H.-S. Lee, H.-M. Wang, and S.-K. Jeng, "Learning the similarity of audio music in bag-of-frames representation from tagged music data," in Proc. ISMIR, 2011.
38. J. Schlüter and C. Osendorfer, "Music similarity estimation with the mean-covariance restricted Boltzmann machine," in Proc. Int. Conf. Machine Learning and Applications, 2011, pp. 118-123.
39. A. Gersho and R. M. Gray, Vector Quantization and Signal Compression. Norwell, MA, USA: Kluwer, 1991.
40. A. Lacoste and D. Eck, "A supervised classification algorithm for note onset detection," EURASIP J. Adv. Signal Process., pp. 1-14, 2007.
41. E. J. Humphrey, T. Cho, and J. P. Bello, "Learning a robust tonnetzspace transform for automatic chord recognition," in Proc. IEEE ICASSP, 2012, pp. 453-456.
42. A. Coates and A. Ng, "The importance of encoding versus training with sparse coding and vector quantization," in Proc. ICML, 2011, pp. 921-928.
43. B. Efron, T. Hastie, L. Johnstone, and R. Tibshirani, "Least angle regression," Ann. Statist., vol. 32, pp. 407-499, 2004. (Pubitemid 41250302)
44. S. Maji, A. Berg, and J. Malik, "Classification using intersection kernel support vector machines is efficient," in Proc. IEEE CVPR, 2008, pp. 1-8.
45. J. Wright, Y. Ma, J. Mairal, G. Sapiro, T. Huang, and S. Yan, "Sparse representation for computer vision and pattern recognition," Proc. IEEE, vol. 98, no. 6, pp. 1031-1044, 2010.
46. J. F. Gemmeke, T. Virtanen, and A. Hurmalainen, "Exemplar-based sparse representations for noise robust automatic speech recognition," IEEE Trans. Audio, Speech, Lang. Process., vol. 19, no. 7, pp. 2067-2080, Sep. 2011.
47. D. Sculley, "Web-scale k-means clustering," in Proc. ACM WWW, 2010, pp. 1177-1178.
48. M. Aharon, M. Elad, and A. Bruckstein, "K-svd: An algorithm for designing overcomplete dictionaries for sparse representation," IEEE Trans. Signal Process., vol. 54, no. 11, pp. 4311-4322, 2006. (Pubitemid 44637761)
49. S. S. Chen, D. L. Donoho, Michael, and A. Saunders, "Atomic decomposition by basis pursuit," SIAM J. Sci. Comput., vol. 20, pp. 33-61, 1998. (Pubitemid 128689501)
50. R. Tibshirani, "Regression shrinkage and selection via the lasso," J. Royal Statist. Soc., vol. 58, pp. 267-288, 1996.
51. A. Coates, H. Lee, and A. Ng, "An analysis of single-layer networks in unsupervised feature learning," in Proc. AISTATS, 2011.
52. M. Müller, D. P. W. Ellis, A. Klapuri, and G. Richard, "Signal processing for music analysis," J. Select. Topics Signal Process., vol. 5, no. 6, pp. 1088-1110, 2011.
53. J. Yang, K. Yu, Y. Gong, and T. Huang, "Linear spatial pyramid matching using sparse coding for image classification," in Proc. IEEE CVPR, 2009, pp. 1794-1801.
54. P. Hamel, S. Lemieux, Y. Bengio, and D. Eck, "Temporal pooling and multiscale learning for automatic annotation and ranking of music audio," in Proc. ISMIR, 2011, pp. 729-734.
55. Y.-L. Boureau, J. Ponce, and Y. Lecun, "A theoretical analysis of feature pooling in visual recognition," in Proc. ICML, 2010.
56. S. Robertson, "Understanding inverse document frequency: On theoretical arguments for IDF," J. Document., vol. 60, no. 5, pp. 503-520, 2004. (Pubitemid 39538229)
57. M. Schedl, T. Pohle, P. Knees, and G. Widmer, "Exploring the music similarity space on the web," ACM Trans. Inf. Syst., vol. 29, no. 3, pp. 14:1-14:24, 2011.
58. S. E. Robertson, S. Walker, M. M. Beaulieu, M. Gatford, and A. Payne, "Okapi at trec-4," in Proc. Text Retrieval Conf., 1995, pp. 73-96.
59. M. Lan, C. L. Tan, J. Su, and Y. Lu, "Supervised and traditional term weighting methods for automatic text categorization," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, pp. 721-735, 2009.
60. H. Jégou, F. Perronnin, M. Douze, J. Sánchez, P. Pérez, and C. Schmid, "Aggregating local image descriptors into compact codes," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, pp. 1704-1716, 2012.
61. B. L. Sturm, "An analysis of the GTZAN music genre dataset," in Proc. ACM Workshop Music Information Retrieval With User-Centered and Multimodal Strategies, 2012, pp. 7-12.
62. C.-C. Chang and C.-J. Lin, "LIBSVM: A library for support vector machines," ACM Trans. Intell. Syst. Technol., 2001.
63. E. Coviello, Y. Vaizman, A. B. Chan, and G. R. Lanckriet, "Multivariate autoregressive mixture models for music auto-tagging," in Proc. ISMIR, 2012, pp. 547-552.
64. M. Haro, P. H. Joan Serrà, and Á Corral, "Zipf's law in short-time timbral codings of speech, music, and environmental sound signals," PLoS ONE, vol. 7, no. 3, 2012, e33993.