Learning content similarity for music recommendation

IEEE Transactions on Audio, Speech and Language Processing

Volumn 20, Issue 8, 2012, Pages 2207-2218

  McFee, Brian ^a   Barrington, Luke ^b   Lanckriet, Gert ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b Tomnod Inc   (United States)

Author keywords

Audio retrieval and recommendation; collaborative filters (CFs); music information retrieval; query by example; structured prediction

Indexed keywords

AUDIO RETRIEVAL; COLLABORATIVE FILTERS (CFS); MUSIC INFORMATION RETRIEVAL; QUERY-BY-EXAMPLE; STRUCTURED PREDICTION;

INFORMATION RETRIEVAL; OPTIMIZATION;

QUERY PROCESSING;

EID: 84865241218     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2012.2199109     Document Type: Article

References (58)

1. D. Goldberg, D. Nichols, B. M. Oki, and D. Terry, "Using collaborative filtering to weave an information tapestry," Commun. ACM, vol. 35, pp. 61-70, Dec. 1992.
2. L. Barrington, R. Oda, and G. Lanckriet, "Smarter than genius? Human evaluation of music recommender systems," in Proc. 10th Int. Conf. Music Inf. Retrieval, 2009.
3. J. Kim, B. Tomasik, and D. Turnbull, "Using artist similarity to propagate semantic information," in Proc. 10th Int. Soc. Music Inf. Retrieval Conf., ser. ISMIR, 2009.
4. O. Celma, Music Recommendation and Discovery in the Long Tail. New York: Springer, 2010.
5. B. Logan and A. Salomon, "A music similarity function based on signal analysis," in Proc. IEEE Int. Conf. Multimedia and Expo, 2001, pp. 745-748.
6. J.-J. Aucouturier and F. Pachet, "Music similarity measures: What's the use?," in Proc. 3rd Int. Conf. Music Inf. Retrieval, ser. ISMIR, 2002, pp. 157-163.
7. M. Hoffman, D. Blei, and P. Cook, "Content-based musical similarity computation using the hierarchical Dirichlet process," in Proc. 9th Int. Conf. Music Inf. Retrieval, ser. ISMIR, 2008, pp. 349-354.
8. D. Ellis, B. Whitman, A. Berenzweig, and S. Lawrence, "The quest for ground truth in musical artist similarity," in Proc. 2nd Int. Symp. Music Inf. Retrieval, ser. ISMIR, Oct. 2002, pp. 170-177.
9. A. Berenzweig, B. Logan, D. P. Ellis, and B. Whitman, "A large-scale evaluation of acoustic and subjective music-similarity measures," Comput. Music J., vol. 28, no. 2, pp. 63-76, 2004.
10. M. Slaney, K. Weinberger, and W. White, "Learning a metric for music similarity," in Proc. 9th Int. Conf. Music Inf. Retrieval, ser. ISMIR, Sep. 2008, pp. 313-318.
11. B. McFee and G. Lanckriet, "Learning multi-modal similarity," J. Mach. Learn. Res., vol. 12, pp. 491-523, Feb. 2011.
12. M. Slaney and W. White, "Similarity based on rating data," in Proc. 8th Int. Conf. Music Inf. Retrieval, ser. ISMIR, 2007, pp. 479-484.
13. K. Yoshii, M. Goto, K. Komatani, T. Ogata, and H. Okuno, "An efficient hybrid music recommender system using an incrementally trainable probabilistic generative model," IEEE Trans. Audio, Speech, Lang. Process., vol. 16, no. 2, pp. 435-447, Feb. 2008.
14. R. Stenzel and T. Kamps, "Improving content-based similarity measures by training a collaborative model," in Proc. 6th Int. Conf. Music Inf. Retrieval, ser. ISMIR, 2005, pp. 264-271.
15. B. McFee, L. Barrington, and G. Lanckriet, "Learning similarity from collaborative filters," in Proc. 11th Int. Soc. Music Inf. Retrieval Conf., ser. ISMIR, 2010.
16. B. McFee and G. Lanckriet, J. Fürnkranz and T. Joachims, Eds., "Metric learning to rank," in Proc. 27th Int. Conf. Mach. Learn., ser. ICML, Haifa, Israel, Jun. 2010, pp. 775-782.
17. B. Sarwar, G. Karypis, J. Konstan, and J. Reidl, "Item-based collaborative filtering recommendation algorithms," in Proc. 10th Int. Conf. World Wide Web, ser. WWW '01., New York, 2001, pp. 285-295.
18. M. Deshpande and G. Karypis, "Item-based top-n recommendation algorithms," ACM Trans. Inf. Syst., vol. 22, pp. 143-177, Jan. 2004.
19. Y. Hu, Y. Koren, and C. Volinsky, "Collaborative filtering for implicit feedback datasets," in Proc. 8th IEEE Int. Conf. Data Mining, ser. ICDM, 2008, pp. 263-272.
20. P. Jaccard, "Étude comparative de la distribution florale dans une portion des alpes et des jura," Bull. del la Soc. Vaudoise des Sciences Naturelles, vol. 37, pp. 547-579, 1901.
21. E. P. Xing, A. Y. Ng, M. I. Jordan, and S. Russell, "Distance metric learning, with application to clustering with side-information," in Advances in Neural Information Processing Systems, Ser. NIPS. Cambridge, MA: MIT Press, 2003, pp. 505-512.
22. K. Q. Weinberger, J. Blitzer, and L. K. Saul, "Distance metric learning for large margin nearest neighbor classification," in Advances in Neural Information Processing Systems, ser. NIPS, Y. Weiss, B. Schölkopf, and J. Platt, Eds. Cambridge, MA: MIT Press, 2006, pp. 451-458.
23. J. V. Davis, B. Kulis, P. Jain, S. Sra, and I. S. Dhillon, "Information-theoretic metric learning," in Proc. 24th Int. Conf. Machine learning, ser. ICML., New York, 2007, pp. 209-216.
24. J. P. Egan, Signal Detection Theory and ROC Analysis, Ser. Series in Cognition and Perception. New York: Academic, 1975.
25. I. Tsochantaridis, T. Joachims, T. Hofmann, and Y. Altun, "Large margin methods for structured and interdependent output variables," J. Mach. Learn. Res., vol. 6, pp. 1453-1484, 2005.
26. T. Joachims, "A support vector method for multivariate performance measures," in Proc. 22nd Int. Conf. Mach. Learn., ser. ICML., New York, 2005, pp. 377-384. (Pubitemid 43183356)
27. Y. Yue, T. Finley, F. Radlinski, and T. Joachims, "A support vector method for optimizing average precision," in Proc. 30th Annu. Int. ACM SIGIR Conf. Res. Develop. Inf. Retrieval, ser. SIGIR., New York, 2007, pp. 271-278. (Pubitemid 350164971)
28. S. Chakrabarti, R. Khanna, U. Sawant, and C. Bhattacharyya, "Structured learning for non-smooth ranking losses," in Proc. 14th ACM SIGKDD Int. Conf. Knowl. Discov. and Data Mining, ser. KDD., New York, 2008, pp. 88-96.
29. E. M. Voorhees, "Overview of the trec 2001 question answering track," in Proc. 10th Text Retrieval Conf. (TREC), 2001, pp. 42-51.
30. K. J. Kekäläinen, "Ir evaluation methods for retrieving highly relevant documents," in Proc. 23rd Annu. Int. ACM SIGIR Conf.n Res. Develop. in Inf. Retrieval, ser. SIGIR., New York, 2000, pp. 41-48.
31. K. Crammer and Y. Singer, "On the algorithmic implementation of multiclass kernel-based vector machines," J. Mach. Learn. Res., vol. 2, pp. 265-292, 2002.
32. C. Cortes and V. Vapnik, "Support-vector networks," Mach. Learn., vol. 20, no. 3, pp. 273-297, Sep. 1995.
33. T. Joachims, T. Finley, and C.-N. J. Yu, "Cutting-plane training of structural SVMs," Mach. Learn., vol. 77, no. 1, pp. 27-59, 2009.
34. L. Fei-Fei and P. Perona, "A Bayesian hierarchical model for learning natural scene categories," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recogn., ser. CVPR, 2005, pp. 524-531.
35. S. Sundaram and S. Narayanan, "Audio retrieval by latent perceptual indexing," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., ser. ICASSP, 2008, pp. 49-52.
36. K. Seyerlehner, G. Widmer, and P. Knees, "Frame level audio similarity - A codebook approach," in Proc. 11th Int. Conf. Digital Audio Effects, ser. DAFx, Espoo, Finland, 2008.
37. M. Hoffman, D. Blei, and P. Cook, "Easy as CBA: A simple probabilistic model for tagging music," in Proc. 10th Int. Conf. Music Inf. Retrieval, ser. ISMIR, 2009.
38. L. Rabiner and B.-H. Juang, Fundamentals of Speech Recognition. Upper Saddle River, NJ: Prentice-Hall, 1993.
39. C. Buchanan, "Semantic-based audio recognition and retrieval," M.S. thesis, School of Informatics, Univ. of Edinburgh, Edinburgh, U.K., 1995.
40. J. A. Hartigan, Clustering Algorithms. New York: Wiley, 1975.
41. T. Jebara, R. Kondor, and A. Howard, "Probability product kernels," J. Mach. Learn. Res., vol. 5, pp. 819-844, Dec. 2004.
42. A. Bhattacharyya, "On a measure of divergence between two statistical populations defined by probability distributions," Bull. Calcutta Math. Soc., vol. 35, pp. 99-109, 1943.
43. B. Schölkopf and A. Smola, Learning With Kernels. Cambridge, MA: MIT Press, 2002.
44. A. Barla, F. Odone, and A. Verri, "Histogram intersection kernel for image classification," in Proc. Int. Conf. Image Process., ser. ICIP, 2003, vol. 3, pp. III-513-III-16.
45. C.Galleguillos, B.McFee, S. Belongie, and G. Lanckriet, "From region similarity to category discovery," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recogn., ser. CVPR, 2011, pp. 2665-2672.
46. D. Tingle, Y. Kim, and D. Turnbull, "Exploring automatic music annotation with acoustically-objective tags," in Proc. IEEE Int. Conf. Multimedia Inf. Retrieval, 2010.
47. B. Whitman, G. Flake, and S. Lawrence, "Artist detection in music with minnowmatch," in Proc. IEEE Signal Process. Soc. Workshop, Neural Netw. for Signal Process. XI, 2001, pp. 559-568. (Pubitemid 35475610)
48. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. R. Statist. Soc. Ser. B (Methodological), vol. 39, no. 1, pp. 1-38, 1977.
49. D. Turnbull, L. Barrington, D. Torres, and G. Lanckriet, "Semantic annotation and retrieval of music and sound effects," IEEE Trans. Audio, Speech, Lang. Process., vol. 16, no. 2, pp. 467-476, Feb. 2008.
50. J. Jensen, D. Ellis, M. Christensen, and S. Jensen, "Evaluation of distance measures between gaussian mixture models of MFCCs," in Proc. 8th Int. Conf. Music Inf. Retrieval, ser. ISMIR, 2007, pp. 107-108.
51. S. Kullback, Information Theory and Statistics, 2nd ed. New York: Dover, 1968.
52. J. Hershey and P. Olsen, "Approximating the Kullback Leibler divergence between gaussian mixture models," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., ser. ICASSP, 2007, vol. 4, pp. IV-317-IV-320.
53. G. Salton and C. Buckley, "Term weighting approaches in automatic text retrieval," Ithaca, NY, 1987.
54. J. Sivic and A. Zisserman, "Video google: A text retrieval approach to object matching in videos," in Proc. 9th IEEE Int. Conf. Comput. Vis. Vol. 2, ser. ICCV '03., Washington, DC, 2003, p. 1470 [Online]. Available: http://portal.acm.org/citation.cfm?id=946247.946751
55. D. Turnbull, L. Barrington, D. Torres, and G. Lanckriet, "Towards musical query-by-semantic-description using the cal 500 data set," in Proc. 30th Annu. Int. ACM SIGIR Conf. Res. Develop. in Inf. Retrieval, ser. SIGIR., New York, 2007, pp. 439-446. (Pubitemid 350164991)
56. L. van der Maaten and G. Hinton, "Visualizing high-dimensional data using t-SNE," J. Mach. Learn. Res., vol. 9, pp. 2579-2605, 2008.
57. N. Rasiwasia, P. Moreno, and N. Vasconcelos, "Bridging the gap: Query by semantic example," IEEE Trans. Multimedia, vol. 9, no. 5, pp. 923-938, Aug. 2007. (Pubitemid 47171250)
58. L. Barrington, A. Chan, D. Turnbull, and G. Lanckriet, "Audio information retrieval using semantic similarity," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., ser. ICASSP, Apr. 2007, vol. 2, pp. II-725-II-728.