A simple method to determine if a music information retrieval system is a 'horse'

IEEE Transactions on Multimedia

Volumn 16, Issue 6, 2014, Pages 1636-1644

  Sturm, Bob L ^a  

^a AALBORG UNIVERSITY   (Denmark)

Author keywords

2 WORK system performance; 5 CONT content description and annotation; 5 SEAR multimedia search and retrieval

Indexed keywords

2-WORK SYSTEM PERFORMANCE; CONTENT DESCRIPTION; MULTIMEDIA SEARCH; MUSIC INFORMATION RETRIEVAL; SIMPLE METHOD;

EID: 84907449171     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2014.2330697     Document Type: Article

References (51)

1. N. Scaringella, G. Zoia, and D. Mlynek, "Automatic genre classification of music content: A survey, " IEEE Signal Process. Mag., vol. 23, no. 2, pp. 133-141, Mar. 2006.
2. Z. Fu, G. Lu, K. M. Ting, and D. Zhang, "A survey of audio-based music classification and annotation, " IEEE Trans. Multimedia, vol. 13, no. 2, pp. 303-319, Apr. 2011.
3. B. L. Sturm, "A survey of evaluation in music genre recognition, " in Post-Proc. 2012 Int. Workshop Adapt. Multimedia Retrieval, LNCS, 2014, to be published.
4. B. L. Sturm, "The state of the art ten years after a state of the art: Future research in music information retrieval, " J. New Music Res., vol. 43, no. 2, pp. 147-172, 2014.
5. E. Pampalk, A. Flexer, and G. Widmer, "Improvements of audio-based music similarity and genre classification, " in Proc. ISMIR, London, U.K., Sep. 2005, pp. 628-233.
6. A. Flexer, "A closer look on artist filters for musical genre classification, " in Proc. ISMIR, Sep. 2007, pp. 341-344.
7. G. Marques, T. Langlois, F. Gouyon, M. Lopes, and M. Sordo, "Short-term feature space and music genre classification, " J. New Music Res., vol. 40, no. 2, pp. 127-137, 2011.
8. G. Marques, M. Domingues, T. Langlois, and F. Gouyon, "Three current issues in music autotagging, " in Proc. ISMIR, 2011, pp. 795-800.
9. B. L. Sturm, "Classification accuracy is not enough: On the evaluation of music genre recognition systems, " J. Intell. Inf. Syst., vol. 41, no. 3, pp. 371-406, 2013.
10. B. L. Sturm, "Evaluating music emotion recognition: Lessons from music genre recognition?, " in Proc. ICME, 2013, pp. 1-6.
11. C. C. Liem, M. Müller, D. Eck, G. Tzanetakis, and A. Hanjalic, "The need for music information retrieval with user-centered and multi-modal strategies, " in Proc. Int. ACM Workshop Music Inf. Retrieval User-Centered Multimodal Strategies, 2011, pp. 1-6.
12. M. Schedl, A. Flexer, and J. Urbano, "The neglected user in music information retrieval research, " J. Intell. Inf. Syst., vol. 41, no. 3, pp. 523-539, Dec. 2013.
13. B. L. Sturm, "Making explicit the formalism underlying evaluation in music information retrieval research: A look at the MIREX automatic mood classification task, " in Post-Proc. 2013 Comput. Music Model. Res., to be published.
14. J. Urbano, M. Schedl, and X. Serra, "Evaluation in music information retrieval, " J. Intell. Inf. Syst., vol. 41, no. 3, pp. 345-369, Dec. 2013.
15. J. Urbano, "Evaluation in audio music similarity, " Ph.D. dissertation, Dept. Informat., Univ. Carlos III of Madrid, Madrid, Spain, 2013.
16. X. Serra et al., Roadmap for Music Information ReSearch, G. Peeters, Ed. Paris, France: Creative Commons, 2013.
17. O. Pfungst, Clever Hans (The Horse of Mr. Von Osten): A Contribution to Experimental Animal and Human Psychology, C. L. Rahn, Ed. New York, NY, USA: Henry Holt, 1911.
18. C. Lesimple, C. Sankey, M.-A. Richard, and M. Hausberger, "Do horses expect humans to solve their problems?, " Frontiers Psychol., vol. 3, pp. 1-4, Aug. 2012.
19. B. L. Sturm, "The GTZAN dataset: Its contents, its faults, their effects on evaluation, and its future use, " Clinical Orthopaedics Related Res., vol. 1306.1461, Jun. 2013 [Online]. Available: http://dblp.uni-trier.de/rec/bibtex/journals/corr/Sturm13
20. R. A. Bailey, Design of Comparative Experiments. Cambridge, U.K.: Cambridge Univ. Press, 2008.
21. E. R. Dougherty and L. A. Dalton, "Scientific knowledge is possible with small-sample classification, " EURASIP J. Bioinf. Syst. Biol., vol. 2013:10, 2013.
22. T. Bertin-Mahieux, D. Eck, F. Maillet, and P. Lamere, "Autotagger: A model for predicting social tags from acoustic features on large music databases, " J. New Music Res., vol. 37, no. 2, pp. 115-135, 2008.
23. C. Joder, S. Essid, and G. Richard, "Temporal integration for audio classification with application to musical instrument classification, " IEEE Trans. Audio, Speech, Signal Process., vol. 17, no. 1, pp. 174-184, Jan. 2009.
24. Y. E. Kim, E. M. Schmidt, R. Migneco, B. G. Morton, P. Richardson, J. J. Scott, J. A. Speck, and D. Turnbull, "State of the art report: Music emotion recognition: A state of the art review, " in Proc. ISMIR, 2010, pp. 255-266.
25. T. Bertin-Mahieux, D. Eck, and M. Mandel, "Automatic tagging of audio: The state-of-the-art, " in Machine Audition: Principles, Algorithms and Systems, W. Wang, Ed. Hershey, PA, USA: IGI Global, 2010.
26. G. Tzanetakis and P. Cook, "Musical genre classification of audio signals, " IEEE Trans. Speech Audio Process., vol. 10, no. 5, pp. 293-302, Jul. 2002.
27. M. Mauch and S. Ewert, "The audio degradation toolbox and its application to robustness evaluation, " in Proc. ISMIR, 2013, pp. 83-88.
28. D. Porter and A. Neuringer, "Music discriminations by pigeons, " Exp. Psychol.: Animal Behavior Processes, vol. 10, no. 2, pp. 138-148, 1984.
29. S. Watanabe and M. Nemoto, "Reinforcing property of music in Java sparrows (Padda oryzivora), " Behavioural Processes, vol. 43, no. 2, pp. 211-218, 1998.
30. A. Chase, "Music discriminations by carp "Cyprinus carpio, " Animal Learn. Behavior, vol. 29, no. 4, pp. 336-353, 2001.
31. R. Panda, R. Malheiro, B. Rocha, A. Oliveira, and R. P. Paiva, "Multi-modal music emotion recognition: A new dataset, methodology and comparative analysis, " in Proc. CMMR, 2013, pp. 570-582.
32. Y. Song, S. Dixon, and M. Pearce, "Evaluation of musical features for emotion classification, " in Proc. ISMIR, Oct. 2012, pp. 523-528.
33. O. Lartillot and P. Toiviainen, "A MATLAB toolbox for musical feature extraction from audio, " in Proc. DAFx, 2007, pp. 237-244.
34. Y. Costa, L. Oliveira, A. Koerich, F. Gouyon, and J. Martins, "Music genre classification using LBP textural features, " Signal Process., vol. 92, no. 11, pp. 2723-2737, Nov. 2012.
35. J.-M. Ren and J.-S. R. Jang, "Discovering time-constrained sequential patterns for music genre classification, " IEEE Trans. Audio, Speech, Lang. Process., vol. 20, no. 4, pp. 1134-1144, May 2012.
36. K. Markov and T. Matsui, "Music genre classification using self-taught learning via sparse coding, " in Proc. ICASSP, Mar. 2012, pp. 1929-1932.
37. B. L. Sturm, C. Kereliuk, and A. Pikrakis, "A closer look at deep learning neural networks with low-level spectral periodicity features, " in Proc. Int. Workshop Cognitive Inf. Process., to be published.
38. G. Xia, J. Tay, R. Dannenberg, and M. Veloso, "Autonomous robot dancing driven by beats and emotions of music, " in Proc. Int. Conf. Autonomous Agents Multiagent Syst, 2012, pp. 205-212.
39. D. J. Hand, "Deconstructing statistical questions, " J. Royal Statist. Soc. A (Statist. Soc.), vol. 157, no. 3, pp. 317-356, 1994.
40. J.-J. Aucouturier and F. Pachet, "Representing music genre: A state of the art, " J. New Music Res., vol. 32, no. 1, pp. 83-93, 2003.
41. A. Craft, G. A. Wiggins, and T. Crawford, "How many beans make five? The consensus problem in music-genre classification and a new evaluation method for single-genre categorisation systems, " in Proc. ISMIR, 2007, pp. 73-76.
42. A. Craft, "The role of culture in music information retrieval: A model of negotiated musical meaning, and its implications in methodology and evaluation of the music genre classification task, " Ph.D. dissertation, Dept. Comput., Goldsmiths College, Univ. London, London, U.K., 2008.
43. M. Levy and M. Sandler, "Learning latent semantic models for music from social tags, " J. New Music Res., vol. 37, no. 2, pp. 137-150, 2008.
44. G. A. Wiggins, "Semantic gap? Schemantic schmap!! Methodological considerations in the scientific study of music, " in Proc. IEEE Int. Symp. Mulitmedia, Dec. 2009, pp. 477-482.
45. J.-J. Aucouturier and F. Pachet, "Improving timbre similarity: How high is the sky?, " J. Neg. Results Speech Audio Sci., vol. 1, no. 1, 2004.
46. J.-J. Aucouturier, F. Pachet, P. Roy, and A. Beurivé, "Signal + context = better classification, " in Proc. ISMIR, 2007, pp. 425-430.
47. J.-J. Aucouturier, "Sounds like teen spirit: Computational insights into the grounding of everyday musical terms, " in Language, Evolution and the Brain: Frontiers in Linguistic Series, J. Minett and W. Wang, Eds. Taipei, Taiwan: Academia Sinica, 2009.
48. E. J. Humphrey, J. P. Bello, and Y. LeCun, "Feature learning and deep architectures: New directions for music informatics, " J. Intell. Inf. Syst., vol. 41, no. 3, pp. 461-481, 2013.
49. R. Hamming, "You get what you measure, " lecture at Naval Postgraduate School. Monterey, CA, USA, Jun. 1995 [Online]. Available: http://www.youtube.com/watch?v=LNhcaVi3zPA
50. F. Gouyon, S. Dixon, E. Pampalk, and G. Widmer, "Evaluating rhythmic descriptors for musical genre classification, " in Proc. Int. Audio Eng. Soc. Conf., 2004, pp. 196-204.
51. F. Gouyon and S. Dixon, "Dance music classification: A tempo-based approach, " in Proc. ISMIR, 2004, pp. 501-504.