The State of the Art Ten Years After a State of the Art: Future Research in Music Information Retrieval

Journal of New Music Research

Volumn 43, Issue 2, 2014, Pages 147-172

  Sturm, Bob L ^a  

^a AALBORG UNIVERSITY   (Denmark)

Author keywords

databases; information retrieval; machine learning; music analysis

Indexed keywords

EID: 84902659726     PISSN: 09298215     EISSN: 17445027     Source Type: Journal    
DOI: 10.1080/09298215.2014.894533     Document Type: Article

References (115)

1. Ammer, C. (2004). Dictionary of music (4th ed.). New York: The Facts on File Inc.
2. Andén, J., & Mallat, S. (2011). Multiscale scattering for audio classification. In A. Klapuri & C. Leider (Eds.), Proceedings of ISMIR (pp. 657-662). Miami, FL: University of Miami.
3. Andén, J., & Mallat, S. (2013). Deep scattering spectrum. arXiv.1304.6763v2 [cs.SD]. Retrieved from http://arxiv.org/abs/1304.6763.
4. Anglade, A., Ramirez, R., & Dixon, S. (2009). Genre classification using harmony rules induced from automatic chord transcriptions. In Proceedings of ISMIR (pp. 669-674). Canada: International Society for Music Information Retrieval.
5. Aucouturier, J.-J. (2009). Sounds like teen spirit: Computational insights into the grounding of everyday musical terms. In J. Minett & W. Wang (Eds.), Language, evolution and the brain: Frontiers in linguistic series. Taipei: Academia Sinica Press.
6. Aucouturier, J.-J., & Bigand, E. (2013). Seven problems that keep MIR from attracting the interest of cognition and neuroscience. Journal of Intelligent Information Systems, 41(3), 483-497.
7. Aucouturier, J.-J., & Pachet, F. (2003). Representing music genre: A state of the art. Journal of New Music Research, 32(1), 83-93.
8. Aucouturier, J.-J., & Pampalk, E. (2008). Introduction - from genres to tags: A little epistemology of music information retrieval research. Journal of New Music Research, 37(2), 87-92.
9. Bailey, R.A. (2008). Design of comparative experiments. Cambridge: Cambridge University Press.
10. Barbedo, J.G.A., & Lopes, A. (2007). Automatic genre classification of musical signals. EURASIP Journal on Advances in Signal Processing, 2007, 064960.
11. Barreira, L., Cavaco, S., & da Silva, J. (2011). Unsupervised music genre classification with a model-based approach. InL. Antunes & H.S. Pinto (Eds.), Progress in artificial intelligence: 15th Portuguese conference on artificial intelligence, EPIA 2011, Lisbon, Portugal, October 10-13, 2011. Proceedings (Lecture Notes in Computer Science, Vol. 7026, pp. 268-281). Berlin/Heidelberg: Springer.
12. Barrington, L., Yazdani, M., Turnbull, D., & Lanckriet, G.R.G. (2008). Combining feature kernels for semantic music retrieval. In Proceedings of ISMIR (pp. 614-619).
13. Basili, V., Selby, R., & Hutchens, D. (1986). Experimentation in software engineering. IEEE Transactions on Software Engineering, 12(7), 733-743.
14. Baǧci, U., & Erzin, E. (2007). Automatic classification of musical genres using inter-genre similarity. IEEE Signal Processing Letters, 14(8), 521-524.
15. Bergstra, J., Casagrande, N., Erhan, D., Eck, D., & Kégl, B. (2006). Aggregate features and AdaBoost for music classification. Machine Learning, 65(2-3), 473-484.
16. Bertin-Mahieux, T., Eck, D., Maillet, F., & Lamere, P. (2008). Autotagger: A model for predicting social tags from acoustic features on large music databases. Journal of New Music Research, 37(2), 115-135.
17. Bertin-Mahieux, T., Eck, D., & Mandel, M. (2010). Automatic tagging of audio: The state-of-the-art. In W. Wang (Ed.), Machine audition: Principles, algorithms and systems. Hershey, PA: IGI Publishing.
18. Bertin-Mahieux, T., Ellis, D.P., Whitman, B., & Lamere, P. (2011). The million song dataset. Proceedings of ISMIR (pp. 591-596). Canada: International Society for Music Information Retrieval.
19. Bowker, G.C., & Star, S.L. (1999). Sorting things out: Classification and its consequences. Cambridge, MA: MIT Press.
20. Chang, K., Jang, J.-S.R., & Iliopoulos, C.S. (2010). Music genre classification via compressive sampling. In Proceedings of ISMIR (pp. 387-392). Canada: International Society for Music Information Retrieval.
21. Chase, A. (2001). Music discriminations by carp 'Cyprinus carpio'. Animal Learning & Behavior, 29(4), 336-353.
22. Craft, A. (2007). The role of culture in the music genre classification task: Human behaviour and its effect on methodology and evaluation (Technical report). London: Queen Mary University of London.
23. Craft, A., Wiggins, G.A., & Crawford, T. (2007). How many beans make five? The consensus problem in music-genre classification and a new evaluation method for single-genre categorisation systems. In Proceedings of ISMIR (pp. 73-76). Vienna: Austrian Computer Society (OCG).
24. Cunningham, S.J., Bainbridge, D., & Downie, J.S. (2012). The impact of MIREX on scholarly research (2005-2010). In Proceedings of ISMIR (pp. 259-264). Canada: International Society for Music Information Retrieval.
25. Dannenberg, R.B. (2010). Style in music. In S. Argamon, K. Burns & S. Dubnov (Eds.), The structure of style (pp. 45-57). Berlin/Heidelberg: Springer.
26. Dannenberg, R.B., Thom, B., & Watson, D. (1997). A machine learning approach to musical style recognition. In Proceedings of ICMC (pp. 344-347). Ann Arbor, MI: Michigan Publishing.
27. Denning, P.J. (1980). What is experimental computer science? Communications of the ACM, 23(10), 543-544.
28. Denning, P.J. (1981). Performance analysis: experimental computer science as its best. Communications of the ACM, 24(11), 725-727.
29. Dixon, S., Gouyon, F., & Widmer, G. (2004). Towards characterisation of music via rhythmic patterns. In Proceedings of ISMIR (pp. 509-517). Barcelona: Universitat Pompeu Fabra.
30. Dougherty, E.R., & Dalton, L.A. (2013). Scientific knowledge is possible with small-sample classification. EURASIP Journal on Bioinformatics and Systems Biology, 2013, 10.
31. Downie, J., Ehmann, A., Bay, M., & Jones, M. (2010). The music information retrieval evaluation exchange: Some observations and insights. In Z. Ras & A. Wieczorkowska (Eds.), Advances in music information retrieval (pp. 93-115). Berlin/Heidelberg: Springer.
32. Downie, J.S. (2003). Toward the scientific evaluation of music information retrieval systems. In Proceedings of ISMIR (pp. 25-32). Baltimore, MD: The Johns Hopkins University.
33. Downie, J.S. (2004). The scientific evaluation of music information retrieval systems: Foundations and future. Computer Music Journal, 28(2), 12-23.
34. Downie, J.S. (2008). The music information retrieval evaluation exchange (2005-2007): A window into music information retrieval research. Acoustical Science and Technology, 29(4), 247-255.
35. Duin, R.P.W., Juszczak, P., de Ridder, D., Paclik, P., Pekalska, E., & Tax, D.M.J. (2007). PR-Tools4.1, a MATLAB toolbox for pattern recognition. Retrieved from: http://prtools.org.
36. Fabbri, F. (1980, June). A theory of musical genres: Two applications. Paper presented at the First International Conference on Popular Music Studies, Amsterdam.
37. Fabbri, F. (1999). Browsing musical spaces. Paper presented at the International Association for the Study of Popular Music (UK). Available at: http://www.tagg.org/others/ffabbri9907.html
38. Feitelson, D.G. (2006). Experimental computer science: The need for a cultural change. (Technical report). Jerusalem: The Hebrew University of Jerusalem.
39. Fenton, N., Pfleeger, S.L., & Glass, R.L. (1994). Science and substance: A challenge to software engineers. IEEE Software, 11(4), 86-95.
40. Flexer, A. (2006). Statistical evaluation of music information retrieval experiments. Journal of New Music Research, 35(2), 113-120.
41. Flexer, A. (2007). A closer look on artist filters for musical genre classification. In Proceedings of ISMIR (pp. 341-344). Vienna: Austrian Computer Society (OCG).
42. Flexer, A., & Schnitzer, D. (2009). Album and artist effects for audio similarity at the scale of the web. In Proceedings of SMC 2009, July 23-25, Porto, Portugal (pp. 59-64).
43. Flexer, A., & Schnitzer, D. (2010). Effects of album and artist filters in audio similarity computed for very large music databases. Computer Music Journal, 34(3), 20-28.
44. Frow, J. (2005). Genre. New York: Routledge.
45. Fu, Z., Lu, G., Ting, K.M., & Zhang, D. (2011). A survey of audio-based music classification and annotation. IEEE Transactions on Multimedia, 13(2), 303-319.
46. Gjerdingen, R. O., & Perrott, D. (2008). Scanning the dial: The rapid recognition of music genres. Journal of New Music Research, 37(2), 93-100.
47. Gouyon, F., Sturm, B.L., Oliveira, J.L., Hespanhol, N., & Langlois, T. (2013). On evaluation in music autotagging research (submitted).
48. Guaus, E. (2009). Audio content processing for automatic music genre classification: Descriptors, databases, and classifiers (PhD thesis). Universitat Pompeu Fabra, Barcelona, Spain.
49. Hand, D. J. (1994). Deconstructing statistical questions. Journal of the Royal Statistical Society A (Statistics in Society), 157(3), 317-356.
50. Hartmann, M.A. (2011). Testing a spectral-based feature set for audio genre classification. (Master's thesis). University of Jyväskylä, Jyväskylä, Finland.
51. Humphrey, E.J., Bello, J.P., & LeCun, Y. (2013). Feature learning and deep architectures: New directions for music informatics. Journal of Intelligent Information Systems, 41(3), 461-481.
52. Kemp, C. (2004). Towards a holistic interpretation of musical genre classification. (Master's thesis). University of Jyväskylä, Jyväskylä, Finland.
53. Kimball, A.W. (1957). Errors of the third kind in statistical consulting. Journal of the American Statistical Association, 52(278), 133-142.
54. Law, E. (2011). Human computation for music classification. In T. Li, M. Ogihara & G. Tzanetakis (Eds.), Music data mining (pp. 281-301). New York: CRC Press.
55. Levy, M., & Sandler, M. (2009). Music information retrieval using social tags and audio. IEEE Transactions on Multimedia, 11(3), 383-395.
56. Li, M., & Sleep, R. (2005). Genre classification via an LZ78-based string kernel. Proceedings of ISMIR (pp. 252-259). London: Queen Mary, University of London.
57. Li, T., & Chan, A. (2011). Genre classification and the invariance of MFCC features to key and tempo. In K.-T. Lee, W.-H. Tsai, H.-Y.M. Liao, T. Chen, J.-W. Hsieh, & C.-C. Tseng (Eds.), Advances in multimedia modeling: 17th International Multimedia Modeling Conference, MMM 2011, Taipei, Taiwan, January 5-7, 2011, Proceedings, Part I (Lecture Notes in Computer Science Vol. 6523 pp. 317-327). Berlin/Heidelberg: Springer.
58. Li, T., & Ogihara, M. (2006). Toward intelligent music information retrieval. IEEE Transactions on Multimedia, 8(3), 564-574.
59. Lidy, T. (2006). Evaluation of new audio features and their utilization in novel music retrieval applications (Master's thesis). Vienna University of Technology, Vienna, Austria.
60. Lidy, T., & Rauber, A. (2005). Evaluation of feature extractors and psycho-acoustic transformations for music genre classification. In Proceedings of ISMIR (pp. 34-41). London: Queen Mary, University of London.
61. Lippens, S., Martens, J., & De Mulder, T. (2004). A comparison of human and automatic musical genre classification. In IEEE International Conference on Acoustics, Speech, and Signal Processing, 2004. Proceedings. (ICASSP '04) (Vol. 4, pp. 233-236). Piscataway, NJ: IEEE.
62. Mandel, M., & Ellis, D.P.W. (2005). Song-level features and support vector machines for music classification. In Proceedings of the International Symposium on Music Information Retrieval (pp. 594-599). London: Queen Mary, University of London.
63. Markov, K., & Matsui, T. (2012a). Music genre classification using self-taught learning via sparse coding. In 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (pp. 1929-1932). Piscataway, NJ: IEEE.
64. Markov, K., & Matsui, T. (2012b). Nonnegative matrix factorization based self-taught learning with application to music genre classification. In Proceedings of the IEEE International Workshop on Machine Learnin and Signal Processing (pp. 1-5). Piscataway, NJ: IEEE.
65. Marques, C., Guiherme, I.R., Nakamura, R.Y.M., & Papa, J.P. (2011a). New trends in musical genre classification using optimum-path forest. In Proceedings of ISMIR (pp. 699-704). Canada: International Society for Music Information Retrieval.
66. Marques, G., Domingues, M., Langlois, T., & Gouyon, F. (2011b). Three current issues in music autotagging. In Proceedings of ISMIR (pp. 795-800). Canada: International Society for Music Information Retrieval.
67. Matityaho, B., & Furst, M. (1995). Neural network based model for classification of music type. In Eighteenth Convention of Electrical and Electronics Engineers in Israel (pp. 1-5). Piscataway, NJ: IEEE.
68. Mayer, R., Neumayer, R., & Rauber, A. (2008). Rhyme and style features for musical genre classification by song lyrics. Proceedings of ISMIR (pp. 337-342). Canada: International Society for Music Information Retrieval.
69. McCracken, D.D., Denning, P.J., & Brandin, D.H. (1979). An ACM executive committee position on the crisis in experimental computer science. Communications of the ACM, 22(9), 503-504.
70. McKay, C., & Fujinaga, I. (2006). Music genre classification: Is it worth pursuing and how can it be improved? In Proceedings of ISMIR (pp. 101-106). Victoria, BC: University of Victoria.
71. McLuhan, M. (1964). Understanding media: The extensions of man (94th ed.). Cambridge, MA: MIT Press.
72. Moerchen, F., Mierswa, I., & Ultsch, A. (2006). Understandable models of music collections based on exhaustive feature generation with temporal statistics. In Proceedings of the International Conference on Knowledge Discovery and Data Mining (pp. 882-891). New York: ACM.
73. Noorzad, P., & Sturm, B.L. (2012). Regression with sparse approximations of data. In Proceedings of EUSIPCO (pp. 674-678). Piscataway, NJ: IEEE.
74. Pachet, F., & Cazaly, D. (2000). A taxonomy of musical genres. In Proceedings of Content-based Multimedia Information Access Conference, Paris, France. (pp. 1238-1245).
75. Pampalk, E. (2006). Computational models of music similarity and their application in music information retrieval. (PhD thesis). Vienna University of Technology, Vienna, Austria.
76. Pampalk, E., Flexer, A., & Widmer, G. (2005). Improvements of audio-based music similarity and genre classification. In Proceedings of ISMIR (pp. 628-233). London: Queen Mary, University of London.
77. Panagakis, Y., & Kotropoulos, C. (2010). Music genre classification via topology preserving non-negative tensor factorization and sparse representations. In Proceedings of ICASSP (pp. 249-252). Piscataway, NJ: IEEE.
78. Panagakis, Y., Kotropoulos, C., & Arce, G. R. (2009a). Music genre classification using locality preserving non-negative tensor factorization and sparse representations. In Proceedings of ISMIR (pp. 249-254). Canada: International Society for Music Information Retrieval.
79. Panagakis, Y., Kotropoulos, C., & Arce, G.R. (2009b). Music genre classification via sparse representations of auditory temporal modulations. In Proceedings of EUSIPCO. New York: Curran Associates Inc.
80. Park, S., Park, J., & Sim, K. (2011). Optimization system of musical expression for the music genre classification. In Proceedings of the 11th International Conference on Control, Automation and Systems (ICCAS) (pp. 1644-1648). Piscataway, NJ: IEEE.
81. Pfungst, O. (1911). Clever Hans (The horse of Mr. Von Osten): A contribution to experimental animal and human psychology. New York: Henry Holt.
82. Porter, D., & Neuringer, A. (1984). Music discriminations by pigeons. Experimental Psychology: Animal Behavior Processes, 10(2), 138-148.
83. Salzberg, S.L. (1997). Data mining and knowledge discovery, chapter On comparing classifiers: Pitfalls to avoid and a recommended approach (pp. 317-328). Dordrecht: Kluwer Academic Publishers.
84. Scaringella, N., Zoia, G., & Mlynek, D. (2006). Automatic genre classification of music content: A survey. IEEE Signal Processing Magazine, 23(2), 133-141.
85. Serra, X., Magas, M., Benetos, E., Chudy, M., Dixon, S., Flexer, A., Gómez, E., Gouyon, F., Herrera, P., Jordá, S., Paytuvi, O., Peeters, G., Schlüter, J., Vinet, H., & Widmer, G. (2013). Roadmap for Music Information ReSearch (Geoffroy Peeters, Ed.). Creative Commons BY-NC-ND 3.0 license.
86. Seyerlehner, K. (2010). Content-based music recommender systems: Beyond simple frame-level audio similarity. (PhD thesis). Johannes Kepler University, Linz, Austria.
87. Seyerlehner, K., Widmer, G., & Pohle, T. (2010). Fusing block-level features for music similarity estimation. In Proceedings of DAFx (pp. 1-8). Graz, Austria: Institute of Electronic Music and Acoustics.
88. Shapiro, P. (2005). Turn the beat around: The secret history of disco. London: Faber & Faber.
89. Slaney, M. (1998). Auditory toolbox (Technical report). Palo Alto, CA: Interval Research Corporation. Retrievable from https://engineering.purdue.edu/~malcolm/interval/1998-010/
90. Sordo, M., Celma, O., Blech, M., & Guaus, E., (2008). The quest for musical genres: Do the experts and the wisdom of crowds agree? In Proceedings of ISMIR (pp. 255-260).
91. Sturm, B.L. (2012a). An analysis of the GTZAN music genre dataset. In Proceedings of the ACM MIRUM Workshop (pp. 7-12). New York: ACM.
92. Sturm, B.L. (2012b). A survey of evaluation in music genre recognition. In Proceedings of Adaptive Multimedia Retrieval.
93. Sturm, B.L. (2012c). Two systems for automatic music genre recognition: What are they really recognizing? In Proceedings of ACM MIRUM Workshop (pp. 69-74). New York: ACM.
94. Sturm, B.L. (2013a). Classification accuracy is not enough: On the evaluation of music genre recognition systems. Journal of Intelligent Information Systems, 41(3), 371-406.
95. Sturm, B. L. (2013b). Evaluating music emotion recognition: Lessons from music genre recognition? In Proceedings of ICME (pp. 1-6). Piscataway, NJ: IEEE.
96. Sturm, B.L. (2013c). Formalizing evaluation in music information retrieval: A look at the mirex automatic mood classification task. In Proceedings of CMMR.
97. Sturm, B.L. (2013d). The GTZAN dataset: Its contents, its faults, their effects on evaluation, and its future use. arXiv.1306.1461v2[cs.SD]. Retrieved from http://arxiv.org/abs/1306.1461.
98. Sturm, B.L. (2013e). Music genre recognition with risk and rejection. In Proceedings of ICME (pp. 1-6). Piscataway, NJ: IEEE.
99. Sturm, B.L. (2013f). On music genre classification via compressive sampling. In Proceedings of ICME (pp. 1-6). Piscataway, NJ: IEEE.
100. Sturm, B.L. (2013g). A simple method to determine if a music information retrieval system is a horse (submitted).
101. Sturm, B.L., & Gouyon, F. (2013). Revisiting inter-genre similarity. IEEE Signal Processing Letters, 20(11), 1050-1053.
102. Sturm, B.L., & Noorzad, P. (2013). On automatic music genre recognition by sparse representation classification using auditory temporal modulations. In Proceedings of CMMR (pp. 379-394).
103. Theodoridis, S., & Koutroumbas, K. (2009). Pattern recognition (4th ed.). Amsterdam: Academic Press, Elsevier.
104. Truzzi, M. (1978). On the extraordinary: An attempt at clarification. Zetetic Scholar, 1, 11-22.
105. Tzanetakis, G., & Cook, P. (2002). Musical genre classification of audio signals. IEEE Transactions on Speech Audio Processing, 10(5), 293-302.
106. Urbano, J. (2011). Information retrieval meta-evaluation: Challenges and opportunities in the music domain. In Proceedings of ISMIR (pp. 609-614). Canada: International Society for Music Information Retrieval.
107. Urbano, J., McFee, B., Downie, J.S., & Schedl, M. (2012). How significant is statistically significant? The case of audio music similarity and retrieval. In Proceedings of ISMIR (pp. 181-186). Canada: International Society for Music Information Retrieval.
108. Urbano, J., Mónica, M., & Morato, J. (2011). Audio music similarity and retrieval: Evaluation power and stability. In Proceedings of ISMIR (pp. 597-602). Canada: International Society for Music Information Retrieval.
109. Urbano, J., Schedl, M., & Serra, X. (2013). Evaluation in music information retrieval. Journal of Intelligent Information Systems, 41(3), 345-369.
110. van den Berg, E., & Friedlander, M.P. (2008). Probing the Pareto frontier for basis pursuit solutions. SIAM Journal on Scientific Computing, 31(2), 890-912.
111. Vandewalle, P., Kovacevic, J., & Vetterli, M. (2009). Reproducible research in signal processing: What, why, and how. IEEE Signal Processing Magazine, 26(3), 37-47.
112. Wang, A. (2003). An industrial strength audio search algorithm. In Proceedings of the International Society for Music Information Retrieval. Baltimore, MD: Johns Hopkins University.
113. Wiggins, G.A. (2009). Semantic gap?? Schemantic schmap!! Methodological considerations in the scientific study of music. In Proceedings of the IEEE International Symposium on Mulitmedia (pp. 477-482). Piscataway, NJ: IEEE.
114. Wright, J., Yang, A.Y., Ganesh, A., Sastry, S.S., & Ma, Y. (2009). Robust face recognition via sparse representation. IEEE Transactions on Pattern Analsis and Machine Intelligence, 31(2), 210-227.
115. Xia, G., Tay, J., Dannenberg, R., & Veloso, M. (2012). Autonomous robot dancing driven by beats and emotions of music. In Proceedings of the International Conference on Autonomous Agents and Multiagent Systems (pp. 205-212). New York: ACM.