The music information retrieval evaluation exchange (2005-2007): A window into music information retrieval research

Acoustical Science and Technology

Volumn 29, Issue 4, 2008, Pages 247-255

  Downie, J Stephen ^a  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

Evaluation; MIREX; Music information retrieval

Indexed keywords

AUDIO-BASED; DATA SUPPORT; GLASS CEILING; MUSIC INFORMATION RETRIEVAL (MIR); POST-HOC ANALYSES; PROPERTY (S); RAPID DEVELOPMENT; ROOT CAUSES; TEST COLLECTIONS;

ELECTRONIC MUSICAL INSTRUMENTS; INFORMATION ANALYSIS; INFORMATION RETRIEVAL; INFORMATION SCIENCE; INFORMATION SERVICES; INTELLECTUAL PROPERTY; SEARCH ENGINES; SIGNAL PROCESSING; TESTING;

RESEARCH;

EID: 46649102100     PISSN: 13463969     EISSN: 13475177     Source Type: Journal    
DOI: 10.1250/ast.29.247     Document Type: Review

References (20)

1. J. Futrelle and J. S. Downie, "Interdisciplinary research issues in music information retrieval: ISMIR 2000-2002," J. New Music Res., 32, 121-131 (2003).
2. J. S. Downie, "Music information retrieval," Annu. Rev. Inf. Sci. Technol., 37, 295-340 (2003).
3. N. Orio, "Music information retrieval: A tutorial and review," Found. Trends Inf. Retr., 1, 1-90 (2006).
4. M. Fingerhut, Ed., Cumulative ISMIR Proceedings, Available: http://www.ismir.net/proceedings.
5. J. S. Downie, J. Futrelle and D. Tcheng, "The International Music Information Retrieval Systems Evaluation Laboratory: Governance, access, and security," Proc. ISMIR 2004, pp. 9-14 (2004).
6. J. S. Downie, K. West, K. A. Ehmann and E. Vincent, "The 2005 Music Information Retrieval Evaluation eXchange (MIREX 2005): Preliminary overview," Proc. ISMIR 2005, pp. 320-323 (2005).
7. P. Cano, E. Gomez, F. Gouyon, P. Herrera, M. Koppenberger, B. Ong, X. Serra, S. Streich and N. Wack, "ISMIR 2004 Audio Description Contest," MTG Tech. Rep., MTG-TR-2006-02 (Music Technology Group, Barcelona, Spain, 2004).
8. J. S. Downie, "The scientific evaluation of music information retrieval systems: Foundations and future," Comput. Music J., 28, 12-23 (2004).
9. E. Voorhees and D. Harmon, "The Text Retrieval Conference," in TREC Experiment and Evaluation in Information Retrieval, E. Voorhees and D. Harmon, Eds. (MIT Press, Cambridge, Mass., 2005), pp. 3-20.
10. J.-J. Aucouturier and F. Pachet, "Improving timbre similarity: How high is the sky?" J. Negative Results Speech Audio Sci., 1, http://www.csl.sony.fr/downloads/papers/uploads/aucouturier04b.pdf, in press (2004).
11. B. Whitman, G. Flake and S. Lawrence, "Artist detection in music with Minnowmatch," Proc. IEEE Workshop on Neural Networks for Signal Processing, pp. 559-568 (2001).
12. Y. E. Kim, D. S. Williamson and S. Pilli, "Towards quantifying the 'album effect' in artist identification," Proc. ISMIR 2006, pp. 393-394 (2006).
13. E. Pampalk, A. Flexer and G. Widmer, "Improvements of audio-based music similarity and genre classification," Proc. ISMIR 2005, pp. 260-263 (2005).
14. A. Flexer, "A closer look on artist filters for musical genre classification," Proc. ISMIR 2007, pp. 341-344 (2007).
15. C. McKay and I. Fujinaga, "Musical genre classification: Is it worth pursuing and how can it be improved?" Proc. ISMIR 2006, pp. 101-106 (2006).
16. J. Tague-Sutcliffe and J. Blustein, "The statistical analysis of the TREC-3 data," in Overview of the Third Text Retrieval Conference, D. Harmon, Ed. (NIST, Gaithersburg, Md., 1995), pp. 385-398.
17. M. L. Berenson, D. M. Levine and M. Goldstein, Intermediate Statistical Methods and Applications: A Computer Package Approach (Prentice-Hall, Englewood Cliffs, N.J., 1983).
18. W. J. Conover, Practical Non-Parametric Statistics (Wiley, New York, 1980).
19. M. C. Jones, J. S. Downie and A. F. Ehmann, "Understanding human judgments of similarity in music information retrieval," Proc. ISMIR 2007, pp. 101-106 (2007).
20. E. Pampalk, "Audio-based music similarity and retrieval: Combining a spectral similarity model with information extracted from fluctuation patterns," MIREX 2006, Submission Abstracts (2006) Available: http://www.music-ir.org/evaluation/MIREX/2006-abstracts/AS_pampalk.pdf.