Semantic annotation and retrieval of music and sound effects

IEEE Transactions on Audio, Speech and Language Processing

Volumn 16, Issue 2, 2008, Pages 467-476

  Turnbull, Douglas ^a   Barrington, Luke ^b   Torres, David ^a   Lanckriet, Gert ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Audio annotation and retrieval; Music information retrieval; Semantic music analysis

Indexed keywords

ACOUSTIC FEATURES; AUDIO ANNOTATION AND RETRIEVAL; AUDIO CONTENTS; AUDIO FEATURES; AUDIO TRACKS; AUDITION SYSTEMS; COMPUTER AUDITIONS; CONTENT-BASED; DATA SETS; DENSITY ESTIMATES; ESTIMATION TECHNIQUES; EXPECTATION-MAXIMIZATION ALGORITHMS; GAUSSIAN MIXTURE MODELS; JOINT PROBABILITIES; LARGE DATA SETS; MULTI CLASS; MULTILABEL; MUSIC INFORMATION RETRIEVAL; POPULAR MUSICS; SEMANTIC ANNOTATIONS; SOUND EFFECTS; TEXT-BASED QUERIES;

AUDITION; ELECTRONIC MUSICAL INSTRUMENTS; IMAGE SEGMENTATION; INFORMATION RETRIEVAL; INFORMATION SERVICES; INFORMATION THEORY; PARAMETER ESTIMATION; SEMANTICS;

AUDIO ACOUSTICS;

EID: 57049092565     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2007.913750     Document Type: Article

References (35)

1. G. Carneiro and N. Vasconcelos, "Formulating semantic image annotation as a supervised learning problem," in Proc. IEEE CVPR, 2005, pp. 163-168.
2. N. Vasconcelos, "Image indexing with mixture hierarchies," in Proc. IEEE CVPR, 2001, pp. 3-10.
3. M. Goto and K. Hirata, "Recent studies on music information processing," Acoust, Sci. Technol, vol. 25, no. 4, pp. 419-425, 2004.
4. R. B. Dannenberg and N. Hu, "Understanding search performance in query-by-humming systems," in Proc. ISMIR, 2004, pp. 232-237.
5. A. Kapur, M. Benning, and G. Tzanetakis, "Query by beatboxing: Music information retrieval for the dj," in Proc. 1SM1R, 2004, pp. 170-178.
6. G. Eisenberg, J. M. Batke, and T. Sikora, "Beatbank-An MPEG-7 compliant query by tapping system," Audio Eng. Soc. Conv, 2004, paper 6136.
7. M. F. McKinnev and J. Breebaart, "Features for audio and music classification," in Proc. ISMIR, 2003, pp. 151-158.
8. T. Li and G. Tzanetakis, "Factors in automatic musical genre classification of audio signals," in IEEE WASPAA, 2003, pp. 143-146.
9. S. Essid, G. Richard, and B. David, "Inferring efficient hierarchical taxonomies for music information retrieval tasks: Application to musical instruments," in Proc. ISMIR, 2005, pp. 324-328.
10. F. Pachet and D. Cazaly, "A taxonomy of musical genres," RIAO, 2000.
11. D. Forsvth and M. Fleck, "Body plans," in Proc. IEEE CVPR. 1997, pp. 678-683.
12. D. M. Blei and M. I. Jordan, "Modeling annotated data," in Proc. ACM SIGIR, 2003, pp. 127-134.
13. S. L. Feng, R. Manmatha, and V. Lavrenko, "Multiple bernoulli relevance models for image and video annotation," in Proc. IEEE CVPR, 2004, pp. II-1002-11-1009.
14. B.Whitman, "Learning the meaning of music," Ph.D. dissertation, Mass. Inst. Technol., Cambridge, 2005.
15. B. Whitman and D. Ellis, "Automatic record reviews," in Pmc. ISMIR, 2004, pp. 470-477.
16. B. Whitman and R. Rifkin, "Musical query-by- description as a multiclass learning problem," in IEEE Workshop Multimedia Signal Process., 2002, pp. 153-156.
17. M. Slaney, "Semantic-audio retrieval," in Pmc. IEEE ICASSP, 2002, pp. IV-1408-1V-1411.
18. P. Cano and M. Koppenberger, "Automatic sound annotation," in Proc. IEEE Workshop Much. Learn. Signal Process., 2004, pp. 391-400.
19. M. Slaney, "Mixtures of probability experts for audio retrieval and indexing," in Proc. IEEE Multimedia Expo., 2002, pp. 345-348.
20. D. Reynolds, T. F. Quatieri, and R. B. Dunn, "Speaker verification using adapted Gaussian mixture models," Digital Signal Process., vol. 10, pp. 19-41, 2000.
21. D. Turnbull, L. Barrington, D. Torres, and G. Lanckriet, "Towards musical query-by-semantic description using the CAL500 data set," in Pmc. SIGIR'07, 2007, pp. 439-446.
22. D. Turnbull, L. Barrington, and G. Lanckriet, "Modelling music and words using a multi-class naive bayes approach," in Proc. ISMIR, 2006, pp. 254-259.
23. C. McKay, D. McEnnis, and I. Fujinaga, "A large publicly accessible prototype audio database for music research," in Proc. ISMIR, 2006, pp. 160-163.
24. J. Skowronek, M. McKinnev, and S. ven de Par, "Ground-truth for automatic music mood classification," in Pmc. ISMIR, 2006, pp. 395-396.
25. X. Hu, J. S. Downie, and A. F. Ehmann, "Exploiting recommended usage metadata: Exploratory analyses," in Proc. ISMIR. 2006, pp. 19-22.
26. "Magnatune: Free MP3 music and music licensing," Magnatune [Online], Available: http://www.magnatune.com
27. C. R. Buchanan, "Semantic-based audio recognition and retrieval," M.S. thesis, School of Informatics. Univ. Edinburgh. Edinburgh, U.K., 2005.
28. L. Rabiner and B. H. Juang, Fundamentals of Speech Recognition. Englewood Cliffs, NJ: Prentice-Hall, 1993.
29. J. S. Downie, "Music information retrieval evaluation exchange (Mirex)," [Online]. Available: http://www.music-ir.org/mirex2006
30. D. Ellis and G. Poliner, "Identifying cover songs with chroma features and dynamic programming beat tracking," in Proc. IEEE ICASSP, 2007, pp. 1V-1429-1V-1432.
31. E. Pampalk, "Computational models of music similarity and their application in music information retrieval," Ph.D. dissertation, Vienna Univ. Technol., Vienna, Austria, 2006.
32. D. Torres, D. Turnbull, L. Barrington, and G. Lanckriet, "Identifying words that are musically meaningful," in Proc. ISMIR'07, 2007, pp. 405-410.
33. D. Turnbull, R. Liu, L. Barrington, D. Torres, and G. anckriet. "Using games to collect semantic information about music," in Proc. ISMIR'07, 2007, pp. 535-538.
34. A. Berenzweig, B. Logan, D. Ellis, and B. Whitman, "A large-scale evalutation of acoustic and subjective music-similarity measures," Comput. Music J., pp. 63-76, 2004.
35. L. Barrington, A. Chan, D. Turnbull, and G. Lanckriet, "Audio information retrieval using semantic similarity," in Proc. IEEE ICASSP, 2007, pp. II-725-II-728.