The need for music information retrieval with user-centered and multimodal strategies

MM'11 - Proceedings of the 2011 ACM Multimedia Conference and Co-Located Workshops - MIRUM 2011 Workshop, MIRUM'11

Volumn , Issue , 2011, Pages 1-6

  Liem, Cynthia C S ^a   Müller, Meinard ^b   Eck, Douglas ^c   Tzanetakis, George ^d   Hanjalic, Alan ^a  

^a DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

^b SAARLAND UNIVERSITY   (Germany)

^c GOOGLE INC   (United States)

^d UNIVERSITY OF VICTORIA   (Canada)

Author keywords

Cross domain methodology transfer; Multimodal music processing; Music information retrieval; User centered design

Indexed keywords

AUDIO SIGNAL; CROSS-DOMAIN; DIGITAL INFORMATION; DIGITAL MUSIC DATA; MULTI-MODAL; MUSIC CONTENTS; MUSIC INFORMATION; MUSIC INFORMATION RETRIEVAL; USAGE PATTERNS; USER CENTERED DESIGNS; USER-CENTERED;

COMPUTER MUSIC; INFORMATION RETRIEVAL;

AUDIO ACOUSTICS;

EID: 84555179033     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2072529.2072531     Document Type: Conference Paper

References (76)

1. J.-J. Aucouturier. Sounds like Teen Spirit: Computational Insights into the Grounding of Everyday Musical Terms. In J. Minett and W. Wang, editors, Language, Evolution and the Brain. Academia Sinica Press, 2009.
2. J.-J. Aucouturier and F. Pachet. Improving Timbre Similarity: How high is the skys? JNRSAS, 1(1), 2004.
3. J.-J. Aucouturier, F. Pachet, P. Roy, and A. Beurivé. Signal + Context = Better Classification. In Proc. ISMIR, pages 425-430, 2007.
4. D. Bainbridge, B. J. Novak, and S. J. Cunningham. A user-centered design of a personal digital library for music exploration. In Proc. JCDL, pages 149-158, 2010.
5. L. Barrington, R. Oda, and G. Lanckriet. Smarter than Genius? Human Evaluation of Music Recommender Systems. In Proc. ISMIR, pages 357-362, 2009.
6. L. Barrington, D. Turnbull, M. Yazdani, and G. Lanckriet. Combining Audio Content and Social Context for Semantic Music Discovery. In Proc. SIGIR, pages 387-394, 2009.
7. N. J. Belkin. Some(what) Grand Challenges for Information Retrieval. SIGIR Forum, 42(1), 2008.
8. T. Bertin-Mahieux, D. Eck, and M. Mandel. Automatic Tagging of Audio: The State-of-the-Art. In W. Wang, editor, Machine Audition: Principles, Algorithms and Systems. IGI Publishing, 2010.
9. P. Cano, E. Batlle, T. Kalker, and J. Haitsma. A Review of Algorithms for Audio Fingerprinting. In Proc. IEEE MMSP Workshop, pages 169-173, 2002.
10. M. A. Casey, R. Veltkamp, M. Goto, M. Leman, C. Rhodes, and M. Slaney. Content-Based Music Information Retrieval: Current Directions and Future Challenges. Proc. IEEE, 96(4):668-696, 2008.
11. Ò. Celma. Music Recommendation and Discovery. Springer, 2010.
12. A. Cont. A Coupled Duration-Focused Architecture for Real-Time Music to Score Alignment. IEEE TPAMI, 32(6):974-987, 2010.
13. D. Damm, C. Fremerey, V. Thomas, M. Clausen, F. Kurth, and M. Müller. A Digital Library Framework for Heterogeneous Music Collections-from Document Acquisition to Cross-Modal Interaction. Int. J. Dig. Libr., 2011, to appear.
14. R. B. Dannenberg. An On-Line Algorithm for Real-Time Accompaniment. In Proc. ICMC, pages 193-198, 1984.
15. R. B. Dannenberg and C. Raphael. Music Score Alignment and Computer Accompaniment. Comm. ACM, 49(8):38-43, 2006.
16. J. S. Downie. The music information retrieval evaluation exchange (2005-2007): A window into music information retrieval research. Acoust. Sci. & Tech., 29(4):247-255, 2008.
17. J. S. Downie, D. Byrd, and T. Crawford. Ten Years of ISMIR: Reflections on Challenges and Opportunities. In Proc. ISMIR, pages 13-18, 2009.
18. D. Eck, P. Lamere, T. Bertin-Mahieux, and S. Green. Automatic Generation of Social Tags for Music Recommendation. In NIPS '07, 2008.
19. S. Ewert, M. Müller, and P. Grosche. High Resolution Audio Synchronization Using Chroma Onset Features. In Proc. ICASSP, pages 1869-1872, 2009.
20. B. Fields. Contextualize Your Listening: The Playlist as Recommendation Engine. PhD thesis, Goldsmiths, Univ. of London, 2011.
21. H. Fujihara, M. Goto, J. Ogata, and H. Okuno. LyricSynchronizer: Automatic Synchronization Method Between Musical Audio Signals and Lyrics. IEEE JSTSP, 5(6):1252-1261, 2011.
22. E. Gómez. Tonal Description of Music Audio Signals. PhD thesis, UPF Barcelona, 2006.
23. M. Goto. Music Listening in the Future: Augmented Music-Understanding Interfaces and Crowd Music Listening. In Proc. 42nd AES Conf., pages 21-30, 2011.
24. A. Hanjalic, R. Lienhart, W.-Y. Ma, and J. R. Smith. The Holy Grail of Multimedia Information Retrieval: So Close or Yet So Far Away? Proc. IEEE, 96(4):541-547, 2008.
25. X. Hu and J. S. Downie. Improving mood classification in music digital libraries by combining lyrics and audio. In Proc. JCDL, pages 159-168, 2010.
26. X. Hu and J. S. Downie. When Lyrics outperform Audio for Music Mood Classification: a Feature Analysis. In Proc. ISMIR, pages 619-624, 2010.
27. C. Joder, S. Essid, and G. Richard. A Conditional Random Field Framework for Robust and Scalable Audio-to-Score Matching. IEEE TASLP, 19(8):2385-2397, 2011.
28. M.-Y. Kan, Y. Wang, D. Iskandar, T. L. Nwe, and A. Shenoy. LyricAlly: Automatic Synchronization of Textual Lyrics to Acoustic Music Signals. IEEE TASLP, 16(2):338-349, 2008.
29. Y. E. Kim, E. M. Schmidt, R. Migneco, B. G. Morton, P. Richardson, J. Scott, J. A. Speck, and D. Turnbull. Music Emotion Recognition: A State of the Art review. In Proc. ISMIR, pages 255-266, 2010.
30. P. Knees, T. Pohle, M. Schedl, and G. Widmer. A Music Search Engine Built upon Audio-based and Web-based Similarity Measures. In Proc. SIGIR, pages 447-454, 2007. (Pubitemid 350164992)
31. F. Kurth and M. Müller. Efficient Index-Based Audio Matching. IEEE TASLP, 16(2):382-395, 2008.
32. F. Kurth, M. Müller, C. Fremerey, Y. ha Chang, and M. Clausen. Automated Synchronization of Scanned Sheet Music with Audio Recordings. In Proc. ISMIR, pages 261-266, Vienna, Austria, 2007.
33. E. Law. Human Computation for Music Classification. In T. Li, M. Ogihara, and G. Tzanetakis, editors, Music Data Mining. CRC Press, 2011.
34. J. H. Lee. Analysis of user needs and information features in natural language queries seeking user information. JASIST, 61:1025-1045, 2010.
35. T. Lidy and P. van der Linden. Think-Tank on the Future of Music Search, Access and Consumption, 2011.
36. B. Logan. Mel Frequency Cepstral Coefficients for Music Modeling. In Proc. ISMIR, 2000.
37. M. I. Mandel, D. Eck, and Y. Bengio. Learning Tags that Vary Within a Song. In Proc. ISMIR, pages 399-404, 2010.
38. M. Mauch, H. Fujihara, and M. Goto. Integrating Additional Chord Information into HMM-Based Lyrics-to-Audio Alignment. IEEE TASLP, 2011, to appear.
39. R. Mayer, R. Neumayer, and A. Rauber. Combination of audio and lyrics features for genre classification in digital audio collections. In Proc. ACM MM, pages 159-168, 2008.
40. C. McKay, J. A. Burgoyne, J. Hockman, J. B. L. Smith, G. Vigliensoni, and I. Fujinaga. Evaluating the genre classification performance of lyrical features relative to audio, symbolic and cultural features. In Proc. ISMIR, pages 213-218, 2008.
41. M. Müller. Information Retrieval for Music and Motion. Springer Verlag, 2007.
42. M. Müller. New Developments in Music Information Retrieval. In Proc. 42nd AES Conf., pages 11-20, 2011.
43. M. Müller, M. Clausen, V. Konz, S. Ewert, and C. Fremerey. A Multimodal Way of Experiencing and Exploring Music. Interdisc. Sci. Rev. (ISR), 35(2):138-153, 2010.
44. M. Müller, D. P. W. Ellis, A. Klapuri, and G. Richard. Signal Processing for Music Analysis. IEEE JSTSP, 5(6):1088-1110, 2011.
45. M. Müller and S. Ewert. Towards Timbre-Invariant Audio Features for Harmony-Based Music. IEEE TASLP, 18(3):649-662, 2010.
46. M. Müller, F. Kurth, and M. Clausen. Audio Matching via Chroma-Based Statistical Features. In Proc. ISMIR, pages 288-295, 2005.
47. S. R. Ness and G. Tzanetakis. SOMba: Multiuser music creation using Self-Organizing Maps and Motion Tracking. In Proc. ICMC, 2009.
48. S. R. Ness, T. C. Walters, and R. F. Lyon. Auditory Sparse Coding. In T. Li, M. Ogihara, and G. Tzanetakis, editors, Music Data Mining. CRC Press, 2011.
49. Nielsen. Digital music consumption and digital music access, 2011.
50. N. Orio. Music Retrieval: A Tutorial and Review. Foundations & Trends in IR, 1(1):1-90, 2006. (Pubitemid 46088691)
51. E. Pampalk, A. Flexer, and G. Widmer. Improvements of Audio-based Music Similarity and Genre Classification. In Proc. ISMIR, pages 628-633, 2005.
52. J. Paulus, M. Müller, and A. Klapuri. Audio-Based Music Structure Analysis. In Proc. ISMIR, pages 625-636, 2010.
53. T. Pavlidis. The Holy Grail of Multimedia Information Retrieval: So Close or Yet So Far Away? - An Answer. http://www.theopavlidis.com/technology/CBIR/ summaryB.htm, accessed September 2011, 2008.
54. T. Pohle, D. Schnitzer, M. Schedl, P. Knees, and G. Widmer. On Rhythm and General Music Similarity. In Proc. ISMIR, pages 525-530, 2009.
55. C. Raphael. A Probabilistic Expert System for Automatic Musical Accompaniment. J. Comp. & Graph. Stat., 10(3):487-512, 2001.
56. C. Raphael. Music Plus One and Machine Learning. In Proc. ICML, pages 21-28, 2010.
57. M. Schedl. Automatically Extracting, Analyzing, and Visualizing Information on Music Artists from the World Wide Web. PhD thesis, Johannes Kepler University, Linz, Austria, June 2008.
58. E. M. Schmidt and Y. E. Kim. Prediction of Time-Varying Musical Mood Distributions Using Kalman Filtering. In Proc. ICMLA, pages 655-660, 2010.
59. B. Schuller and F. Burkhardt. Learning with Synthesized Speech for Automatic Emotion Recognition. In Proc. ICASSP, pages 5150-5153, 2010.
60. J. Serrà, E. Gómez, P. Herrera, and X. Serra. Chroma Binary Similarity and Local Alignment Applied to Cover Song Identification. IEEE TASLP, 16:1138-1151, 2008.
61. M. Slaney. Web-Scale Multimedia Analysis: Does Content Matter? IEEE MultiMedia, 18(2):12-15, 2011.
62. A. W. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain. Content-Based Image Retrieval at the End of the Early Years. IEEE TPAMI, 22(23):1349-1380, December 2000. (Pubitemid 32088465)
63. M. Sordo, F. Gouyon, and L. Sarmento. A Method for Obtaining Semantic Facets of Music Tags. In Proc. ACM WOMRAD, 2010.
64. S. Stober. Adaptive Distance Measures for Exploration and Structuring of Music Collections. In Proc. 42nd AES Conf., pages 275-284, 2011.
65. E. Tsunoo, G. Tzanetakis, N. Ono, and S. Sagayama. Beyond Timbral Statistics: Improving Music Classification Using Percussive Patterns and Bass Lines. IEEE TASLP, 19(4):1003-1013, 2011.
66. D. Turnbull, L. Barrington, D. Torres, and G. Lanckriet. Semantic Annotation and Retrieval of Music and Sound Effects. IEEE TASLP, 16(2):467-476, 2008.
67. G. Tzanetakis and P. Cook. Musical Genre Classification of Audio Signals. IEEE T. Speech & Audio Proc., 10(5):293-302, 2002. (Pubitemid 34950067)
68. J. Urbano. Information Retrieval Meta-Evaluation: Challenges and Opportunities in the Music Domain. In Proc. ISMIR, 2011, to appear.
69. A. Wang. An Industrial Strength Audio Search Algorithm. In Proc. ISMIR, pages 7-13, 2003.
70. J. Weston, S. Bengio, and P. Hamel. Multi-Tasking with Joint Semantic Spaces for Large-Scale Music Annotation and Retrieval. J. New Music Res., 2011, to appear.
71. B. Whitman and R. Rifkin. Musical Query-By-Description as a Multiclass Learning Problem. In Proc. IEEE MMSP Workshop, pages 153-156, 2002.
72. G. A. Wiggins. Computer-Representation of Music in the Research Environment. In T. T. Crawford and L. Gibson, editors, Modern Methods for Musicology: Prospects, Proposals and Realities, pages 7-22. Ashgate, 2009.
73. G. A. Wiggins. "I let the music speak": cross-domain application of a cognitive model of musical learning. In P. Rebuschat and J. Williams, editors, Statistical Learning and Language Acquisition. Mouton De Gruyter, 2011. In press.
74. G. A. Wiggins, D. Müllensiefen, and M. T. Pearce. On the non-existence of Music: Why Music Theory is a figment of the imagination. Musicae Scientiae, Discussion Forum 5:231-255, 2010.
75. Y. Zhou, G. Percival, X. Wang, Y. Wang, and S. Zhao. MOGCLASS: Evaluation of a Collaborative System of Mobile Devices for Classroom Music Education of Young Children. In Proc. ACM CHI, pages 523-532, 2011.
76. R. Zimmermann, E. Chew, S. A. Ay, and M. Pawar. Distributed Musical Performances: Architecture and Stream Management. ACM TOMCCAP, 4(2), 2008.