A multimodal way of experiencing and exploring music

Interdisciplinary Science Reviews

Volumn 35, Issue 2, 2010, Pages 138-153

  Müller, Meinard ^a   Konz, Verena ^a   Clausen, Michael ^b   Ewert, Sebastian ^b   Fremerey, Christian ^b  

^a SAARLAND UNIVERSITY   (Germany)

^b UNIVERSITY OF BONN   (Germany)

Author keywords

ALIGNMENT; MULTIMODALITY; SYNCHRONIZATION; USER INTERFACES

Indexed keywords

MULTI-MODALITY; MUSIC COLLECTION; MUSIC REPRESENTATION; MUSIC SYNCHRONIZATIONS; MUSIC UNDERSTANDING; SEMANTIC RELATIONSHIPS; SYMBOLIC DATA; SYNCHRONIZATION TECHNIQUE;

ALIGNMENT; SEMANTICS; SYNCHRONIZATION; USER INTERFACES;

AUDIO ACOUSTICS;

EID: 77958536445     PISSN: 03080188     EISSN: 17432790     Source Type: Journal    
DOI: 10.1179/030801810X12723585301110     Document Type: Article

References (30)

1. Arifi, Vlora, Michael Clausen, Frank Kurth, and Meinard Müller. 2004. Synchronization of music data in score-, MIDI- and PCM-format. Computing in Musicology 13: 9-33.
2. Bello, Juan Pablo, Laurent Daudet, Samer Abdallah, Chris Duxbury, Mike Davies, and Mark B. Sandler. 2005. A tutorial on onset detection in music signals. IEEE Transactions on Speech and Audio Processing 13(5): 1035-47.
3. Brown, Andrew. 1999. Music, media and making: humanising digital media in music education. International Journal of Music Education 33(1): 10-7.
4. Brown, Andrew. 2007. Computers in Music Education. London: Routledge.
5. Bartsch, Mark A., and Gregory H. Wakefield. 2005. Audio thumbnailing of popular music using chroma-based representations. IEEE Transactions on Multimedia 7(1): 96-104.
6. Dunn, Jon W., Donald Byrd, Mark Notess, Jenn Riley, and Ryan Scherle. 2006. Variations2: Retrieving and using music in an academic set ing. Communications of the ACM, Special Issue 49(8): 53-48.
7. Dannenberg, Roger, and Ning Hu. 2003. Polyphonic audio matching for score following and intelligent audio editors. Proceedings of the ICMC, San Francisco, USA, 27-34.
8. Dixon, Simon. 2007. Evaluation of the audio beat tracking system Beat Root. Journal of New Music Research 36: 39-50.
9. Dannenberg, Roger, and Christopher Raphael. 2006. Music score alignment and computer accompaniment. Communications of the ACM, Special Issue 49(8): 39-43.
10. Dixon, Simon, and Gerhard Widmer. 2005. MATCH: A music alignment tool chest. Proceedings of the ISMIR, London, GB, 492-7.
11. Fujihara, Hiromasa, Masataka Goto, Jun Ogata, Kazunori Komatani, Tetsuya Ogata, and Hiroshi G. Okuno. 2006. Automatic synchronization between lyrics and music CD recordings based on Viterbi alignment of segregated vocal signals. Proceedings of the Eighth IEEE International Symposium on Multimedia, 257-64.
12. Fremerey, Christian, Frank Kurth, Meinard Müller, and Michael Clausen. 2007. A demonstration of the Sync Player system. Proceedings of the ISMIR, Vienna, Austria, 131-2.
13. Fremerey, Christian, Meinard Müller, Frank Kurth, and Michael Clausen. 2008. Automatic mapping of scanned sheet music to audio recordings. Proceedings of the ISMIR, Philadelphia, USA, 413-8.
14. Klapuri, Anssi, and Manuel Davy. 2006. Signal processing methods for music transcription. Springer.
15. Kurth, Frank, David Damm, Christian Fremerey, Meinard Müller, and Michael Clausen. 2008. A framework for managing multimodal digitised music collections. Proceedings of the 12th European Conference on Research and Advanced Technology for Digital Libraries (ECDL), 334-45.
16. Kurth, Frank, Meinard Müller, Christian Fremerey, Yoon-Ha Chang, and Michael Clausen. 2007. Automated synchronization of scanned sheet music with audio recordings. Proceedings of the ISMIR, Vienna, Austria, 261-6.
17. Kiraly, Zsuzsanna. 2003. Solfeggio 1: a vertical ear training instruction assisted by the computer. International Journal of Music Education 40(1): 41-58.
18. Langner, Jörg, and Werner Goebl. 2003. Visualizing expressive performance in tempo-loudness space. Computer Music Journal 27(4): 69-83.
19. Müller, Meinard, Frank Kurth, David Damm, Christian Fremerey, and Michael Clausen. 2007. Lyrics-based audio retrieval and multimodal navigation in music collections. Proceedings of the 11th European Conference on Digital Libraries (ECDL), 112-23.
20. Müller, Meinard, Frank Kurth, and Tido Röder. 2004. Towards an effi cient algorithm for automatic score-to-audio synchronization. Proceedings of the ISMIR, Barcelona, Spain, 365-72.
21. Müller, Meinard, Henning Mat es, and Frank Kurth. 2006. An effi cient multiscale approach to audio synchronization. Proceedings of the ISMIR, Victoria, Canada, 192-7.
22. Müller, Meinard. 2007. Information retrieval for music and motion. Springer.
23. Raphael, Christopher. 2004. A hybrid graphical model for aligning polyphonic audio with musical scores. Proceedings of the ISMIR, Barcelona, Spain, 387-94.
24. Sapp, Craig Stuart. 2007. Comparative analysis of multiple musical performances. Proceedings of the ISMIR, Vienna, Austria, 497-500.
25. Smith, Kenneth H. 2009. The eff ect of computer-assisted instruction and field independence on the development of rhythm sight-reading skills of middle school instrumental students. International Journal of Music Education 27(1): 59-68.
26. Soulez, Ferréol, Xavier Rodet, and Diemo Schwarz. 2003. Improving polyphonic and poly-instrumental music to score alignment. Proceedings of the ISMIR, Baltimore, USA, 143-148.
27. Stevens, Robin S. 1991. The best of both worlds: An eclectic approach to the use of computer technology in music education. International Journal of Music Education 17(1): 24-36.
28. Turetsky, Robert J., and Daniel P. W. Ellis. 2003. Ground-truth transcriptions of real music from force-aligned MIDI syntheses. Proceedings of the ISMIR, Baltimore, USA, 135-141.
29. Widmer, Gerhard, Simon Dixon, Werner Goebl, Elias Pampalk, and Asmir Tobudic. 2003. In search of the Horowitz factor. AI Magazine 24(3): 111-30.
30. Wang, Ye, Min-Yen Kan, Tin Lay Nwe, Arun Shenoy, and Jun Yin. Lyric Ally: automatic synchronization of acoustic musical signals and textual lyrics. In MULTIMEDIA '04: Proceedings of the 12th annual ACM international conference on multimedia, 212-219. New York, NY, USA: ACM Press.