Analyzing sound tracings - A multimodal approach to music information retrieval

MM'11 - Proceedings of the 2011 ACM Multimedia Conference and Co-Located Workshops - MIRUM 2011 Workshop, MIRUM'11

Volumn , Issue , 2011, Pages 39-44

  Nymoen, Kristian ^a   Caramiaux, Baptiste ^b   Kozak, Mariusz ^c   Torresen, Jim ^a  

^a UNIVERSITY OF OSLO   (Norway)

^b CNRS   (France)

^c UNIVERSITY OF CHICAGO   (United States)

Author keywords

Canonical Correlation Analysis; Cross modal analysis; Sound tracing

Indexed keywords

CANONICAL CORRELATION ANALYSIS; CROSS-MODAL; DATA SETS; MULTI-MODAL APPROACH; MUSIC INFORMATION RETRIEVAL;

MODAL ANALYSIS;

INFORMATION RETRIEVAL;

EID: 84555189859     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2072529.2072541     Document Type: Conference Paper

References (17)

1. A. Camurri, I. Lagerlöf, and G. Volpe. Recognizing emotion from dance movement: comparison of spectator recognition and automated techniques. International Journal of Human-Computer Studies, 59(1):213-225, 2003.
2. B. Caramiaux, F. Bevilacqua, and N. Schnell. Towards a gesture-sound cross-modal analysis. In S. Kopp and I. Wachsmuth, editors, Gesture in Embodied Communication and Human-Computer Interaction, volume 5934 of LNCS, pages 158-170. Springer Berlin / Heidelberg, 2010.
3. B. Caramiaux, F. Bevilacqua, and N. Schnell. Sound selection by gestures. In New Interfaces for Musical Expression, pages 329-330, Oslo, Norway, 2011.
4. J. Chen, V. Penhune, and R. Zatorre. Moving on time: Brain network for auditory-motor synchronization is modulated by rhythm complexity and musical training. Cerebral Cortex, 18:2844-2854, 2008.
5. Z. Eitan and R. Y. Granot. How music moves: Musical parameters and listeners' images of motion. Music Perception, 23(3):pp. 221-248, 2006.
6. R. I. Godøy. Gestural-sonorous objects: Embodied extensions of Schaeffer's conceptual apparatus. Organised Sound, 11(2):149-157, 2006.
7. R. I. Godøy, E. Haga, and A. R. Jensenius. Exploring music-related gestures by sound-tracing. A preliminary study. In 2nd ConGAS Int. Symposium on Gesture Interfaces for Multimedia Systems, Leeds, UK, 2006.
8. R. I. Godøy and A. R. Jensenius. Body movement in music information retrieval. In International Society for Music Information Retrieval Conference, pages 45-50, Kobe, Japan, 2009.
9. J. F. Hair, W. C. Black, B. J. Babin, and R. E. Anderson. Multivariate Data Analysis. Prentice Hall, New Jersey, USA, February, 2009.
10. G. Luck and P. Toiviainen. Ensemble musicians' synchronization with conductors' gestures: An automated feature-extraction analysis. Music Perception, 24(2):189-200, 2006.
11. J. MacRitchie, B. Buch, and N. J. Bailey. Visualising musical structure through performance gesture. In International Society for Music Information Retrieval Conference, pages 237-242, Kobe, Japan, 2009.
12. A. Merer, S. Ystad, R. Kronland-Martinet, and M. Aramaki. Semiotics of sounds evoking motions: Categorization and acoustic features. In R. Kronland-Martinet, S. Ystad, and K. Jensen, editors, Computer Music Modeling and Retrieval. Sense of Sounds, volume 4969 of LNCS, pages 139-158. Springer Berlin / Heidelberg, 2008.
13. N. Misdariis, A. Minard, P. Susini, G. Lemaitre, S. McAdams, and P. Etienne. Environmental sound perception: Metadescription and modeling based on independent primary studies. EURASIP Journal on Audio, Speech, and Music Processing, 2010.
14. B. Nettl. An ethnomusicologist contemplates universals in musical sound and musical culture. In N. Wallin, B. Merker, and S. Brown, editors, The Origins of Music, pages 463-472. Cambridge, Mass: MIT Press, 2000.
15. K. Nymoen, K. Glette, S. A. Skogstad, J. Torresen, and A. R. Jensenius. Searching for cross-individual relationships between sound and movement features using an SVM classifier. In New Interfaces for Musical Expression, pages 259-262, Sydney, Australia, 2010.
16. P. Susini, S. McAdams, S. Winsberg, I. Perry, S. Vieillard, and X. Rodet. Characterizing the sound quality of air-conditioning noise. Applied Acoustics, 65(8):763-790, 2004.
17. D. van Nort. Instrumental listening: Sonic gesture as design principle. Organised Sound, 14(02):177-187, 2009.