Gesture - Sound mapping by demonstration in interactive music systems

MM 2013 - Proceedings of the 2013 ACM Multimedia Conference

Volumn 2013-January, Issue , 2013, Pages 1051-1054

  Françoise, Jules ^a  

^a IRCAM   (France)

Author keywords

gesture; hierarchical modeling; hmm; mapping; multimodal; music performance; sound synthesis

Indexed keywords

COMPUTER MUSIC; HIERARCHICAL SYSTEMS; MUSIC;

GESTURE; HIERARCHICAL MODEL; HMM; INTERACTIVE MUSIC SYSTEMS; MULTI-MODAL; MULTIMODAL MODELS; MUSIC PERFORMANCE; ORTHOGONAL MODELS; PROBABILISTIC MODELS; SOUND-SYNTHESIS;

MAPPING;

EID: 85009939300     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2502081.2502214     Document Type: Conference Paper

References (13)

1. F. Bevilacqua, N. Schnell, N. Rasamimanana, B. Zamborlin, and F. Guedy. Online Gesture Analysis and Control of Audio Processing. In Musical Robots and Interactive Multimodal Systems, pages 127-142. Springer, 2011.
2. F. Bevilacqua, B. Zamborlin, A. Sypniewski, N. Schnell, F. Guedy, and N. Rasamimanana. Continuous realtime gesture following and recognition. Gesture in Embodied Communication and Human-Computer Interaction, pages 73-84, 2010.
3. A. Billard, S. Calinon, R. Dillmann, and S. Schaal. Robot programming by demonstration. Handbook of robotics, 1, 2008.
4. K. Choi, Y. Luo, and J.-n. Hwang. Hidden Markov model inversion for audio-to-visual conversion in an MPEG-4 facial animation system. The Journal of VLSI Signal Processing, 29(1):51-61, 2001.
5. R. Fiebrink, P. R. Cook, and D. Trueman. Play-along mapping of musical controllers. In In Proceedings of the International Computer Music Conference, 2009.
6. J. Francoise, B. Caramiaux, and F. Bevilacqua. A Hierarchical Approach for the Design of Gesture-to-Sound Mappings. In Proceedings of the 9th Sound and Music Computing Conference, pages 233-240, Copenhagen, Denmark, 2012.
7. J. Francoise, N. Schnell, and F. Bevilacqua. A Multimodal Probabilistic Model for Gesture-based Control of Sound Synthesis. In Proceedings of the 21st ACM international conference on Multimedia (MM'13), Barcelona, Spain, 2013.
8. S. Fu, R. Gutierrez-Osuna, A. Esposito, P. Kakumanu, and O. Garcia. Audio/visual mapping with cross-modal hidden Markov models. Multimedia, IEEE Transactions on, 7(2):243-252, Apr. 2005.
9. N. Gillian and R. Knapp. A Machine Learning Toolbox For Musician Computer Interaction. In proceedings of the International Conference on New Interfaces for Musical Expression, Oslo, Norway, 2011.
10. P. Modler. Neural Networks for Mapping Hand Gestures to Sound Synthesis parameters. Trends in Gestural Control of Music, pages 301-314, 2000.
11. N. Rasamimanana, F. Bevilacqua, J. Bloit, N. Schnell, E. Flety, A. Cera, U. Petrevski, and J.-L. Frechin. The urban musical game: using sport balls as musical interfaces. In CHI '12 Extended Abstracts on Human Factors in Computing Systems, pages 1027-1030, Austin, Texas, USA, 2012.
12. D. Rocchesso, S. Serafin, F. Behrendt, N. Bernardini, R. Bresin, G. Eckel, K. Franinovic, T. Hermann, S. Pauletto, P. Susini, and Y. Visell. Sonic interaction design: sound, information and experience. In CHI '08 Extended Abstracts on Human Factors in Computing Systems, pages 3969-3972, 2008.
13. H. Zen, Y. Nankaku, and K. Tokuda. Continuous Stochastic Feature Mapping Based on Trajectory HMMs. Audio, Speech, and Language Processing, IEEE Transactions on, 19(2):417-430, 2011.