A multimodal probabilistic model for gesture-based control of sound synthesis

MM 2013 - Proceedings of the 2013 ACM Multimedia Conference

Volumn , Issue , 2013, Pages 705-708

  Françoise, Jules ^a   Schnell, Norbert ^a   Bevilacqua, Frédéric ^a  

^a IRCAM   (France)

Author keywords

Gesture; Hmm; Multimodal; Music; Music performance; Sound synthesis

Indexed keywords

GESTURE; HMM; MULTI-MODAL; MUSIC; MUSIC PERFORMANCE; SOUND SYNTHESIS;

MODELS;

EID: 84887474048     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2502081.2502184     Document Type: Conference Paper

References (14)

1. F. Bevilacqua, N. Schnell, N. Rasamimanana, B. Zamborlin, and F. Gúedy. Online Gesture Analysis and Control of Audio Processing. In Musical Robots and Interactive Multimodal Systems, pages 127{142. Springer, 2011.
2. M. Brand. Voice puppetry. In Proceedings of the 26th annual conference on Computer graphics and interactive techniques, pages 21{28. 1999.
3. K. Choi, Y. Luo, and J.-n. Hwang. Hidden Markov model inversion for audio-to-visual conversion in an MPEG-4 facial animation system. The Journal of VLSI Signal Processing, 29(1):51{61, 2001.
4. R. Fiebrink, P. R. Cook, and D. Trueman. Play-along mapping of musical controllers. In In Proceedings of the International Computer Music Conference, 2009.
5. R. Fiebrink, P. R. Cook, and D. Trueman. Human model evaluation in interactive supervised learning. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 147{156. 2011.
6. S. Fu, R. Gutierrez-Osuna, A. Esposito, P. Kakumanu, and O. Garcia. Audio/visual mapping with cross-modal hidden Markov models. Multimedia, IEEE Transactions on, 7(2):243{252, Apr. 2005.
7. N. Gillian and R. Knapp. A Machine Learning Toolbox For Musician Computer Interaction. In proceedings ot the International Conference on New Interfaces for Musical Expression, Oslo, Norway, 2011.
8. G. Hofer. Speech-driven animation using multi-modal hidden Markov models. Phd dissertation, University of Edimburgh, 2009.
9. L. R. Rabiner. A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition. Proceedings of the IEEE, 77(2):257{286, 1989.
10. N. Rasamimanana, F. Bevilacqua, J. Bloit, N. Schnell, E. Fĺety, A. Cera, U. Petrevski, and J.-L. Frechin. The urban musical game: using sport balls as musical interfaces. In CHI '12 Extended Abstracts on Human Factors in Computing Systems, pages 1027{1030. 2012.
11. D. Rocchesso, S. Sera-n, F. Behrendt, N. Bernardini, R. Bresin, G. Eckel, K. Franinovic, T. Hermann, S. Pauletto, P. Susini, and Y. Visell. Sonic interaction design: Sound, information and experience. In CHI '08 Extended Abstracts on Human Factors in Computing Systems, pages 3969{3972. 2008.
12. D. Wessel and M. Wright. Problems and Prospects for Intimate Musical Control of Computers. Computer Music Journal, 26(3):11{22, Sept. 2002.
13. E. Yamamoto, S. Nakamura, and K. Shikano. Speech-to-lip movement synthesis based on the EM algorithm using audio-visual HMMs. In Multimedia Signal Processing, 1998 IEEE Second Workshop on, pages 2{5, 1998.
14. H. Zen, Y. Nankaku, and K. Tokuda. Continuous Stochastic Feature Mapping Based on Trajectory HMMs. Audio, Speech, and Language Processing, IEEE Transactions on, 19(2):417{430, 2011.