Phalanger: Controlling music software with hand movement using a computer vision and machine learning approach

Proceedings of the International Conference on New Interfaces for Musical Expression

Volumn , Issue , 2009, Pages 246-249

  Kiefer, Chris ^a   Collins, Nick ^a   Fitzpatrick, Geraldine ^a  

^a UNIVERSITY OF SUSSEX   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; MUSIC; WEARABLE TECHNOLOGY;

BACKGROUND SEGMENTATION; FINGER MOTION; FRAME ANALYSIS; HAND MOTION; HANDS MOVEMENT; HANDS POSITIONS; MACHINE LEARNING APPROACHES; NEURAL-NETWORKS; SUPPORT VECTORS MACHINE; VISION LEARNING;

SUPPORT VECTOR MACHINES;

EID: 78650078178     PISSN: 22204792     EISSN: 22204806     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (16)

1. Ankur Agarwal, Shahram Izadi, Manmohan Chandraker, and Andrew Blake. High precision multi-touch sensing on surfaces using overhead cameras. In Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer System, 2007.
2. Newton Armstrong. An Enactive Approach to Digital Musical Instrument Design. PhD thesis, Princeton University, 2006.
3. Olav W. Bertelsen, Morten Breinbjerg, and Søren Pold. Instrumentness for creativity mediation, materiality & metonymy. In C&C ’07: Proceedings of the 6th ACM SIGCHI conference on Creativity & cognition, pages 233– 242, New York, NY, USA, 2007. ACM.
4. Anne-Marie Burns and Marcelo M. Wanderley. Visual methods for the retrieval of guitarist fingering. In NIME ’06: Proceedings of the 2006 conference on New interfaces for musical expression, pages 196–199, Paris, France, France, 2006. IRCAM — Centre Pompidou.
5. Antonio Camurri, Paolo Coletta, Giovanna Varni, and Simone Ghisio. Developing multimodal interactive systems with eyesweb xmi. In NIME ’07: Proceedings of the 7th international conference on New interfaces for musical expression, pages 305–308, New York, NY, USA, 2007. ACM.
6. Chih-Chung Chang and Chih-Jen Lin. LIBSVM: a library for support vector machines, 2001. Software available at http://www.csie.ntu.edu.tw/˜cjlin/libsvm.
7. David Forsyth and Jean Ponce. Computer Vision: A Modern Approach. Prentice Hall, 2003.
8. Don Ihde. Technologies–musics–embodiments. Janus Head, 2007.
9. Sergi Jordà, Günter Geiger, Marcos Alonso, and Martin Kaltenbrunner. The reactable: exploring the synergy between live music performance and tabletop tangible interfaces. In TEI ’07: Proceedings of the 1st international conference on Tangible and embedded interaction, pages 139– 146, New York, NY, USA, 2007. ACM.
10. Aamer Mohamed, Ying Weng, Jianmin Jiang, and Stan Ip-son. Face detection based neural networks using robust skin color segmentation. Systems, Signals and Devices, 2008. IEEE SSD 2008. 5th International Multi-Conference on, pages 1–5, July 2008.
11. Kia Ng and Paolo Nesi. i-maestro framework and interactive multimedia tools for technology-enhanced learning and teaching for music. Automated solutions for Cross Media Content and Multi-channel Distribution, 2008. AXMEDIS ’08. International Conference on, pages 266–269, Nov. 2008.
12. K. Oka, Y. Sato, and H. Koike. Real-time fingertip tracking and gesture recognition. IEEE Computer Graphics and Applications, 22(6):64–71, 2002.
13. Jennifer Preece, Yvonne Rogers, and Helen Sharp. Interaction Design: Beyond Human Computer Interaction. Wiley, 2002.
14. P. Premaratne and Q. Nguyen. Consumer electronics control system based on hand gesture moment invariants. Computer Vision, IET, 1(1):35–41, March 2007.
15. David Toop. Replicant: On dub. In Audio Culture: Readings In Modern Music. Continuum Books, 2002.
16. Hailing Zhou, Lijun Xie, and Xuliang Fang. Visual mouse: Sift detection and pca recognition. In International Conference on Computational Intelligence and Security, 2007.