Pianist motion capture with the kinect depth camera

Proceedings of the 9th Sound and Music Computing Conference, SMC 2012

Volumn , Issue , 2012, Pages

  Hadjakos, Aristotelis ^a  

^a DARMSTADT UNIVERSITY OF TECHNOLOGY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER MUSIC;

DEPTH CAMERA; DEPTH SENSING; ELECTRONIC MUSIC; MARKER TRACKING; MARKERLESS; MOTION CAPTURE; MUSIC PERFORMANCE;

CAMERAS;

EID: 84905192242     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. J. Paradiso and N. Gershenfeld, "Musical applications of electric field sensing," Computer music journal, vol. 21, no. 2, pp. 69-89, 1997.
2. N. Rasamimanana, F. Guedy, N. Schnell, J.-P. Lambert, and F. Bevilacqua, "Three pedagogical scenarios using the sound and gesture lab," in 4th i-Maestro Workshop on Technology-Enhanced Music Education, 2008.
3. R. Dannenberg, "An on-line algorithm for real-time accompaniment," in International Computer Music Conference 1984, 1984.
4. B. Vercoe, "The synthetic performer in the context of live performance," in International Computer Music Conference 1984, 1984.
5. T. Großhauser, U. Großekathöfer, and T. Hermann, "New sensors and pattern recognition techniques for string instruments," in New Interfaces for Musical Expression 2010, 2010.
6. O. Ortmann, The Physiological Mechanics of Piano Technique. K. Paul, Trench, Trubner & Co., 1929.
7. P. Hodgson, Motion study and violin bowing. London: L.H. Lavender & Co, 1934.
8. S. Nicolls, "Twenty-first century piano," in New Interfaces for Musical Expression 2009, 2009, pp. 203-206.
9. A. McPherson and Y. Kim, "Augmenting the acoustic piano with electromagnetic string actuation and continuous key position sensing," in New Interfaces for Musical Expression 2010, 2010.
10. A. Hadjakos, "Sensor-based feedback for piano pedagogy," Ph.D. dissertation, TU Darmstadt, 2011.
11. A. Hadjakos, E. Aitenbichler, and M. Mühlhäuser, "Probabilistic model of pianists' arm touch movements," in New Interfaces for Musical Expression 2009, 2009, pp. 7-12.
12. W. Goebl and C. Palmer, "Tactile feedback and timing accuracy in piano performance," Experimental Brain Research, vol. 186, no. 3, pp. 471-479, 2008.
13. S. Furuya and H. Kinoshita, "Expertise-dependent modulation of muscular and non-muscular torques in multi-joint arm movements during piano keystroke," Neurosience, vol. 156, pp. 390-402, 2008.
14. A. Menache, Understanding motion capture for computer animation and video games. Morgan Kaufmann Pub, 2000.
15. W. Goebl and C. Palmer, "Finger motion in piano performance: Touch and tempo," in International Symposium on Performance Science, ISPS 2009. European Association of Conservatoires (AEC), 2009, pp. 65-70.
16. C. Sforza, C. Macri, M. Turci, G. Grassi, and V. F. Ferrario, "Neuromuscular patterns of finger movements during piano playing. definition of an experimental protocol." Ital J Anat Embryol., vol. 108, no. 4, pp. 211-222, 2003.
17. V. F. Ferrario, C. Macri, E. Biffi, P. Pollice, and C. Sforza, "Three-dimensional analysis of hand and finger movements during piano playing," Medical Problems of Performing Artists, vol. 22, no. 1, 2007.
18. J. Shotton, A. Fitzgibbon, M. Cook, T. Sharp, M. Finocchio, R. Moore, A. Kipman, and A. Blake, "Real-time human pose recognition in parts from single depth images," in CVPR, vol. 2, 2011, p. 7.
19. D. O. Gorodnichy and A. Yogeswaran, "Detection and tracking of pianist hands and fingers," in Proc. of the The 3rd Canadian Conference on Computer and Robot Vision, 2006.
20. G. Castellano, M. Mortillaro, A. Camurri, G. Volpe, and K. Scherer, "Automated analysis of body movement in emotionally expressive piano performances," Music Perception, pp. 103-119, 2008.
21. F. Klompmaker, K. Nebe, and A. Fast, "dsensingni - a framework for advanced tangible interaction using a depth camera," in Sixth International Conference on Tangible, Embedded and Embodied interaction (TEI), 2012.
22. "http://en.wikipedia.org/wiki/kinect."
23. H. Veeger, B. Yu, K. An, and R. Rozendal, "Parameters for modeling the upper extremity," Journal of Biomechanics, vol. 30, no. 6, pp. 647-652, 1997.