Visual associations in augmented keyboard performance

Proceedings of the International Conference on New Interfaces for Musical Expression

Volumn , Issue , 2013, Pages 252-255

  Yang, Qi ^a   Essl, Georg ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

Author keywords

Augmented keyboard; Gesture; Interaction; Kinect; Musical instrument; NIME; Visual feedback

Indexed keywords

MUSIC; VISUAL COMMUNICATION;

AUGMENTED KEYBOARD; DESIGN FACTORS; GESTURE; INTERACTION; KINECT; LOCUS OF ATTENTIONS; NIME; PERFORMANCE; VISUAL FEEDBACK;

ASSOCIATION REACTIONS;

EID: 84919912944     PISSN: 22204792     EISSN: 22204806     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (14)

1. A.-M. Bonnel and E. R. Haftser. Divided attention between simultaneous auditory and visual signals. Attention, Perception, & Psychophysics, 60(2):179–190, 1998.
2. W. Brent. The gesturally extended piano. Proceedings of the International Conference on New Interfaces for Musical Expression (NIME), 2012.
3. P. L. Davidson and J. Y. Han. Synthesis and control on large scale multi-touch sensing displays. In Proceedings of the International Conference on New Interfaces for Musical Expression (NIME), pages 216–219, Paris, France, France, 2006.
4. G. Essl and S. O’Modhrain. An enactive approach to the design of new tangible musical instruments. Organised Sound, 11(03):285–296,2006.
5. D. Gorodnichy and A. Yogeswaran. Detection and tracking of pianist hands and fingers. In Proceedings of the Canadian Conference on Computer and Robot Vision, 2006.
6. A. Hadjakos. Pianist Motion Capture with the Kinect Depth Camera. In Proceedings of the International Conference on Sound and Music Computing, Copenhagen, Denmark, 2012.
7. R. Hamilton, J. Smith, and G. Wang. Social Composition: Musical Data Systems for Expressive Mobile Music. Leonardo Music Journal, 21(21):57–64, 2011.
8. J. Y. Han. Low-cost multi-touch sensing through frustrated total internal reflection. In Proceedings of the 18th annual ACM symposium, pages115–118, New York, 2005.
9. S. Jordà. Sonigraphical instruments: from FMOL to the reacTable. In Proceedings of the International Conference on New Interfaces for Musical Expression (NIME), pages 70–76, 2003.
10. G. Levin and Z. Lieberman. Sounds from shapes: audiovisual performance with hand silhouette contours in the manual input sessions. In Proceedings of the International Conference on New Interfaces for Musical Expression (NIME), pages 115–120, Singapore, Singapore, 2005. National University of Singapore.
11. E. Miranda and M. Wanderley. New digital musical instruments: control and interaction beyond the keyboard, volume 21. AR Editions, Inc., 2006.
12. Y. Takegawa, T. Terada, and M. Tsukamoto. Design and implementation of a piano practice support system using a real-time fingering recognition technique. In Proceedings of the International Computer Music Conference (ICMC), pages 387–394, University of Huddersfield, UK, 2011.
13. J. Wagemans, J. Elder, M. Kubovy, S. Palmer, M. Peterson, M. Singh, and R. von der Heydt. A Century of Gestalt Psychology in Visual Perception: I. and II. . Psychological Bulletin, 138(6):1172–1217, 1218–1252, 2012.
14. Q. Yang and G. Essl. Augmented piano performance using a depth camera. In Proceedings of the International Conference on New Interfaces for Musical Expression (NIME), Ann Arbor, May 2012.