Sounds from shapes: Audiovisual performance with hand silhouette contours in the manual input sessions

Proceedings of the International Conference on New Interfaces for Musical Expression

Volumn , Issue , 2005, Pages 115-120

  Levin, Golan ^a   Lieberman, Zachary ^b  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b NEW SCHOOL FOR SOCIAL RESEARCH   (United States)

Author keywords

Audiovisual performance; Augmented reality; Computer vision; Contour analysis; Hand silhouettes; Sound image relationships

Indexed keywords

COMPUTER VISION; MUSIC;

AUDIOVISUAL PERFORMANCE; CONTOUR ANALYSIS; FREEFORMS; HAND GESTURE; HAND SILHOUETTE; IMAGE RELATIONSHIP; PERFORMANCE; SOUND IMAGE; SOUND-IMAGE RELATIONSHIP; VIDEO PROJECTORS;

AUGMENTED REALITY;

EID: 84893929198     PISSN: 22204792     EISSN: 22204806     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (11)

1. Bencina, Ross. PortAudio sound synthesis library. http://www.portaudio.com/.
2. Da Fontoura Costa, L. et al. Shape Analysis and Classification: Theory and Practice. CRC Press, 2000.
3. Krueger, M. Artificial Reality II. Addison-Wesley, 1991.
4. Levin, G. “Painterly Interfaces for Audiovisual Performance.” M.S. Thesis, MIT Media Laboratory, August 2000. http://acg.media.mit.edu/people/golan/thesis/.
5. Levin, G. and Lieberman, Z. “In-Situ Speech Visualization in Real-Time Interactive Installation and Performance.” Proc. 3rd International Symposium on Non-Photorealistic Animation and Rendering, Annecy, France, 2004.
6. Lyons, M., Haehnel, M., and Tetsutani, N. “The Mouthesizer: A Facial Gesture Musical Interface.” Conference Abstracts, Siggraph 2001, Los Angeles, p. 230.
7. Manovich, Lev. The Language of New Media. MIT Press, 2001.
8. Axel G.E. Mulder, S. Sidney Fels and Kenji Mase. “Design of Virtual 3D Instruments for Musical Interaction.” Proceedings of Graphics Interface ‘99, (Kingston, ON, Canada, 2-4 June 1999, S. Mackenzie and J. Stewart (eds.)) pp. 76-83, Toronto, ON, Canada: University of Toronto.
9. O'Brien, J., Cook, P., and Essl, G. “Synthesizing Sounds from Physically Based Motion.” The proceedings of ACM Siggraph 2001, Los Angeles, California, pp. 529-536.
10. Piernot, P., Vescovi, M., Cohen, J., Levin, G., et al. “Video camera based computer input system with interchangeable physical interface” (A modular tabletop surface for use with computer-vision-based children's games). US Pats. 5953686 and 6047249. Filed 7 July 1996, issued 4 April 2000.
11. Pope, Stephen et. al. CREATE Signal Library (CSL). http://www.create.ucsb.edu/mailman/listinfo/csl.