The "One-Person Choir": A multidisciplinary approach to the development of an embodied human-computer interface

Computer Music Journal

Volumn 35, Issue 2, 2011, Pages 22-35

  Maes, Pieter Jan ^a   Leman, Marc ^a   Kochman, Katty ^a   Lesaffre, Micheline ^a   Demey, Michiel ^a  

^a GHENT UNIVERSITY   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

COMPLEX STRUCTURE; GESTURAL CONTROL; HUMAN COMPUTER INTERFACES; INERTIAL MOTIONS; MAPPING PROBLEM; MULTI-DISCIPLINARY APPROACH; REAL TIME; RIGID BODY; UPPER ARM; UPPER LIMBS;

ACCELEROMETERS; SENSORS; SIGNAL PROCESSING; THREE DIMENSIONAL;

USER INTERFACES;

EID: 79957623885     PISSN: 01489267     EISSN: 15315169     Source Type: Journal    
DOI: 10.1162/COMJ_a_00054     Document Type: Article

References (45)

1. Barsalou, L.W., et al. 2003. "Social Embodiment." In B. H. Ross, ed. The Psychology of Learning and Motivation. San Diego, California: Academic Press, pp. 43-92. (Pubitemid 137639573)
2. Beaudouin-Lafon, M. 2004. "Designing Interaction, Not Interfaces." In Proceedings of the Working Conference on Advanced Visual Interfaces, pp. 15-22.
3. Camurri, A., et al. 2001. "A Multi-Layered Conceptual Framework for Expressive Gesture Applications" In Proceedings of the MOSART Workshop on Current Research Directions in Computer Music, pp. 29- 34.
4. Camurri, A., et al. 2004. "Multimodal Analysis of Expressive Gesture inMusic and Dance Performances." In A. Camurri and G. Volpe, eds. Gesture-Based Communication in Human-Computer Interaction. Berlin: Springer Verlag, pp. 20-39. (Pubitemid 38285426)
5. Camurri, A., et al. 2005. "Communicating Expressiveness and Affect in Multimodal Interactive Systems." IEEE Multimedia, 12(1):43-53. (Pubitemid 40351838)
6. Camurri, A., I. Lagerlöf, and G. Volpe. 2003. "Recognizing Emotion from Dance Movement: Comparison of Spectator Recognition and Automated Techniques." International Journal of Human-Computer Studies, 59(1-2):213-225.
7. Cook, P. R. 2005. "Real-Time Performance Controllers for Synthesized Singing." In Proceedings of the International Conference on New Interfaces for Musical Expression, pp. 236-237.
8. D'Alessandro, N., et al. 2006. "Real-Time Calm Synthesizer: New Approaches in Hands-Controlled Voice Synthesis." In Proceedings of the International Conference on New Interfaces for Musical Expression, pp. 266-271.
9. D'Alessandro, N., et al. 2007. "Realtime and Accurate Musical Control of Expression in Singing Synthesis." Journal on Multimodal User Interfaces 1(1):31-39.
10. Davidson, J. W. 1994. "What Type of Information Is Conveyed in the Body Movements of Solo Musician Performers." Journal of Human Movement Studies 26(6):279-301.
11. Davidson, J. W. 2001. "The Role of the Body in the Production and Perception of Solo Vocal Performance: A Case Study of Annie Lennox." Musicae Scientiae 5(2):235-256.
12. Di Scipio, A. 2003. "'Sound Is the Interface': From Interactive to Ecosystemic Signal Processing." Organised Sound 8(3):269-277.
13. Di Scipio, A. 2005. "Due Di Uno: A Composition Dedicated to Horacio Vaggione." Contemporary Music Review 24(4):383-397.
14. Farne, A., M. L. Dematte, and E. Ladavas. 2005. "Neuropsychological Evidence of Modular Organization of the near Peripersonal Space." Neurology 65(11):1754-1758.
15. Godøy, R. I., and M. Leman. 2010. Musical Gestures: Sound, Movement, and Meaning.New York: Routledge.
16. Goldin, D., S. Smolka, and P.Wegner, eds. 2006. Interactive Computation: The New Paradigm. London: Springer.
17. Grudin, J. 1990. "The Computer Reaches Out: The Historical Continuity of Interface Design." In Proceedings of the SIGCHI 1990 Human Factors in Computing Systems Conference, pp. 261-268.
18. Hewitt, D., and I. Stevenson. 2003. "E-Mic: Extended Mic-Stand Interface Controller." In Proceedings of the International Conference on New Interfaces for Musical Expression, pp. 122-128.
19. Huyghe, B., J. Doutreloigne, and J. Vanfleteren. 2009. "Design of Flexible, Low-Power and Wireless Sensor Nodes for Human Posture Tracking Aiding Epileptic Seizure Detection." In Proceedings of the Annual IEEE Conference on Sensors, pp. 1963-1966.
20. Jellema, T., and D. I. Perrett. 2006. "Neural Representations of Perceived Bodily Actions Using a Categorical Frame of Reference." Neuropsychologia 44(9):1535-1546. (Pubitemid 43849857)
21. Kessous, L. 2004. "Gestural Control of Singing Voice, a Musical Instrument." In Proceedings of the Sound and Music Computing Conference. Available on-line at smcnetwork.org/node/1040. Accessed January 2011.
22. Kleinsmith, A., T. Fushimi, and N. Bianchi-Berthouze. 2005. "An Incremental and Interactive Affective Posture Recognition System." In International Workshop on Adapting the Interaction Style to Affective Factors. Available on-line at www.di.uniba.it/intint/UM05/ list-ws-um05.html. Accessed January 2011.
23. Knapp, R. B., and P. R. Cook. 2006. "Creating a Network of Integral Music Controllers." In Proceedings of the International Conference on New Interfaces for Musical Expression, pp. 124-128.
24. Kuyken, B., et al. 2008. "The Hop Sensor:WirelessMotion Sensor." In Proceedings of the International Conference on New Interfaces for Musical Expression, pp. 229-231.
25. Laban, R. 1963. Modern Educational Dance. London: MacDonald and Evans.
26. Laban, R., and F. C. Lawrence. 1967. Effort. London: Macdonald and Evans.
27. Leman, M. 2007. Embodied Music Cognition and Mediation Technology. Cambridge, Massachusetts: MIT Press.
28. Leman, M. 2008. "Emcometecca Project." Available online at www.ipem.ugent.be/?q=EmcoMetecca. Accessed January 2011.
29. Leman, M., and A. Camurri. 2006. "Understanding Musical Expressiveness Using Interactive Multimedia Platforms." Musicae Scientiae 10(1):209-234.
30. Liao, M. Y. 2008. "The Effects of Gesture Use on Young Children's Pitch Accuracy for Singing Tonal Patterns." International Journal of Music Education 26(3):197-211.
31. Luck, G., and P. Toiviainen. 2008. "Exploring Relationships between the Kinematics of a Singer's Body Movement and the Quality of Their Voice." Journal of Interdisciplinary Music Studies 2(1-2):173-186.
32. Maes, P.-J., et al. 2010. "From Expressive Gesture to Sound: The Development of an Embodied Mapping Trajectory inside a Musical Interface." Journal on Multimodal User Interfaces 3(1-2):67-78.
33. McGinley, H., R. LeFevre, and P. McGinley. 1975. "The Influence of a Communicator's Body Position on Opinion Change in Others." Journal of Personality and Social Psychology 31 (4):686-690.
34. McNeill, D. 2005. Gesture and Thought. Chicago: University of Chicago Press.
35. Mehrabian, A., and J. T. Friar. 1969. "Encoding of Attitude by a Seated Communicator Via Posture and Position Cues." Journal of Consulting and Clinical Psychology 33(3):330-336.
36. Meric, R., and M. Solomos. 2009. "Audible Ecosystems and Emergent Sound Structures in Di Scipio's Music. Music Philosophy Helps Musical Analysis." Journal of Interdisciplinary Music Studies 3(1-2):57-76.
37. Morganti, F. 2008. "What Intersubjectivity Affords: Paving the Way for a Dialogue between Cognitive Science, Social Cognition and Neuroscience." In F. Morganti, A. Carassa, and G. Riva, eds. Enacting Intersubjectivity: A Cognitive and Social Perspective on the Study of Interactions. Amsterdam: IOS Press, pp. 3-16.
38. Pérez, M. A. O., B. Knapp, andM. Alcorn. 2007. "Díamair: Composing for Choir and Integral Music Controller." In Proceedings of the International Conference on New Interfaces for Musical Expression, pp. 289-292.
39. Siegel, W., and J. Jacobsen. 1998. "The Challenges of Interactive Dance: An Overview and Case Study." Computer Music Journal 22(4):29-43. (Pubitemid 128455407)
40. Vaggione, H. 2001. "Some Ontological Remarks About Music Composition Processes." Computer Music Journal 25(1):54-61. (Pubitemid 33593195)
41. Wegner, P. 1997. "Why Interaction Is More Powerful Than Algorithms." Communications of the ACM 40 (5):80-91. (Pubitemid 127442927)
42. Wong, E. L. 2009. "Augmenting Media Performance with Interactive Technology." Proceedings of the Generative Art Conference, pp. 283-293.
43. Yonezawa, T., et al. 2005. "Handysinger: Expressive Singing Voice Morphing Using Personified Hand- Puppet Interface." In Proceedings of the International Conference on New Interfaces for Musical Expression, pp. 121-126.
44. Yonezawa, T., et al. 2006. "Cross-Modal Coordination of Expressive Strength between Voice and Gesture for Personified Media." In Proceedings of the International Conference on Multimodal Interaction, pp. 43-50. (Pubitemid 47113427)
45. Young, A. D., M. J. Ling, and D. K. Arvind. 2007. "Orient- 2: A Realtime Wireless Posture Tracking System Using Local Orientation Estimation." In Proceedings of EmNets, pp. 53-57.