Cross-modal coordination of expressive strength between voice and gesture for personified media

ICMI'06: 8th International Conference on Multimodal Interfaces, Conference Proceeding

Volumn , Issue , 2006, Pages 43-50

  Yonezawa, Tomoko ^a,c   Suzuki, Noriko ^b,d   Abe, Shinji ^b,c   Mase, Kenji ^a   Kogure, Kiyoshi ^b,e  

^a NAGOYA UNIVERSITY   (Japan)

^b ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

^c ATR MIS   (Japan)

^d NiCT / ATR CIS   (Japan)

^e ATR KSL   (Japan)

Author keywords

Cross modality; Perceptual experiment; Personified puppet interface; Vocal gestural expression

Indexed keywords

CROSS-MODALITY; PERCEPTUAL EXPERIMENTS; PERSONIFIED PUPPET-INTERFACES; VOCAL-GESTURAL EXPRESSION;

GESTURE RECOGNITION; MODAL ANALYSIS; SENSORY PERCEPTION; SPEECH RECOGNITION;

USER INTERFACES;

EID: 34547162333     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1180995.1181006     Document Type: Conference Paper

References (18)

1. J. Bates. The role of emotion in believable agents. Communications of the ACM, pages 122-126, 1994.
2. T. W. Bickmore and J. Cassell. Small talk and conversational storytelling in embodied conversational interface agent. AAAI fall symposium on narrative intelligence, pages 87-92, 1999.
3. J. Cassell, J. Sullivan, S. Prevost, and E. Churchill. Embodied Conversational Agents. MIT Press, 2000.
4. T. Chen and R. R. Rao. Audio-visual integration in multimodal communication. Proc. IEEE, 86(5):837-852, 1998.
5. B. Duffy. Anthropomorphism and the social robot. IEEE/RSJ International Conference on Intelligent Robots and Systems, 2002.
6. M. Fujita and K. Kageyama. An open architecture for robot entertainment. Proc. the First International Conference on Autonomous Agents, pages 435-442, 1997.
7. M. Imai, T. Ono, and T. Etani. Attractive interface for human robot interaction. Proc. of 8th IEEE International Workshop on Robot and Human Communication (ROMAN'99), pages 124-129, 1999.
8. S. Iwamiya. Multimodal communication by music and motion picture. Proc. of 7th International Conference on Music Perception and Cognition, pages 3-8, 2002.
9. H. Kawahara, I. Masuda-Kasuse, and A. Cheveigne. Restructuring speech representations using a pitch-adaptive time-frequency smoothing and an instantaneous-frequency-based f0 extraction: Possible role of a reptitive structure in sounds. Speech Communication, 27:187-207, 1999.
10. H. Kawahara and H. Matsui. Auditory morphing based on an elastic perceptual distance metric in an interference-free time-frequency representation. Proc. ICASSP'2003, I:256-259, 2003.
11. H. Mcgurk and M. Lewis. Space perception in early infancy: perception within a common auditory-visual space. Science, 186:649-650, 1974.
12. S. M. Puckette. "pure data". Proc. ICMC1997, pages 224-227, 1997.
13. D. Sekiguchi, M. Inami, and S. Tachi. Robotphone: Rui for interpersonal communication. CHI2001 Extended Abstracts, pages 277-278, 2001.
14. Y. Sogabe, K. Kakehi, and H. Kawahara. Psychological evaluation of emotional speech using a, new morphing method. 4th ICCS International Conference on Cognitive Science, 2003.
15. M. Yamamoto and T. Watanabe. Timing control effects of utterance to communicative actions on embodied interaction with a robot. Proc. IEEE Workshop on Robot and Human Interactive Communication, pages 467-472, 2004.
16. T. Yonezawa and K. Mase. Musically expressive doll in face-to-face communication. IEEE Proc. International Conference of Multimodal Interfaces, pages 417-422, 2002.
17. T. Yonezawa, N. Suzuki, K. Mase, and K. Kogure. Gradually changing expression of singing voice based on morphing. Proc. Interspeech2005, pages 541-544, 2005.
18. T. Yonezawa, N. Suzuki, K. Mase, and K. Kogure. Handysinger: Expressive singing voice morphing using personified hand-puppet interface. Proc. NIME2005, pages 121-126, 2005.