Facial expression generation from speaker's emotional states in daily conversation

IEICE Transactions on Information and Systems

Volumn E91-D, Issue 6, 2008, Pages 1628-1633

  Mori, Hiroki ^a   Ohshima, Koh ^a  

^a UTSUNOMIYA UNIVERSITY   (Japan)

Author keywords

Avatar; Dialogue; Emotional state; Facial action coding system; Paralinguistic information

Indexed keywords

COMPUTER KEYBOARDS; MAPPING;

AVATAR; DIALOGUE; EMOTIONAL STATE; FACIAL ACTION CODING SYSTEM; PARALINGUISTIC INFORMATION;

SIGNAL ENCODING;

EID: 68149168613     PISSN: 09168532     EISSN: 17451361     Source Type: Journal    
DOI: 10.1093/ietisy/e91-d.6.1628     Document Type: Article

References (16)

1. G.L. Trager, "Paralanguage: A first approximation," Studies in Linguistics, vol.13, nos.1-2, pp.1-12, 1958.
2. P. Ekman, "Basic emotions," in Handbook of Cognition and Emotion, ed. T. Dalgleish and M. Power, pp.169-200, John Wiley, New York, 1999.
3. N. Campbell, "The JST/CREST ESP project Amid-term progress report," 1st JST/CREST Intl. Workshop Expressive Speech Processing, pp.61-70, 2003.
4. P. Ekman and W. Friesen, Facial Action Coding System: A technique for the measurement of facial movement, Consulting Psychologists Press, Palo Alto, 1978.
5. R. Cowie and R.R. Cornelius, "Describing the emotional states that are expressed in speech," Speech Commun., vol.40, no.1-2, pp.5-32, 2003.
6. H. Mori and H. Kasuya, "Voice source and vocal tract variations as cues to emotional states perceived from expressive conversational speech," Proc. Interspeech 2007, pp.102-105, 2007.
7. J.A. Russell, "How shall an emotion be called?," in Circumplex Models of Personality and Emotions, ed. R. Plutchik and H.R. Conte, pp.205-220, APA,Washington, 1997.
8. R. Cowie, E. Douglas-Cowie, N. Tsapatsoulis, G. Votsis, S. Kollias, W. Fellentz, and J.G. Taylor, "Emotion recognition in humancomputer interaction," IEEE Signal Process. Mag., vol.18, no.1, pp.32-80, 2001.
9. H. Mori, H. Kasuya, M. Nakamura, and M. Amanuma, "Some considerations for designing spoken dialogue database from the viewpoint of paralinguistic information," Acoust. Sci. & Tech., vol.24, no.6, pp.376-378, 2003.
10. R.W. Picard, E. Vyzas, and J. Healey, "Toward machine emotional intelligence: Analysis of affective physiological state," IEEE Trans. Pattern Anal. Mach. Intell., vol.23, no.10, pp.1175-1191, 2001.
11. J.A. Russell and G. Lemay, "Emotion concepts," in Handbook of Emotions, 2nd ed., ed. M. Lewis and J.M. Haviland-Jones, pp.491-503, Guilford, New York, 2000.
12. H. Mori, H. Aizawa, and H. Kasuya, "Consistency and agreement of paralinguistic information annotation for conversational speech," J. Acoust. Soc. Jpn., vol.61, no.12, pp.690-697, 2005.
13. H. Prendinger and M. Ishizuka, eds., Life-Like Characters Tools, Affective Functions, and Applications, Springer, Berlin, 2004.
14. J. Cohen, Statistical Power Analysis for the Behavioral Sciences, 2nd ed., Lawrence Erlbaum, Hillsdale, NJ, 1988.
15. K.L. Schmidt and J.L. Cohn, "Dynamics of facial expression: Normative characteristics and individual differences," Proc. Intl. Conf. Multimedia & Expo, pp.728-731, 2001.
16. J.F. Cohn, L.I. Reed, T. Moriyama, J. Xiao, K. Schmidt, and Z. Ambadar, "Multimodal coordination of facial action, head rotation, and eye motion during spontaneous smiles," Proc. Intl. Conf. Automatic Face & Gesture Recognition, pp.129-135, 2004.