Joint analysis of the emotional fingerprint in the face and speech: A single subject study

2007 IEEE 9Th International Workshop on Multimedia Signal Processing, MMSP 2007 - Proceedings

Volumn , Issue , 2007, Pages 43-47

  Busso, Carlos ^a   Narayanan, Shrikanth S ^a  

^a University of Southern California ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DEGREES OF FREEDOMS; ENCODING PROCESSES; FACIAL EXPRESSIONS; HUMAN INTERACTIONS; JOINT ANALYSES; VERBAL INFORMATIONS; VOCAL TRACTS;

DECODING; LINGUISTICS; SIGNAL PROCESSING; TECHNICAL PRESENTATIONS;

MODULATION;

EID: 48149101094     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/MMSP.2007.4412814     Document Type: Conference Paper

References (18)

1. K. Scherer, "Vocal communication of emotion: A review of research paradigms," Speech Communication, vol. 40, no. 1-2, pp. 227-256, April 2003.
2. R. Cowie and R. Cornelius, "Describing the emotional states that are expressed in speech," Speech Communication, vol. 40, no. 1-2, pp. 5-32, April 2003.
3. P. Ekman and E. Rosenberg, What the Face Reveals: Basic and Applied Studies of Spontaneous Expression using the Facial Action Coding System (FACS). New York, NY, USA: Oxford University Press, 1997.
4. C. Busso, Z. Deng, M. Grimm, U. Neumann, and S. Narayanan, "Rigid head motion in expressive speech animation: Analysis and synthesis," IEEE Transactions on Audio, Speech and Language Processing, vol. 15, no. 3, pp. 1075-1086, March 2007.
5. M. Coulson, "Attributing emotion to static body postures: Recognition accuracy, confusions, and viewpoint dependence," Journal of Nonverbal Behavior, vol. 28, no. 2, pp. 117-139, June 2004.
6. S. Yildirim, M. Bulut, C. Lee, A. Kazemzadeh, C. Busso, Z. Deng, S. Lee, and S. Narayanan, "An acoustic study of emotions expressed in speech," in 8th International Conference on Spoken Langaugae Processing (ICSLP 04), Jeju Island, Korea, 2004.
7. S. Lee, S. Yildirim, A. Kazemzadeh and S. Narayanan, "An articulatory study of emotional speech production," in 9th European Conference on Speech Communication and Technology (Interspeech'2005 - Eurospeech), Lisbon, Portugal, September 2005, pp. 497-500.
8. C. Busso, S. Lee, and S. Narayanan, "Using neutral speech models for emotional speech analysis," in to appear In Interspeech 2007 - Eurospeech. Antwerp, Belgium, August 2007.
9. C. Busso and S. Narayanan, "Interplay between linguistic and affective goals in facial expression during emotional utterances," in 7th International Seminar on Speech Production (ISSP 2006), Ubatuba-SP, Brazil. December 2006, pp. 549-556.
10. T. Cover and J. Thomas, Elements of Information Theory. New York. NY, USA: Wiley-Interscience, 2006.
11. T. Hazen, "Visual model structures and synchrony constraints for audio-visual speech recognition," IEEE Transactions on Audio, Speech and Language Processing, vol. 14, no. 3, pp. 1082-1089, May 2006.
12. K. Arun, T. Huang, and S. Blostein, "Least-squares fitting of two 3-d point sets," IEEE Trans. Pattern Anal. Mach. Intell., vol. 9, no. 5, pp. 698-700, September 1987.
13. J. Lucero, A. Baigorri, and K. Munhall, "Data-driven facial animation of speech using a QR factorization algorithm," in 7th International Seminar on Speech Production (ISSP 2006), Ubatuba-SP, Brazil, December 2006, pp. 135-142.
14. P. Boersma and D. Weeninck, "Praat, a system for doing phonetics by computer," Institute of Phonetic Sciences of the University of Amsterdam, Amsterdam. Netherlands, Technical Report 132, 1996, http://www.praat.org.
15. S. Young, G. Evermann. M. Gales, T. Hain, D. Kershaw, X. Liu, G. Moore, J. Odell, D. Ollason. D. Povey, V. Valtchev, and P. Woodland, The HTK Book. Entropic Cambridge Research Laboratory, Cambridge, England, December 2006.
16. S. Lee, E. Bresch, and S. Narayanan, "An exploratory study of emotional speech production using functional data analysis techniques," in 7th International Seminar on Speech Production (ISSP 2006), Ubatuba-SP, Brazil, December 2006, pp. 525-532.
17. M. Nordstrand, G. Svanfeldt, B. Granström, and D. House, "Measurements of articulatory variations and communicative signals in expressive speech," in Audio Visual Speech Processing (AVSP 03), S. Jorioz, France, September 2003, pp. 233-237.
18. W. Mendenhall and T. Sincich, Statistics for Engineering and the Sciences. Upper Saddle River, NJ, USA: Prentice-Hall, 2006.