Speaker-Dependent Audio-Visual Emotion Recognition

Auditory-Visual Speech Processing 2009, AVSP 2009

Volumn , Issue , 2009, Pages 53-58

  Haq, Sanaul ^a   Jackson, Philip J B ^a  

^a UNIVERSITY OF SURREY   (United Kingdom)

Author keywords

audio visual emotion; data evaluation; linear transformation; speaker dependent

Indexed keywords

DISCRIMINANT ANALYSIS; EMOTION RECOGNITION; METADATA; PRINCIPAL COMPONENT ANALYSIS; SPEECH RECOGNITION;

AUDIO FEATURES; AUDIO-VISUAL; AUDIO-VISUAL EMOTION; AUDIO-VISUAL FEATURES; BHATTACHARYYA DISTANCE; DATA EVALUATION; LINEAR DISCRIMINANT ANALYZE; PERFORMANCE; SPEAKER DEPENDENTS; VISUAL FEATURE;

LINEAR TRANSFORMATIONS;

EID: 85009493095     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (32)

1. C. Busso and S. Narayanan, “Interrelation between speech and facial gestures in emotional utterances: A single subject study,” IEEE Transactions on ASLP, vol. 15, no. 8, pp. 2331–2347, 2007.
2. A. Ortony et al., “What’s Basic About Basic Emotions?” Psychological Review, vol. 97, no. 3, pp. 315–331, 1990.
3. K. Scherer, “What are emotions? and how can they be measured?” Social Science Information, vol. 44, no. 4, pp. 695–729, 2005.
4. J. Russell, L. Ward, and G. Pratt, “Affective Quality Attributed to Environments: A Factor Analytic Study,” Environment and Behaviour, vol. 13, no. 3, pp. 259–288, 1981.
5. E. Douglas-Cowie, R. Cowie, and M. Schroeder, “A New Emotional Database: Considerations, Sources and Scope,” in Proc. ISCA Workshop Speech and Emotion: A conceptual framework for research, 2000, pp. 39–44.
6. F. Burkhardt et al., “A Database of German Emotional Speech,” in Proc. Interspeech, 2005, pp. 1517–1520.
7. N. Amir, S. Ron, and N. Laor, “Analysis of emotional speech corpus in Hebrew based on objective criteria,” in Proc. ISCA Workshop Speech and Emotion: A conceptual framework for research, 2000, pp. 29–33.
8. G. Chetty et al., “A multilevel fusion for audiovisual emotion recognition,” in Proc. AVSP, 2008, pp. 115–120.
9. I. Luengo, E. Navas et al., “Automatic Emotion Recognition using Prosodic Parameters,” in Proc. Interspeech, 2005, pp. 493–496.
10. D. Ververidis and C. Kotropoulos, “Emotional speech classification using Gaussian mixture models,” in Proc. ISCAS, 2005, pp. 2871–2874.
11. L. Vidrascu et al., “Detection of real-life emotions in call centers,” in Proc. Interspeech, 2005, pp. 1841–1844.
12. M. Borchert and A. Düsterhöft, “Emotions in Speech - Experiments with Prosody and Quality Features in Speech for Use in Categorical and Dimensional Emotion Recognition Environments,” in Proc. NLP-KE, 2005, pp. 147–151.
13. A. Nogueiras, A. Moreno et al., “Speech Emotion Recognition Using Hidden Markov Models,” in Proc. Eurospeech, 2001, pp. 2679–2682.
14. Y. Lin and G. Wei, “Speech Emotion Recognition Based on HMM and SVM,” in Proc. 4th Int. Conf. on Mach. Learn. and Cybernetics, 2005, pp. 4898–4901.
15. Y. Kao and L. Lee, “Feature Analysis for Emotion Recognition from Mandarin Speech Considering the Special Characteristics of Chinese Language,” in Proc. Interspeech, 2006, pp. 1814–1817.
16. D. Neilberg, K. Elenius et al., “Emotion Recognition in Spontaneous Speech Using GMMs,” in Proc. Interspeech, 2006, pp. 809–812.
17. C. Chen, Y. Huang, and P. Cook, “Visual/Acoustic emotion recognition,” in Proc. Int. Conf. on Multimedia & Expo, 2005, pp. 1468–1471.
18. C. Busso, Z. Deng, S. Yildirim et al., “Analysis of Emotion Recognition using Facial Expressions, Speech and Multimodal Information,” in Proc. ACM Int. Conf. on Multimodal Interfaces, 2004, pp. 205–211.
19. M. Song, C. Chen, and M. You, “Audio-visual based emotion recognition using tripled Hidden Markov Model,” in Proc. ICASSP, vol. 5, 2004, pp. 877–880.
20. V. Sethu, E. Ambikairajah, and J. Epps, “Phonetic and speaker variations in automatic emotion classification,” in Proc. Interspeech, 2008, pp. 617–620.
21. B. Schuller, G. Rigoll, and M. Lang, “Hidden Markov Model-Based Speech Emotion Recognition,” in Proc. ICASSP, vol. 2, 2003, pp. 1–4.
22. B. Schuller, M. Wimmer et al., “Detection of security related affect and behaviour in passenger transport,” in Proc. Interspeech, 2008, pp. 265–268.
23. J. Campbell, “Speaker Recognition: A Tutorial,” in Proc. IEEE, vol. 85, no. 9, 1997, pp. 1437–1462.
24. S. Haq, P. Jackson, and J. Edge, “Audio-visual feature selection and reduction for emotion classication,” in Proc. AVSP, 2008, pp. 185–190.
25. 3dMD 4D Capture System. Online: http://www.3dmd.com, accessed on 3 May, 2009.
26. M. Swerts and E. Krahmer, “Gender-related differences in the production and perception of emotion,” in Proc. Interspeech, 2008, pp. 334–337.
27. A. L. Edwards, Experimental Design in Psychological Research. New York: Holt, Rinehart and Winston, 1962.
28. M. Huckvale, Speech Filing System. UCL Dept. of Phonetics & Linguistics, UK. Online: http://www.phon.ucl.ac.uk/resource/sfs/, accessed on 3 May, 2009.
29. S. Young and P. Woodland, Hidden Markov Model Toolkit. Cambridge University Engineering Department, UK. Online: http://htk.eng.cam.ac.uk/, accessed on 3 May, 2009.
30. C. Chen, Pattern Recognition and Signal Processing. Sijthoff & Noordoff, The Netherlands, 1978.
31. J. Shlens, A Tutorial on Principal Component Analysis. Systems Neurobiology Laboratory, Salk Institute for Biological Studies, La Jolla, 2005.
32. R. Duda, P. Hart, and D. Stork, Pattern Classication. John Wiley & Sons, Inc. USA, Canada, 2001.