A hybrid speech emotion recognition system based on spectral and prosodic features

IEICE Transactions on Information and Systems

Volumn E93-D, Issue 10, 2010, Pages 2813-2821

  Zhou, Yu ^a   Li, Junfeng ^b   Sun, Yanqing ^a   Zhang, Jianping ^a   Yan, Yonghong ^a   Akagi, Masato ^b  

^a INSTITUTE OF GEOLOGY AND GEOPHYSICS   (China)

^b JAPAN ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY   (Japan)

Author keywords

Non uniform subband processing; Prosodic feature; Spectral feature; Speech emotion recognition

Indexed keywords

FEATURE EXTRACTION; SPEECH;

EMOTIONAL INFORMATION; MEL-FREQUENCY CEPSTRAL COEFFICIENTS; PROSODIC FEATURES; SPECTRAL FEATURE; SPECTRAL FEATURE EXTRACTION; SPEECH EMOTION RECOGNITION; SPEECH EMOTION RECOGNITION SYSTEMS; SUB-BAND PROCESSING;

SPEECH RECOGNITION;

EID: 77957852009     PISSN: 09168532     EISSN: 17451361     Source Type: Journal    
DOI: 10.1587/transinf.E93.D.2813     Document Type: Article

References (26)

1. R. Fernandez, A computational model for the automatic recognition of affect in speech, Ph.D. thesis, Massachusetts Institute of Technol- ogy, Supervisor-Picard, Rosalind W., 2004.
2. D. Ververidis and C. Kotropoulos, "Emotional speech recognition: Resources, features, and methods," Speech Commun., vol.48, no.9, pp.1162-1181, 2006.
3. R. Cowie, E. Douglas-Cowie, N. Tsapatsoulis, G. Votsis, S. Kollias, W. Fellenz, and J. Taylor, "Emotion recognition in human-computer interaction," IEEE Signal Process. Mag., vol.18, no.1, pp.32-80, Jan. 2001.
4. I. Campbell, A. Iida, N. Campbell, S. Iga, F. Higuchi, and M. Yasumura, "A speech synthesis system with emotion for assisting communication," Proc. ISCA Workshop on Speech and Emotion, pp. 167-172, Belfast, 2000.
5. P. Ekman, "An argument for basic emotions," Cognition & Emotion, vol.6, no.3, pp. 169-200, 1992.
6. H. Schlossberg, "Three dimensions of emotion," Psychological Re- view, vol.61, no.2, pp.81-88, 1954.
7. Z. Zeng, M. Pantic, G. Roisman, and T. Huang, "A survey of affect recognition methods: Audio, visual, and spontaneous expressions," IEEE Trans. Pattern Anal. Mach. Intell., vol.31, no.1, pp.39-58, Jan. 2009.
8. T. Nwe, S. Foo, and L.D. Silva, "Speech emotion recognition using hidden markov models," Speech Commun., vol.41, no.4, pp.603- 623, 2003.
9. G. Zhou, J. Hansen, and J. Kaiser, "Nonlinear feature based classifi- cation of speech under stress," IEEE Trans. Speech Audio Process., vol.9, no.3, pp.201-216, March 2001.
10. Y. Wang and L. Guan, "An investigation of speech-based human emotion recognition," Proc. IEEE 6th Workshop on Multimedia Sig- nal Processing, pp. 15-18, 2004.
11. C.M. Lee, S. Yildirim, M. Bulut, A. Kazemzadeh, C. Busso, Z. Deng, S. Lee, and S. Narayanan, "Emotion recognition based on phoneme classes," Proc. ICSLP, pp.889-892, Oct. 2004.
12. S. Lee, E. Bresch, and S. Narayanan, "An exploratory study of emotional speech production using functional data analysis techniques," Proc. 7th Int. Seminar Speech Production, 2006.
13. http://hyperphysics.phy-astr.gsu.edu/hbase/Music/vowel.html
14. Y. Zhou, Y. Sun, J. Li, J. Zhang, and Y. Yan, "Physiologically- inspired feature extraction for emotion recognition," Proc. Inter- speech, pp.1975-1978, Brighton, U.K., Sept. 2009.
15. R. Moddemeijer, "On estimation of entropy and mutual information of continuous distributions," Signal Process., vol.16, no.3, pp.233- 246, 1989.
16. "Mandarin emotional speech corpus." http://www.chineseldc.org/- doc/CLDC-SPC-2005-010/intro.htm, 2005. Institute of Automation, Chinese Academy of Sciences.
17. C. de Boor, A. Practical Guide to Splines, revised ed., Springer, Nov. 2001.
18. L. Devillers, I. Vasilescu, and L. Vidrascu, "F0 and pause features analysis for anger and fear detection in real-life spoken dialogs," Speech Prosody 2004, Nara, Japan, 2004.
19. G. McLachlan and K. Basford, Mixture Models: Inference and Ap- plications to Clustering, Marcel Dekker, New York, 1988.
20. R.O. Duda, P.E. Hart, and D.G. Stork, Pattern Classification, 2nd ed., Wiley-Interscience, 2000.
21. A.P. Dempster, N.M. Laird, and D.B. Rubin, "Maximum likelihood from incomplete data via the em algorithm," J. Royal Statistical So- ciety, Series B, vol.39, no.1, pp. 1-38, 1977.
22. C.C. Chang and C.J. Lin, LIBSVM: A library for support vector machines, 2001. Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm
23. C.W. Hsu and C.J. Lin, "A comparison of methods for multiclass support vector machines," IEEE Trans. Neural Netw., vol.13, no.2, pp.415-425, 2002.
24. T.F. Wu, C.J. Lin, and R.C. Weng, "Probability estimates for multi- class classification by pairwise coupling," J. Machine Learning Re- search, vol.5, pp.975-1005, Aug. 2004.
25. H.T. Lin, C.J. Lin, and R.C. Weng, "A note on plan's probabilistic outputs for support vector machines," Machine Learning., vol.68, no.3, pp.267-276, 2007. http://www.csie.ntu.edu.tw/-cjlin/papers/- plattprob.pdf
26. J.C. Platt, "Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods," in Advances in Large Margin Classifiers, pp.61-74, MIT Press, 1999.