Spoken emotion recognition through optimum-path forest classification using glottal features

Computer Speech and Language

Volumn 24, Issue 3, 2010, Pages 445-460

  Iliev, Alexander I ^a   Scordilis, Michael S ^a   Papa, João P ^b   Falcão, Alexandre X ^b  

^a University of Miami College of Engineering   (United States)

^b UNIVERSITY OF CAMPINAS   (Brazil)

Author keywords

Emotion recognition; Glottal analysis; Optimum path forest; Speech analysis

Indexed keywords

ARTIFICIAL NEURAL NETWORK; BAYESIAN CLASSIFIER; CLASSIFICATION METHODS; EMOTION RECOGNITION; FOREST CLASSIFICATION; GAUSSIAN MIXTURE MODEL; INVERSE FILTERING; K-NEAREST NEIGHBOR RULES; MULTI LAYER PERCEPTRON; RECOGNITION RATES; SPEECH DATABASE; SPEECH FEATURES; SPEECH SIGNALS; WAVE FORMS;

ACOUSTIC GENERATORS; BAYESIAN NETWORKS; CHARACTER RECOGNITION; CLASSIFIERS; DECISION TREES; MAGNETOSTRICTIVE DEVICES; NEURAL NETWORKS; SPEECH ANALYSIS; SUPPORT VECTOR MACHINES; WIRELESS SENSOR NETWORKS;

SPEECH RECOGNITION;

EID: 77950073346     PISSN: 08852308     EISSN: 10958363     Source Type: Journal    
DOI: 10.1016/j.csl.2009.02.005     Document Type: Article

References (58)

1. Airas, M., Alku, P., 2004. Emotions in short vowel segments: effects of the glottal flow as reflected by the normalized amplitude quotient. Lecture Notes in Artificial Intelligence (Subseries of Lecture Notes in Computer Science), v 3068, Affective Dialogue Systems, 2004, pp. 13-24.
2. Alku P., and Vilkman E. Amplitude domain quotient for characterization of the glottal volume velocity waveform estimated by inverse filtering. Speech Communication 18 (1996) 131-138
3. Allène C., Audibert J.Y., Couprie M., Cousty J., and Keriven R. Some links between min-cuts, optimal spanning forests and watersheds. Mathematical Morphology and its Applications to Image and Signal Processing (2007) 253-264
4. Ananthakrishnan S., and Narayanan S. Automatic prosodic event detection using acoustic, lexical, and syntactic evidence. IEEE Transactions on Speech and Audio Processing - ICASSP (2005) 216-228
5. Beckman M., and Elam G. Guidelines for ToBI Labeling (1997), The Ohio State University Research Foundation
6. Bhatti, M., Wang, Y., Guan, L., 2004. A neural network approach for human emotion recognition in speech. In: IEEE International Symposium on Circuits and Systems, Vancouver BC, pp. 181-184.
7. Bosch L. Emotions, speech and the ASR framework. Speech Communication 40 (2003) 213-225
8. Boser, B.E., Guyon, I.M., Vapnik, V.N., 1992. A training algorithm for optimal margin classifiers. In: 5th Workshop on Computational Learning Theory, pp. 144-152.
9. Cabral, J.P., Oliveira, L.C., 2006. Emo Voice: A system to generate emotions in speech. In: Proceedings of INTERSPEECH 2006 and 9th International Conference on Spoken Language Processing, ICSLP, vol. 4, pp. 1798-1801.
10. Chang, C.C., Li, C.J., 2001. LIBSVM: A Library for Support Vector Machines, Software available at url: .
11. Chuang, Z., Wu, C., 2004. Emotion recognition using acoustic features and textual content. In: IEEE International Conference on Multimedia and Expo (ICME), pp. 53-56.
12. Collobert, R., Bengio, S., 2004. Links between perceptrons, MLPs and SVMs, In: 21th International Conference on Machine learning.
13. Cormen T., Leiserson C., and Rivest R. Introduction to Algorithms (1990), MIT
14. Cornelius R. The Science of Emotion. Research and Tradition in the Psychology of Emotion (1996), Prentice-Hall, Upper Saddle River, NJ
15. Cowie R., and Cornelius R. Describing the emotional states that are expressed in speech. Speech Communication 40 (2003) 5-32
16. Cummings K.E., and Clements M.A. Analysis of the glottal excitation of emotionally styled and stressed speech. Journal of the Acoustical Society of America 98 1 (1995) 88-98
17. Duan K., and Keerthi S.S. Which is the best multiclass SVM method: an empirical study. Multiple Classifier Systems (2005) 278-285
18. Eckman P. An argument for basic emotions. Cognition and Emotion 6 3/4 (1992) 169-200
19. Falcão A.X., Stolfi J., and Lotufo R.A. The image foresting transform: theory, algorithms, and applications. IEEE Transactions on Pattern Analysis and Machine Intelligence 26 1 (2004) 19-29
20. Fant G. Glottal flow: models and interaction. Journal of Phonetics 14 (1986) 393-399
21. Flanagan J.L. Speech Analysis, Synthesis and Perception (1972), Springer-Verlag
22. Go, H., Kwak, K., Lee, D., Chun, M., 2003. Emotion recognition from the facial image and speech signal. In: SICE Annual Conference in Fukui, pp. 2890-2895.
23. Gobl C., and Chasaide A. The role of voice quality in communicating emotion, mood and attitude. Speech Communication 40 (2003) 189-212
24. Haykin S. Neural Networks: A Comprehensive Foundation (1994), Prentice Hall
25. Iida A., Campbell N., Higuchi F., and Yasumara M. A corpus-based speech synthesis system with emotion. Speech Communication 40 1-2 (2003) 161-187
26. Iida, A., Campbell, N., Yasumura, M., 1998. Emotional Speech as an Effective Interface for people with special needs. In: Proceedings of the 3rd Asia Pacific Computer and Human Interaction, IEEE Computer Society, pp. 266-271.
27. Iliev, A.I., Zhang, Y., Scordilis. M.S., 2007. Spoken emotion classification using ToBI features and GMM. In: IEEE 6th EURASIP Conference Focused on Speech and Image Processing, pp. 495-498.
28. Jain A.K., Duin R.P.W., and Mao J. Statistical pattern recognition: a review. IEEE Transactions on Pattern Analysis and Machine Intelligence 22 1 (2000) 4-37
29. Jilka M., Moler G., and Dogil G. Rules for the generation of ToBI-based American English intonation. Speech Communication 28 (1999) 83-108
30. Klasmeyer, G., Sendlneier, W.F., 1995. Objective voice parameters to characterize the emotional content in speech. In: Proceedings of ICPhS 95, p. 1182.
31. Kwon, O., Chan, K., Hao, J., Lee, T., 2003. Emotion Recognition by Speech Signals, Eurospeech-Geneva, pp. 125-128.
32. Laukkanen A.-M., Vilkman E., Alku P., and Oksanen H. Physical variation related to stress and emotional state: a preliminary study. Journal of Phonetics 24 (1996) 313-335
33. Lee C.M., and Narayanan S.S. Toward detecting emotions in spoken dialogs. IEEE Transactions on Speech and Audio Processing 13 2 (2005) 293-303
34. Ling Zhen-Hua, Hu Yu, Wang Ren-Hua, 2005. A Novel Source Analysis Method by Matching Spectral Characters of LF Model with STRAIGHT Spectrum, Springer-Verlag, Berlin, Heidelberg, pp. 441-448.
35. Miranda P.A.V., Falcão A.X., Rocha A., and Bergo F.P.G. Object delineation by κ -connected components. EURASIP Journal on Advances in Signal Processing (2008) 1-14
36. Mokhtari P., and Campbell N. Automatic measurement of pressed/breathy phonation at acoustic centres of reliability in continuous speech. IEICE Transactions on Information and Systems E86-D 3 (2003) 574-582
37. Moore, E., Clements, M., Peifer, J., Weisser, L., 2003. Investigating the Role of Glottal Features in Classifying Clinical Depression. In: 25th Annual International Conference of the IEEE EMBAS, pp. 2849-2852.
38. Moore, E., Clements, M., 2004. Algorithm for automatic glottal waveform estimation without the reliance on precise glottal closure information. In: Proceedings of the 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing, vol.1, pp. I-101-I-104.
39. Moore, E., II, Clements, M.A., Peifer, J.W., Weisser, L., 2008. IEEE Transactions on Biomedical Engineering 55 (1) 96-107. Nissen S., 2003. Implementation of a Fast Artificial Neural Network Library (FANN), Department of Computer Science University of Copenhagen (DIKU), Software available at .
40. Noda, T., Yano, Y., Doki, S., Okuma, S., 2006. Adaptive emotion recognition in speech by feature selection based on KL-divergence. In: IEEE International Conference on Systems, Man, and Cybernetics, 1921-1926, October 8-11, Taipei, Taiwan.
41. O'Shaughnessy D. Speech Communications - Human and Machine (2000), IEEE Press
42. Papa, J.P., Falcão, A.X., Suzuki, C.T.N., Mascarenhas, N.D.A., 2008. A discrete approach for supervised pattern recognition. In: 12th International Workshop on Combinatorial Image Analysis, vol. 4958., pp. 136-147.
43. Papa, J.P., Suzuki, C.T.N., Falcão A.X., 2008. LibOPF: A Library for the Design of Optimum-Path Forest Classifiers, Software version 1.0 available at .
44. Quatieri T.F. Discrete-Time Speech Signal Processing Principles and Practice (2002), Prentice Hall
45. Rabiner L.R., and Schafer R.W. Digital Processing of Speech Signals (1978), Prentice Hall
46. Roach, P., 2000. Techniques for the phonetic description of emotional speech. In: Proceedings of the ISCA Workshop on Speech and Emotion, Northern Ireland, pp. 53-59.
47. Rothenberg M. A new inverse-filtering technique for deriving the glottal air flow waveform during voicing. Journal of the Acoustical Society of America 53 6 (1973) l632-1645
48. Scherer K. Vocal communication of emotion: a review of research paradigms. Speech Communication 40 (2003) 227-256
49. Schuller, B., Rigoll, G., Lang, M., 2003. Hidden Markov Model-based speech emotion recognition. In: ICME'2003 Multimedia and Expo Proceedings, 6-9 July 2003, vol. 1, pp. 401-404.
50. Schuller, B., Rigoll, G., Lang, M. 2004. Speech emotion recognition combining acoustic features and linguistic information in a hybrid support vector machine-belief network architecture. In: Proceedings of the 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing, vol.1, pp. I-577-I-580.
51. Stibbard, R.,2000. Automated extraction of ToBI annotation data from the Reading/Leeds emotional speech corpus. ITRW on Speech and Emotion, ISCA, in Speech Emotion, pp. 60-65.
52. Titze I.R. Principles of Voice Production (1994), Prentice Hall
53. Ververidis D., and Kotropoulos C. Emotional speech recognition: resources, features, and methods. Speech Communication 48 (2006) 1162-1181
54. Wang Y., Guan L., 2004. An investigation of speech-based human emotion recognition. In: IEEE 6th Workshop on Multimedia Signal Processing, pp. 15-18.
55. Witten I., and Frank E. Data Mining: Practical machine learning tools and techniques. second ed. (2005), Morgan Kaufmann
56. Wong D., Markel J., and Gray A. Least squares glottal inverse filtering from the acoustical speech waveform. IEEE Transactions on Acoustics, Speech and Signal Processing ASSP-27 4 (1979) 350-355
57. Zhou, G., Hansen H., Kaiser J., 1999. Methods for stress classification: nonlinear TEO and linear speech based features. In: Acoustics, Speech, and Signal Processing ICASSP'99 Proceedings, pp. 2087-2090.
58. Zhou G., Hansen H., and Kaiser J. Nonlinear feature based classification of speech under stress. IEEE Transactions on Speech and Audio Processing 9 3 (2001) 201-216