Classification of emotion in spoken Finnish using vowel-length segments: Increasing reliability with a fusion technique

Speech Communication

Volumn 53, Issue 3, 2011, Pages 269-282

  Väyrynen, Eero ^a   Toivanen, Juhani ^a   Seppänen, Tapio ^a  

^a UNIVERSITY OF OULU   (Finland)

Author keywords

Automatic classification of emotion; Classifier fusion; Prosodic features; Spoken Finnish; Vocal source features; Vowel segments

Indexed keywords

AUTOMATIC CLASSIFICATION; CLASSIFIER FUSION; FINNISH; PROSODIC FEATURES; VOCAL SOURCE FEATURES; VOWEL SEGMENTS;

CLASSIFIERS;

LINGUISTICS;

EID: 79551484916     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2010.09.007     Document Type: Article

References (43)

1. Airas, M.; Pulakka, H.; Bäckström, T.; Alku, P.; 2005. A toolkit for voice inverse filtering and parametrisation. In: Proceedings of the 9th European Conference on Speech Communication and Technology. ISCA, ISCA Archive, pp. 2145-2148.
2. P. Alku Glottal wave analysis with pitch synchronous iterative adaptive inverse filtering Speech Comm. 11 1992 109 118
3. P. Alku, T. Bäckström, and E. Vilkman Normalized amplitude quotient for parameterization of the glottal flow J. Acoust. Soc. Amer. 112 2 2002 701 710
4. P. Alku, and E. Vilkman Amplitude domain quotient for characterization of the glottal volume velocity waveform estimated by inverse filtering Speech Comm. 18 1996 131 138
5. R. Banse, and K.R. Scherer Acoustic profiles in vocal emotion expression J. Personal. Social Psychol. 70 3 1996 614 636
6. Barra, R.; Montero, J.; Macias-Guarasa, J.; D'Haro, L.; San-Segundo, R.; Cordoba, R.; 2006. Prosodic and segmental rubrics in emotion identification. In: Proc. IEEE Internat. Conf. on Acoustics, Speech and Signal Processing ICASSP2006. IEEE, Conference Management Services, pp. 1085-1088.
7. Batliner, A.; Fischer, K.; Huber, R.; Spilker, J.; Nöth, E.; 2000. Desperately seeking emotions or: actors, wizards, and human beings. In: Proc. ISCA Tutorial and Research Workshop on Speech and Emotion. Newcastle, Northern Ireland, UK, pp. 195-200.
8. C. Breazeal, and L. Aryananda Recognition of affective communicative intent in robot-directed speech Autonom. Robots 12 2002 83 104
9. Campbell, J.P.; Reynolds, D.A.; Dunn, R.B.; 2003. Fusing high- and low-level features for speaker recognition. In: Proc. 8th Eur. Conf. on Speech Communication and Technology. ISCA, ISCA Archive, pp. 2665-2668.
10. R. Cowie, E. Douglas-Cowie, N. Tsapatsoulis, G. Votsis, S. Kollias, W. Fellenz, and J. Taylor Emotion recognition in human-computer interaction IEEE Signal Process. Mag. 18 1 2001 32 80
11. A. Cruttenden Intonation 1997 Cambridge University Press
12. Dellaert, F.; Polzin, T.S.; Waibel, A.; 1996. Recognizing emotion in speech. In: Proc. Internat. Congr. on Spoken Language Processing, Vol. 3, Philadelphia, PA, pp. 1970-1973.
13. Drugman, T.; Dubuisson, T.; Moinet, A.; D'Alessandro, N.; Dutoit, T.; 2008. Glottal source estimation robustness. In: Proc. IEEE Internat. Conf. on Signal Processing and Multimedia Applications (SIGMAP08).
14. R.O. Duda, P.E. Hart, and D.G. Stork Pattern Classification second ed. 2001 John Wiley & Sons, Inc. New York, NY
15. Engberg, I.; Hanse, A.; 1996. Documentation of the danish emotional speech database (des). Internal AAU Report.
16. Gobl, C.; Nf Chasaide, A.; 2003. Amplitude-based source parameters for measuring voice quality. In: Proc. ISCA Tutorial and Research Workshop VOQUAL'03 on Voice Quality: Functions, Analysis and Synthesis. ISCA, ISCA Archive, pp. 151-156.
17. Kim, S.; Georgiou, P.; Sungbok, L.; Narayanan, S.; 2007. Real-time emotion detection system using speech: Multi-modal fusion of different timescale features. In: Proc. IEEE 9th Workshop on Multimedia Signal Processing. IEEE, Conference Management Services, pp. 48-51.
18. J. Kittler A framework for classifier fusion: Is it still needed? Advances in Pattern Recognition 2000 Springer Berlin/Heidelberg 45 56
19. J. Kittler, M. Hatef, R. Duin, and J. Matas On combining classifiers IEEE Trans. Pattern Anal. Machine Intell. 20 3 1998 226 239
20. A.-M. Laukkanen, E. Vilkman, P. Alku, and H. Oksanen Physical variations related to stress and emotional state: a preliminary study J. Phonetics 24 1996 313 335
21. Lee, C.M.; Narayanan, S.; Pieraccini, R.; 2001. Recognition of negative emotions from the speech signal. In: Proc. IEEE Workshop on Automatic Speech Recognition and Understanding, Madonna di Campiglio Trento, Italy.
22. McGilloway, S.; Cowie, R.; Douglas-Cowie, E.; Gielen, S.; Westerdijk, M.; Stroeve, S.; 2000. Approaching automatic recognition of emotion from voice: a rough benchmark. In: Proc. ISCA Tutorial and Research Workshop on Speech and Emotion. Newcastle, Northern Ireland, UK, pp. 207-212.
23. D. Morrison, R. Wang, and L. De Silva Ensemble methods for spoken emotion recognition in call-centres Speech Comm. 49 2007 98 112
24. Mozziconacci, S.J.L.; Hermes, D.J.; 1999. Role of intonation patterns in conveying emotion in speech. In: Proc. 14th Internat. Congr. Phonetic Sciences, San Francisco, CA, USA, pp. 2001-2004.
25. T. Nwe, S. Foo, and L. De Silva Speech emotion recognition using hidden markov models Speech Comm. 41 2003 603 623
26. P.-Y. Oudeyer The production and recognition of emotions in speech: features and algorithms Int. J. Hum.-Comput. Stud. 59 2003 157 183
27. Paeschke, A.; Sendelmeier, W.F.; 2000. Prosodic characteristics of emotional speech: measurements of fundamental frequency movements. In: Proc. ISCA Tutorial and Research Workshop on Speech and Emotion, Newcastle, Northern Ireland, UK, pp. 75-80.
28. Polzin, T.S.; Waibel, A.; 2000. Emotion-sensitive human-computer interfaces. In: Proc. ISCA Tutorial and Research Workshop on Speech and Emotion, Newcastle, Northern Ireland, UK, pp. 201-206.
29. P. Pudil, J. Novovičová, and J. Kittler Floating search methods in feature selection Pattern Recognition Lett. 15 1994 1119 1125
30. Pulakka, H.; 2005. Analysis of human voice production using inverse filtering, high-speed imaging, and electroglottography. Master's Thesis. Helsinki University of Technology, Laboratory of Acoustics and Audio Signal Processing, Espoo.
31. A. Schaefer, F. Collette, P. Philippot, M. van der Linden, S. Laureys, G. Delfiore, C. Degueldre, P. Maquet, A. Luxen, and E. Salmon Neural correlates of "hot" and "cold" emotional processing: a multilevel approach to the functional anatomy of emotion Neuroimage 18 4 2003 938 949
32. K.R. Scherer Vocal communication of emotion: A review of research paradigms Speech Comm. 40 1-2 2003 227 256
33. Schuller, B.; Lang, M.; Rigoll, G.; 2006. Recognition of spontaneous emotions by speech within automotive environment. In: DAGA (Ed.), Proc. 32. Deutsche Jahrestagung fnr Akustik. Deutsche Gesellschaft fnr Akustik, Berlin.
34. Seppänen, T.; Toivanen, J.; Väyrynen, E.; 2003a. Mediateam speech corpus: A first large finnish emotional speech database. In: Proc. 15th Internat. Congr. of Phonetic Sciences, Vol. 3, Barcelona, Spain, pp. 2469-2472.
35. Seppänen, T.; Väyrynen, E.; Toivanen, J.; 2003b. Prosody-based classification of emotions in spoken finnish. In: Proc. 8th Eur. Conf. on Speech Communication and Technology, Geneva, Switzerland, pp. 717-720.
36. M. Slaney, and G. McRoberts A recognition system for affective vocalization Speech Comm. 39 2003 367 384
37. P. Somol, P. Pudil, J. Novovičová, and P. Paclík Adaptive floating search methods in feature selection Pattern Recognition Lett. 20 1999 1157 1163
38. K. Suomi, J. Toivanen, and R. Ylitalo Durational and tonal correlates of accent in finnish J. Phonetics 31 2003 113 138
39. K. Suomi, J. Toivanen, and R. Ylitalo Finnish sound structure: phonetics, phonology, phonotactics and prosody Studia humaniora ouluensia Vol. 9 2008 Oulu University Press
40. L. ten Bosch Emotions, speech and the ASR framework Speech Comm. 40 1-2 2003 213 225
41. J. Toivanen, E. Väyrynen, and T. Seppänen Automatic discrimination of emotion from spoken finnish Lang. Speech 47 4 2004 383 412
42. Ververidis, D.; Kotropoulos, C.; Pitas, I.; 2004. Automatic emotional speech classification. In: IEEE (Ed.), Proc. ICASSP, Conference Management Services, pp. 593-596.
43. J. Vroomen, J. Tuomainen, and B. de Gelder The roles of word stress and vowel harmony in speech segmentation J. Memory Lang. 38 1998 133 149