Ensemble methods for spoken emotion recognition in call-centres

Speech Communication

Volumn 49, Issue 2, 2007, Pages 98-112

  Morrison, Donn ^a   Wang, Ruili ^a   De Silva, Liyanage C ^a  

^a MASSEY UNIVERSITY   (New Zealand)

Author keywords

Affect recognition; Emotion recognition; Ensemble methods; Speech databases; Speech processing

Indexed keywords

HUMAN COMPUTER INTERACTION; INTERACTIVE COMPUTER SYSTEMS; INTERFACES (COMPUTER); PATTERN RECOGNITION; SPEECH INTELLIGIBILITY; SPEECH PROCESSING; SPEECH SYNTHESIS;

AFFECT RECOGNITION; EMOTION RECOGNITION; ENSEMBLE METHODS; SPEECH DATABASES;

SPEECH RECOGNITION;

EID: 33846952503     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2006.11.004     Document Type: Article

References (54)

1. Aha D., and Kibler D. Instance-based learning algorithms. Machine Learning 6 (1991) 37-66
2. Ang J., Dhillon R., Krupski A., Shriberg E., and Stolcke A. Prosody-based automatic detection of annoyance and frustration in human-computer dialog. Proceedings of the International Conference on Spoken Language Processing (ICSLP 2002) (2002), Denver, Colorado
3. Anton H. Elementary Linear Algebra (2000), Von Hoffman Press
4. Batliner A., Fischer K., Huber R., Spilker J., and Noth E. How to find trouble in communication. Speech Communication 40 (2003) 117-143
5. Blum A., and Langley P. Selection of relevant features and examples in machine learning. Aritificial Intelligence 97 (1997) 245-271
6. Breazeal C., and Aryananda L. Recognition of affective communicative intent in robot-directed speech. Autonomous Robots 12 (2002) 83-104
7. Breiman L. Random forests. Machine Learning 45 (2001) 5-32
8. *: An instance-based learner using and entropic distance measure. In: ICML, 1995, pp. 108-114.
9. Cover T.T., and Hart P.E. Nearest neighbour pattern classification. IEEE Transactions on Information Theory 13 (1967) 21-27
10. Cowan, M., xxx. Pitch and intensity characteristics of stage speech, Arch. Speech, Supplement to December Issue.
11. Davitz J.R. Personality, perceptual, and cognitive correlates of emotional sensitivity. In: Davitz J.R. (Ed). The Communication of Emotional Meaning (1964), McGraw-Hill, New York
12. Dellaert, F., Polzin, T., Waibel, A., 1996. Recognizing emotion in speech. In: Proceedings of the International Conference on Spoken Language Processing (ICSLP 1996), Philadelphia, PA, pp. 1970-1973.
13. Devillers, L., Vasilescu, I., Lamel, L., 2002. Annotation and detection of emotion in a task-oriented human-human dialog corpus. In: Proceedings of ISLE Workshop on Dialogue Tagging, Edinburgh.
14. Dieterle, F., 2003. Multianalyte quantifications by means of integration of artificial neural networks, genetic algorithms and chemometrics for time-resolved analytical data, Ph.D. thesis.
15. Dietterich T.G. Ensemble learning. In: Arbib M.A. (Ed). The Handbook of Brain Theory and Neural Networks (2002), The MIT Press, Cambridge, Massachusetts 405-408
16. Elfenbein H.A., and Ambady N. On the universality and cultural specificity of emotion recognition: a meta-analysis. Psychological Bulletin 128 (2002) 203-235
17. Emmanouilidis, C., Hunter, A., MacIntyre, J., Cox, C., 1999. Multiple-criteria genetic algorithms for feature selection in neurofuzzy modeling. In: Proceedings of the International Joint Conference on Neural Networks, Washington, USA, pp. 4387-4392.
18. Fairbanks G., and Hoaglin L.W. An experimental study of the durational characteristics of the voice during the expression of emotion. Speech Monograph 8 (1941) 85-91
19. Fairbanks G., and Pronovost W. An experimental study of the pitch characteristics of the voice during the expression of emotion. Speech Monograph 6 (1939) 87-104
20. Fonagy I. A new method of investigating the perception of prosodic features. Language and Speech 21 (1978) 34-49
21. Fonagy, I., 1981. Emotions, voice and music. In: Sundberg, J. (Eds.), Research Aspects on Singing, Royal Swedish Academy of Music No. 33, pp. 51-79.
22. Fonagy I., and Magdics K. Emotional patterns in intonation and music. Kommunikationsforsch 16 (1963) 293-326
23. Frick R.W. The prosodic expression of anger: differentiating thread and frustration. Aggressive Behaviour 12 (1986) 121-128
24. Goldberg D.E. Genetic Algorithms in Search, Optimization, and Machine Learning (1989), Addison-Wesley, Reading, Mass
25. Haykin S. Neural Networks: A Comprehensive Foundation (1999), Prentice-Hall, Upper Saddle River, New Jersey
26. Huber R., Noth E., Batliner A., Buckow J., Warnke V., and Niemann H. You beep machine - emotion in automatic speech understanding systems. Proceedings of the Workshop on Text, Speech, and Dialog (1998), Masark University 223-228
27. Huber, R., Batliner, A., Buckow, J., Noth, E., Warnke, V., Niemann, H., 2000. Recognition of emotion in a realistic dialogue scenario. In: Proceedings of the International Conference on Spoken Language Processing (ICSLP 2000), Vol. 1, Beijing, China, pp. 665-668.
28. Johnson W.F., Emde R.N., Scherer K.R., and Klinnert M.D. Recognition of emotion from vocal cues. Arch. Gen. Psych. 43 (1986) 280-283
29. Lee, C.M., Narayanan, S., xxx. Towards detecting emotion in spoken dialogs 13 (2).
30. Lee, C.M., Yildirim, S., Bulut, M., Kazemzadeh, A., Busso, C., Deng, Z., Lee, S., Narayanan, S., 2004. Emotion recognition based on phoneme classes. In: Proceedings of the International Conference on Spoken Language Processing (ICSLP 2004), Jeju Island, Korea.
31. Liscombe J., Riccardi G., and Hakkani-Tnr D. Using context to improve emotion detection in spoken dialog systems. Interspeech (2005) 1845-1848
32. McGilloway, S., Cowie, R., Douglas-Cowie, E., Gielen, S., Westerdijk, M., Stroeve, S., 2000. Approaching automatic recognition of emotion from voice: a rough benchmark. In: Proceedings of the ISCA Workshop on Speech and Emotion, Belfast, Northern Ireland, pp. 200-205.
33. Murray I., and Arnott J. Toward the simulation of emotion in synthetic speech: a review of the literature on human vocal emotion. Journal of the Acoustical Society of America 93 (1993) 1097-1108
34. Nakatsu, R., Nicholson, J., Tosa, N., 1999. Emotion recognition and its application to computer agents with spontaneous interactive capabilities. In: Proceedings of the International Conference on Multimedia Computing and Systems, Florence, Italy.
35. Nwe, T.L., 2003. Analysis and detection of human emotion and stress from speech signals, Ph.D. thesis, Department of Electrical and Computer Engineering, National University of Singapore.
36. Nwe T.L., Foo S.W., and De Silva L.C. Speech emotion recognition using hidden markov models. Speech Communication 41 (2003) 603-623
37. O'Shaughnessy D. Speech Communications: Human and Machine. Second edition (2000), IEEE Press, New York
38. Oster A., and Risberg A. The identification of the mood of a speaker by hearing impaired listeners. Speech Transmission Lab. - Q. Prog. Stat. Rep. 4 (1986) 79-90
39. Petrushin, V., 2000. Emotion recognition in speech signal: experimental study, development, and application. In: Proceedings of the Sixth International Conference on Spoken Language Processing (ICSLP 2000), Beijing, China.
40. Platt J. Fast training of support vector machines using sequential minimal optimization. In: Schoelkopf B., Burges C., and Smola A. (Eds). Advances in Kernel Methods - Support Vector Learning (1998), MIT Press, Cambridge, Massachusetts
41. Polzin, T.S., Waibel, A., 2000. Emotion-sensitive human-computer interfaces. In: Proceedings of the ISCA Workshop on Speech and Emotion, Belfast, Northern Ireland.
42. Rabiner L.R., and Schafer R.W. Digital Processing of Speech Signals (1978), Prentice-Hall, Englewood Cliffs, New Jersey
43. Salovey P., Kokkonen M., Lopes P., and Mayer J. Emotional intelligence: what do we know?. In: Manstead A.S.R., Frijda N.H., and Fischer A.H. (Eds). Feelings and Emotions: The Amsterdam Symposium (2004), Cambridge University Press, Cambridge, UK 321-340
44. Scherer, K.R., 1996. Adding the affective dimension: a new look in speech analysis and synthesis. In: Proceedings of the International Conference on Spoken Language Processing (ICSLP 1996), Philadelphia, PA.
45. Scherer K.R. Vocal communication of emotion: a review of research paradigms. Speech Communication 40 (2003) 227-256
46. Seewald, A.K., 2002. How to make stacking better and faster while also taking care of an unknown weakness. In: Proceedings of the 19th International Conference on Machine Learning, San Francisco, California.
47. Shipp C.A., and Kuncheva L.I. Relationships between combination methods and measures of diversity in combining classifiers. Information Fusion 3 (2002) 135-148
48. Skinner E.R. A calibrated recording and analysis of the pitch, force and quality of vocal tones expressing happiness and sadness. Speech Monograph 2 (1935) 81-137
49. Talkin D. A robust algorithm for pitch tracking (rapt). In: Kleijn W., and Paliwal K. (Eds). Speech Coding and Synthesis (1995), Elsevier Science B.V., The Netherlands 495-518
50. Vafaie, H., De Jong, K., 1992. Genetic algorithms as a tool for feature selection in machine learning. In: Proceedings of the 4th International Conference on Tools with Artificial Intelligence, Arlington, VA.
51. Vapnik V. The Nature of Statistical Learning Theory (1995), Springer-Verlag, NY
52. Williams C.E., and Stevens K.N. Emotions and speech: some acoustical correlates. Nonverbal Communication: Readings with Commentary. second edition (1972), Oxford University Press, New York
53. Wolpert D.H. Stacked generalization. Neural Networks 5 (1992) 241-260
54. Yacoub, S., Simske, S., Lin, X., Burns, J., 2003. Recognition of emotion in interactive voice systems. In: Proceedings of Eurospeech 2003, 8th European Conference on Speech Communication and Technology, Geneva, Switzerland.