Recognising realistic emotions and affect in speech: State of the art and lessons learnt from the first challenge

Speech Communication

Volumn 53, Issue 9-10, 2011, Pages 1062-1087

  Schuller, Björn ^a   Batliner, Anton ^b   Steidl, Stefan ^b   Seppi, Dino ^c  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^b UNIVERSITY OF ERLANGEN NUREMBERG   (Germany)

^c UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

Adaptation; Affect; Automatic classification; Emotion; Evaluation; Feature selection; Feature types; Noise robustness; Standardisation; Usability

Indexed keywords

ADAPTATION; AFFECT; AUTOMATIC CLASSIFICATION; EMOTION; EVALUATION; FEATURE TYPES; NOISE ROBUSTNESS; USABILITY;

FEATURE EXTRACTION;

SPEECH RECOGNITION;

EID: 79960846940     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2011.01.011     Document Type: Article

References (252)

1. Ai, H.; Litman, D.; Forbes-Riley, K.; Rotaru, M.; Tetreault, J.; Purandare, A.; 2006. Using system and user performance features to improve emotion detection in spoken tutoring dialogs. In: Proc. Interspeech, Pittsburgh, PA, USA, pp. 797-800.
2. Al-Hames, M.; Rigoll, G.; 2006. Reduced complexity and scaling for asynchronous HMMs in a bimodal input fusion application. In: Proc. ICASSP, Toulouse, France, pp. 757-760.
3. H. Altun, and G. Polata Boosting selection of speech related features to improve performance of multi-class SVMs in emotion detection Expert Systems Appl. 36 4 2009 8197 8203
4. Ang, J.; Dhillon, R.; Shriberg, E.; Stolcke, A.; 2002. Prosody-based automatic detection of annoyance and frustration in human-computer dialog. In: Proc. Interspeech, Denver, CO, USA, pp. 2037-2040.
5. J. Armstrong Significance tests harm progress in forecasting Internat. J. Forecast. 23 2007 321 327
6. Arunachalam, S.; Gould, D.; Anderson, E.; Byrd, D.; Narayanan, S.; 2001. Politeness and frustration language in child-machine interactions. In: Proc. Eurospeech, Aalborg, Denmark, pp. 2675-2678.
7. B. Atal, and S.L. Hanauer Speech analysis and synthesis by linear prediction of the speech wave J. Acoust. Soc. Amer. 50 1971 637 655
8. T. Athanaselis, S. Bakamidis, I. Dologlu, R. Cowie, E. Douglas-Cowie, and C. Cox ASR for emotional speech: clarifying the issues and enhancing performance Neural Networks 18 2005 437 444 (Pubitemid 40922650)
9. Ayadi, M.M.H.E.; Kamel, M.S.; Karray, F.; 2007. Speech emotion recognition using gaussian mixture vector autoregressive models. In: Proc. ICASSP, Honolulu, HY, pp. 957-960.
10. Baggia, P.; Burnett, D.C.; Carter, J.; Dahl, D.A.; McCobb, G.; Raggett, D.; 2007. EMMA: Extensible MultiModal Annotation markup language.
11. Barra-Chicote, R.; Fernandez, F.; Lutfi, S.; Lucas-Cuesta, J.M.; Macias-Guarasa, J.; Montero, J.M.; San-Segundo, R.; Pardo, J.M.; 2009. Acoustic emotion recognition using dynamic bayesian networks and multi-space distributions. In: Proc. Interspeech, Brighton, pp. 336-339.
12. Batliner, A.; Steidl, S.; Schuller, B.; Seppi, D.; Vogt, T.; Devillers, L.; Vidrascu, L.; Amir, N.; Kessous, L.; Aharonson, V.; 2007. The impact of F0 extraction errors on the classification of prominence and emotion. In: Proc. ICPhS, Saarbrücken, Germany, pp. 2201-2204.
13. Batliner, A.; Fischer, K.; Huber, R.; Spilker, J.; Nöth, E.; 2000. Desperately seeking emotions: actors, wizards, and human beings. In: Proc. ISCA Workshop on Speech and Emotion, Newcastle, Northern Ireland, pp. 195-200.
14. Batliner, A.; Buckow, J.; Huber, R.; Warnke, V.; Nöth, E.; Niemann, H.; 2001. Boiling down prosody for the classification of boundaries and accents in German and English. In: Proc. Eurospeech, Aalborg, Denmark, pp. 2781-2784.
15. A. Batliner, K. Fischer, R. Huber, J. Spilker, and E. Nöth How to find trouble in communication Speech Comm. 40 2003 117 143
16. Batliner, A.; Zeissler, V.; Frank, C.; Adelhardt, J.; Shi, R.P.; Nöth, E.; 2003b. We are not amused - but how do you know? User states in a multi-modal dialogue system. In: Proc. Interspeech, Geneva, Switzerland, pp. 733-736.
17. Batliner, A.; Hacker, C.; Steidl, S.; Nöth, E.; Haas, J.; 2004. From emotion to interaction: lessons from real human-machine-dialogues. In: Proc. Tutorial and Research Workshop on Affective Dialogue Systems, Kloster Irsee, Germany, pp. 1-12. (Pubitemid 38851663)
18. Batliner, A.; Steidl, S.; Hacker, C.; Nöth, E.; Niemann, H.; 2005. Tales of tuning - prototyping for automatic classification of emotional user states. In: Proc. Interspeech, Lisbon, Portugal, pp. 489-492. (Pubitemid 43908106)
19. Batliner, A.; Burkhardt, F.; van Ballegooy, M.; Nöth, E.; 2006a. A taxonomy of applications that utilize emotional awareness. In: Proc. IS-LTC 2006, Ljubliana, Slovenia, pp. 246-250.
20. Batliner, A.; Steidl, S.; Schuller, B.; Seppi, D.; Laskowski, K.; Vogt, T.; Devillers, L.; Vidrascu, L.; Amir, N.; Kessous, L.; Aharonson, V.; 2006b. Combining efforts for improving automatic classification of emotional user states. In: Proc. IS-LTC 2006, Ljubliana, Slovenia, pp. 240-245.
21. Batliner, A.; Steidl, S.; Nöth, E.; 2007a. Laryngealizations and emotions: How many Babushkas? In: Proc. Internat. Workshop on Paralinguistic Speech - between Models and Data (ParaLing'07), Saarbrücken, Germany, pp. 17-22.
22. Batliner, A.; Schuller, B.; Schaeffler, S.; Steidl, S.; 2008a. Mothers, adults, children, pets - towards the acoustics of intimacy. In: Proc. ICASSP 2008, Las Vegas, NV, pp. 4497-4500.
23. A. Batliner, S. Steidl, C. Hacker, and E. Nöth Private emotions vs. social interaction - a data-driven approach towards analysing emotions in speech User Model. User-Adapted Interact. 18 2008 175 206 (Pubitemid 351185636)
24. Batliner, A.; Seppi, D.; Steidl, S.; Schuller, B.; 2010. Segmenting into adequate units for automatic recognition of emotion-related episodes: a speech-based approach. Advances in Human-Computer Interaction, Vol. 2010. Article ID 782802, 15 pages.
25. A. Batliner, S. Steidl, B. Schuller, D. Seppi, T. Vogt, J. Wagner, L. Devillers, L. Vidrascu, V. Aharonson, and N. Amir Whodunnit - searching for the most important feature types signalling emotional user states in speech Comput. Speech Lang. 25 2011 4 28
26. R. Bellman Adaptive Control Processes 1961 Princeton University Press
27. Bengio, S.; 2003. An asynchronous hidden markov model for audio-visual speech recognition. Advances in NIPS 15.
28. Y. Bengio, and P. Frasconi An input output HMM architecture Adv. Neural Inform. Process. Systems 7 1995 427 434
29. Boda, P.P.; 2004. Multimodal integration in a wider sense. In: Proc. COLING 2004 Satellite Workshop on Robust and Adaptive Information Processing for Mobile Speech Interfaces, Geneva, Switzerland, pp. 22-30.
30. P. Boersma Accurate short-term analysis of the fundamental frequency and the harmonics-to-noise ratio of a sampled sound Proc. Inst. Phonetic Sci. (Univ. Amsterdam) 17 1993 97 110
31. Boersma, P.; Weenink, D.; 2005. Praat: doing phonetics by computer (version 4.3.14). .
32. Bogert, B.; Healy, M.; Tukey, J.; 1963. The quefrency analysis of time series for echoes: cepstrum, pseudo-autocovariance, cross-cepstrum and saphe cracking. In: Rosenblatt, M. (Ed.), Symposium on Time Series Analysis. John Wiley & Sons, New York, pp. 209-243.
33. Bozkurt, E.; Erzin, E.; Erdem,.E.; Erdem, A.T.; 2009. Improving automatic emotion recognition from speech signals. In: Proc. Interspeech, Brighton, pp. 324-327.
34. Breese, J.; Ball, G.; 1998. Modeling emotional state and personality for conversational agents. Technical Report MS-TR-98-41, Microsoft.
35. Brendel, M.; Zaccarelli, R.; Schuller, B.; Devillers, L.; 2010. Towards measuring similarity between emotional corpora. In: Proc. 3rd ELR0A Internat. Workshop on EMOTION (satellite of LREC): Corpora for Research on Emotion and Affect, Valetta, pp. 58-64.
36. Burkhardt, F.; Paeschke, A.; Rolfes, M.; Sendlmeier, W.; Weiss, B.; 2005. A database of german emotional speech. In: Proc. Interspeech, Lisbon, Portugal, pp. 1517-1520. (Pubitemid 43908362)
37. Burkhardt, F.; van Ballegooy, M.; Engelbrecht, K.-P.; Polzehl, T.; Stegmann, J.; 2009. Emotion detection in dialog systems: applications, strategies and challenges. In: Proc. ACII, Amsterdam, Netherlands, pp. 1-6.
38. Busso, C.; Deng, Z.; Yildirim, S.; Bulut, M.; Lee, C.M.; Kazemzadeh, A.; Lee, S.; Neumann, U.; Narayanan, S.; 2004. Analysis of emotion recognition using facial expressions, speech and multimodal information. In: Proc. ICMI '04: Proc. 6th Internat. Conf. on Multimodal interfaces, New York, USA, pp. 205-211. (Pubitemid 40371911)
39. Campbell, N.; Kashioka, H.; Ohara, R.; 2005. No laughing matter. In: Proc. Interspeech, Lisbon, Portugal, pp. 465-468. (Pubitemid 43908100)
40. Chen, L.S.; Tao, H.; Huang, T.S.; Miyasato, T.; Nakatsu, R.; 1998. Emotion recognition from audiovisual information. In: Proc. IEEE Workshop on Multimedia Signal Processing, pp. 83-88.
41. Cheng, Y.-M.; Kuo, Y.-S.; Yeh, J.-H.; Chen, Y.-T.; Chien, C.; 2006. Using recognition of emotions in speech to better understand brand slogans. In: Proc. IEEE 8th Workshop on Multimedia Signal Processing, Victoria, BC, pp. 238-242. (Pubitemid 46948544)
42. A.D. Cheveigne, and H. Kawahara Yin: a fundamental frequency estimator for speech and music J. Acoust. Soc. Amer. 111 4 2002 1917 1930
43. Chuang, Z.-J.; Wu, C.-H.; 2004. Emotion recognition using acoustic features and textual content. In: Proc. ICME, Taipei, Taiwan, pp. 53-56. (Pubitemid 40062965)
44. Cohen, J.; 1988. Statistical Power Analysis for the Behavioural Sciences, second ed. Erlbaum, Hillsdale, NJ.
45. Cowie, R.; Douglas-cowie, E.; Apolloni, B.; Taylor, J.; Romano, A.; Fellenz, W.; 1999. What a neural net needs to know about emotion words. In: Mastorakis, N. (Ed.), Computational Intelligence and Applications. Word Scientific Engineering Society, Society Press, pp. 109-114.
46. Cowie, R.; Douglas-Cowie, E.; Savvidou, S.; McMahon, E.; Sawey, M.; Schröder, M.; 2000. Feeltrace: an instrument for recording perceived emotion in real time. In: Proc. ISCA Workshop on Speech and Emotion, Newcastle, Northern Ireland, pp. 19-24.
47. R. Cowie, E. Douglas-Cowie, and C. Cox Beyond emotion archetypes: databases for emotion modelling using neural networks Neural Networks 18 2005 3388
48. R. Cowie, N. Sussman, and A. Ben-Ze'ev Emotions: concepts and definitions R. Cowie, P. Petta, C. Pelachaud, Emotion-Oriented Systems: The HUMAINE Handbook 2010 Springer
49. I. Daubechies The wavelet transform, time-frequency localization and signal analysis TransIT 36 5 1990 961 1005 (Pubitemid 20738359)
50. S. Davis, and P. Mermelstein Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentences IEEE Trans. Acoust. Speech Signal Process. 29 1980 917 919
51. B. de Gelder, and J. Vroomen The perception of emotions by ear and eye Cognition Emotion 14 3 2000 289 311
52. B. de Gelder, K.B.E. Böcker, J. Tuomainen, M. Hensen, and J. Vroomen The combined perception of emotion from voice and face: early interaction revealed by human electric brain responses Neurosci. Lett. 260 2 1999 133 136 (Pubitemid 29066883)
53. Dellaert, F.; Polzin, T.; Waibel, A.; 1996. Recognizing emotion in speech. In: Proc. ICSLP, Philadelphia, PA, USA, pp. 1970-1973.
54. Devillers, L.; Vasilescu, I.; Lamel, L.; 2003. Emotion detection in task-oriented spoken dialogs. In: Proc. ICME 2003, IEEE, Multimedia Human-Machine Interface and Interaction, Baltimore, MD, USA, pp. 549-552.
55. L. Devillers, and L. Vidrascu Real-life emotion recognition in speech C. Müller, Speaker Classification II Lecture Notes in Computer Science Vol. 4441/2007 2007 Springer Berlin/Heidelberg 34 42
56. Devillers, L.; Abrilian, S.; Martin, J.-C.; 2005a. Representing real-life emotions in audiovisual data with non basic emotional patterns and context features. In: Proc. ACII, Beijing, China, pp. 519-526. (Pubitemid 43763370)
57. L. Devillers, L. Vidrascu, and L. Lamel Challenges in real-life emotion annotation and machine learning based detection Neural Networks 18 2005 407 422 (Pubitemid 40922648)
58. Ding, H.; Qian, B.; Li, Y.; Tang, Z.; 2006. A method combining lpc-based cepstrum and harmonic product spectrum for pitch detection. In: Proc. 2006 Internat. Conf. on Intelligent Information Hiding and Multimedia, IEEE, pp. 537-540.
59. Dumouchel, P.; Dehak, N.; Attabi, Y.; Dehak, R.; Boufaden, N.; 2009. Cepstral and long-term features for emotion recognition. In: Proc. Interspeech, Brighton, pp. 344-347.
60. Elliott, C.; 1992. The affective reasoner: a process model of emotions in a multi-agent system. Ph.D. Thesis, Dissertation, Northwestern University.
61. Engberg, I.S.; Hansen, A.V.; Andersen, O.; Dalsgaard, P.; 1997. Design, recording and verification of a Danish emotional speech database. In: Proc. Eurospeech, Rhodes, Greece, pp. 1695-1698.
62. D. Erickson, K. Yoshida, C. Menezes, A. Fujino, T. Mochida, and Y. Shibuya Exploratory study of some acoustic and articulatory characteristics of sad speech Phonetica 63 2004 1 25 (Pubitemid 43333525)
63. Eyben, F.; Wöllmer, M.; Schuller, B.; 2009. openEAR - Introducing the Munich Open-Source Emotion and Affect Recognition Toolkit. In: Proc. ACII, Amsterdam, Netherlands, pp. 576-581.
64. Eyben, F.; Batliner, A.; Schuller, B.; Seppi, D.; Steidl, S.; 2010a. Cross-corpus classification of realistic emotions some pilot experiments. In: Proc. 3rd Internat. Workshop on EMOTION (Satellite of LREC): Corpora for Research on Emotion and Affect, Valetta, pp. 77-82.
65. F. Eyben, M. Wöllmer, A. Graves, B. Schuller, E. Douglas-Cowie, and R. Cowie On-line emotion recognition in a 3-D activation-valence-time continuum using acoustic and linguistic cues J. Multimodal User Interfaces 3 1-2 2010 7 12 Special Issue on "Real-Time Affect Analysis and Interpretation: Closing the Affective Loop in Virtual Agents and Robots"
66. Eyben, F.; Wöllmer, M.; Schuller, B.; 2010c. openSMILE - the munich versatile and fast open-source audio feature Extractor. In: Proc. ACM Multimedia, Florence, Italy, pp. 1459-1462.
67. H. Eysenck The concept of statistical significance and the controversy about one-tailed tests Psychol. Rev. 67 1960 269 271
68. Fattah, S.A.; Zhu, W.P.; Ahmad, M.O.; 2008. A cepstral domain algorithm for formant frequency estimation from noise-corrupted speech. In: Internat. Conf. on Neural Networks and Signal Processing 2008, Zhenjiang, China, pp. 114-119.
69. B. Fehr, and J.A. Russel Concept of emotion viewed from a prototype perspective J. Exp. Psychol.: Gen. 113 1984 464 486
70. Fei, Z.; Huang, X.; Wu, L.; 2006. Mining the relation between sentiment expression and target using dependency of words. In: Proc. 20th Pacific Asia Conf. on Language, Information and Computation (PACLIC20), Wuhan, China, pp. 257-264.
71. C.J. Ferguson An effect size primer: a guide for clinicians and researchers Prof. Psychol.: Res. Practice 40 2009 532 538
72. R. Fernandez, and R.W. Picard Modeling drivers' speech under stress Speech Comm. 40 2003 145 159
73. S. Fillenbaum Memory for gist: some relevant variables Lang. Speech 9 1966 217 227
74. Fiscus, J.; 1997. A post-processing system to yield reduced word error rates: Recognizer output voting error reduction (ROVER). In: Proc. ASRU, Santa Barbara, CA, USA, pp. 347-352.
75. J. Fleiss, J. Cohen, and B. Everitt Large sample standard errors of kappa and weighted kappa Psychol. Bull. 72 5 1969 323 327
76. Forbes-Riley, K.; Litman, D.; 2004. Predicting emotion in spoken dialogue fromm multiple knowledge sources. In: Proc. Human Language Technology Conf. of the North American Chap. of the Assoc. for Computational Linguistics, Boston, MA, USA, no pagination.
77. R. Frick Communicating emotion: the role of prosodic features Psychol. Bull. 97 1985 412 429
78. K. Fukunaga Introduction to Statistical Pattern Recognition 1990 Academic Press
79. Gaussier, E.; Goutte, C.; 2005. Relation between PLSA and NMF and implications. In: Proc. 28th Internat. ACM SIGIR Conf. on Research and Development in Information Retrieval (SIGIR-05), Salvador, Brazil, pp. 601-602.
80. G. Gigerenzer Mindless statistics J. Socio-Econ. 33 2004 587 606 (Pubitemid 39615265)
81. Godbole, N.; Srinivasaiah, M.; Skiena, S.; 2007. Large-scale sentiment analysis for news and blogs. In: Proc. Internat. Conf. on Weblogs and Social Media (ICWSM), Boulder, CO, no pagination.
82. Goertzel, B.; Silverman, K.; Hartley, C.; Bugaj, S.; Ross, M.; 2000. The baby webmind project. In: Proc. Annual Conf. of The Society for the Study of Artificial Intelligence and the Simulation of Behaviour (AISB), no pagination.
83. M. Grimm, K. Kroschel, H. Harris, C. Nass, B. Schuller, G. Rigoll, and T. Moosmayr On the necessity and feasibility of detecting a driver's emotional state while driving A. Paiva, R. Prada, R.W. Picard, Affective Computing and Intelligent Interaction 2007 Springer Berlin-Heidelberg 126 138
84. Grimm, M.; Kroschel, K.; Narayanan, S.; 2008. The Vera am Mittag German audio-visual emotional speech database. In: Proc. IEEE Internat. Conf. on Multimedia and Expo (ICME), Hannover, Germany, pp. 865-868.
85. Gunes, H.; Piccardi, M.; 2005. Affect recognition from face and body: early fusion vs. late fusion. In: IEEE Internat. Conf. Systems, Man and Cybernetics, Vol. 4, pp. 3437-3443. (Pubitemid 41667345)
86. Hall, M.A.; 1998. Correlation-based feature selection for machine learning. Ph.D. Thesis, Hamilton, NZ: Waikato University, Department of Computer Science.
87. Hansen, J.; Bou-Ghazale, S.; 1997. Getting started with susas: a speech under simulated and actual stress database. In: Proc. EUROSPEECH-97, Vol. 4, Rhodes, Greece, pp. 1743-1746.
88. S. Harnad Categorical Perception The Groundwork of Cognition 1987 University Press Cambridge
89. H. Hermansky Perceptual linear predictive (plp) analysis for speech J. Acoust. Soc. Amer. (JASA) 87 1990 1738 1752 (Pubitemid 20256470)
90. W. Hess, A. Batliner, A. Kießling, R. Kompe, E. Nöth, A. Petzold, M. Reyelt, and V. Strom Prosodic modules for speech recognition and understanding in verbmobil Y. Sagisaka, N. Campell, N. Higuchi, Computing Prosody. Approaches to a Computational Analysis and Modelling of the Prosody of Spontaneous Speech 1996 Springer-Verlag New York 363 383
91. Hirschberg, J.; Liscombe, J.; Venditti, J.; 2003. Experiments in emotional speech. In: Proc. ISCA and IEEE Workshop on Spontaneous Speech Processing and Recognition, Tokyo, Japan, pp. 1-7.
92. Hui, L.; Dai, B.-Q.; Wei, L.; 2006. A pitch detection algorithm based on amdf and acf. In: Proc. ICASSP, Toulouse, France, p. I.
93. A. Hyvärinen, J. Karhunen, and E. Oja Independent Component Analysis 2001 Wiley & Sons New York
94. Inanoglu, Z.; Caneel, R.; 2005. Emotive alert: HMM-based emotion detection in voicemail messages. In: Proc. 10th Internat. Conf. on Intelligent User Interfaces, San Diego, CA, USA, pp. 251-253.
95. Joachims, T.; 1998. Text categorization with support vector machines: learning with many relevant features. In: Nédellec, C.; Rouveirol, C. (Eds.), Proc. ECML-98, 10th European Conf. on Machine Learning. Springer, Heidelberg, Chemnitz, Germany, pp. 137-142. (Pubitemid 128067178)
96. T. Johnstone, and K.R. Scherer Vocal communication of emotion M. Lewis, J.M. Haviland-Jones, Handbook of Emotions 2000 Guilford Press New York, London 220 235 second ed. (Chapter 14)
97. I.T. Jolliffe Principal Component Analysis 2002 Springer Berlin, Germany
98. G.U. Kharat, and S.V. Dudul Human emotion recognition system using optimally designed SVM with different facial feature extraction techniques WSEAS Trans. Comput. 7 6 2008
99. Kießling, A.; 1997. Extraktion und Klassifikation prosodischer Merkmale in der automatischen Sprachverarbeitung. Berichte aus der Informatik. Shaker, Aachen, Germany.
100. Kim, S.-M.; Hovy, E.; 2005. Automatic detection of opinion bearing words and sentences. In: Companion Volume to the Proc. Internat. Joint Conf. on Natural Language Processing (IJCNLP), Jeju Island, Korea, pp. 61-66.
101. K.H. Kim, S.W. Bang, and S.R. Kim Emotion recognition system using short-term monitoring of physiological signals Medical Biological Eng. Comput. 42 3 2004 419 427 (Pubitemid 38786706)
102. Kim, J.; André, E.; Rehm, M.; Vogt, T.; Wagner, J.; 2005. Integrating information from speech and physiological signals to achieve emotional sensitivity. In: Proc. Interspeech, Lisbon, Portugal, pp. 809-812. (Pubitemid 43908185)
103. Kim, E.; Hyun, K.; Kim, S.; Kwak, Y.; 2007. Emotion interactive robot focus on speaker independently emotion recognition. In: Proc. IEEE/ASME Internat. Conf. on Advanced Intelligent Mechatronics, Zurich, Switzerland, pp. 1-6.
104. Kockmann, M.; Burget, L.; Černocký, J.; 2009. Brno University of Technology System for Interspeech 2009 Emotion Challenge. In: Proc. Interspeech, Brighton, pp. 348-351.
105. Kwon, O.-W.; Chan, K.; Hao, J.; Lee, T.-W.; 2003. Emotion recognition by speech signals. In: Proc. Interspeech, pp. 125-128.
106. Laskowski, K.; 2009. Contrasting emotion-bearing laughter types in multiparticipant vocal activity detection for meetings. In: Proc. ICASSP, IEEE, Taipei, Taiwan, pp. 4765-4768.
107. C.M. Lee, and S.S. Narayanan Toward detecting emotions in spoken dialogs IEEE Trans. Speech Audio Process. 13 2 2005 293 303 (Pubitemid 40320247)
108. D.D. Lee, and H.S. Seung Learning the parts of objects by non-negative matrix factorization Nature 401 6755 1999 788 791
109. Lee, C.M.; Narayanan, S.S.; Pieraccini, R.; 2002. Combining acoustic and language information for emotion recognition. In: Proc. Interspeech, Denver, CO, USA, pp. 873-376.
110. Lee, C.; Mower, E.; Busso, C.; Lee, S.; Narayanan, S.; 2009. Emotion recognition using a hierarchical binary decision tree approach. In: Proc. Interspeech, Brighton, pp. 320-323.
111. Lefter, I.; Wiggers, P.; Rothkrantz, L.; 2010. EmoReSp: an online emotion recognizer based on speech. In: Proc. 11th Internat. Conf. on Computer Systems and Technologies (CompSysTech), Sofia, Bulgaria, pp. 287-292.
112. Liscombe, J.; Hirschberg, J.; Venditti, J.; 2005. Detecting certainness in spoken tutorial dialogues. In: Proc. INTERSPEECH, Lisbon, Portugal, pp. 1837-1840. (Pubitemid 43908442)
113. Liscombe, J.; Riccardi, G.; Hakkani-Tür, D.; 2005b. Using context to improve emotion detection in spoken dialog systems. In: Proc. Interspeech, Lisbon, Portugal, pp. 1845-1848. (Pubitemid 43908444)
114. Liscombe, J.; Venditti, J.; Hirschberg, J.; 2003. Classifying subject ratings of emotional speech using acoustic features. In: Proc. Eurospeech, Geneva, Switzerland, pp. 725-728.
115. Litman, D.; Forbes, K.; 2003. Recognizing emotions from student speech in tutoring dialogues. In: Proc. ASRU, Virgin Island, USA, pp. 25-30.
116. Liu, H.; Liebermann, H.; Selker, T.; 2003. A model of textual affect sensing using real-world knowledge. In: Proc. 7th Internat. Conf. on Intelligent User Interfaces (IUI 2003), pp. 125-132.
117. W. Lizhong, S. Oviatt, and P.R. Cohen Multimodal integration - a statistical view IEEE Trans. Multimedia 1 1999 334 341
118. J.B. Lovins Development of a stemming algorithm Mech. Transl. Comput. Linguist. 11 1968 22 31
119. Luengo, I.; Navas, E.; Hernáez, I.; 2009. Combining spectral and prosodic information for emotion recognition in the interspeech 2009 emotion challenge. In: Proc. Interspeech, Brighton, pp. 332-335.
120. Lugger, M.; Yang, B.; 2008. Psychological motivated multi-stage emotion classification exploiting voice quality features. In: Mihelic, F.; Zibert, J. (Eds.), Speech Recognition, IN-TECH, p. 1.
121. Lugger, M.; Yang, B.; Wokurek, W.; 2006. Robust estimation of voice quality parameters under real world disturbances. In: Proc. ICASSP, Toulouse, France, pp. 1097-1100.
122. J. Makhoul Linear prediction: a tutorial review Proc. IEEE 63 1975 561 580
123. J.-C. Martin, R. Niewiadomski, L. Devillers, S. Buisine, and C. Pelachaud Multimodal complex emotions: gesture expressivity and blended facial expressions Int. J. Human. Robot. 3 3 2006 1 23
124. Martinez, C.A.; Cruz, A.; 2005. Emotion recognition in non-structured utterances for human-robot interaction. In: IEEE Internat. Workshop on Robot and Human Interactive Communication, Nashville, TN, USA, pp. 19-23. (Pubitemid 44144353)
125. S. Matos, S. Birring, I. Pavord, and D. Evans Detection of cough signals in continuous audio recordings using hidden markov models IEEE Trans. Biomed. Eng. 2006 1078 1108
126. McGilloway, S.; Cowie, R.; Doulas-Cowie, E.; Gielen, S.; Westerdijk, M.; Stroeve, S.; 2000. Approaching automatic recognition of emotion from voice: A rough benchmark. In: Proc. ISCA Workshop on Speech and Emotion, Newcastle, Northern Ireland, pp. 207-212.
127. Meyer, D.; Leisch, F.; Hornik, K.; 2002. Benchmarking support vector machines. Report Series No. 78, Adaptive Informations Systems and Management in Economics and Management Science, 19 pages.
128. Missen, M.; Boughanem, M.; 2009. Using WordNet's semantic relations for opinion detection in blogs. In: Advances in Information Retrieval, Lecture Notes in Computer Science, Vol. 5478/2009. Springer, pp. 729-733.
129. D. Morrison, and L.C.D. Silva Voting ensembles for spoken affect classification J. Network Comput. Appl. 30 2007 1356 1365 (Pubitemid 47263519)
130. D. Morrison, R. Wang, and L.C.D. Silva Ensemble methods for spoken emotion recognition in call-centres Speech Comm. 49 2 2007 98 112
131. D. Morrison, R. Wang, W. Xu, and L.C.D. Silva Incremental learning for spoken affect classification and its application in call-centres Int. J. Intell. Systems Technol. Appl. 2 2007 242 254
132. Mower, E.; Metallinou, A.; Lee, C.-C.; Kazemzadeh, A.; Busso, C.; Lee, S.; Narayanan, S.; 2009. Interpreting ambiguous emotional expressions. In: Proc. ACII, Amsterdam, Netherlands, pp. 662-669.
133. F. Nasoz, K. Alvarez, C.L. Lisetti, and N. Finkelstein Emotion recognition from physiological signals using wireless sensors for presence technologies Cognition Technol. Work 6 1 2004 4 14 (Pubitemid 38305312)
134. Nefian, A.V.; Luhong, L.; Xiaobo, P.; Liu, X.; Mao, C.; Murphy, K.; 2002. A coupled HMM for audio-visual speech recognition. In: Proc. ICASSP, Orlando, FL, USA, pp. 2013-2016.
135. Neiberg, D.; Elenius, K.; Laskowski, K.; 2006. Emotion recognition in spontaneous speech using GMMs. In: Proc. Interspeech, Pittsburgh, PA, USA, pp. 809-812.
136. R.S. Nickerson Null hypothesis significance testing: a review of an old and continuing controversy Psychol. Methods 5 2000 241 301
137. Nogueiras, A.; Moreno, A.; Bonafonte, A.; Mariño, J.B.; 2001. Speech emotion recognition using hidden markov models. In: Proc. Eurospeech, Aalborg, Denmark, pp. 2267-2270.
138. A.M. Noll Cepstrum pitch determination J. Acoust. Soc. Amer. (JASA) 14 1967 293 309
139. Nose, T.; Kato, Y.; Kobayashi, T.; 2007. Style estimation of speech based on multiple regression hidden semi-markov model. In: Proc. Interspeech, Antwerp, Belgium, pp. 2285-2288.
140. E. Nöth, A. Batliner, V. Warnke, J. Haas, M. Boros, J. Buckow, R. Huber, F. Gallwitz, M. Nutt, and H. Niemann On the use of prosody in automatic dialogue understanding Speech Comm. 36 1-2 2002 45 62 (Pubitemid 33034218)
141. T. Nwe, S. Foo, and L.D. Silva Speech emotion recognition using hidden markov models Speech Comm. 41 2003 603 623
142. F. Pachet, and P. Roy Analytical features: a knowledge-based approach to audio feature generation EURASIP J. Audio Speech Music Process. 2009 23 pages
143. Pal, P.; Iyer, A.; Yantorno, R.; 2006. Emotion detection from infant facial expressions and cries. In: Proc. ICASSP, Toulouse, France, pp. 809-812.
144. Pang, B.; Lee, L.; Vaithyanathan, S.; 2002. Thumbs up? sentiment classification using machine learning techniques. In: Proc. 2002 Conf. on Empirical Methods in Natural Language Processing (EMNLP), Philadelphia, PA, USA, pp. 79-86.
145. M. Pantic, and L. Rothkrantz Toward an affect-sensitive multimodal human-computer interaction Proc. IEEE 91 9 2003 1370 1390 (Pubitemid 40890819)
146. T.V. Pernegger What's wrong with Bonferroni adjustment Brit. Med. J. 316 1998 1236 1238
147. Petrushin, V.; 1999. Emotion in speech: recognition and application to call centers. In: Proc. Artificial Neural Networks in Engineering (ANNIE '99), St. Louis, MO, USA, pp. 7-10.
148. R. Picard, E. Vyzas, and J. Healey Toward machine emotional intelligence: Analysis of affective physiological state IEEE Trans. Pattern Anal. Machine Intell. 23 10 2001 1175 1191 (Pubitemid 33047955)
149. Planet, S.; Iriondo, I.; Socoró, J.-C.; Monzo, C.; Adell, J.; 2009. GTM-URL contribution to the INTERSPEECH 2009 Emotion Challenge. In: Proc. Interspeech, Brighton, pp. 316-319.
150. Polzehl, T.; Sundaram, S.; Ketabdar, H.; Wagner, M.; Metze, F.; 2009. Emotion classification in children's speech using fusion of acoustic and linguistic features. In: Proc. Interspeech, Brighton, pp. 340-343.
151. Polzin, T.S.; Waibel, A.; 2000. Emotion-sensitive human-computer interfaces. In: Proc. ISCA Workshop on Speech and Emotion, Newcastle, Northern Ireland, pp. 201-206.
152. Popescu, A.-M.; Etzioni, O.; 2005. Extracting product features and opinions from reviews. In: Proc. Human Language Technology Conf. and the Conf. on Empirical Methods in Natural Language Processing (HLT/EMNLP), Vancouver, British Columbia, pp. 339-346.
153. M. Porter An algorithm for suffix stripping Program 14 3 1980 130 137
154. P. Pudil, J. Novovicova, and J. Kittler Floating search methods in feature selection Pattern Recognition Lett. 15 1994 1119 1125
155. L.R. Rabiner On the use of autocorrelation analysis for pitch detection IEEE Trans. Acoust. Speech Signal Process. 25 1977 24 33 (Pubitemid 8037639)
156. Rahurkar, M.A.; Hansen, J.H.L.; 2003. Towards affect recognition: an ICA approach. In: Proc. 4th Internat. Symp. on Independent Component Analysis and Blind Signal Separation (ICA2003), Nara, Japan, pp. 1017-1022.
157. Rong, J.; Chen, Y.-P.P.; Chowdhury, M.; Li, G.; 2007. Acoustic features extraction for emotion recognition. In: Proc. ACIS Internat. Conf. on Computer and Information Science. IEEE Computer Society, Los Alamitos, CA, pp. 419-424.
158. E. Rosch Cognitive representations of semantic categories J. Exp. Psychol.: Gen. 104 3 1975 192 233
159. Rosenberg, A.; Binkowski, E.; 2004. Augmenting the kappa statistic to determine interannotator reliability for multiply labeled data points. In: Dumais, D.M.; Roukos, S. (Eds.), HLT-NAACL 2004: Short Papers. Association for Computational Linguistics, Boston, MA, USA, pp. 77-80.
160. W. Rozeboom The fallacy of the null-hypothesis significance test Psychol. Bull. 57 1960 416 428
161. J. Russell, J. Bachorowski, and J. Fernandez-Dols Facial and vocal expressions of emotion Annu. Rev. Psychol. 2003 329 349 (Pubitemid 37417497)
162. J. Sachs Recognition memory for syntactic and semantic aspects od connected discourse Percept. Psychophys. 2 1967 437 442
163. C. Said, C. Moore, K. Norman, J. Haxby, and A. Todorov Graded representations of emotional expressions in the left superior temporal sulcus Front. Systems Neurosci. 4 2010 6 doi:10.3389/fnsys.2010.00006
164. S. Salzberg On comparing classifiers: pitfalls to avoid and a recommended approach Data Mining Knowl. Discov. 1 3 1997 317 328
165. N. Sato, and Y. Obuchi Emotion recognition using mel-frequency cepstral coefficients Inform. Media Technol. 2 3 2007 835 848
166. K.R. Scherer, T. Johnstone, and G. Klasmeyer Vocal expression of emotion R.J. Davidson, K.R. Scherer, H.H. Goldsmith, Handbook of Affective Sciences 2003 Oxford University Press Oxford, New York 433 456 (Chapter 23)
167. Schiel, F.; 1999. Automatic phonetic transcription of non-prompted speech. In: Proc. ICPhS, San Francisco, CA, USA, pp. 607-610.
168. Schröder, M.; Pirker, H.; Lamolle, M.; 2006. First suggestions for an emotion annotation and representation language. In: Devillers, L.; Martin, J.-C.; Cowie, R.; Douglas-Cowie, E.; Batliner, A. (Eds.), Proc. Satellite Workshop of LREC 2006 on Corpora for Research on Emotion and Affect, Genoa, Italy, pp. 88-92.
169. M. Schröder, L. Devillers, K. Karpouzis, J.-C. Martin, C. Pelachaud, C. Peter, H. Pirker, B. Schuller, J. Tao, and I. Wilson What should a generic emotion markup language be able to represent? A. Paiva, R. Prada, R.W. Picard, Affective Computing and Intelligent Interaction 2007 Springer Berlin-Heidelberg 440 451
170. Schröder, M.; Cowie, R.; Heylen, D.; Pantic, M.; Pelachaud, C.; Schuller, B.; 2008. Towards responsive sensitive artificial listeners. In: Proc. 4th Internat. Workshop on Human-Computer Conversation, Bellagio, Italy, no pagination.
171. Schuller, B.; Rigoll, G.; Lang, M.; 2003. Hidden markov model-based speech emotion recognition. In: Proc. ICASSP, Hong Kong, pp. 1-4.
172. Schuller, B.; Rigoll, G.; Lang, M.; 2004. Speech emotion recognition combining acoustic features and linguistic information in a hybrid support vector machine-belief network architecture. In: Proc. ICASSP, Montreal, Canada, pp. 577-580.
173. Schuller, B.; Jiménez Villar, R.; Rigoll, G.; Lang, M.; 2005a. Meta-classifiers in acoustic and linguistic feature fusion-based affect recognition. In: Proc. ICASSP, Philadelphia, PA, USA, pp. I:325-328.
174. Schuller, B.; Müller, R.; Lang, M.; Rigoll, G.; 2005b. Speaker independent emotion recognition by early fusion of acoustic and linguistic features within ensemble. In: Proc. Interspeech, Lisbon, Portugal, pp. 805-808. (Pubitemid 43908184)
175. Schuller, B.; Reiter, S.; Mller, R.; Al-Hames, M.; Lang, M.; Rigoll, G.; 2005c. Speaker independent speech emotion recognition by ensemble classification. In: Proc. ICME, Amsterdam, Netherlands, pp. 864-867. (Pubitemid 44669004)
176. Schuller, B.; Arsić, D.; Wallhoff, F.; Rigoll, G.; 2006. Emotion recognition in the noise applying large acoustic feature sets. In: Proc. Speech Prosody 2006, Dresden, Germany, no pagination.
177. Schuller, B.; Rigoll, G.; 2006. Timing levels in segment-based speech emotion recognition. In: Proc. Interspeech, Pittsburgh, PA, USA, pp. 1818-1821.
178. Schuller, B.; Köhler, N.; Müller, R.; Rigoll, G.; 2006b. Recognition of interest in human conversational speech. In: Proc. Interspeech, Pittsburgh, PA, USA, pp. 793-796.
179. Schuller, B.; Reiter, S.; Rigoll, G.; 2006c. Evolutionary feature generation in speech emotion recognition. In: Proc. Internat. Conf. on Multimedia and Expo ICME 2006, Toronto, Canada, pp. 5-8. (Pubitemid 46679640)
180. Schuller, B.; Stadermann, J.; Rigoll, G.; 2006d. Affect-robust speech recognition by dynamic emotional adaptation. In: Proc. Speech Prosody 2006, Dresden, Germany, no pagination.
181. Schuller, B.; Batliner, A.; Seppi, D.; Steidl, S.; Vogt, T.; Wagner, J.; Devillers, L.; Vidrascu, L.; Amir, N.; Kessous, L.; Aharonson, V.; 2007a. The relevance of feature type for the automatic classification of emotional user states: low level descriptors and functionals. In: Proc. Interspeech, Antwerp, Belgium, pp. 2253-2256.
182. Schuller, B.; Müller, R.; Hörnler, B.; Höthker, A.; Konosu, H.; Rigoll, G.; 2007b. Audiovisual recognition of spontaneous interest within conversations. In: Proc. 9th Internat. Conf. on Multimodal Interfaces (ICMI), Special Session on Multimodal Analysis of Human Spontaneous Behaviour. ACM SIGCHI, Nagoya, Japan, pp. 30-37.
183. Schuller, B.; Seppi, D.; Batliner, A.; Meier, A.; Steidl, S.; 2007c. Towards more reality in the recognition of emotional speech. In: Proc. ICASSP, Honolulu, HY, USA, pp. 941-944.
184. Schuller, B.; Batliner, A.; Steidl, S.; Seppi, D.; 2008a. Does affect automatic recognition of children's speech? In: Proc. 1st Workshop on Child, Computer and Interaction, Chania, Greece, 4 pages, no pagination.
185. Schuller, B.; Eyben, F.; Rigoll, G.; 2008b. Static and dynamic modelling for the recognition of non-verbal vocalisations in conversational speech. In: André, E. (Ed.), Proc. 4th IEEE Tutorial and Research Workshop on Perception and Interactive Technologies for Speech-based Systems (PIT 2008), Kloster Irsee, Germany, LNCS, Vol. 5078. Springer, pp. 99-110.
186. Schuller, B.; Vlasenko, B.; Arsic, D.; Rigoll, G.; Wendemuth, A.; 2008c. Combining speech recognition and acoustic word emotion models for robust text-independent emotion recognition. In: Proc. ICME, Hannover, Germany, pp. 1333-1336.
187. Schuller, B.; Wimmer, M.; Arsic, D.; Moosmayr, T.; Rigoll, G.; 2008d. Detection of security related affect and behaviour in passenger transport. In: Proc. Interspeech, Brisbane, Australia, pp. 265-268.
188. Schuller, B.; Wimmer, M.; Mösenlechner, L.; Kern, C.; Arsic, D.; Rigoll, G.; 2008e. Brute-forcing hierarchical functionals for paralinguistics: a waste of feature space? In: Proc. ICASSP, Las Vegas, NV, pp. 4501-4504.
189. Schuller, B.; Rigoll, G.; 2009. Recognising interest in conversational speech - comparing bag of frames and supra-segmental features. In: Proc. Interspeech, Brighton, UK, pp. 1999-2002.
190. Schuller, B.; Batliner, A.; Steidl, S.; Seppi, D.; 2009a. Emotion recognition from speech: putting ASR in the loop. In: Proc. ICASSP, IEEE, Taipei, Taiwan, pp. 4585-4588.
191. Schuller, B.; Müller, R.; Eyben, F.; Gast, J.; Hörnler, B.; Wöllmer, M.; Rigoll, G.; Höthker, A.; Konosu, H.; 2009b. Being bored? Recognising natural interest by extensive audiovisual integration for real-life Application. Image Vision Comput. J. (IMAVIS) 27, 1760-1774 (Special Issue on Visual and Multimodal Analysis of Human Spontaneous Behavior).
192. Schuller, B.; Schenk, J.; Rigoll, G.; Knaup, T.; 2009c. The "Godfather" vs. "Chaos": comparing linguistic analysis based on online knowledge sources and Bags-of-N-grams for movie review valence estimation. In: Proc. Internat. Conf. on Document Analysis and Recognition, Barcelona, Spain, pp. 858-862.
193. Schuller, B.; Steidl, S.; Batliner, A.; 2009d. The INTERSPEECH 2009 Emotion Challenge. In: Proc. Interspeech, Brighton, UK, pp. 312-315.
194. Schuller, B.; Vlasenko, B.; Eyben, F.; Rigoll, G.; Wendemuth, A.; 2009e. Acoustic emotion recognition: a benchmark comparison of performances. In: Proc. IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), Merano, pp. 552-557.
195. Schuller, B.; Wöllmer, M.; Eyben, F.; Rigoll, G.; 2009f. Spectral or voice quality? Feature type relevance for the discrimination of emotion pairs. In: Hancil, S. (Ed.), The Role of Prosody in Affective Speech. Linguistic Insights, Studies in Language and Communication, Vol. 97. Peter Lang, pp. 285-307.
196. Schuller, B.; Wöllmer, M.; Moosmayr, T.; Rigoll, G.; 2009g. Recognition of noisy speech: a comparative survey of robust model architectures and feature enhancement. EURASIP J. Audio Speech Music Process. (JASMP), 17 pages, Article ID 942617.
197. Schuller, B.; Burkhardt, F.; 2010. Learning with synthesized speech for automatic emotion recognition. In: Proc. 35th IEEE Internat. Conf. on Acoustics, Speech and Signal Processing (ICASSP), Dallas, pp. 5150-5153.
198. Schuller, B.; Weninger, F.; 2010. Discrimination of speech and non-linguistic vocalizations by non-negative matrix factorization. In: Proc. ICASSP, Dallas, pp. 5054-5057.
199. Schuller, B.; Eyben, F.; Can, S.; Feussner, H.; 2010a. Speech in minimal invasive surgery - towards an affective language resource of real-life medical operations. In: Proc. 3rd ELRA Internat. Workshop on EMOTION (satellite of LREC): Corpora for Research on Emotion and Affect, Valetta, pp. 5-9.
200. Schuller, B.; Metze, F.; Steidl, S.; Batliner, A.; Eyben, F.; Polzehl, T.; 2010b. Late fusion of individual engines for improved recognition of negative emotions in speech - learning vs. democratic vote. In: Proc. 35th IEEE Internat. Conf. on Acoustics, Speech and Signal Processing (ICASSP), Dallas, pp. 5230-5233.
201. Schuller, B.; Steidl, S.; Batliner, A.; Burkhardt, F.; Devillers, L.; Müller, C.; Narayanan, S.; 2010c. The INTERSPEECH 2010 paralinguistic challenge. In: Proc. INTERSPEECH 2010, Makuhari, Japan, pp. 2794-2797.
202. Seppi, D.; Batliner, A.; Schuller, B.; Steidl, S.; Vogt, T.; Wagner, J.; Devillers, L.; Vidrascu, L.; Amir, N.; Aharonson, V.; 2008a. Patterns, prototypes, performance: classifying emotional user states. In: Proc. Interspeech, Brisbane, Australia, pp. 601-604.
203. Seppi, D.; Gerosa, M.; Schuller, B.; Batliner, A.; Steidl, S.; 2008b. Detecting problems in spoken child-computer interaction. In: Proc. 1st Workshop on Child, Computer and Interaction, Chania, Greece, no pagination.
204. Seppi, D.; Batliner, A.; Steidl, S.; Schuller, B.; Nöth, E.; 2010. Word accent and emotion. In: Proc. Speech Prosody 2010, Chicago, IL, no pagination.
205. Sethu, V.; Ambikairajah, E.; Epps, J.; 2007. Speaker normalisation for speech-based emotion detection. In: Proc. 15th Internat. Conf. on Digital Signal Processing, Cardiff, pp. 611-614.
206. Shami, M.; Verhelst, W.; 2007. Automatic classification of expressiveness in speech: a multi-corpus study. In: Müller, C. (Ed.), Speaker Classification II, Lecture Notes in Computer Science/Artificial Intelligence, Vol. 4441. Springer, Heidelberg-Berlin-New York, pp. 43-56.
207. P.R. Shaver, S. Wu, and J.C. Schwartz Cross-cultural similarities and differences in emotion and its representation: a prototype approach Emotion 1992 175 212
208. Sood, S.; Krishnamurthy, A.; 2004. A robust on-the-fly pitch (otfp) estimation algorithm. In: Proc. 12th Annual ACM Internat. Conf. on Multimedia (MULTIMEDIA '04). ACM, New York, NY, USA, pp. 280-283. (Pubitemid 40211763)
209. Steidl, S.; Ruff, C.; Batliner, A.; Nöth, E.; Haas, J.; 2004. Looking at the last two turns, I'd say this dialogue is doomed - measuring dialogue success. In: Sojka, P.; Kopeček, I.; Pala, K. (Eds.), 7th Internat. Conf. on Text, Speech and Dialogue, TSD 2004, Berlin, Heidelberg, pp. 629-636.
210. Steidl, S.; Batliner, A.; Nöth, E.; Hornegger, A.; 2008. Quantification of segmentation and fo errors and their effect on emotion recognition. In: 11th Internat. Conf. on Text, Speech and Dialogue, TSD 2008, pp. 525-534.
211. Steidl, S.; 2009. Automatic classification of emotion-related user states in spontaneous children's speech. Logos Verlag, Berlin, Germany, (Ph.D. Thesis, FAU Erlangen-Nuremberg).
212. Steidl, S.; Schuller, B.; Batliner, A.; Seppi, D.; 2009. The hinterland of emotions: facing the open-microphone challenge. In: Proc. ACII, Amsterdam, Netherlands, pp. 690-697.
213. Steidl, S.; Batliner, A.; Seppi, D.; Schuller, B.; 2010. On the impact of children's emotional speech on acoustic and language models. EURASIP J. Audio Speech Music Process.; 14. doi:10.1155/2010/783954.
214. Takahashi, K.; 2004. Remarks on emotion recognition from bio-potential signals. In: Proc. 2nd Internat. Conf. on Autonomous Robots and Agents, pp. 186-191.
215. L. tenBosch Emotions, speech and the ASR framework Speech Comm. 40 1-2 2003 213 225
216. Tomlinson, M.J.; Russell, M.J.; Brooke, N.M.; 1996. Integrating audio and visual information to provide highly robust speech recognition. In: Proc. ICASSP, Atlanta, GA, USA, pp. 812-824.
217. Truong, K.; van Leeuwen, D.; 2005. Automatic detection of laughter. In: Proc. Interspeech, Lisbon, Portugal, pp. 485-488. (Pubitemid 43908105)
218. Ververidis, D.; Kotropoulos, C.; 2003. A review of emotional speech databases. In: PCI 2003, 9th Panhellenic Conf. on Informatics, November 1-23, 2003, Thessaloniki, Greece, pp. 560-574.
219. Ververidis, D.; Kotropoulos, C.; 2006. Fast sequential floating forward selection applied to emotional speech features estimated on DES and SUSAS data collection. In: Proc. European Signal Processing Conf. (EUSIPCO 2006), Florence, Italy, no pagination.
220. Vidrascu, L.; Devillers, L.; 2007. Five emotion classes in real-world call center data: the use of various types of paralinguistic features. In: Proc. PARALING07, pp. 11-16.
221. Vinciarelli, A.; Pantic, M.; Bourlard, H.; Pentland, A.; 2008. Social signals, their function, and automatic analysis: a survey. In: Proc. 10th Internat. Conf. on Multimodal Interfaces, ACM, New York, USA, pp. 61-68.
222. Vlasenko, B.; 2009. Processing affected speech within human machine interaction. In: Proc. Interspeech, Brighton, pp. 2039-2042.
223. Vlasenko, B.; Schuller, B.; Wendemuth, A.; Rigoll, G.; 2007a. Combining frame and turn-level information for robust recognition of emotions within speech. In: Proc. Interspeech, Antwerp, Belgium, pp. 2249-2252.
224. B. Vlasenko, B. Schuller, A. Wendemuth, and G. Rigoll Frame vs. turn-level: emotion recognition from speech considering static and dynamic processing A. Paiva, R. Prada, R.W. Picard, Affective Computing and Intelligent Interaction 2007 Springer Berlin-Heidelberg 139 147
225. Vlasenko, B.; Schuller, B.; Mengistu, T.K.; Rigoll, G.A.W.; 2008. Balancing spoken content adaptation and unit length in the recognition of emotion and interest. In: Proc. Interspeech, Brisbane, Australia, pp. 805-808.
226. Vogt, T.; André, E.; 2005. Comparing feature sets for acted and spontaneous speech in view of automatic emotion recognition. In: Proc. Multimedia and Expo (ICME05), Amsterdam, Netherlands, pp. 474-477. (Pubitemid 44668907)
227. Vogt, T.; André, E.; 2009. Exploring the benefits of discretization of acoustic features for speech emotion recognition. In: Proc. Interspeech, Brighton, pp. 328-331.
228. Vogt, T.; André, E.; Bee, N.; 2008. Emovoice - a framework for online recognition of emotions from voice. In: Proc. IEEE Tutorial and Research Workshop on Perception and Interactive Technologies for Speech-Based Systems (PIT 2008). Lecture Notes in Computer Science, Vol. 5078. Springer, Kloster Irsee, Germany, pp. 188-199.
229. Vogt, T.; André, E.; Wagner, J.; Gilroy, S.; Charles, F.; Cavazza, M.; 2009. Real-time vocal emotion recognition in artistic installations and interactive storytelling: Experiences and lessons learnt from CALLAS and IRIS. In: Proc. ACII, Amsterdam, Netherlands, pp. 670-677.
230. Wagner, J.; Kim, J.; André, E.; 2005. From physiological signals to emotions: implementing and comparing selected methods for feature extraction and classification. In: Proc. ICME, Amsterdam, Netherlands, pp. 940-943. (Pubitemid 44669023)
231. Wagner, J.; Vogt, T.; André, 2007. A systematic comparison of different HMM designs for emotion recognition from acted and spontaneous speech. In: Paiva, A.; Prada, R.; Picard, R.W. (Eds.), Affective Computing and Intelligent Interaction. Springer, Berlin-Heidelberg, pp. 114-125.
232. Wang, Y.; Guan, L.; 2005. Recognizing human emotion from audiovisual information. In: Proc. ICASSP, Vol. 2. Philadelphia, PA, USA, pp. 1125-1128.
233. Wilson, T.; Wiebe, J.; Hwa, R.; 2004. Just how mad are you? Finding strong and weak opinion clauses. In: Proc. Conf. American Association for Artificial Intelligence (AAAI), San Jose, CA, no pagination.
234. Wimmer, M.; Schuller, B.; Arsic, D.; Radig, B.; Rigoll, G.; 2008. Low-level fusion of audio and video features for multi-modal emotion recognition. In: Proc. 3rd Internat. Conf. on Computer Vision Theory and Applications, Funchal, Portugal, pp. 145-151.
235. I.H. Witten, and E. Frank Data Mining: Practical Machine Learning Tools and Techniques second ed. 2005 Morgan Kaufmann San Francisco, CA, USA
236. Wöllmer, M.; Eyben, F.; Reiter, S.; Schuller, B.; Cox, C.; Douglas-Cowie, E.; Cowie, R.; 2008. Abandoning emotion classes - towards continuous emotion recognition with modelling of long-range dependencies. In: Proc. Interspeech, Brisbane, Australia, pp. 597-600.
237. M. Wöllmer, M. Al-Hames, F. Eyben, B. Schuller, and G. Rigoll A multidimensional dynamic time warping algorithm for efficient multimodal fusion of asynchronous data streams Neurocomputing 73 2009 366 380
238. Wöllmer, M.; Eyben, F.; Keshet, J.; Graves, A.; Schuller, B.; Rigoll, G.; 2009. Robust discriminative keyword spotting for emotionally colored spontaneous speech using bidirectional LSTM networks. In: Proc. ICASSP, Taipei, Taiwan, pp. 3949-3952.
239. Wöllmer, M.; Schuller, B.; Eyben, F.; Rigoll, G.; 2010. Combining long short-term memory and dynamic bayesian networks for incremental emotion-sensitive artificial listening. IEEE J. Select. Topics Signal Process. 4, 867-881 (Special Issue on "Speech Processing for Natural Interaction with Intelligent Environments").
240. D. Wolpert Stacked generalization Neural Networks 5 1992 241 259
241. T. Wu, F. Khan, T. Fisher, L. Shuler, and W. Pottenger Posting act tagging using transformation-based learning T.Y. Lin, S. Ohsuga, C.-J. Liau, X. Hu, S. Tsumoto, Foundations of Data Mining and Knowledge Discovery 2005 Springer Berlin-Heidelberg 319 331
242. Wu, C.-H.; Yeh, J.-F.; Chuang, Z.-J.; 2008a. Emotion perception and recognition from speech. In: Affective Information Processing. II. Springer, London, pp. 93-110.
243. Wu, S.; Falk, T.; Chan, W.-Y.; 2008b. Long-term spectro-temporal information for improved automatic speech emotion classification. In: Proc. INTERSPEECH, Brisbane, Australia, pp. 638-641.
244. Yi, J.; Nasukawa, T.; Bunescu, R.; Niblack, W.; 2003. Sentiment analyzer: extracting sentiments about a given topic using natural language processing techniques. In: Proc. IEEE Internat. Conf. on Data Mining (ICDM), Melbourne, FL, pp. 427-434.
245. You, M.; Chen, C.; Bu, J.; Liu, J.; Tao, J.; 2006. Emotion recognition from noisy speech. In: Proc. ICME, Toronto, Canada, pp. 1653-1656. (Pubitemid 46680050)
246. Young, S.; Evermann, G.; Gales, M.; Hain, T.; D.Kershaw, Liu, X.; Moore, G.; Odell, J.; Ollason, D.; Povey, D.; Valtchev, V.; Woodland, P.; 2006. The HTK Book, for htk version 3.4 Edition, Cambridge University Engineering Department.
247. Yu, C.; Aoki, P.; Woodruf, A.; 2004. Detecting user engagement in everyday conversations. In: Proc. ICSLP, pp. 1329-1332.
248. Z. Zeng, Y. Hu, G.I. Roisman, Z. Wen, Y. Fu, and T.S. Huang Audio-visual spontaneous emotion recognition Artif. Intell. Human Comput. 2007 72 90
249. Z. Zeng, J. Tu, M. Liu, T.S. Huang, B. Pianfetti, D. Roth, and S. Levinson Audio-visual affect recognition IEEE Trans. Multimedia 9 2 2007 424 428 (Pubitemid 46183104)
250. Z. Zeng, M. Pantic, G.I. Roisman, and T.S. Huang A survey of affect recognition methods: audio, visual, and spontaneous expressions IEEE Trans. Pattern Anal. Machine Intell. 31 1 2009 39 58
251. Zhe, X.; Boucouvalas, A.; 2002. Text-to-emotion engine for real time internet communication. In: Proc. Internat. Symp. on Communication Systems, Networks, and DSPs, Staffordshire University, pp. 164-168.
252. E. Zwicker, and H. Fastl Psychoacoustics - Facts and Models second ed. 1999 Springer-Verlag