Affective speaker state analysis in the presence of reverberation

International Journal of Speech Technology

Volumn 14, Issue 2, 2011, Pages 77-87

  Schuller, Björn ^a  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

Affective computing; Model adaptation; Reverberation; Speaker classification

Indexed keywords

ACOUSTIC ENVIRONMENT; AFFECTIVE COMPUTING; AFFECTIVE SPEECH; CLASSIFICATION SYSTEM; DATA SETS; FEATURE TYPES; MODEL ADAPTATION; PUBLIC ROOMS; SPEAKER ADAPTATION; SPEAKER CLASSIFICATION; SPEECH DATA; STATE ANALYSIS;

IMPULSE RESPONSE;

REVERBERATION;

EID: 80052565773     PISSN: 13812416     EISSN: 15728110     Source Type: Journal    
DOI: 10.1007/s10772-011-9090-8     Document Type: Article

References (45)

1. Athanaselis, T., Bakamidis, S., Dologlu, I., Cowie, R., Douglas-Cowie, E., & Cox, C. (2005). ASR for emotional speech: clarifying the issues and enhancing performance. Neural Networks, 18, 437-444. (Pubitemid 40922650)
2. Batliner, A., Steidl, S., Schuller, B., Seppi, D., Laskowski, K., Vogt, T., Devillers, L., Vidrascu, L., Amir, N., Kessous, L., & Aharonson, V. (2006). Combining efforts for improving automatic classification of emotional user states. In Proc. IS-LTC 2006 (pp. 240-245), Ljubliana.
3. Batliner, A., Steidl, S., Schuller, B., Seppi, D., Vogt, T., Wagner, J., Devillers, L., Vidrascu, L., Aharonson, V., & Amir, N. (2011). Whodunnit-searching for the most important feature types signalling emotional user states in speech. Computer Speech and Language, 25, 4-28.
4. Burkhardt, F., Paeschke, A., Rolfes, M., Sendlmeier, W., & Weiss, B. (2005). A database of German emotional speech. In Proc. Interspeech (pp. 1517-1520), Lisbon. (Pubitemid 43908362)
5. Campanini, S., & Farina, A. (2009). A new audacity feature: room objective acoustical parameters calculation module. In Proc. Linux audio conference.
6. Datcu, D., & Rothkrantz, L. J. M. (2008). Semantic audio-visual data fusion for automatic emotion recognition. In Proc. Euromedia 2008, Eurosis.
7. Grimm, M., Kroschel, K., Harris, H., Nass, C., Schuller, B., Rigoll, G., & Moosmayr, T. (2007). On the necessity and feasibility of detecting a driver's emotional state while driving. In A. Paiva, R. Prada, & R. W. Picard (Eds.), Affective computing and intelligent interaction (pp. 126-138). Berlin: Springer.
8. Haderlein, T., Nöth, E., Herbordt,W., Kellermann,W., & Niemann, H. (2005). Using artificially reverberated training data in distanttalking ASR. In LNCS: Vol. 3658. Text, speech and dialogue (pp. 226-233). Berlin: Springer.
9. Hall, M. A. (1998). Correlation-based feature selection for machine learning. PhD thesis, Hamilton, Waikato University, Department of Computer Science.
10. Kandali, A. B., Routray, A., & Basu, T. K. (2009). Vocal emotion recognition in five native languages of assam using new wavelet features. International Journal of Speech Technology, 12, 1-13.
11. Kim, E. H., Hyun, K. H.,& Kwak, Y. K. (2005). Robust emotion recognition feature, frequency range of meaningful signal. In Proc. IEEE international workshop on robots and human interactive communication (RO-MAN) (pp. 667-671), Nashville, USA. (Pubitemid 44144459)
12. Lee, K. K., Cho, Y. H., & Park, K. S. (2006). Robust feature extraction for mobile-based speech emotion recognition system. In Lecture notes in control and information sciences. Intelligent computing in signal processing and pattern recognition (pp. 470-477). Berlin: Springer.
13. Lugger, M., Yang, B., & Wokurek, W. (2006). Robust estimation of voice quality parameters under real world disturbances. In Proc. ICASSP (pp. 1097-1100), Toulouse.
14. Mansoorizadeh, M., & Charkari, N. M. (2008). Bimodal persondependent emotion recognition comparison of feature level and decision level information fusion. In Proc. 1st international conference on pervasive technologies related to assistive environments (pp. 1-4). New York: ACM.
15. Martin, O., Kotsia, I., Macq, B., & Pitas, I. (2006). The enterface'05 audio-visual emotion database. In Proc. IEEE workshop on multimedia database management.
16. Meng, H., Pittermann, J., Pittermann, A., & Minker, W. (2007). Combined speech-emotion recognition for spoken human-computer interfaces. In Proc. international conference on signal processing and communications (pp. 1179-1182), Dubai, United Emirates. New York: IEEE Press.
17. Naylor, PA, & Gaubitch, N. D. (2005). Speech dereverberation. In Proc. 2005 international workshop on acoustic echo and noise control, EURASIP.
18. Naylor, P.,& Gaubitch, N. D. (2010). Speech dereverberation. London: Springer.
19. Neely, S. T. & Allen, J. B. (1979). Invertibility of a room impulse response. Journal of the Acoustical Society of America, 66, 165-169.
20. Paleari, M., Benmokhtar, R., & Huet, B. (2008). Evidence theorybased multimodal emotion recognition. In Proc. 15th international multimedia modeling conference on advances in multimedia modeling (pp. 435-446). Berlin: Springer.
21. Payton, K. L., Uchanski, R. M., & Braida, L. D. (1994). Intelligibility of conversational and clear speech in noise and reverberation for listeners with normal and impaired hearing. Journal of the Acoustical Society of America, 95, 1581-1592. (Pubitemid 24085759)
22. Pittermann, J., Pittermann, A., & Minker, W. (2010). Emotion recognition and adaptation in spoken dialogue systems. International Journal of Speech Technology, 13, 49-60.
23. Raja, G. S., & Dandapat, S. (2010). Speaker recognition under stressed condition. International Journal of Speech Technology, 13, 141-161.
24. Schröder, M., Cowie, R., Heylen, D., Pantic, M., Pelachaud, C., & Schuller, B. (2008). Towards responsive sensitive artificial listeners. In Proc. 4th international workshop on human-computer conversation, Bellagio.
25. Schuller, B., Jiménez Villar, R., Rigoll, G., & Lang, M. (2005). Metaclassifiers in acoustic and linguistic feature fusion-based affect recognition. In Proc. ICASSP (Vol. I, pp. 325-328), Philadelphia.
26. Schuller, B., Arsíc, D., Wallhoff, F., & Rigoll, G. (2006a). Emotion recognition in the noise applying large acoustic feature sets. In Proc. speech prosody 2006, Dresden.
27. Schuller, B., Köhler, N., Müller, R., & Rigoll, G. (2006b). Recognition of interest in human conversational speech. In Proc. interspeech (pp. 793-796), Pittsburgh.
28. Schuller, B., Reiter, S., & Rigoll, G. (2006c). Evolutionary feature generation in speech emotion recognition. In Proc. international conference on multimedia and Expo ICME 2006 (pp. 5-8), Toronto, Canada. (Pubitemid 46679640)
29. Schuller, B., Seppi, D., Batliner, A., Meier, A., & Steidl, S. (2007). Towards more reality in the recognition of emotional speech. In Proc. ICASSP (pp. 941-944), Honolulu.
30. Schuller, B., Wimmer, M., Arsic, D., Moosmayr, T., & Rigoll, G. (2008a). Detection of security related affect and behaviour in passenger transport. In Proc. interspeech (pp. 265-268), Brisbane.
31. Schuller, B., Wimmer, M., Mösenlechner, L., Kern, C., Arsic, D., & Rigoll, G. (2008b). Brute-forcing hierarchical functionals for paralinguistics: a waste of feature space. In Proc. ICASSP (pp. 4501-4504), Las Vegas.
32. Schuller, B., Müller, R., Eyben, F., Gast, J., Hörnler, B., Wöllmer, M., Rigoll, G., Höthker, A., & Konosu, H. (2009). Being bored? Recognising natural interest by extensive audiovisual integration for real-life application. Image and Vision Computing Journal, 27, 1760-1774. Special Issue on Visual and Multimodal Analysis of Human Spontaneous Behavior.
33. Schuller, B., Steidl, S., Batliner, A., Burkhardt, F., Devillers, L., Müller, C., & Narayanan, S. (2010a). The INTERSPEECH 2010 paralinguistic challenge. In Proc. INTERSPEECH 2010 (pp. 2794-2797), Makuhari, Japan.
34. Schuller, B., Steidl, S., Batliner, A., & Seppi, D. (2010b). Recognising realistic emotions and affect in speech: state of the art and lessons learnt from the first challenge. Speech Communication. Special issue on "Sensing emotion and affect-facing realism in speech processing".
35. Schuller, B., Vlasenko, B., Eyben, F.,Wöllmer,M., Stuhlsatz, A.,Wendemuth, A., & Rigoll, G. (2010c). Cross-corpus acoustic emotion recognition: variances and strategies. IEEE Transactions on Affective Computing, 1.
36. Slavova, V., Verhelst, W., & Sahli, H. (2008). A cognitive science reasoning in recognition of emotions in audio-visual speech. International Journal Information Technologies and Knowledge, 2, 324-334.
37. Steidl, S., Batliner, A., Seppi, D., & Schuller, B. (2010). On the impact of children's emotional speech on acoustic and language models. EURASIP Journal on Audio, Speech, and Music Processing, 2010, 783954.
38. Tawari, A., & Trivedi, M. (2010). Speech emotion analysis in noisy real world environment. In Proc. ICPR (pp. 4605-4608), Istanbul, Turkey.
39. Ververidis, D., & Kotropoulos, C. (2006). Fast sequential floating forward selection applied to emotional speech features estimated on des and susas data collection. In Proc. European signal processing conf. (EUSIPCO 2006), Florence.
40. Witten, I. H., & Frank, E. (2005). Data mining: practical machine learning tools and techniques (2nd edn.). San Francisco: Morgan Kaufmann.
41. Wöllmer, M., Eyben, F., Keshet, J., Graves, A., Schuller, B., & Rigoll, G. (2009). Robust discriminative keyword spotting for emotionally colored spontaneous speech using bidirectional LSTM networks. In Proc. of ICASSP (pp. 3949-3952), Taipei, Taiwan.
42. Yoon, W. J., Cho, Y. H., & Park, K. S. (2007). A study of speech emotion recognition and its application to mobile services. In Lecture notes in computer science. Ubiquitous intelligence and computing (pp. 758-766). Berlin: Springer.
43. You, M., Chen, C., Bu, J., Liu, J., & Tao, J. (2006). Emotion recognition from noisy speech. In Proc. ICME (pp. 1653-1656), Toronto. (Pubitemid 46680050)
44. You, M., Chen, C., Bu, J., Liu, J., & Tao, J. (2007). Manifolds based emotion recognition in speech. Computational Linguistics and Chinese Language Processing, 12, 49-64.
45. Zeng, Z., Pantic, M., Roisman, G. I., & Huang, T. S. (2009). A survey of affect recognition methods: audio, visual, and spontaneous expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(1), 39-58.