Emotional speech characterization based on multi-features fusion for face-to-face interaction

3rd International Conference on Signals, Circuits and Systems, SCS 2009

Volumn , Issue , 2009, Pages

  Mahdhaoui, Ammar ^a   Ringeval, Fabien ^a   Chetouani, Mohamed ^a  

^a SORBONNE UNIVERSITÉ   (France)

Author keywords

Data driven approach; Emotional speech; Face to face interaction; Feature extraction; Statistical fusion; Time scales analysis

Indexed keywords

CLASS PROBABILITIES; COMPUTATIONAL FRAMEWORK; DATA-DRIVEN APPROACH; EMOTION RECOGNITION; EMOTIONAL SPEECH; EMOTIONAL STATE; FACE-TO-FACE INTERACTION; FEATURE SPACE; FUSION METHODOLOGY; FUSION TIME; NON-VERBAL COMMUNICATIONS; POSTERIORI; PROSODIC FEATURES; REAL-LIFE APPLICATIONS; SOCIAL INTERACTIONS; SPEAKING STYLES; SPEECH SEGMENTS; TIME SCALE ANALYSIS; TIME-SCALES; VOICE QUALITY; WEIGHTING FACTORS;

COMMUNICATION; LINGUISTICS; SIGNAL DETECTION; SPEECH ANALYSIS;

FEATURE EXTRACTION;

EID: 77951482455     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICSCS.2009.5412691     Document Type: Conference Paper

References (37)

1. Jianhua, T. and Tan, T. "Affective Computing: A Review". Affective Computing and Intelligent Interaction LNCS 3784: 981995, Springer. doi:10.1007/11573548, (2005)
2. Picard, R. "Affective Computing". MIT Press, ( 1997)
3. Pentland, A. Social signal processing, IEEE Signal Processing Magazine, 24(4), 108-111, (2007)
4. Vinciarelli, A., Pantic, M., Bourlard, H. and Pentland, A. Social signals, their function, and automatic analysis: a survey, IEEE International Conference on Multimodal Interfaces (ICMI'08), 61-68, (2008)
5. Schuller, B., Batliner, A., Seppi, D., Steidl, S., Vogt, T., Wagner, J., Devillers, L., Vidrascu, L., Amir, N., Kessous, L. and Aharonson, V. The relevance of feature type for the automatic classification of emotional user states: low level descriptors and functionals. In Proc. of Interspeech, 2253-2256, (2007)
6. Campbell, N. On the Use of NonVerbal Speech Sounds in Human Communication. in A. Esposito et al. (Eds.): Verbal and Nonverbal Commun. Behaviours, LNAI 4775, 117-28, 2007; Springer-Verlag Berlin Heidelberg, (2007)
7. Williams, C.-E. and Stevens, K.-N. Emotions and speech: some acoustic correlates. Journal of the Acoustical Society of America 52, 1238-1250, (1972)
8. Murray, I.-R. and Amott, J.-L. Toward the simulation of emotion in synthetic speech - A review of the literature on human vocal emotion. Journal of Acoustic Society of America, 93(2), 1097-1108, (1993)
9. Shami, M. and Verfielst., W. An Evaluation of the Robustness of Existing Supervised Machine Learning Approaches to the Classification of Emotions, Speech.Speech Communication, 49(3), 201-212, (2007)
10. Vlasenko, B., Schuller, B., Wendemuth, A. and Rigoll, G. Frame vs. Turn-Level: Emotion Recognition from Speech Considering Static and Dynamic Processing, Affective Computing and Intelligent Interaction, 139-147, (2007)
11. Schuller, B., Vlasenko, B., Minguez, R., Rigoll, G. and Wendemuth, A., Comparing one and two-stage acoustic modeling in the recognition of emotion in speech. In Proc. of IEEE Automatic Speech Recognition and Understanding Workshop (ASRU 2007), 596-600, (2007).
12. Kim, S., Georgiou, P., Lee, S. and Narayanan, S. Realtime emotion detection system using speech: Multimodal fusion of different timescale features. IEEE International Workshop on Multimedia Signal Processing, (2007)
13. Fernald, A. and Simon, T. Expanded intonation contours in mother's speech to newborns. Developmental Psychology, 20(1), 104-113, (1987)
14. Fernald, A. and Kuhl, P. Acoustic determinants of infant preference for Motherese speech. Infant Behavior and Development, 10, 279-293 (1987)
15. Maestrea S. el al., Early Behavioral Development in Autistic Children: The First 2 Years of Life through Home Movies, Psychopathology, 34: 147-152, (2001)
16. Mahdhaoui, A., Chetouani, M., Zong, C., Cassei, R. S., Saint-Georges, C., Laznik, M-C., Maestro, S., Apicella, F., Muratori, F. and Cohen, D. Automatic Motherese Detection for Face-to-Face Interaction Analysis, In Anna Esposito et al. (ed.) Springer-Verlag, Multimodal Signals: Cognitive and Algorithmic Issues, 248-255, (2009)
17. Mahdhaoui, A., Chetouani, M., Zong, C., Motherese Detection Based On Segmental and Supra-Segmental Features. International Conference on Pattern Recognition, ICPR 2008, (2008)
18. Chetouani, M., Faundez-Zanuy, M., Gas, B. and Zarader, J.-L. Investigation on LP-residual representations for speaker identification, Pattern Recognition, 42(3), 487-494, (2009)
19. Duda, R.-O., Hart, P.-E. and Stork, D.-G. "Pattern classification". 2nd edition. New York: Wiley, (2000)
20. Kuncheva, I. "Combining pattern classifiers: Methods & algorithms". Wiley, (2004)
21. Monte-Moreno, E., Chetouani, M., Faundez-Zanuy, M., and Sole-Casals, J. Maximum Likelihood Linear Programming Data Fusion for Speaker Recognition. Speech Communication, In press. (2009).
22. Reynolds, D. Speaker identification and verification using Gaussian mixture speaker models, Speech Communication, 17, 91-108, (1995)
23. Leinonen, L., Hiltunen, T., Linnankoski, I., and Laakso, M.-J. Expression or emotional-motivational connotations with a one-word utterance, Journal of Acoustic Society of America, 102(3): 53-63, (1997)
24. Pereira, C. and Watson, C. Some Acoustic Characteristics of Emotion. In International Conference on Spoken Language Processing (ICSLP98), 927-930, (1998).
25. Lee, C. M., Yildirim, S., Bulut, M., Kazemzadeh, A., Busso, C., Deng, Z., Lee, S. and Narayanan, S. Effects of emotion on different phoneme classes. Journal of Acoustic Society of America., 116(4), 2481,(2004).
26. Ringeval, F., Chetouani, M., Exploiting a vowel based approach for acted emotion recognition, in A. Esposito and al. [Ed]: Verbal and Nonverbal Features of Human-Human and Human-Machine Interaction, LNAI 5042, Springer-Verlag Berlin Heidelberg, 244-245, (2008)
27. Ringeval, F., Chetouani, M. A Vowel Based Approach for Acted Emotion Recognition, In Proc. of Interspeech' 08, 2763-2766, (2008)
28. André-Ohrecht, R. A new statistical approach for automatic speech segmentation, IEEE Transaction on ASSP, 36(1): 29-40 (1988)
29. Rouas, J.L., Farinas, J., Pellegrino, F., André-Obrecht, R. Rhythmic unit extraction and modelling for automatic language identification, Speech Communication, 47(4): 436-456, (2005)
30. Burkhardt, F. and al., A database of German emotional speech, in Proc. of Interspeech, 1517-1520, (2005)
31. Robnik, M. and Konenko, I, Theoretical and empirical analysis of ReliefF and RReliefF, Machine Learning Journal, 53, 23-69, (2003)
32. Keller, E. and Port, R. Speech timing: Approaches to speech rhythm. Special session on timing. In Proc. of the International congress of phonetic sciences, 327-329, (2007)
33. Tincoff, R., Hauser, M., Tsao, F., Spaepen, G., Ramus, F. and Mehler, J. The role of speech rhythm in language discrimination: further tests with anonhumanprimate. Dev Sci. 8(1): 26-35, (2005)
34. Ramus F., Nespor M., Mehler J. Correlates of linguistic rhythm in the speech signal. Cognition. 73(3): 265-292, (1999)
35. Grabe, E., and Low, E. Durational variability in. speech and the rhythm class hypothesis. Papers in Laboratory Phonology 7, Mouton, (2002)
36. Ringeval, F., and Chetouani, M. Non-linearity modelling of speech. rhythm using Hilbert-Huang Transform. In Proc. of NOn-LInear Speech Processing, NOLISP 2009, (2009)
37. Chetouani, M., Mahdhaoui, A., Ringeval, F., Time-Scale Features Extractions for Emotional Speech Characterization. Cognitive Computation 1(2): 194-201 (2009)