Speaker state recognition using an HMM-based feature extraction method

Computer Speech and Language

Volumn 27, Issue 1, 2013, Pages 135-150

  Gajsek R ^a   Mihelic F ^a   Dobrisek S ^a  

^a UNIVERSITY OF LJUBLJANA   (Slovenia)

Author keywords

Emotion recognition; Hidden Markov Models; Intoxication recognition; Model adaptation; Universal Background Model

Indexed keywords

ACOUSTIC FEATURES; ADAPTATION SCHEME; DETECTION TASKS; EMOTION RECOGNITION; FEATURE EXTRACTION METHODS; GAUSSIAN MIXTURE MODEL; INTOXICATION RECOGNITION; MODEL ADAPTATION; STATE RECOGNITION; STATE-OF-THE-ART SYSTEM; UNIVERSAL BACKGROUND MODEL;

FEATURE EXTRACTION;

HIDDEN MARKOV MODELS;

EID: 84867328373     PISSN: 08852308     EISSN: 10958363     Source Type: Journal    
DOI: 10.1016/j.csl.2012.01.007     Document Type: Article

References (41)

1. Batliner A.; Steidl S.; Hacker C.; and Nöth E. Private emotions versus social interaction: a data-driven approach towards analysing emotion in speech User Model. User-Adapted Interact. 18 2008 175 206
2. Batliner A.; Steidl S.; Schuller B.; Seppi D.; Vogt T.; Wagner J.; Devillers L.; Vidrascu L.; Aharonson V.; Kessous L.; and Amir N. Whodunnit - searching for the most important feature types signalling emotion-related user states in speech Comput. Speech Lang. 25 2011 4 28
3. Baum L.E.; Petrie T.; Soules G.; and Weiss N. A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains Ann. Math. Stat. 41 1970 164 171
4. Bocklet T.; Stemmer G.; Zeißler V.; and Nöth E. Age and gender recognition based on multiple systems - early vs. late fusion INTERSPEECH 2010 2830 2833
5. Burget L.; Matějka P.; and Černocký J. Discriminative training techniques for acoustic language identification Proceedings of ICASSP 2006 2006 209 212
6. Busso C.; Lee S.; and Narayanan S. Analysis of emotionally salient aspects of fundamental frequency for emotion detection IEEE Trans. Audio Speech Lang. Proc. 17 2009 582 596
7. Cowie R.; Douglas-Cowie E.; Tsapatsoulis N.; Votsis G.; Kollias S.; Fellenz W.; and Taylorr J. Emotion recognition in human-computer interaction IEEE Signal Process Mag. 18 1 2001 32 80
8. Davis S.; and Mermelstein P. Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentences IEEE Trans. Acoust. Speech Signal Proc. 28 1980 357 366
9. Dempster A.P.; Laird N.M.; and Rubin D.B. Maximum likelihood from incomplete data via the EM algorithm J. Roy. Stat. Soc. Ser. B (Methodological) 39 1977 1 38
10. Dumouchel P.; Dehak N.; Attabi Y.; Dehak R.; and Boufaden N. Cepstral and long-term features for emotion recognition Proc. INTERSPEECH 2009 Brighton, UK, ISCA 2009 344 347
11. Eyben F.; Wöllmer M.; and Schuller B. openEAR - introducing the munich open-source emotion and affect recognition toolkit Proc. 4th International HUMAINE Association Conference on Affective Computing and Intelligent Interaction 2009 (ACII 2009) Amsterdam, The Netherlands, IEEE 2009 576 581
12. Eyben F.; Wöllmer M.; and Schuller B. openSMILE - the munich versatile and fast open-source audio feature extractor Proc. ACM Multimedia (MM) Florence, Italy 2010 1459 1462
13. Feld M.; Burkhardt F.; and Müller C. Automatic speaker age and gender recognition in the car for tailoring dialog and mobile services INTERSPEECH, ISCA 2010 2834 2837
14. Gajšek R.; Dobrišek S.; and Mihelič F. University of ljubljana system for interspeech 2011 speaker state challenge INTERSPEECH 2011, ISCA 2011 3297 3300
15. Gajšek R.; Štruc V.; and Mihelič F. Multi-modal emotion recognition using canonical correlations and acoustic features Int. Conf. on Pattern Recognition 2010 IEEE Computer Society 2010 4133 4136
16. Gajšek R.; Žibert J.; Justin T.; Štruc V.; Vesnicer B.; and Mihelič F. Gender and affect recognition based on GMM and GMM-UBM modeling with relevance MAP estimation INTERSPEECH-2010 2010 2810 2813
17. Hall M.; Frank E.; Holmes G.; Pfahringer B.; Reutemann P.; and Witten I.H. The WEKA data mining software: an update SIGKDD Expl. 11 2009 10 18
18. Keerthi S.S.; Shevade S.K.; Bhattacharyya C.; and Murthy K.R.K. Improvements to Platt's SMO algorithm for SVM classifier design Neural Comput. 13 3 2001 637 649
19. Kockmann M.; Burget L.; and Černocký J. Brno University of Technology System for Interspeech 2009 Emotion Challenge Proc. INTERSPEECH 2009, ISCA 2009 348 351
20. Kockmann M.; Burget L.; and Černocký J. Brno University of Technology System for Interspeech 2010 Paralinguistic Challenge Proc. INTERSPEECH 2010, ISCA 2010 2822 2825
21. Lee C.H.; and Gauvain J.L. Speaker adaptation based on MAP estimation of HMM parameters Acoustics, Speech, and Signal Processing, 1993 IEEE International Conference on ICASSP-93, vol. 2 1993 558 561
22. Linde Y.; Buzo A.; and Gray R. An algorithm for vector quantizer design IEEE Trans. Commun. 28 1980 84 95
23. Mihelič F.; Gros J.; Dobrišek S.; Žibert J.; and Pavešić N. Spoken Language Resources at LUKS of the University of Ljubljana Int. J Speech Technol. 6 2003 221 232
24. Nitesh V.; and Chawla E.A. Synthetic minority over-sampling technique J. Artif. Intel. Res. 16 2002 321 357
25. Platt J.C. Fast training of support vector machines using sequential minimal optimization Schoelkopf B. Burges C. Smola A. Advances in Kernel Methods - Support Vector Learning 1999 MIT Cambridge, MA, USA 185 208
26. Pols, L.C.W.; 1966. Spectral Analysis and Identification of Dutch Vowels in Monosyllabic Words. Ph.D. thesis. Free University, Amsterdam, Netherlands.
27. Reynolds D.A.; Quatieri T.F.; and Dunn R.B. Speaker Verification Using Adapted Gaussian Mixture Models Digit. Signal Proc. 10 2000 19 41
28. Schiel F.; Heinrich C.; and Barfüsser S. Alcohol language corpus: the first public corpus of alcoholized german speech Lang. Resourc. Eval. 2011 1 19
29. Schuller B.; Batliner A.; Seppi D.; Steidl S.; Vogt T.; Wagner J.; Devillers L.; Vidrascu L.; Amir N.; Kessous L.; and Aharonson V. The relevance of feature type for the automatic classification of emotional user states: low level descriptors and functionals INTERSPEECH, ISCA Antwerp, Belgium 2007 2253 2256
30. Schuller, B.; Batliner, A.; Steidl, S.; Seppi, D.; 2011. Recognising realistic emotions and affect in speech: state of the art and lessons learnt from the first challenge. Speech Communication, in press.
31. Schuller B.; Hage C.; Schuller D.; and Rigoll G. 'Mister D.J.; Cheer me up!': musical and textual features for automatic mood classification J. New Music Res. (JNMR) 38 4 2009 Taylor & Francis
32. Schuller B.; Steidl S.; and Batliner A. The INTERSPEECH 2009 emotion challenge INTERSPEECH 2009 ISCA, Brighton, UK 2009 312 315
33. Schuller B.; Steidl S.; Batliner A.; Burkhardt F.; Devillers L.; Müller C.; and Narayanan S. The INTERSPEECH 2010 paralinguistic challenge ISCA INTERSPEECH 2010, ISCA 2010 2794 2797
34. Schuller B.; Steidl S.; Batliner A.; Burkhardt F.; Devillers L.; Müller C.; and Narayanan S. The INTERSPEECH 2011 speaker state challenge INTERSPEECH 2011, ISCA 2011 3201 3204
35. Schuller B.; Vlasenko B.; Eyben F.; Rigoll G.; and Wendemuth A. Acoustic emotion recognition: A benchmark comparison of performances Proceedings of Automatic Speech Recognition and Understanding Workshop (ASRU) 2009 552 557
36. Schuller B.; Wöllmer M.; Eyben F.; and Rigoll G. The role of prosody in affective speech, linguistic insights, studies in language and communication J. New Music Res. 97 2009 285 307
37. Steidl S. Automatic Classification of Emotion-Related User States in Spontaneous Children's Speech 2009 Logos Verlag Berlin
38. Vapnik V.N. Statistical Learning Theory 1998 Wiley-Interscience
39. Vlasenko B.; and Wendemuth A. Processing affected speech within human-machine interaction Proc. INTERSPEECH 2009 Brighton, UK, ISCA 2009 2039 2042
40. Žibert J.; Pavešić N.; and Mihelič F. Speech/non-speech segmentation based on phoneme recognition features EURASIP J. Appl. Signal Proc. 2006 1 13
41. Young S.J.; Evermann G.; Gales M.J.F.; Hain T.; Kershaw D.; Moore G.; Odell J.; Ollason D.; Povey D.; Valtchev V.; and Woodland P.C. The HTK Book, Version 3.4.1. 2009 Cambridge University Engineering Department Cambridge, UK