On the use of speech parameter contours for emotion recognition

Eurasip Journal on Audio, Speech, and Music Processing

Volumn 2013, Issue 1, 2013, Pages

  Sethu, Vidhyasaharan ^a   Ambikairajah, Eliathamby ^a   Epps, Julien ^a  

^a UNIVERSITY OF NEW SOUTH WALES   (Australia)

Author keywords

Emotion recognition; Formant contours; Glottal spectrum; LDC emotional prosody speech corpus; Paralinguistic information; Pitch contours; Temporal information

Indexed keywords

EMOTION RECOGNITION; FORMANT CONTOURS; GLOTTAL SPECTRUM; PARALINGUISTIC INFORMATION; PITCH CONTOURS; SPEECH CORPORA; TEMPORAL INFORMATION;

HIDDEN MARKOV MODELS;

SPEECH;

EID: 84887104454     PISSN: 16874714     EISSN: 16874722     Source Type: Journal    
DOI: 10.1186/1687-4722-2013-19     Document Type: Article

References (50)

1. Barra R, Montero JM, Macias-Guarasa J, D'Haro LF, San-Segundo R, Cordoba R: Prosodic and segmental rubrics in emotion identification, in Proceedings of the 2006 IEEE. Speech and Signal Processing, vol. 1 (IEEE, Piscataway, 2006): International Conference on Acoustics; 2006:1.
2. Borchert M, Dusterhoft A: Emotions in speech - experiments with prosody and quality features in speech for use in categorical and dimensional emotion recognition environments, in Proceedings of 2005 IEEE International Conference on Natural Language Processing and Knowledge Engineering (IEEE NLP-KE'05). IEEE: Piscataway; 2005:147-151.
3. Lugger M, Yang B: An incremental analysis of different feature groups in speaker independent emotion recognition, in Proceedings of the 16th International Congress of Phonetic Sciences, Saarbruecken, August 2007. IEEE: Washington; 2007. pp. 2149-2152
4. Pantic M, Rothkrantz LJM: Toward an affect-sensitive multimodal human-computer interaction. Proc IEEE 2003, 91:1370-1390. (Pubitemid 40890819)
5. Ververidis D, Kotropoulos C: Emotional speech recognition: resources, features, and methods. Speech Communication 2006, 48:1162-1181. (Pubitemid 44128615)
6. Vidrascu L, Devillers L: Five emotion classes detection in real-world call center data: the use of various types of paralinguistic features, in Proceedings of International Workshop on Paralinguistic Speech - 2007. Saarbrücken August 2007, 3:11-16.
7. Yacoub S, Simske S, Lin X, Burns J: Recognition of emotions in interactive voice response systems, in Proceedings of the 8th European Conference on Speech Communication and Technology, EUROSPEECH 2003 - INTERSPEECH 2003. Geneva September 2003, 1-4:729-732.
8. Bitouk D, Verma R, Nenkova A: Class-level spectral features for emotion recognition. Speech Communication 2010, 52:613-625.
9. El Ayadi M, Kamel MS, Karray F: Survey on speech emotion recognition: features, classification schemes, and databases. Pattern Recognition 2011, 44:572-587.
10. Lee C, Narayanan S, Pieraccini R: Combining acoustic and language information for emotion recognition, in Seventh International Conference on Spoken Language Processing. Denver: September; 2002:873-876.
11. Schuller B, Batliner A, Steidl S, Seppi D: Emotion recognition from speech: putting ASR in the loop, in Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2009. IEEE: Piscataway; 2009:4585-4588.
12. Fant G: Acoustic Theory of Speech Production. The Hague: Mouton; 1960.
13. Schuller B, Rigoll G, Lang M: Hidden Markov model-based speech emotion recognition, in Proceedings of International Conference on Acoustics. IEEE, New York, 2003: Speech, and Signal Processing, (ICASSP'03). vol 2 2nd edn; 2003:1-4.
14. Nogueiras A, Moreno A, Bonafonte A, Mariño J: Speech emotion recognition using hidden Markov models, in Proceedings of EUROSPEECH-2001. Scandinavia: EUROSPEECH; 2001:2679-2682.
15. Schuller B, Seppi D, Batliner A, Maier A, Steidl S: Towards more reality in the recognition of emotional speech, in Proceedings IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2007), Honolulu, April 2007. Volume 4. IEEE: Piscataway; 2007:941-944.
16. Vlasenko B, Schuller B, Wendemuth A, Rigoll G: Frame vs. turn-level: emotion recognition from speech considering static and dynamic processing, in Affective Computing and Intelligent Interaction. Springer Berlin, Heidelberg, 2007: Frame vs. turn-level: emotion recognition from speech considering static and dynamic processing, in Affective Computing and Intelligent Interaction; 2007:139-147.
17. Planet S, Iriondo I, Socoró J, Monzo C, Adell J: GTM-URL contribution to the INTERSPEECH 2009 Emotion Challenge, in Proceedings of the 10th Annual Conference of the International Speech Communication Association (INTERSPEECH-2009). Brighton September 2009, 6-10:316-319.
18. Wu S, Falk TH, Chan W-Y: Automatic speech emotion recognition using modulation spectral features. Speech Communication 2011, 53:768-785.
19. Dumouchel P, Dehak N, Attabi Y, Dehak R, Boufaden N: Cepstral and long-term features for emotion recognition, in Proceedings of the 10th Annual Conference of the International Speech Communication Association (INTERSPEECH-2009). Brighton September 2009, 6-10:344-347.
20. Moriyama T, Ozawa S: Emotion recognition and synthesis system on speech, in IEEE International Conference on Multimedia Computing and Systems, 1999 vol 1. 1st edition. New York: IEEE; 1999:840-844.
21. Sethu V, Ambikairajah E, Epps J: Pitch contour parameterisation based on linear stylisation for emotion recognition, in Proceedings of the 10th Annual Conference of the International Speech Communication Association (INTERSPEECH-2009). Brighton September 2009, 6-10:2011-2014.
22. Childers DG, Lee CK: Vocal quality factors: analysis, synthesis, and perception. J. Acoust. Soc. Am. 1991, 90:2394-2410.
23. Cabral J, Renals S, Richmond K, Yamagishi J: Towards an improved modeling of the glottal source in statistical parametric speech synthesis, in 6th ISCA Workshop on Speech Synthesis. Germany: Bonn; 2007.
24. D'Alessandro C, Doval B: Voice quality modification for emotional speech synthesis, in Proceedings of the 8th European Conference on Speech Communication and Technology. Geneva: EUROSPEECH 2003 - INTERSPEECH 2003; 2003:1653-1656.
25. He L, Lech M, Allen N: On the importance of glottal flow spectral energy for the recognition of emotions in speech, in Proceedings of the 11th Annual Conference of the International Speech Communication Association, INTERSPEECH 2010. Makuhari, Chiba, Japan September 2010, 26-30:2346-2349.
26. Tao J, Kang Y: Features importance analysis for emotional speech classification, in Affective Computing and Intelligent Interaction. Springer Berlin, Heidelberg, 2005: ed. by J Tao et al; 2005:449-457.
27. Rui S, Moore E: JF Torres, Investigating glottal parameters for differentiating emotional categories with similar prosodics, in IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2009. New York: IEEE; 2009:4509-4512.
28. Fant G, Liljencrants J, Lin Q: A four-parameter model of glottal flow. STL-QPSR 1985, 4:1-13.
29. Rosenberg AE: Effect of glottal pulse shape on the quality of natural vowels. J. Acoust. Soc. Am. 1971, 49:583-590.
30. Klatt DH, Klatt LC: Analysis, synthesis, and perception of voice quality variations among female and male talkers. J. Acoust. Soc. Am. 1990, 87:820-857. (Pubitemid 20129722)
31. Veldhuis R: A computationally efficient alternative for the Liljencrants-Fant model and its perceptual evaluation. J. Acoust. Soc. Am. 1998, 103:566-571. (Pubitemid 28042430)
32. Doval B: C d'Alessandro, N Henrich. The spectrum of glottal flow models. Acta Acustica united with Acustica 2006, 92:1026-1046.
33. Alku P: Glottal wave analysis with pitch synchronous iterative adaptive inverse filtering, in Proceedings of the EUROSPEECH-1991. Mechanicsburg: ICSA; 1991:1081-1084.
34. Cabral J, Renals S, Richmond K, Yamagishi J: Glottal spectral separation for parametric speech synthesis, in Proceedings of INTERSPEECH-2008. Brisbane: ICSA; 2008:1829-1832.
35. Frohlich M, Michaelis D, Strube HW: SIM-simultaneous inverse filtering and matching of a glottal flow model for acoustic speech signals. J. Acoust. Soc. Am. 2001, 110:479-488. (Pubitemid 32642587)
36. Hui-Ling L: JO Smith III, Joint estimation of vocal tract filter and glottal source waveform via convex optimization, in 1999 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics. IEEE: Piscataway; 1999:79-82.
37. Riegelsberger EL, Krishnamurthy AK: Glottal source estimation: methods of applying the LF-model to inverse filtering, in 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP-93, vol 2. 2nd edition. IEEE: Piscataway; 1993. pp. 542-545
38. Vincent D, Rosec O, Chonavel T: Estimation of LF glottal source parameters based on an ARX model, in Proceedings of INTERSPEECH 2005 - EUROSPEECH, 9th European Conference on Speech Communication and Technology. Lisbon September 2005, 4-8:333-336.
39. Naylor PA, Anastasis K, Jon G, Mike B: Estimation of glottal closure instants in voiced speech using the DYPSA algorithm. IEEE Transactions on Audio, Speech, and Language Processing 2007, 15:34-43.
40. Wang D, Narayanan S: Piecewise linear stylization of pitch via wavelet analysis, in Proceedings of INTERSPEECH 2005 - EUROSPEECH, 9th European Conference on Speech Communication and Technology. Lisbon September 2005, 4-8:3277-3280.
41. Ravuri S: DPW Ellis, Stylization of pitch with syllable-based linear segments, in IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2008. IEEE: Piscataway; 2008:3985-3988.
42. Liberman M, Davis K, Grossman M, Martey N: J Bell, Emotional prosody speech and transcripts. LDC catalog no. LDC2002S28: Linguistic Data Consortium (LDC) database; 2007. http://www.ldc.upenn.edu/Catalog/CatalogEntry.jsp? catalogId=LDC2002S28 ISBN 1-58563-237-6
43. Steidl S: Automatic Classification of Emotion-Related User States in Spontaneous Children's Speech. Berlin: Logos Verlag; 2009.
44. Banse R, Scherer K: Acoustic profiles in vocal emotion expression. J. Pers. Soc. Psychol. 1996, 70:614-636. (Pubitemid 126420699)
45. Schuller B, Steidl S, Batliner A: The INTERSPEECH 2009 Emotion Challenge, in INTERSPEECH-2009. Brighton: ISCA; 2009:312-315.
46. McAulay R, Quatieri T: Speech analysis/synthesis based on a sinusoidal representation. Acoustics, Speech and Signal Processing, IEEE Transactions on 1986, 34:744-754.
47. Talkin D: A robust algorithm for pitch tracking (RAPT), in Speech Coding and Synthesis. Elsevier, New York: by W Kleijn, K Paliwal; 1995:495-518.
48. Nwe TL, Foo SW, De LC: Silva, Speech emotion recognition using hidden Markov models. Speech Communication 2003, 41:603-623.
49. Huang R, Ma C: Toward a speaker-independent real-time affect detection system, in 18th International Conference on Pattern Recognition ICPR 2006. Volume 1. New York: IEEE; 2006:1204-1207.
50. Sethu V, Ambikairajah E, Epps J: Speaker normalisation for speech-based emotion detection, in 15th International Conference on Digital Signal Processing, 2007. IEEE: Piscataway; 2007:611-614.