Automatic extraction of paralinguistic information using prosodic features related to F0, duration and voice quality

Speech Communication

Volumn 50, Issue 6, 2008, Pages 531-543

  Ishi, Carlos Toshinori ^a   Ishiguro, Hiroshi ^a   Hagita, Norihiro ^a  

^a ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

Author keywords

Automatic detection; Emotion; Paralinguistic information; Prosody; Speech act; Voice quality

Indexed keywords

FEATURE EXTRACTION; INFORMATION ANALYSIS; LINGUISTICS; PROBLEM SOLVING; SPEECH INTELLIGIBILITY;

AUTOMATIC DETECTION; CLASSICAL PROSODIC FEATURES; PARALINGUISTIC INFORMATION; PROSODY; SPEECH ACTS; VOICE QUALITY;

SPEECH RECOGNITION;

EID: 44149121656     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2008.03.009     Document Type: Article

References (31)

1. Campbell N., and Erickson D. What do people hear? A study of the perception of non-verbal affective information in conversational speech. J. Phonet. Soc. Jpn. 8 1 (2004) 9-28
2. Campbell, N., Mokhtari, P., 2003. Voice quality, the 4th prosodic dimension. In: Proceedings of 15th International Congress of Phonetic Sciences (ICPhS2003), Barcelona, pp. 2417-2420.
3. Dang J., and Honda K. Acoustic characteristics of the piriform fossa in models and humans. J. Acoust. Soc. Amer. 101 1 (1966) 456-465
4. Erickson D. Expressive speech: Production, perception and application to speech synthesis. Acoust. Sci. Tech. 26 4 (2005) 317-325
5. Fernandez, R., Picard, R.W., 2005. Classical and novel discriminant features for affect recognition from speech. In: Proceedings of Interspeech 2005, Lisbon, Portugal, pp. 473-476.
6. Fujie, S., Ejiri, Y., Matsusaka, Y., Kikuchi, H., Kobayashi, T., 2003. Recognition of paralinguistic information and its application to spoken dialogue system. In: Proceedings of IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU'03), St. Thomas, US, pp. 231-236.
7. Fujimoto, M., Maekawa, K. 2003. Variation of phonation types due to paralinguistic information: An analysis of high-speed video images. In: Proceedings of 15th International Congress of Phonetic Sciences (ICPhS2003), Barcelona, pp. 2401-2404.
8. Gobl C., and Ní Chasaide A. The role of voice quality in communicating emotion, mood and attitude. Speech Comm. 40 (2003) 189-212
9. Gordon M., and Ladefoged P. Phonation types: A cross-linguistic overview. J. Phonet. 29 (2001) 383-406
10. Hanson H. Glottal characteristics of female speakers: Acoustic correlates. J. Acoust. Soc. Amer. 101 (1997) 466-481
11. Hayashi, Y., 1999. Recognition of vocal expression of emotions in Japanese: using the interjection "eh". In: Proceedings of ICPhS 99, San Francisco, USA, pp. 2355-2359.
12. Hess W. Pitch Determination of Speech Signals. Springer Series of Information Sciences vol. 3 (1983), Springer-Verlag, Berlin, Heidelberg, New York
13. Imagawa, H., Sakakibara, K., Tayama, N., Niimi, S., 2003. The effect of the hypopharyngeal and supra-glottic shapes for the singing voice. In: Proceedings of the Stockholm Music Acoustics Conference (SMAC 2003), II, pp. 471-474.
14. Ishi, C.T., 2004. A new acoustic measure for aspiration noise detection. In: Proceedings of Interspeech 2004-ICSLP, Jeju, Korea, pp. 941-944.
15. Ishi C.T. Perceptually-related F0 parameters for automatic classification of phrase final tones. IEICE Trans. Inf. Syst. 88 3 (2005) 481-488
16. Ishi, C.T., Ishiguro, H., Hagita, N., 2005. Proposal of acoustic measures for automatic detection of vocal fry. In: Proceedings of Interspeech 2005, Lisbon, Portugal, pp. 481-484.
17. Ito, M., 2004. Politeness and voice quality - The alternative method to measure aspiration noise. In: Proceedings of Speech Prosody 2004, Nara, Japan, pp. 213-216.
18. JST/CREST ESP Project homepage. .
19. Kasuya, H., Yoshizawa, M., Maekawa, K., 2000. Roles of voice source dynamics as a conveyer of paralinguistic features. In: Proceedings of International Conference on Spoken Language Processing (ICSLP2000), Beijing, pp. 345-348.
20. Kitamura T., Honda K., and Takemoto H. Individual variation of the hypopharyngeal cavities and its acoustic effects. Acoust. Sci. Tech. 26 1 (2005) 16-26
21. Klasmeyer G., and Sendlmeier W.F. Voice and Emotional States. In: Kent R.D., and Ball M.J. (Eds). Voice Quality Measurement (2000), Springer, Berlin 339-358
22. Kreiman J., and Gerratt B. Measuring vocal quality. In: Kent R.D., and Ball M.J. (Eds). Voice Quality Measurement (2000), Singular Thomson Learning, San Diego 73-102
23. Laver J. Phonatory settings. The Phonetic Description of Voice Quality (1980), Cambridge University Press, Cambridge 93-135
24. Maekawa, K., 2004. Production and perception of 'Paralinguistic' information. In: Proceedings of Speech Prosody 2004, Nara, Japan, pp. 367-374.
25. Neiberg, D., Elenius, K., Laskowski, K., 2006. Emotion recognition in spontaneous speech using GMMs. In: Proceedings of Interspeech 2006, Pittsburgh, USA, pp. 809-812.
26. Nwe T.L., Foo S.W., and De Silva L.C. Speech emotion recognition using hidden Markov models. Speech Comm. 41 (2003) 603-623
27. Sadanobu T. A natural history of Japanese pressed voice. J. Phonetic Soc. Jpn. 8 1 (2004) 29-44
28. Schroeder M.R. Hilbert envelope and instantaneous frequency. Computer speech - Recognition, compression, synthesis (1999), Springer, Berlin 174-177
29. Schuller, B., Muller, R., Lang, M., Rigoll, G., 2005. Speaker independent emotion recognition by early fusion of acoustic and linguistic features within ensembles. In: Proceedings of Interspeech 2005, Lisbon, Portugal, pp. 805-808.
30. Stevens K. Turbulence noise at the glottis during breathy and modal voicing. Acoustic Phonetics (2000), The MIT Press, Cambridge 445-450
31. Voice quality sample homepage. .