A rule-based emotion-dependent feature extraction method for emotion analysis from speech

Journal of the Acoustical Society of America

Volumn 119, Issue 5, 2006, Pages 3109-3120

  Hozjan, Vladimir ^a   Kačič, Zdravko ^a  

^a UNIVERSITY OF MARIBOR   (Slovenia)

Author keywords

[No Author keywords available]

Indexed keywords

AUDITION; COMPUTATIONAL LINGUISTICS; SENSORY PERCEPTION; SPEECH SYNTHESIS; STATISTICAL METHODS;

EMOTION-DEPENDENT FEATURES; EMOTIONAL EXPRESSION; SPEAKERS;

FEATURE EXTRACTION;

ANALYTIC METHOD; ANGER; ARTICLE; COMPARATIVE STUDY; DATA BASE; EMOTION; EVALUATION; FEAR; FEMALE; HAPPINESS; HUMAN; HUMAN EXPERIMENT; LANGUAGE; MALE; PRIORITY JOURNAL; SPEECH ANALYSIS; STATISTICAL ANALYSIS;

ADULT; EMOTIONS; FEMALE; HUMANS; MALE; PRINCIPAL COMPONENT ANALYSIS; PSYCHOACOUSTICS; SPEECH ACOUSTICS; SPEECH INTELLIGIBILITY; SPEECH PERCEPTION; SPEECH PRODUCTION MEASUREMENT; VERBAL BEHAVIOR;

EID: 33646438098     PISSN: 00014966     EISSN: None     Source Type: Journal    
DOI: 10.1121/1.2188647     Document Type: Article

References (53)

1. Amir, N., Ziv, S., and Cohen, R., (2003). " Characteristics of authentic anger in Hebrew speech., " in Proceedings of Eurospeech '03, Geneva,, pp. 713-716.
2. Amir, N., Almogi, B. C., and Gal, R. (2004). " Perceiving Prominence and Emotion in Speech-a Cross Lingual Study., " in Proceedings of Speech Prosody '04, Japan,, pp. 375-378.
3. Ang, J., Dhillon, R., Krupski, A., Shilberg, E., and Stockle, A. (2002). " Prosody-based automatic detection of annoyance and frustration in human-computer dialog., " in Proceedings of ICLSP '02, Denver, Colorado, pp. 2037-2040.
4. Arnfield, S. C. (1994). " Prosody and Syntax in Corpus Based Analysis of Spoken English., " Ph.D. dissertation, The University of Leeds School of Computer Studies.
5. Auberge, V., Audibert, N., and Rilliard, A. (2004). " E-Wiz: A Trapper Protocol for Hunting the Expressive Speech Corpora in Lab., " in Proceedings of LREC'04, Lisbon, pp. 179-182.
6. Banse, R., and Scherer, K. R. (1996). " Acoustic profiles in vocal emotion expression., " J. Pers Soc. Psychol. 70/3, 614-636.
7. Batliner, A., Fisher, K., Huber, R., Spilker, J., and Noeth, E. (2000). " Desperately seeking emotions or: Actors, wizards and human beings., " in Proceedings of ISCA-Workshop on Speech and Emotion, Newcastle, Northern Ireland,, pp. 195-200.
8. Batliner, A., Fisher, K., Huber, R., Spilker, J., and Noeth, E. (2003). " How to find trouble in communication., " Speech Commun. 40, 117-143.
9. Bruner, J., and Tagiuri, R. (1954). " The perception of people., " in Handbook of Social Psychology, edited by, G. Lindzey, (Addison-Wesley, Cambridge, MA), Vol. 2.
10. Burkhardt, F. (2000). " Simulation emotionaler Sprechweise mit Sprachsyntheseverfahren., " Ph.D. thesis, Berlin.
11. Cahn, E. J. (1990). " Generating expression in synthesized speech., " Master thesis, Massachusetts Institute of Technology.
12. Camurri, A., and Coglio, A. (1998). " An architecture for emotional agents., " IEEE Multimedia, October - December, 24-33.
13. Coleman, R. and Williams, R. (1979). " Identification of emotional states using perceptual and acoustic analyses., " in Care of the Professional Voice, edited by, V. Lawrence, and, B. Weinberg, (The Voice Foundation New York), Vol. 1.
14. Cornelius, R. (1996). The Science of Emotion (Prentice-Hall, Englewood Cliffs, NJ).
15. Cowie, R., Douglas-Cowie, E., Tsapatsoulis, N., Votsis, G., Kollias, S., Fellenz, W., and Taylor, J. (2001). " Emotion recognition in human-computer interaction., " IEEE Signal Process. Mag. 18 (1), 32-80.
16. Davitz, J. R. (1964). The Communication of Emotional Meaning (McGraw-Hill, New York).
17. Douglas-Cowie, E., Cowie, R., and Schröder, M. (2000). " A new emotional speech database: Consideration, sources and scope., " in Proceedings of ISCA-Workshop on Speech and Emotion, Newcastle, Northern Ireland,, pp. 39-44.
18. Ekman, P. (1972). " Universal and cultural differences in facial expression of emotion. " in Nebraska Symposium on Motivation, edited by, J. R. Cole, (Nebraska University Press, Lincoln, NE), pp. 207-283.
19. Ekman, P. (1994). " Strong evidence for universals in facial expressions: A reply to Russell's critique., " Psychol. Bull. 115, pp. 268-287.
20. Everitt, B. S., and Dunn, G. (1992). Applied Multivariate Data Analysis (Oxford University Press, New York.)
21. Fairbanks, G., and Hoaglin, L. W. (1941). " An experimental study of duration characteristics of the voice during the expression of emotion., " Speech Monograms, 8, pp. 85-90.
22. Fairbanks, G., and Pronovost, W. (1939). " An experimental study of the pitch characteristics of the voice during the expression of emotions., " Speech Monographs 6, 87-104.
23. Fonagy, I. (1978). " Emotions, voice and music., " Lang Speech 21, 34-49.
24. Frick, R. W. (1985). " Communicating emotion: The role of prosodic features., " Psychol. Bull. 97 (3), 412-429.
25. Frijda, N. H. (1986). The Emotions (Cambridge University Press, Cambridge).
26. Gobl, C., and Ni Chasaide, A. (2000). " Testing affective correlates of voice quality through analysis and resynthesis., " in Proceedings of ISCA-Workshop on Speech and Emotion, Newcastle, Northern Ireland,, pp. 178-183.
27. Heuft, B., Portele, T., and Rauth, M. (1996). " Emotion in time domain synthesis., " in Proceedings ICSLP '96, pp. 1974-1977.
28. Hozjan, V., Kačič, Z., Moreno, A., Bonafonte, A., and Nogueiras, A. (2002). " Interface Databases: Design and Collection of a Multilingual Emotional Speech Database., " in Proceedings of LREC '02, pp. 2024-2028.
29. Izard, C. E. (1971). The Face of Emotion (Appleton-Century-Crofts East Norwalk, CT).
30. Johnstone, I. T. (1996). " Emotional speech elicited using computer games., " in Proceedings of ICSLP '96, pp. 1985-1988.
31. Kienast, M., Paeschke, A., and Sendlmeier, W. (1999). " Articulatory reduction in emotional speech., " in Proceedings of Eurospeech '99, pp. 117-120.
32. Kwon, O-W., Chan, K., Hao, J., and Lee, T-W. (2003). " Emotion recognition by speech signals., " in Proceedings Eurospeech '03, Geneva,, pp. 125-128.
33. Lee, C., and Narayanan, S. (2003). " Emotion recognition using a data-driven fuzzy inference system., " in Proceedings of Eurospeech '03, Geneva,, pp. 157-160.
34. Lee, C-M., Yildirim, S., Bulut, M., Kazemzadeh, A., Busso, C., Deng, Z., Lee, S., and Narayanan, S. (2004). " Emotion recognition based on phoneme classes., " in Proceedings of ICSLP '04, Korea,, pp. 889-892.
35. Li, Y., and Zhao, Y. (1998). " Recognizing Emotions in Speech Using Short-term and Long-term Features., " in Proceedings of ICSLP '98.
36. Montero, J., Gutierrez-Arriola, J., Palazuelos, S., Enriquez, E., Aguilera, S., and Pardo, J. M. (1998). " Emotional Speech Synthesis: From Speech Database to TTS., " in Proceedings of ICLSP '98, Sydney,.
37. Murray, I. R. (1989). " Simulating emotional speech., " Ph.D. thesis, University of Dundee, UK.
38. Murray, I. R., and Arnott, J. L. (1993). " Toward the simulation of the synthesized speech: A review of literature on human vocal emotion., " J. Acoust. Soc. Am. 93, 1097-1108.
39. Noad, J. E., Whiteside, S. P., and Green, P. D. (1997). " A macroscopic analysis of an emotional speech corpus., " in Proceedings of Eurospeech '97, pp. 517-520.
40. Ohala, J. J. (1984). " An ethological perspective on common cross-language utilization of F0 of voice., " Phonetica 41, 1-16.
41. Pell, M. D. (2001). " Influence of emotion and focus location on prosody in matched statements and questions., " J. Acoust. Soc. Am. 109 (4), 1668-1680.
42. Pereira, C. (2000). " Perception and expression of emotion in speech., " Ph.D. thesis, Macquarie University, Australia.
43. Qian, X., and Kimaresan, R. (1996). " A Variable Frame Pitch Estimator and Test Results., " in Proceedings of IEEE ICASSP '96, Vol. 1, pp. 228-231.
44. Rank, E., and Pirker, H. (1998). " Generating emotional speech with concatenative synthesizer., " in Proceedings of ICSLP '98, pp. 671-674.
45. Roach, P. (1994). " Conversion between prosodic transcription systems: 'Standard British' and TOBI., " Speech Commun. 15, 91-99.
46. Schröder, M. (2001). " Emotional Speech Synthesis: A Review., " in Proceedings of Eurospeech '01, pp. 561-564.
47. Schuller, B., Rigoll, G., and Lang, M. (2003). " Hidden Markov Model-Based Speech Emotion Recognition., " in Proceedings of ICASSP '03, pp. 401-405.
48. Tickle, A. (1999). " Cross-language vocalisation of emotion: Methodological issues., " in Proceedings of ICPhS '99, pp. 305-308.
49. Tickle, A. (2000). " English and Japanese speakers' emotion vocalization and recognition: A comparison highlighting vowel quality., " in Proceedings of ISCA-Workshop on Speech and Emotion, Newcastle, Northern Ireland,, pp. 104-109.
50. Ververidis, D., Kontropoulos, C., and Pitas, I. (2004). " Automatic emotional speech classification., " in Proceedings of ICASSP'04, pp. 593-596.
51. Wallbott, H. G., and Scherer, K. R. (1995). " Cultural determinants in experiencing shame and guilt., " in Self-conscious Emotions: The Psychology of Shame, Guilt, Embarrassment, and Pride, edited by, J. P. Tangney, and, K. W. Fischer, (Guilford, New York), pp. 465-487.
52. Williams, C. E., and Stevens, K. N. (1972). " Emotions and speech: Some acoustical correlates., " J. Acoust. Soc. Am. 52, 1238-1250.
53. Young, S., Ollason, D., Valtchev, V., and Woodland, P. (1997). The HTK Book (for HTK 2.1) (Entropic Cambridge Research Laboratory, Cambridge).