A three-layered model for expressive speech perception

Speech Communication

Volumn 50, Issue 10, 2008, Pages 810-828

  Huang, Chun Fang ^a   Akagi, Masato ^a  

^a JAPAN ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY   (Japan)

Author keywords

Acoustic analysis; Expressive speech; Fuzzy inference system; Multi layer model; Perception; Rule based

Indexed keywords

ACOUSTICS; CORRELATION METHODS; EXPERIMENTS; FOOD PROCESSING; FUZZY INFERENCE; INFORMATION THEORY; MODAL ANALYSIS; POWER SPECTRUM; REGRESSION ANALYSIS; SEMANTICS;

ACOUSTIC ANALYSIS; ACOUSTIC FEATURES; ANALYSIS RESULTS; BOTTOM LAYERS; EXPRESSIVE SPEECH; FUZZY INFERENCE SYSTEM; FUZZY INFERENCE SYSTEMS; HUMAN PERCEPTIONS; LAYERED MODELING; MIDDLE LAYERS; MULTI LAYERING; MULTI-LAYER MODEL; MULTIDIMENSIONAL SCALING ANALYSIS; PARAMETERIZED; PERCEPTION; RULE-BASED; RULES BASED; STATISTICAL CORRELATIONS; THREE-LAYER MODELS; TIME DURATION;

SPEECH;

EID: 52949128737     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2008.05.017     Document Type: Article

References (52)

1. Banziger T., and Scherer K.R. The role of intonation in emotional expressions. Speech Commun 46 (2005) 252-267
2. Batliner A., Fischer K., Huber R., Spilker J., and Nöth E. How to find trouble in communication. Speech Commun. 40 1-2 (2003) 117-143
3. Cahn, J.E., 1990. Generating expression in synthesized speech, Master's Thesis, MIT, Media Laboratory.
4. Chiu S. Fuzzy model identification based on cluster estimation. J. Intell. Fuzzy Syst. 2 3 (1994)
5. Cowie R., and Cornelius R.R. Describing the emotional states that are expressed in speech. Speech Commun. 40 (2003) 5-32
6. Cowie, R., Douglas-Cowie, E., 1996. Automatic statistical analysis of the signal and prosodic signs of emotion in speech. In: Proc. ICSLP96, Philadelphia.
7. Cowie R., Douglas-Cowie E., Tsapatsoulis N., Votsis G., Kollias S., Fellenz W., and Taylor J.G. Emotion recognition in human-computer interaction. IEEE Signal Process. Mag. 18 1 (2001) 32-80
8. Darke, G., 2005. Assessment of timbre using verbal attributes. In: Proc. CIM05, Montreal.
9. Devillers, L., Lamel, L., Vasilescu, I., 2003. Emotion detection in task-oriented spoken dialogues. In: Proc. International Conference on Multimedia and Expo, 2003.
10. Devillers L., Vidrascu L., and Lamel L. Challenges in real-life emotion annotation and machine learning based detection. Neural Networks 18 4 (2005) 407-422
11. Douglas-Cowie E., Campbell N., Cowie R., and Roach P. Expressive speech: towards a new generation of databases. Speech Commun. 40 (2003) 33-60
12. Erickson D. Expressive speech: production, perception and application to speech synthesis. Acoust. Sci. Technol. 26 (2005) 317-325
13. Fauconnier G. Mappings in Thought and Language (1997), Cambridge University Press
14. Friberg, A., 2004. A fuzzy analyzer of emotional expression in music performance and body motion. In: Proc. Music and Music Science, Stockholm, 2004.
15. Friberg A., Bresin R., and Sundberg J. Overview of the KTH rule system for music performance. Adv. Cognitive Psych. 2 2-3 (2006) 145-161
16. Fujisaki, H., Manifestation of linguistic, para-linguistic, non-linguistic information in the prosodic characteristics of speech. In: IEICE 1994-0.
17. Gobl C., and Ni Chasaide A. Voice source variation. In: Hardcastle W.J., and Laver J. (Eds). The Handbook of Phonetic Sciences (1997), Blackwell, Oxford 427-461
18. Grimm M., Mower E., Kroschel K., and Narayanan S. Primitives based estimation and evaluation of emotions in speech. Speech Commun (2007)
19. Huang C.F., and Akagi M. Toward a Rule-Based Synthesis of Emotional Speech on Linguistic Descriptions of Perception. Lect. Notes Comput. Sci. 3784/2005 (2005) 366-373
20. Jang J.-S.R., Sun C.-T., and Mizutani E. Neuro-Fuzzy and Soft Computing. Prentice Hall (1996) 1996
21. Juslin P.N. Communication of emotion in music performance: a review and a theoretical framework. In: Juslin P.N., and Sloboda J.A. (Eds). Music and Emotion: Theory and Research (2001), Oxford University Press, New York 309-337
22. Kawahara H., Masuda-Katsuse I., and de Cheveigne A. Restructuring speech representations using a pitch adaptive time-frequency smoothing and an instantaneous-frequency-based F0 extraction: possible role of a repetitive structure in sounds. Speech Commun. 27 (1999) 187-207
23. Keating, P., Esposito, C., 2006. Linguistic Voice Quality. Invited Keynote Paper Presented at 11th Australasian International Conference on Speech Science and Technology in Auckland, December. 2006.
24. Kecman V. Learning and Soft Computing: Support Vector Machines, Neural Networks, and Fuzzy Logic Models (2001), MIT Press
25. In: Kendon A. (Ed). Nonverbal Communication, Interaction and Gesture: Selections from Semiotica, Approaches to Semiotics 41 (1981), Mouton and Co, The Hague
26. Kienast, M., Sendlmeier, W.F., 2000. Acoustical analysis of spectral and temporal changes in expressive speech. In: ISCA Workshop on Speech and Emotion, Belfast.
27. Maekawa, K., 2004. Production and perception of 'paralinguistic' information. In: Proceedings of Speech Prosody, Nara, pp. 367-374.
28. Maekawa K., and Kitagawa N. How does speech transmit paralinguistic information?. Congnitive Studies 9 (2002) 46-66
29. Manning P.K. Symbolic Communication: Signifying Calls and the Police Response (1989), The MIT Press
30. Mehrabian A. Nonverbal Communication (1972), Aldine-Atherton, Chicago, Illinois
31. Menezes, C., Maekawa, K., 2006. Paralinguistic effects on voice quality: a study in Japanese. In: Proc. Speech Prosody 2006, Dresden.
32. Murray I.R., and Arnott J.L. Toward the simulation of emotion in synthetic speech: a review of the literature on human vocal emotion. J. Acoust. Soc. Am. 93 2 (1993) 1097-1108
33. Murray I.R., and Arnott J.L. Implementation and testing of a system for producing emotion-by-rule in synthetic speech. Speech Commun. 16 (1995) 369-390
34. Nguyen P.C., Ochi T., and Akagi M. Modified restricted temporal decomposition and its application to low rate speech coding. IEICE Trans. Inf. Syst. E86-D 3 (2003) 397-405
35. Robbins S., and Langton N. Organizational Behaviour: Concepts, Controversies, Applications. second Canadian ed. (2001), Springer, Upper Saddle River, NJ
36. Scherer K.R. Vocal communication of emotion: a review of research paradigms. Speech Commun. 40 (2003) 227-256
37. Scherer K.R., Ladd D.R., and Silverman K.A. Vocal cues to speaker affect: Testing two models. J. Acoust. Soc. Am. 76 (1984) 1346-1356
38. Scherer K.R., Banse R., Wallbott H.G., and Goldbeck T. Vocal cues in emotion encoding and decoding. Motiv. Emotion 15 (1991) 123-148
39. Schroder, M., Cowie, R., Douglas-Cowie, E., Westerdijk, M., Gielen, S., 2001. Acoustic correlates of emotion dimensions in view of speech synthesis. In: Proc. Eurospeech 2001, Denmark, pp. 87-90.
40. Sobol Shikler T., Robinson, P., 2004. Visualizing dynamic features of expressions in speech. In: Proc. ICSLP2004, Korea.
41. Sugeno M. Industrial Applications of Fuzzy Control (1985), Elsevier Science Inc., New York
42. Tolkmitt F.J., and Scherer K.R. Effect of experimentally induced stress on vocal parameters. J. Exp. Psychol. [Hum. Percept.] 12 3 (1986) 302-313
43. Traube, C., Depalle, P., Wanderley, M., 2003. Indirect acquisition of instrumental gesture based on signal, physical and perceptual information. In: Proc. 2003 Conf. New interfaces for Musical Expression.
44. Ueda K. Should we assume a hierarchical structure for adjectives describing timbre?. Acoust. Sci. Technol. 44 2 (1988) 102-107 (in Japanese)
45. Ueda K. A hierarchical structure for adjectives describing timbre. J. Acoust. Soc. Am. (1996)
46. Ueda K., and Akagi M. Sharpness and amplitude envelopes of broadband noise. J. Acoust. Soc. Am. 87 2 (1990) 814-819
47. Van Bezooijen, R., 1984. The Characteristics and Recognizability of Vocal Expression of Emotions, Foris, Drodrecht, The Netherlands.
48. Venditti, and Jennifer J. The J_ToBI model of Japanese intonation. In: Jun S.-A. (Ed). Prosodic Typology: The Phonology and Intonation of Phrasing (2005), Oxford University Press 172-200
49. Vickhoff, B., Malmgren, H., 2004. Why Does Music Move Us? Philosophical Communication, Web Series, No. 34.
50. Williams C.E., and Stevens K.N. On determining the emotional state of pilots during flight: An exploratory study. Aerospace Med. 40 12 (1969) 1369-1372
51. Williams C.E., and Stevens K.N. Emotions and speech: some acoustical correlates. J. Acoust. Soc. Am. 52 (1972) 1238-1250
52. Wolkenhauer O. Data Engineering: Fuzzy Mathematics in Systems Theory and Data Analysis (2001), Wiley