Emotional expressions as communicative signals

Iconicity in Language and Literature

Volumn 13, Issue , 2013, Pages 33-59

  Xu, Yi ^a   Kelly, Andrew ^a   Cameron, Smillie ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85179419732     PISSN: 18735037     EISSN: None     Source Type: Book Series    
DOI: 10.1075/ill.13.02xu     Document Type: Chapter

References (70)

1. Aubergé, V. & Cathiard, M. 2003. Can we hear the prosody of smile. Speech Communication 40: 87–97.
2. Banse, R. & Scherer, K.R. 1996. Acoustic profiles in vocal emotion expression. Journal of Personality and Social Psychology 70: 614–636.
3. Boersma, P. 2001. Praat. A system for doing phonetics by computer. Glot International 5(9–10): 341–345.
4. Borod, J.C. 1993. Emotion and the brain – Anatomy and theory: An introduction to the special section. Neuropsychology 7: 427–432.
5. Burkhardt, F. & Sendlmeier, W.F. 2000. Verification of acoustical correlates of emotional speech using formant-synthesis. In ISCA Workshop on Speech and Emotion: A Conceptual Framework for research. Belfast.
6. Chuenwattanapranithi, S., Xu, Y., Thipakorn, B. & Maneewongvatana, S. 2008. Encoding emotions in speech with the size code. A perceptual investigation. Phonetica 65: 210–230.
7. Collins, S.A. 2000. Men’s voices and women’s choices. Animal Behaviour 60: 773–780.
8. Cooper, W.E., Eady, S.J. & Mueller, P.R. 1985. Acoustical aspects of contrastive stress in question-answer contexts. Journal of the Acoustical Society of America 77: 2142–2156.
9. Costanzo, F.S., Markel, N.N. & Costanzo, P.R. 1969. Voice quality profile and perceived emotion. Journal of Counseling Psychology 16(3): 267–270.
10. Cowie, R., Douglas-Cowie, E., Tsapatsoulis, N., Votsis, G., Kolias, S., Felenz, W. & Taylor, J.G. 2001. Emotion recognition in human – computer interaction. Signal Processing Magazine, IEEE 18(1): 32–80.
11. Darwin, C. 1872. The Expression of the Emotions in Man and Animals. London: John Murray.
12. Drahota, A., Costall, A. & Reddy, V. 2008. The vocal communication of different kinds of smile. Speech Communication 50(4): 278–287.
13. Ekman, P. 1992. An argument for basic emotions. Cognition and Emotion 6: 169–200.
14. Ekman, P. 1997. Should we call it expression or communication? Innovations in Social Science Research 10: 333–344.
15. Ekman, P. 1998. Universality of emotional expression? A personal history of the dispute. In Third Edition of Charles Darwin’s The Expression of The Emotions in Man and Animals, with Introduction, Afterwords, and Commentaries, 363–393. London: HarperCollins.
16. Ekman, P., Friesen, W.V., O’Sullivan, M., Chan, A., Diacoyanni-Tarlatzis, I., Heider, K., Krause, R., LeCompte, W.A., Pitcairn, T., Ricci-Bitti, P.E., Scherer, K., Tomita, M. & Tzavaras, A. 1987. Universals and cultural differences in the judgments of facial expressions of emotion. Journal of Personality and Social Psychology 53(4): 712–717.
17. Erickson, D., Yoshida, K., Menezes, C., Fujino, A., Mochida, T. & Shibuya, Y. 2006. Exploratory study of some acoustic and articulatory characteristics of sad speech. Phonetica 63: 1–25.
18. Fitch, W.T. 1994. Vocal Tract Length Perception and the Evolution of Language. Ph.D. dissertation, Brown University.
19. Fitch, W.T. 1997. Vocal tract length and formant frequency dispersion correlate with body size in rhesus macaques. Journal of the Acoustical Society of America 102: 1213–1222.
20. Fitch, W.T. 1999. Acoustic exaggeration of size in birds by tracheal elongation: Comparative and theoretical analyses. Journal of Zoology (London) 248: 31–49.
21. Fónagy, I. 1978. A new method of investigating the perception of prosodic features. Language and Speech 21: 34–49.
22. Fónagy, I. & Magdics, K. 1963. Emotional patterns in intonation and music. Zeitschrift fur Phonetik 16: 293–326.
23. Gobl, C. & Chasaide, A.N. 2003. The role of voice quality in communicating emotion, mood and attitude. Speech Communication 40: 189–212.
24. González, J. 2004. Formant frequencies and body size of speaker: A weak relationship in adult humans. Journal of Phonetics 32: 277–287.
25. Gussenhoven, C. 2002. Intonation and interpretation: Phonetics and Phonology. In Proceedings of The 1st International Conference on Speech Prosody, 47–57. Aix-en-Provence.
26. Gussenhoven, C. 2007. Types of focus in English. In Topic and Focus: Cross-linguistic Perspectives on Meaning and Intonation. C. Lee, M. Gordon & D. Büring (eds), 83–100. Berlin: Springer.
27. Hamilton, W.D. 1964. The genetical evolution of social behaviour I & II. Journal of Theoretical Biology 7: 1–52.
28. Hirschberg, J. 2002. Communication and prosody: Functional aspects of prosody. Speech Communication 36: 31–43.
29. Huckvale, M. 2008. SFS Speech Filing System 4.7, University College London. 〈http://www. phon.ucl.ac.uk/resource/sfs/〉
30. Ives, D.T., Smith, D.R.R. & Patterson, R.D. 2005. Discrimination of speaker size from syllable phrases. Journal of the Acoustical Society of America 118: 3816–3822.
31. Juslin, P.N. & Laukka, P. 2001. Impact of intended emotion intensity on cue utilization and decoding accuracy in vocal expression of emotion. Emotion 1: 381–412.
32. Kwon, O.W., Chan, K., Hao, J. & Lee, T.W. 2003. Emotion recognition by speech signals. In Proceedings of Eurospeech, Geneva, Switzerland, 125–128.
33. Ladd, D.R., Silverman, K.E.A., Tolkmitt, F., Bergmann, G. & Scherer, K.R. 1985. Evidence for the independent function of intonation contour type, voice quality, and F0 range in signaling speaker affect. Journal of the Acoustical Society of America 78: 435–444.
34. Liu, F. & Xu, Y. 2005. Parallel encoding of focus and interrogative meaning in Mandarin intonation. Phonetica 62: 70–87.
35. Liu, F. & Xu, Y. 2007. Question intonation as affected by word stress and focus in English. In Proceedings of The 16th International Congress of Phonetic Sciences, Saarbrücken, 1189–1192.
36. Mauss, I.B. & Robinson, M.D. 2009. Measures of emotion: A review. Cognition & Emotion 23(2): 209–237.
37. Morrison, D., Wang, R. & De Silva, L.C. 2007. Ensemble methods for spoken emotion recognition in call-centres. Speech Communication 49: 98–112.
38. Morton, E.W. 1977. On the occurrence and significance of motivation-structural rules in some bird and mammal sounds. American Naturalist 111: 855–869.
39. Mozziconacci, S.J.L. 2001. Modeling emotion and attitude in speech by means of perceptually based parameter values. User Modeling and User-Adapted Interaction 11: 297–326.
40. Murray, I.R. & Arnott, J.L. 1993. Toward the simulation of emotion in synthetic speech: A review of the literature on human vocal emotion. Journal of the Acoustical Society of America 93: 1097–1108.
41. Ohala, J.J. 1984. An ethological perspective on common cross-language utilization of F0 of voice. Phonetica 41: 1–16.
42. Ohala, J.J. 1997. Sound symbolism. In Proceedings of 4th Seoul International Conference on Linguistics, 98–103.
43. Prom-on, S., Xu, Y. & Thipakorn, B. 2009. Modeling tone and intonation in Mandarin and English as a process of target approximation. Journal of the Acoustical Society of America 125: 405–424.
44. Protopapas, A. & Lieberman, P. 1997. Fundamental frequency of phonation and perceived emotional stress. Journal of the Acoustical Society of America 101: 2267–2277.
45. Reby, D. & McComb, K. 2003. Anatomical constraints generate honesty: Acoustic cues to age and weight in the roars of red deer stags. Animal Behaviour 65: 519–530.
46. Rialland, A. 2009. African “lax” question prosody: Its realisations and its geographical distribution. Lingua 119: 928–949.
47. Robson, J. & MackenzieBeck., J. 1999. Hearing smiles – Perceptual, acoustic and production aspects of labial spreading. In Proceedings of The 14th International Conference of Phonetic Sciences, San Francisco, 219–222.
48. Russell, J.A., Bachorowski, J.-A. & Fernández-Dols, J.-M. 2003. Facial and vocal expressions of emotion. Annual Review of Psychology 54(1): 329–349.
49. Sauter, D., Eisner, F., Ekman, P. & Scott, S.K. 2009. Universal vocal signals of emotion. In Proceedings of The 31st Annual Meeting of the Cognitive Science Society, Amsterdam.
50. Scherer, K.R. 1979. Nonlinguistic vocal indicators of emotion and psychopathology. In Emotions in Personality and Psychopathology, C.E. Izard, 493–529. New York NY: Plenum Press.
51. Scherer, K.R. 1986. Vocal affect expression: A review and a model for future research. Psychological Bulletin 99: 143–165.
52. Scherer, K.R. 2003. Vocal communication of emotion: A review of research paradigms. Speech Communication 40: 227–256.
53. Scherer, K.R. & Bänziger, T. 2004. Emotional expression in prosody: A review and an agenda for future research. In Proceedings of Speech Prosody 2004, 359–366.
54. Scherer, K.R., Ladd, D.R. & Silverman, K.A. 1984. Vocal cues to speaker affect: Testing two models. Journal of the Acoustical Society of America 76: 1346–1356.
55. Schlosberg, H. 1954. Three dimensions of emotion. Psychological Review 61(2): 81–88.
56. Shami, M. & Verhelst, W. 2007. An evaluation of the robustness of existing supervised machine learning approaches to the classification of emotions in speech. Speech Communication 49: 201–212.
57. Smith, D.R.R., Patterson, R.D., Turner, R., Kawahara, H. & Irino, T. 2005. The processing and perception of size information in speech sounds. Journal of the Acoustical Society of America 117: 305–318.
58. Stevens, K.N. 1998. Acoustic Phonetics. Cambridge MA: The MIT Press.
59. Sulc, J. 1977. To the problem of emotional changes in the human voice. Activitas Nervosa Superior 19: 215–216.
60. Susskind, J.M., Lee, D.H., Cusi, A., Feiman, R., Grabski, W. & Anderson, A.K. 2008. Expressing fear enhances sensory acquisition. Nat Neurosci 11(7): 843–850.
61. Tartter, V.C. & Braun, D. 1994. Hearing smiles and frowns in normal and whisper registers. Journal of the Acoustical Society of America 96: 2101–2107.
62. Thorsen, N.G. 1980. A study of the perception of sentence intonation. Evidence from Danish. Journal of the Acoustical Society of America 67: 1014–1030.
63. Tooby, J. & Cosmides, L. 1990. The past explains the present: Emotional adaptations and the structure of ancestral environments. Ethology and Sociobiology 11(4–5): 375–424.
64. Turner, R.E. & Patterson, R.D. 2003. An analysis of the size information in classical formant data: (Peterson & Barney 1952) revisited. Journal of the Acoustical Society of Japan 33: 585–589.
65. van Dommelen, W.A. & Moxness, B.H. 1995. Acoustic parameters in speaker height and weight identification: Sex-specific behaviour. Language and Speech 38: 267–287.
66. Ververidis, D. & Kotropoulos, C. 2006. Emotional speech recognition: Resources, features, and methods. Speech Communication 48: 1162–1181.
67. Williams, C.E. & Stevens, K.N. 1972. Emotion and speech: Some acoustical correlates. Journal of the Acoustical Society of America 52: 1238–1250.
68. Xu, Y. 2005. Speech melody as articulatorily implemented communicative functions. Speech Communication 46: 220–251.
69. Xu, Y. & Xu, C.X. 2005. Phonetic realization of focus in English declarative intonation. Journal of Phonetics 33: 159–197.
70. Zei Pollermann, B. 2002. A place for prosody in a unified model of cognition and emotion. In Proceedings of The 1st International Conference on Speech Prosody, Aix-en-Provence, 17–22.