Recognizing vocal emotions in Mandarin Chinese: A validated database of Chinese vocal emotional stimuli

Behavior Research Methods

Volumn 44, Issue 4, 2012, Pages 1042-1051

  Liu, Pan ^a   Pell, Marc D ^a  

^a MCGILL UNIVERSITY   (Canada)

Author keywords

Acoustic features; Cross cultural studies; Emotion recognition; Prosody; Speech production

Indexed keywords

ADULT; ANALYSIS OF VARIANCE; ANGER; ARTICLE; ASIAN; CLASSIFICATION; CULTURAL FACTOR; EMOTION; FACTUAL DATABASE; FEAR; FEMALE; HAPPINESS; HEARING; HUMAN; INTERPERSONAL COMMUNICATION; LANGUAGE; MALE; SPEECH; VALIDATION STUDY; VOICE;

ADULT; ANALYSIS OF VARIANCE; ANGER; ASIAN CONTINENTAL ANCESTRY GROUP; AUDITORY PERCEPTION; COMMUNICATION; CROSS-CULTURAL COMPARISON; DATABASES, FACTUAL; EMOTIONS; FEAR; FEMALE; HAPPINESS; HUMANS; LANGUAGE; MALE; SPEECH; SPEECH ACOUSTICS; VOICE;

EID: 84870522281     PISSN: 1554351X     EISSN: 15543528     Source Type: Journal    
DOI: 10.3758/s13428-012-0203-3     Document Type: Article

References (52)

1. Abelin, Å., & Allwood, J. (2000). Cross linguistic interpretation of emotional prosody. In Proceedings of the ISCA Workshop on Speech and Emotion (pp. 110-113). Newcastle, Northern Ireland.
2. Adolphs, R., Damasio, H., & Tranel, D. (2002). Neural systems for recognition of emotional prosody: A 3-D lesion study. Emotion, 2, 23-51.
3. Adolphs, R., Tranel, D., & Damasio, H. (2001). Emotion recognition from faces and prosody following temporal lobectomy. Neuropsychology, 15, 396-404.
4. Anolli, L., Wang, L., Mantovani, F., & De Toni, A. (2008). The voice of emotion in Chinese and Italian young adults. Journal of Cross-Cultural Psychology, 39, 565-598.
5. Bachorowski, J. A., & Owren, M. J. (1995). Vocal expression of emotion: Acoustic properties of speech are associated with emotional intensity and context. Psychological Science, 6, 219-224.
6. Banse, R., & Scherer, K. R. (1996). Acoustic profiles in vocal emotion expression. Journal of Personality and Social Psychology, 70, 614-636.
7. Baum, K. M., & Nowicki, S., Jr. (1998). Perception of emotion: Measuring decoding accuracy of adult prosodic cues varying in intensity. Journal of Nonverbal Behavior, 22, 89-107.
8. Boersma, P., & Weenink, D. (2001). Praat, a system for doing phonetics by computer. Glot International, 5, 341-345.
9. Burkhardt, F., Paeschke, A., Rolfes, M., Sendlmeier, W., & Weiss, B. (2005). A database of German emotional speech. In Proceedings Interspeech 2005 (pp. 1517-1520). Lisbon, Portugal.
10. Castro, S. L., & Lima, C. F. (2010). Recognizing emotions in spoken language: A validated set of Portuguese sentences and pseudosentences for research on emotional prosody. Behavior Research Methods, 42, 74-81.
11. Ekman, P. (1992a). Are there basic emotions? Psychological Review, 99, 550-553.
12. Ekman, P. (1992b). An argument for basic emotions. Cognition and Emotion, 6, 169-200.
13. Ekman, P. (1994). Strong evidence for universals in facial expressions: A reply to Russell's mistaken critique. Psychological Bulletin, 115, 268-287.
14. Ekman, P., Sorenson, E. R., & Friesen, W. V. (1969). Pan-cultural elements in facial displays of emotion. Science, 164, 86-88.
15. Elfenbein, H. A., & Ambady, N. (2002). On the universality and cultural specificity of emotion recognition: A meta-analysis. Psychological Bulletin, 128, 203-235.
16. Grandjean, D., Sander, D., Pourtois, G., Schwartz, S., Seghier, M. L., Scherer, K. R., & Vuilleumier, P. (2005). The voices of wrath: Brain responses to angry prosody in meaningless speech. Nature Neuroscience, 8, 145-146.
17. Jaywant, A., & Pell, M. D. (2012). Categorical processing of negative emotions from speech prosody. Speech Communication, 54, 1-10.
18. Juslin, P. N., & Laukka, P. (2001). Impact of intended emotion intensity on cue utilization and decoding accuracy in vocal expression of emotion. Emotion, 1, 381-412.
19. Juslin, P. N., & Laukka, P. (2003). Communication of emotions in vocal expression and music performance: Different channels, same code? Psychological Bulletin, 129, 770-814.
20. Li, A., Shao, P., & Dang, J. (2009). Cross-cultural and multi-modal investigation of emotion expression. Journal of Tsinghua University, 49(Suppl. 1), 1393-1401.
21. Montero, J. M., Gutiérrez-Arriola, J. M., Colás, J., Guarasa, J. M., Enríquez, E., & Pardo, J. M. (1999). Development of an emotional speech synthesiser in Spanish. In Proceedings of Eurospeech'99 (pp. 2099-2102). Budapest, Hungary.
22. Mozziconacci, S. J. L. (2001). Modeling emotion and attitude in speech by means of perceptually based parameter values. User Modelling and User-Adapted Interaction, 11, 297-326.
23. Navas, E., Hernáez, I., Castelruiz, A., & Luengo, I. (2004). Obtaining and evaluating an emotional database for prosody modelling in standard Basque. Lecture Notes in Artificial Intelligence (Subseries of Lecture Notes in Computer Science), 3206, 393-400.
24. Nowicki, S., Jr., & Duke, M. P. (1994). Individual differences in the nonverbal communication of affect: The diagnostic analysis of nonverbal accuracy scale. Journal of Nonverbal Behavior, 18, 9-35.
25. Ohman, A., Flykt, A., & Esteves, F. (2001). Emotion drives attention: Detecting the snake in the grass. Journal of Experimental Psychology. General, 130, 466-478.
26. Pao, T., Yeh, J., & Chen, Y. (2008). Emotion recognition via continuous Mandarin speech. In S. Pinder (Ed.), Advances in human computer interaction (pp. 365-384). InTech.
27. Paulmann, S., & Kotz, S. A. (2008). An ERP investigation on the temporal dynamics of emotional prosody and emotional semantics in pseudo- and lexical-sentence context. Brain and Language, 105, 59-69.
28. Paulmann, S., & Pell, M. D. (2011). Is there an advantage for recognizing multi-modal emotional stimuli? Motivation and Emotion, 35, 192-201.
29. Paulmann, S., Pell, M. D., & Kotz, S. A. (2008). Functional contributions of the basal ganglia to emotional prosody: Evidence from ERPs. Brain Research, 1217, 171-178.
30. Pell, M. D. (2001). Influence of emotion and focus location on prosody in matched statements and questions. Journal of the Acoustical Society of America, 109, 1668-1680.
31. Pell, M. D. (2002). Evaluation of nonverbal emotion in face and voice: Some preliminary findings on a new battery of tests. Brain and Cognition, 48, 499-504.
32. Pell, M. D. (2006). Cerebral mechanisms for understanding emotional prosody in speech. Brain and Language, 96, 221-234.
33. Pell, M. D., & Kotz, S. A. (2011). On the time course of vocal emotion recognition. PLoS One, 6, e27256.
34. Pell, M. D., & Leonard, C. L. (2003). Processing emotional tone from speech in Parkinson's disease: A role for the basal ganglia. Cognitive, Affective, & Behavioral Neuroscience, 3, 275-288.
35. Pell, M. D., Monetta, L., Paulmann, S., & Kotz, S. A. (2009). Recognizing emotions in a foreign language. Journal of Nonverbal Behavior, 33, 107-120.
36. Pell, M. D., Paulmann, S., Dara, C., Alasseri, A., & Kotz, S. A. (2009). Factors in the recognition of vocally expressed emotions: A comparison of four languages. Journal of Phonetics, 37, 417-435.
37. Ross, E. D., & Monnot, M. (2008). Neurology of affective prosody and its functional- anatomic organization in right hemisphere. Brain and Language, 104, 51-74.
38. Russell, J. A. (1994). Is there universal recognition of emotion from facial expression? A review of the cross-cultural studies. Psychological Bulletin, 115, 102-141.
39. Scherer, K. R. (1986). Vocal affect expression: A review and a model for future research. Psychological Bulletin, 99, 143-165.
40. Scherer, K. R., Banse, R., & Wallbott, H. G. (2001). Emotion inferences from vocal expression correlate across languages and cultures. Journal of Cross-Cultural Psychology, 32, 76-92.
41. Scherer, K. R., Banse, R., Wallbott, H. G., & Goldbeck, T. (1991). Vocal cues in emotion encoding and decoding. Motivation and Emotion, 15, 123-148.
42. Scherer, K. R., London, H., & Wolf, J. J. (1973). The voice of confidence: Paralinguistic cues and audience evaluation. Journal of Research in Personality, 7, 31-44.
43. Tao, J., Kang, Y., & Li, A. (2006). Prosody conversion from neutral speech to emotional speech. IEEE Transactions on Audio, Speech and Language Processing, 14, 1145-1153.
44. Thompson, W. F., & Balkwill, L. L. (2006). Decoding speech prosody in five languages. Semiotica, 158, 407-424.
45. Tooby, J., & Cosmides, L. (1990). The past explains the present: Emotional adaptations and the structure of ancestral environments. Ethology and Sociobiology, 11, 375-424.
46. Wagner, H. L. (1993). On measuring performance in category judgment studies of nonverbal behavior. Journal of Nonverbal Behavior, 17, 3-28.
47. Wallbott, H. G. (1988). Big girls don't frown, big boys don't cry-Gender differences of professional actors in communicating emotion via facial expression. Journal of Nonverbal Behavior, 12, 98-106.
48. Williams, C. E., & Stevens, K. N. (1972). Emotions and speech: Some acoustic correlates. Journal of the Acoustical Society of America, 52, 1238-1250.
49. You, M., Chen, C., & Bu, J. (2005). CHAD: A Chinese affective database. In Proceedings of 1st International Conference on Affective Computing and Intelligent Interaction (pp. 542-549). Beijing, China.
50. Yu, F., Chang, E., Xu, Y., & Shum, H. (2001). Emotion detection from speech to enrich multimedia content. In Proceedings of 2nd IEEE Pacific-Rim Conference on Multimedia (pp. 550-557). Beijing, China.
51. Zhang, S. (2008). Emotion recognition in Chinese natural speech by combining prosody and voice quality features. Lecture Notes in Computer Science, 5264, 457-464.
52. Zhang, S., Ching, P. C., & Kong, F. (2006). Acoustic analysis of emotional speech in Mandarin Chinese. In International Symposium on Chinese Spoken Language Processing (pp. 57-66). Kent Ridge, Singapore.