More than accuracy: Nonverbal dialects modulate the time course of vocal emotion recognition across cultures

Journal of Experimental Psychology: Human Perception and Performance

Volumn 41, Issue 3, 2015, Pages 597-612

  Jiang, Xiaoming ^a   Paulmann, Silke ^b   Robin, Jessica ^c   Pell, Marc D ^a  

^a MCGILL UNIVERSITY   (Canada)

^b UNIVERSITY OF ESSEX   (United Kingdom)

^c UNIVERSITY OF TORONTO   (Canada)

Author keywords

Auditory gating; Cross cultural studies; Emotional prosody; Hindi; In group advantage

Indexed keywords

CULTURAL FACTOR; EMOTION; FEMALE; HUMAN; LANGUAGE; MALE; NONVERBAL COMMUNICATION; PSYCHOLOGY; RECOGNITION; SPEECH; TIME FACTOR; YOUNG ADULT;

CROSS-CULTURAL COMPARISON; EMOTIONS; FEMALE; HUMANS; LANGUAGE; MALE; NONVERBAL COMMUNICATION; RECOGNITION (PSYCHOLOGY); SPEECH; TIME FACTORS; YOUNG ADULT;

EID: 84930045106     PISSN: 00961523     EISSN: 19391277     Source Type: Journal    
DOI: 10.1037/xhp0000043     Document Type: Article

References (45)

1. Baayen, R., Davidson, D., & Bates, D. (2008). Mixed-effects modeling with crossed random effects for subjects and items. Journal of Memory and Language, 59, 390-412. http://dx.doi.org/10.1016/j.jml.2007.12.005
2. Beaupré, M., & Hess, U. (2005). Cross-cultural emotion recognition among Canadian ethnic groups. Journal of Cross-Cultural Psychology, 36, 355-370. http://dx.doi.org/10.1177/0022022104273656
3. Beier, E. G., & Zautra, A. J. (1972). Identification of vocal communication of emotions across cultures. Journal of Consulting and Clinical Psychology, 39, 166. http://dx.doi.org/10.1037/h0033170
4. Belin, P., Fillion-Bilodeau, S., & Gosselin, F. (2008). The Montreal Affective Voices: A validated set of nonverbal affect bursts for research on auditory affective processing. Behavior Research Methods, 40, 531-539. http://dx.doi.org/10.3758/BRM.40.2.531
5. Best, C., & Tyler, M. (2007). Nonnative and second-language speech perception. In O. Bohn & M. Munro (Eds.), Language experience in second language speech learning (pp. 13-34). Philadelphia, PA: John Benjamins. http://dx.doi.org/10.1075/lllt.17.07bes
6. Boersma, P., & Weenink, D. (2005). Praat: Doing phonetics by computer (Version 4.3.01) [Computer program]. Retrieved from http://www.praat.org/
7. Brody, L., Lovas, G., & Hay, D. (1995). Gender differences in anger and fear as a function of situational context. Sex Roles, 32, 47-78. http://dx .doi.org/10.1007/BF01544757
8. Bryant, G. A., & Barrett, H. C. (2008). Vocal emotion recognition across disparate cultures. Journal of Cognition and Culture, 8, 135-148. http://dx.doi.org/10.1163/156770908X289242
9. Clopper, C. (2013). Modeling multi-level factors using linear mixed effects. Proceedings of Meetings on Acoustics, 19, 060028. http://dx.doi .org/10.1121/1.4799729
10. Cornew, L., Carver, L., & Love, T. (2009). There's more to emotion than meets the eye: A processing bias for neutral content in the domain of emotional prosody. Cognition and Emotion, 24, 1133-1152. http://dx .doi.org/10.1080/02699930903247492
11. Cutler, A., Smits, R., & Cooper, N. (2005). Vowel perception: Effects of non-native language vs. non-native dialect. Speech Communication, 47, 32-42. http://dx.doi.org/10.1016/j.specom.2005.02.001
12. Dael, N., Goudbeek, M., & Scherer, K. R. (2013). Perceived gesture dynamics in nonverbal expression of emotion. Perception, 42, 642-657. http://dx.doi.org/10.1068/p7364
13. Dailey, M. N., Joyce, C., Lyons, M. J., Kamachi, M., Ishi, H., Gyoba, J., & Cottrell, G. W. (2010). Evidence and a computational explanation of cultural differences in facial expression recognition. Emotion, 10, 874-893. http://dx.doi.org/10.1037/a0020019
14. Ekman, P. (1972). Universals and cultural differences in facial expressions of emotion. In J. Cole (Ed.), Nebraska symposium of motivation (Vol. 19, pp. 207-283). Lincoln, NE: University of Nebraska Press.
15. Ekman, P., & Friesen, W. V. (1971). Constants across cultures in the face and emotion. Journal of Personality and Social Psychology, 17, 124-129. http://dx.doi.org/10.1037/h0030377
16. Elfenbein, H. A. (2013). Nonverbal dialects and accents in facial expressions of emotion. Emotion Review, 5, 90-96. http://dx.doi.org/10.1177/1754073912451332
17. Elfenbein, H. A., & Ambady, N. (2002). On the universality and cultural specificity of emotion recognition: A meta-analysis. Psychological Bulletin, 128, 203-235. http://dx.doi.org/10.1037/0033-2909.128.2.203
18. Elfenbein, H. A., & Ambady, N. (2003). When familiarity breeds accuracy: Cultural exposure and facial emotion recognition. Journal of Personality and Social Psychology, 85, 276-290. http://dx.doi.org/10.1037/0022-3514.85.2.276
19. Elfenbein, H. A., Beaupré, M., Lévesque, M., & Hess, U. (2007). Toward a dialect theory: Cultural differences in the expression and recognition of posed facial expressions. Emotion, 7, 131-146. http://dx.doi.org/10.1037/1528-3542.7.1.131
20. Grosjean, F. (1980). Spoken word recognition processes and the gating paradigm. Perception & Psychophysics, 28, 267-283. http://dx.doi.org/10.3758/BF03204386
21. Hall, J. A. (1984). Nonverbal sex differences: Communication accuracy and expressive styles. Baltimore. MD: Johns Hopkins University Press.
22. Juslin, P. N., & Laukka, P. (2003). Communication of emotions in vocal expression and music performance: Different channels, same code? Psychological Bulletin, 129, 770-814.
23. Kirouac, G., & Hess, U. (1999). Group membership and the decoding of nonverbal behavior. In P. Philippot, R. Feldman, & E. Coats (Eds.), The social context of nonverbal behavior (pp. 182-210). Cambridge, UK: Cambridge University Press.
24. Liu, P., & Pell, M. D. (2012). Recognizing vocal emotions in Mandarin Chinese: A validated database of Chinese vocal emotional stimuli. Behavior Research Methods, 44, 1042-1051. http://dx.doi.org/10.3758/s13428-012-0203-3
25. Markham, R., & Wang, L. (1996). Recognition of emotion by Chinese and Australian children. Journal of Cross-Cultural Psychology, 27, 616-643. http://dx.doi.org/10.1177/0022022196275008
26. Matsumoto, D. (1989). Cultural influences on the perception of emotion. Journal of Cross-Cultural Psychology, 20, 92-105. http://dx.doi.org/10.1177/0022022189201006
27. Matsumoto, D. (2002). Methodological requirements to test a possible in-group advantage in judging emotions across cultures: Comment on Elfenbein and Ambady (2002) and evidence. Psychological Bulletin, 128, 236-242. http://dx.doi.org/10.1037/0033-2909.128.2.236
28. Mesquita, B., & Frijda, N. H. (1992). Cultural variations in emotions: A review. Psychological Bulletin, 112, 179-204. http://dx.doi.org/10.1037/0033-2909.112.2.179
29. Min, C. S., & Schirmer, A. (2011). Perceiving verbal and vocal emotions in a second language. Cognition and Emotion, 25, 1376-1392. http://dx.doi.org/10.1080/02699931.2010.544865
30. Munro, M. J., & Derwing, T. M. (1995). Processing time, accent, and comprehensibility in the perception of native and foreign-accented speech. Language and Speech, 38, 289-306.
31. Paulmann, S., & Pell, M. D. (2010). Contextual influences of emotional speech prosody on face processing: How much is enough? Cognitive, Affective & Behavioral Neuroscience, 10, 230-242. http://dx.doi.org/10.3758/CABN.10.2.230
32. Paulmann, S., & Pell, M. D. (2011). Is there an advantage for recognizing multi-modal emotional stimuli? Motivation and Emotion, 35, 192-201. http://dx.doi.org/10.1007/s11031-011-9206-0
33. Paulmann, S., & Uskul, A. K. (2014). Cross-cultural emotional prosody recognition: Evidence from Chinese and British listeners. Cognition and Emotion, 28, 230-244. http://dx.doi.org/10.1080/02699931.2013.812033
34. Pell, M. D., & Kotz, S. A. (2011). On the time course of vocal emotion recognition. PLoS ONE, 6, e27256. http://dx.doi.org/10.1371/journal .pone.0027256
35. Pell, M. D., Monetta, L., Paulmann, S., & Kotz, S. A. (2009a). Recognizing emotions in a foreign language. Journal of Nonverbal Behavior, 33, 107-120. http://dx.doi.org/10.1007/s10919-008-0065-7
36. Pell, M. D., Paulmann, S., Dara, C., Alasseri, A., & Kotz, S. A. (2009b). Factors in the recognition of vocally expressed emotions: A comparison of four languages. Journal of Phonetics, 37, 417-435. http://dx.doi.org/10.1016/j.wocn.2009.07.005
37. Pell, M. D., & Skorup, V. (2008). Implicit processing of emotional prosody in a foreign versus native language. Speech Communication, 50, 519-530. http://dx.doi.org/10.1016/j.specom.2008.03.006
38. Rigoulot, S., Wassiliwizky, E., & Pell, M. D. (2013). Feeling backwards? How temporal order in speech affects the time course of vocal emotion recognition. Frontiers in Psychology, 4, 367. http://dx.doi.org/10.3389fpsyg.2013.00367
39. Sauter, D. A., Eisner, F., Ekman, P., & Scott, S. K. (2010). Cross-cultural recognition of basic emotions through nonverbal emotional vocalizations. PNAS Proceedings of the National Academy of Sciences of the United States of America, 107, 2408-2412. http://dx.doi.org/10.1073pnas.0908239106
40. Scherer, K., Banse, R., & Wallbott, H. (2001). Emotion inferences from vocal expression correlate across languages and cultures. Journal of Cross-Cultural Psychology, 32, 76-92. http://dx.doi.org/10.1177/0022022101032001009
41. Schwanenflugel, P., & Rey, M. (1986). Interlingual semantic facilitation: Evidence for a common representational system in the bilingual lexicon. Journal of Memory and Language, 25, 605-618. http://dx.doi.org/10.1016/0749-596X(86)90014-8
42. Snijders, T. (2005). Fixed and random effects. In B. Everitt & D. Howell (Eds.), Encyclopedia of statistics in behavioral science (Vol. 2, pp. 664-665). Chichester, UK: Wiley.
43. Thompson, W., & Balkwill, L. (2006). Decoding speech prosody in five languages. Semiotica, 158, 407-424.
44. Van Bezooijen, R., Otto, S., & Heenan, T. (1983). Recognition of vocal expressions of emotion. A three-nation study to identify universal characteristics. Journal of Cross-Cultural Psychology, 14, 387-406. http://dx.doi.org/10.1177/0022002183014004001
45. Wagner, H. (1993). On measuring performance in category judgment studies of nonverbal behavior. Journal of Nonverbal Behavior, 12, 98-106.