Perceiving verbal and vocal emotions in a second language

Cognition and Emotion

Volumn 25, Issue 8, 2011, Pages 1376-1392

  Min, Chua Shi ^a   Schirmer, Annett ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Bilingualism; Emotion; Prosody; Speech

Indexed keywords

ACCURACY; ADULT; ARTICLE; COGNITION; EMOTION; FEMALE; FOLLOW UP; HUMAN; LANGUAGE ABILITY; LANGUAGE PROCESSING; MAJOR CLINICAL STUDY; MALE; PERCEPTION; PRIORITY JOURNAL; RESPONSE TIME; SPEECH AND LANGUAGE ASSESSMENT; SPEECH INTELLIGIBILITY; TASK PERFORMANCE; VERBAL BEHAVIOR; VERBAL COMMUNICATION; VERBALIZATION; VOICE ANALYSIS;

ACOUSTIC STIMULATION; EMOTIONS; FEMALE; HUMANS; MALE; MULTILINGUALISM; PSYCHOMOTOR PERFORMANCE; REACTION TIME; SEMANTICS; SPEECH PERCEPTION;

EID: 84855717031     PISSN: 02699931     EISSN: 14640600     Source Type: Journal    
DOI: 10.1080/02699931.2010.544865     Document Type: Article

References (51)

1. Anderson, A. K., & Phelps, E. A. (2001). Lesions of the human amygdala impair enhanced perception of emotionally salient events. Nature, 411(6835), 305-309.
2. Anooshian, L., & Hertel, P. T. (1994). Emotionality in free recall: Language specificity in bilingual memory. Cognition and Emotion, 8, 503-514.
3. Ayçiçeiǧi, A., & Harris, C. L. (2004). Bilinguals' recall and recognition of emotion words. Cognition and Emotion, 18, 977-987.
4. Balota, D. A., Yap, M. J., Cortese, M. J., Hutchison, K. A., Kessler, B., Loftis, B., et al. (2007). The English Lexicon Project. Behavior Research Methods, 39, 445-459
5. Bradley, M. M., & Lang, P. J. (1999). Affective Norms for English Words (ANEW): Stimuli, instruction manual and affective ratings (Technical report C-1). Gainesville, FL: The Center for Research in Psychophysiology, University of Florida.
6. Chen, A., Gussenhoven, C., & Rietveld, T. (2004). Language-specificity in the perception of paralinguistic intonational meaning. Language and Speech, 47, 311-349.
7. Cohen, B. H. (2001). Explaining psychological statistics. New York, NY: Wiley.
8. Darwin, C. (1872). The expression of the emotions in man and animals. London, UK: John Murray.
9. DeSoto, M. C., Fabiani, M., Geary, D. C., & Gratton, G. (2001). When in doubt, do it both ways: Brain evidence of the simultaneous activation of conflicting motor responses in a spatial Stroop task. Journal of Cognitive Neuroscience, 13, 523-536.
10. Eilola, T. M., Havelka, J., & Sharma, D. (2007). Emotional activation in the first and second language. Cognition and Emotion, 21, 1064-1076.
11. Estes, Z., & Adelman, J. S. (2008). Automatic vigilance for negative words in lexical decision and naming: Comment on Larsen, Mercer, and Balota (2006). Emotion, 8, 441-444.
12. Estes, Z., & Verges, M. (2008). Freeze or flee? Negative stimuli elicit selective responding. Cognition, 108, 557-565.
13. Graham, C. R., Hamblin, A. W., & Feldstein, S. (2001). Recognition of emotion in English voices by speakers of Japanese, Spanish, and English. International Review of Applied Linguistics in Language Teaching, 39, 19-37.
14. Grimshaw, G. M. (1998). Integration and interference in the cerebral hemispheres: Relations with hemispheric specialization. Brain and Cognition, 36, 108-127.
15. Hamamura, T., Meijer, Z., Heine, S. J., Kamaya, K., & Hori, I. (2009). Approach-avoidance motivation and information processing: A cross-cultural analysis. Personality and Social Psychology Bulletin, 35, 454-462.
16. Harris, C. L. (2004). Bilingual speakers in the lab: Psychophysiological measures of emotional reactivity. Journal of Multilingual and Multicultural Development, 25, 223-244.
17. Harris, C. L., Gleason, J. B., & Ayçiçeiǧi, A. (2006). When is a first language more emotional? Psychophysiological evidence from bilingual speakers. In A. Pavlenko (Ed.), Bilingual minds: Emotional experience, expression, and representation. Clevedon, UK: Mulilingual Matters.
18. Heine, S. J., Kitayama, S., Lehman, D. R., Takata, T., Ide, E., & Leung, C. (2001). Divergent consequences of success and failure in Japan and North America: An investigation of self-improving motivations and malleable selves. Journal of Personality and Social Psychology, 81, 599-615.
19. Herbert, C., Ethofer, T., Anders, S., Junghofer, M., Wildgruber, D., Grodd, W., et al. (2009). Amygdala activation during reading of emotional adjectives: An advantage for pleasant content. Social Cognitive and Affective Neuroscience, 4, 35-49.
20. Hernandez, A. E., Hofmann, J., & Kotz, S. A. (2007). Age of acquisition modulates neural activity for both regular and irregular syntactic functions. Neuro-Image, 36, 912-923.
21. Ishii, K., Reyes, J. A., & Kitayama, S. (2003). Spontaneous attention to word content versus emotional tone: Differences among three cultures. Psychological Science, 14, 39-46.
22. Kitayama, S., & Ishii, K. (2002). Word and voice: Spontaneous attention to emotional utterances in two languages. Cognition and Emotion, 16, 29-59.
23. Kucera, H., & Francis, W. (1967). Computational analysis of present-day American English. Providence, RI: Brown University Press.
24. Larsen, R. J., Mercer, K. A., & Balota, D. A. (2006). Lexical characteristics of words used in emotional Stroop experiments. Emotion, 6, 62-72.
25. Lim, V. P. C., Liow, S. J. R., Lincoln, M., Chan, Y. H., & Onslow, M. (2008). Determining language dominance in English-Mandarin bilinguals: Development of a self-report classification tool for clinical use. Applied Psycholinguistics, 29, 389-412.
26. Lund, K., & Burgess, C. (1996). Producing highdimensional semantic spaces from lexical co-occurrence. Behavior Research Methods, Instruments, & Computers, 28, 203-208.
27. Marian, V., Blumenfeld, H. K., & Kaushanskaya, M. (2007). The language experience and proficiency questionnaire (LEAP-Q): Assessing language profiles in bilinguals and multilinguals. Journal of Speech, Language, and Hearing Research, 50, 940-967.
28. Masaki, H., Takasawa, N., & Yamazaki, K. (2000). An electrophysiological study of the locus of the interference effect in a stimulus-response compatibility paradigm. Psychophysiology, 37, 464-472.
29. Mitchell, R. L. (2006). How does the brain mediate interpretation of incongruent auditory emotions? The neural response to prosody in the presence of conflicting lexico-semantic cues. European Journal of Neuroscience, 24, 3611-3618.
30. Nusbaum, H. C., Pisoni, D. B., & Davis, C. K. (1984). Sizing up the Hoosier mental lexicon: Measuring the familiarity of 20,000 words. In Research on Speech Perception Progress (Report No. 10, pp. 357-376). Bloomington, IN: Speech Research Laboratory, Indiana University.
31. Öhman, A., Flykt, A., & Esteves, F. (2001). Emotion drives attention: Detecting the snake in the grass. Journal of Experimental Psychology: General, 130, 466-478.
32. Oishi, S., & Diener, E. (2003). Culture and well-being: The cycle of action, evaluation, and decision. Personality and Social Psychology Bulletin, 29, 939-949.
33. Pavlenko, A. (2008). Emotion and emotion-laden words in the bilingual lexicon. Bilingualism: Language and Cognition, 11, 147-164.
34. Pell, M. D. (2005). Prosody-face interactions in emotional processing as revealed by the facial affect decision task. Journal of Nonverbal Behavior, 29, 193-215.
35. Pell, M. D., Monetta, L., Paulmann, S., & Kotz, S. A. (2009). Recognizing emotions in a foreign language. Journal of Nonverbal Behavior, 33, 107-120.
36. Pell, M. D., & Skorup, V. (2008). Implicit processing of emotional prosody in a foreign versus native language. Speech Communication, 50, 519-530.
37. Perani, D., Abutalebi, J., Paulesu, E., Brambati, S., Scifo, P., Cappa, S. F., et al. (2003). The role of age of acquisition and language usage in early, highproficient bilinguals: An fMRI study during verbal fluency. Human Brain Mapping, 19, 170-182.
38. Sander, D., Grandjean, D., Pourtois, G., Schwartz, S., Seghier, M. L., Scherer, K. R., et al. (2005). Emotion and attention interactions in social cognition: Brain regions involved in processing anger prosody. NeuroImage, 28, 848-858.
39. Scherer, K. R., Banse, R., & Wallbott, H. G. (2001). Emotion inferences from vocal expression correlate across languages and cultures. Journal of Crosscultural Psychology, 32, 76-92.
40. Schirmer, A., Alter, K., Kotz, S. A., & Friederici, A. D. (2001). Lateralization of prosody during language production: A lesion study. Brain and Language, 76, 1-17.
41. Schirmer, A., Escoffier, N., Zysset, S., Koester, D., Striano, T., & Friederici, A. D. (2008). When vocal processing gets emotional: On the role of social orientation in relevance detection by the human amygdala. NeuroImage, 40, 1402-1410.
42. Schirmer, A., & Kotz, S. A. (2003). ERP evidence for a gender specific Stroop effect in emotional speech. Journal of Cognitive Neuroscience, 15, 1135-1148.
43. Schirmer, A., Kotz, S. A., & Friederici, A. D. (2002). Sex differentiates the role of emotional prosody during word processing. Cognitive Brain Research, 14, 228-233.
44. Schirmer, A., Lui, M., Escoffier, N., Maess, B., Chan, M., & Penney, T. B. (2006). Task and sex modulate the brain response to emotional incongruity in Asian listeners. Emotion, 6, 406-417.
45. Schirmer, A., Striano, T., & Friederici, A. D. (2005). Sex differences in the preattentive processing of vocal emotional expressions. NeuroReport: For Rapid Communication of Neuroscience Research, 16, 635-639.
46. Schirmer, A., Zysset, S., Kotz, S. A., & von Cramon, D. Y. (2004). Gender differences in the activation of inferior frontal cortex during emotional speech perception. NeuroImage, 21, 1114-1123.
47. Shipley, W. (1986). The Shipley Institute of Living Scale (Revised manual). Los Angeles, CA: Western Psychological Services.
48. Solomon, D., & Ali, F. A. (1975). Influence of verbal content and intonation on meaning attributions of first-and second-language speakers. The Journal of Social Psychology, 95, 3-9.
49. Sutton, T. M., Altarriba, J., Gianico, J. L., & Basnight-Brown, D. M. (2007). The automatic access of emotion: Emotional Stroop effects in Spanish-English bilingual speakers. Cognition and Emotion, 21, 1077-1090.
50. Thompson, W. F., & Balkwill, L. L. (2006). Decoding speech prosody in five languages. Semiotica, 158, 407-424.
51. Van Lancker-Sidtis, D. (2003). Auditory recognition of idioms by native and nonnative speakers of English: It takes one to know one. Applied Psycholinguistics, 24, 45-57.