Contextual influences of emotional speech prosody on face processing: How much is enough?

Cognitive, Affective and Behavioral Neuroscience

Volumn 10, Issue 2, 2010, Pages 230-242

  Paulmann, Silke ^a,b   Pell, Marc D ^b  

^a UNIVERSITY OF ESSEX   (United Kingdom)

^b MCGILL UNIVERSITY   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; AUDITORY STIMULATION; BRAIN; ELECTROENCEPHALOGRAPHY; EMOTION; EVOKED RESPONSE; FACE; FACIAL EXPRESSION; FEMALE; HUMAN; MALE; NEUROPSYCHOLOGICAL TEST; PATTERN RECOGNITION; PHOTOSTIMULATION; PHYSIOLOGY; SOUND DETECTION; SPEECH; SPEECH PERCEPTION; TIME; VISION;

ACOUSTIC STIMULATION; BRAIN; ELECTROENCEPHALOGRAPHY; EMOTIONS; EVOKED POTENTIALS; FACE; FACIAL EXPRESSION; FEMALE; HUMANS; MALE; NEUROPSYCHOLOGICAL TESTS; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; SOUND SPECTROGRAPHY; SPEECH ACOUSTICS; SPEECH PERCEPTION; TIME FACTORS; VISUAL PERCEPTION; YOUNG ADULT;

EID: 77955886705     PISSN: 15307026     EISSN: None     Source Type: Journal    
DOI: 10.3758/CABN.10.2.230     Document Type: Article

References (74)

1. ASHLEY, V., VUILLEUMIER, P., & SWICK, D. (2004). Time course and specificity of event-related potentials to emotional expressions. Neuro-Report, 15, 211-216. (Pubitemid 41615001)
2. BALCONI, M., & POZZOLI, U. (2003). Face-selective processing and the effect of pleasant and unpleasant emotional expressions on ERP correlates. International Journal of Psychophysiology, 49, 67-74. (Pubitemid 36802319)
3. BANSE, R., & SCHERER, K. R. (1996). Acoustic profiles in vocal emotion expression. Journal of Personality & Social Psychology, 70, 614-636. (Pubitemid 126420699)
4. BARGH, J. A., CHAIKEN, S., GOVENDER, R., & PRATTO, F. (1992). The generality of the automatic attitude activation effect. Journal of Personality & Social Psychology, 62, 893-912.
5. BENTIN, S., & MCCARTHY, G. (1994). The effects of immediate stimulus repetition on reaction time and event-related potentials in tasks of different complexity. Journal of Experimental Psychology: Learning, Memory, & Cognition, 20, 130-149.
6. BERMEITINGER, C., FRINGS, C., & WENTURA, D. (2008). Reversing the N400: Event-related potentials of a negative semantic priming effect. NeuroReport, 19, 1479-1482.
7. BESSON, M., KUTAS, M., & VAN PETTEN, C. (1992). An event-related potential (ERP) analysis of semantic congruity and repetition effects in sentences. Journal of Cognitive Neuroscience, 4, 132-149.
8. BOBES, M. A., VALDÉS-SOSA, M., & OLIVARES, E. (1994). An ERP study of expectancy violation in face perception. Brain & Cognition, 26, 1-22.
9. BOERSMA, P., & WEENINK, D. (2009). Praat: Doing phonetics by computer (Version 4.1.13) [Computer program]. Available from www.praat.org.
10. BOROD, J. C., PICK, L. H., HALL, S., SLIWINSKI, M., MADIGAN, N., OBLER, L. K., ET AL. (2000). Relationships among facial, prosodic, and lexical channels of emotional perceptual processing. Cognition & Emotion, 14, 193-211. (Pubitemid 30353598)
11. BOSTANOV, V., & KOTCHOUBEY, B. (2004). Recognition of affective prosody: Continuous wavelet measures of event-related brain potentials to emotional exclamations. Psychophysiology, 41, 259-268. (Pubitemid 38524098)
12. BOWER, G. H. (1981). Mood and memory. American Psychologist, 36, 129-148.
13. BOWER, G. H. (1991). Mood congruity of social judgments. In J. P. Forgas (Ed.), Emotion and social judgments (International Series in Experimental Social Psychology) (pp. 31-53). Oxford: Pergamon.
14. BOWERS, D., BAUER, R. M., & HEILMAN, K. M. (1993). The nonverbal affect lexicon: Theoretical perspectives from neuropsychological studies of affect perception. Neuropsychology, 7, 433-444.
15. BROWN, C., & HAGOORT, P. (1993). The processing nature of the N400: Evidence from masked priming. Journal of Cognitive Neuroscience, 5, 34-44. (Pubitemid 23053085)
16. CALDARA, R., JERMANN, F., LÓPEZ ARANGO, G., & VAN DER LINDEN, M. (2004). Is the N400 category-specific? A face and language processing study. NeuroReport, 15, 2589-2593. (Pubitemid 40053943)
17. CARR, T. H., & DAGENBACH, D. (1990). Semantic priming and repetition priming from masked words: Evidence for a center-surround attentional mechanism in perceptual recognition. Journal of Experimental Psychology: Learning, Memory, & Cognition, 16, 341-350.
18. CARROLL, N. C., & YOUNG, A. W. (2005). Priming of emotion recognition. Quarterly Journal of Experimental Psychology, 58 A, 1173-1197. (Pubitemid 41539379)
19. DEACON, D., HEWITT, S., YANG, C.-M., & NAGATA, M. (2000). Eventrelated potential indices of semantic priming using masked and unmasked words: Evidence that the N400 does not reflect a post-lexical process. Cognitive Brain Research, 9, 137-146. (Pubitemid 30145702)
20. DEACON, D., UHM, T.-J., RITTER, W., HEWITT, S., & DYNOWSKA, A. (1999). The lifetime of automatic semantic priming effects may exceed two seconds. Cognitive Brain Research, 7, 465-472. (Pubitemid 29111398)
21. DE GELDER, B., MEEREN, H. K. M., RIGHART, R., VAN DEN STOCK, J., VAN DE RIET, W. A. C., & TAMIETTO, M. (2006). Beyond the face: Exploring rapid influences of context on face processing. Progress in Brain Research, 155, 37-48. (Pubitemid 44485190)
22. DE GELDER, B., & VROOMEN, J. (2000). The perception of emotions by ear and by eye. Cognition & Emotion, 14, 289-311. (Pubitemid 30367746)
23. EIMER, M., & HOLMES, A. (2002). An ERP study on the time course of emotional face processing. NeuroReport, 13, 427-431. (Pubitemid 34293183)
24. FAZIO, R. H., SANBONMATSU, D. M., POWELL, M. C., & KARDES, F. R. (1986). On the automatic activation of attitudes. Journal of Personality & Social Psychology, 50, 229-238.
25. FELDMANN BARETT, L., LINDQUIST, K. A., & GENDRON, M. (2007). Language as context for the perception of emotion. Trends in Cognitive Sciences, 11, 327-332. (Pubitemid 47077913)
26. FRINGS, C., BERMEITINGER, C., & WENTURA, D. (2008). Center-surround or spreading inhibition: Which mechanism caused the negative effect from repeated masked semantic primes? Experimental Psychology, 55, 234-242.
27. GRANDJEAN, D., SANDER, D., POURTOIS, G., SCHWARTZ, S., SEGHIER, M. L., SCHERER, K. R., & VUILLEUMIER, P. (2005). The voices of wrath: Brain responses to angry prosody in meaningless speech. Nature Neuroscience, 8, 145-146. (Pubitemid 40194042)
28. GREEN, M. J., WILLIAMS, L. M., & DAVIDSON, D. (2003). In the face of danger: Specific viewing strategies for facial expressions of threat? Cognition & Emotion, 17, 779-786. (Pubitemid 36926454)
29. GREENHOUSE, S. W., & GEISSER, S. (1959). On methods in the analysis of profile data. Psychometrika, 24, 95-112.
30. HANDY, T. C. (2004). Event-related potentials: A methods handbook. Cambridge, MA: MIT Press.
31. HANSEN, C. H., & SHANTZ, C. A. (1995). Emotion-specific priming: Congruence effects on affect and recognition across negative emotions. Personality & Social Psychology Bulletin, 21, 548-557.
32. HERMANS, D., DE HOUWER, J., & EELEN, P. (1994). The affective priming effect: Automatic activation of evaluative information in memory. Cognition & Emotion, 8, 515-533.
33. HERMANS, D., DE HOUWER, J., & EELEN, P. (2001). A time course analysis of the affective priming effect. Cognition & Emotion, 15, 143-165. (Pubitemid 32536959)
34. HERMANS, D., DE HOUWER, J., SMEESTERES, D., & VAN DEN BROECK, A. (1997). Affective priming with associatively unrelated primes and targets. Paper presented at the Sixth Tagung der Fachgruppe Sozialpsychologie, Konstanz, Germany.
35. HOLCOMB, P. J. (1988). Automatic and attentional processing: An eventrelated brain potential analysis of semantic priming. Brain & Language, 35, 66-85.
36. KANSKE, P., & KOTZ, S. A. (2007). Concreteness in emotional words: ERP evidence from a hemifield study. Brain Research, 1148, 138-148. (Pubitemid 46602167)
37. KLAUER, K. C., & MUSCH, J. (2003). Affective priming: Findings and theories. In J. Musch & K. C. Klauer (Eds.), The psychology of evaluation: Affective processes in cognition and emotion (pp. 7-49). Mahwah, NJ: Erlbaum.
38. KLAUER, K. C., ROßNAGEL, C., & MUSCH, J. (1997). List-context effects in evaluative priming. Journal of Experimental Psychology: Learning, Memory, & Cognition, 23, 246-255. (Pubitemid 127541500)
39. KOTZ, S. A. (2001). Neurolinguistic evidence for bilingual language representation: A comparison of reaction times and event-related brain potentials. Bilingualism: Language & Cognition, 4, 143-154.
40. KOTZ, S. A., & PAULMANN, S. (2007). When emotional prosody and semantics dance cheek to cheek: ERP evidence. Brain Research, 1151, 107-118. (Pubitemid 46709874)
41. KUTAS, M., & FEDERMEIER, K. D. (2000). Electrophysiology reveals semantic memory use in language comprehension. Trends in Cognitive Sciences, 4, 463-470.
42. KUTAS, M., & VAN PETTEN, C. K. (1994). Psycholinguistics electrified: Event-related brain potential investigations. In M. A. Gernsbacher (Ed.), Handbook of psycholinguistics (pp. 83-143). San Diego: Academic Press.
43. MASSARO, D. W., & EGAN, P. B. (1996). Perceiving affect from the voice and the face. Psychonomic Bulletin & Review, 3, 215-221. (Pubitemid 126421515)
44. NIEDENTHAL, P. M., & HALBERSTADT, J. B. (1995). The acquisition and structure of emotional response categories.In D. L. Medin (Vol. Ed.), Psychology of learning and motivation (Vol. 33, pp. 23-63). San Diego: Academic Press.
45. NIEDENTHAL, P. M., HALBERSTADT, J. B., & SETTERLUND, M. B. (1997). Being happy and seeing "happy": Emotional state mediates visual word recognition. Cognition & Emotion, 11, 403-432. (Pubitemid 127465921)
46. PAULMANN, S., & KOTZ, S. A. (2006, August). Valence, arousal, and task effects on the P200 in emotional prosody processing. Poster presented at the 12th Annual Conference on Architectures and Mechanisms for Language Processing, Nijmegen, The Netherlands.
47. PAULMANN, S., & KOTZ, S. A. (2008a). Early emotional prosody perception based on different speaker voices. NeuroReport, 19, 209-213.
48. PAULMANN, S., & KOTZ, S. A. (2008b). An ERP investigation on the temporal dynamics of emotional prosody and emotional semantics in pseudo-and lexical-sentence context. Brain & Language, 105, 59-69.
49. PAULMANN, S., & PELL, M. D. (2009). Facial expression decoding as a function of emotional meaning status: ERP evidence. NeuroReport, 20, 1603-1608.
50. PAULMANN, S., PELL, M. D., & KOTZ, S. A. (2008). Functional contributions of the basal ganglia to emotional prosody: Evidence from ERPs. Brain Research, 1217, 171-178.
51. PEGNA, A. J., LANDIS, T., & KHATEB, A. (2008). Electrophysiological evidence for early non-conscious processing of fearful facial expressions. International Journal of Psychophysiology, 70, 127-136.
52. PELL, M. D. (2001). Influence of emotion and focus location on prosody in matched statements and questions. Journal of the Acoustical Society of America, 109, 1668-1680. (Pubitemid 32275206)
53. PELL, M. D. (2002). Evaluation of nonverbal emotion in face and voice: Some preliminary findings on a new battery of tests. Brain & Cognition, 48, 499-504. (Pubitemid 34267497)
54. PELL, M. D. (2005a). Nonverbal emotion priming: Evidence from the "facial affect decision task." Journal of Nonverbal Behavior, 29, 45-73. (Pubitemid 40366351)
55. PELL, M. D. (2005b). Prosody-face interactions in emotional processing as revealed by the facial affect decision task. Journal of Nonverbal Behavior, 29, 193-215. (Pubitemid 41807466)
56. PELL, M. D., PAULMANN, S., DARA, C., ALASSERI, A., & KOTZ, S. A. (2009). Factors in the recognition of vocally expressed emotions: A comparison of four languages. Journal of Phonetics, 37, 417-435.
57. PELL, M. D., & SKORUP, V. (2008). Implicit processing of emotional prosody in a foreign versus native language. Speech Communication, 50, 519-530.
58. PHILLIPS, M. L., DREVETS, W. C., RAUCH, S. L., & LANE, R. (2003). Neurobiology of emotion perception I: The neural basis of normal emotion perception. Biological Psychiatry, 54, 504-514. (Pubitemid 37289437)
59. POURTOIS, G., DE GELDER, B., VROOMEN, J., ROSSION, B., & CROMMELINCK, M. (2000). The time-course of intermodal binding between seeing and hearing affective information. NeuroReport, 11, 1329-1333. (Pubitemid 30262982)
60. POWER, M. J., BREWIN, C. R., STUESSY, A., & MAHONY, T. (1991). The emotional priming task: Results from a student population. Cognitive Therapy & Research, 15, 21-31.
61. RUSSELL, J. A., & FEHR, B. (1987). Relativity in the perception of emotion in facial expressions. Journal of Experimental Psychology: General, 116, 223-237.
62. RUSSELL, J. [A.], & LEMAY, G. (2000). Emotion concepts. In M. Lewis & J. M. Haviland-Jones (Eds.), Handbook of emotions (pp. 491-503). New York: Guilford.
63. RUYS, K. I., & STAPEL, D. A. (2008). Emotion elicitor or emotion messenger? Subliminal priming reveals two faces of facial expressions. Psychological Science, 19, 593-600.
64. SCHERER, K. R. (1986). Vocal affect expression: A review and a model for future research. Psychological Bulletin, 99, 143-165.
65. SCHIRMER, A., & KOTZ, S. A. (2006). Beyond the right hemisphere: Brain mechanisms mediating vocal emotional processing. Trends in Cognitive Sciences, 10, 24-30. (Pubitemid 43049769)
66. SCHIRMER, A., KOTZ, S. A., & FRIEDERICI, A. D. (2002). Sex differentiates the role of emotional prosody during word processing. Cognitive Brain Research, 14, 228-233. (Pubitemid 34626951)
67. SCHIRMER, A., KOTZ, S. A., & FRIEDERICI, A. D. (2005). On the role of attention for the processing of emotions in speech: Sex differences revisited. Cognitive Brain Research, 24, 442-452. (Pubitemid 41133282)
68. SCHUPP, H. T., JUNGHÖFER, M., WEIKE, A. I., & HAMM, A. O. (2004). The selective processing of briefly presented affective pictures: An ERP analysis. Psychophysiology, 41, 441-449. (Pubitemid 38715399)
69. SPRUYT, A., HERMANS, D., DE HOUWER, J., VANDROMME, H., & EELEN, P. (2007). On the nature of the affective priming effect: Effects of stimulus onset asynchrony and congruency proportion in naming and evaluative categorization. Memory & Cognition, 35, 95-106. (Pubitemid 46691118)
70. VROOMEN, J., DRIVER, J., & DE GELDER, B. (2001). Is cross-modal integration of emotional expressions independent of attentional resources? Cognitive, Affective, & Behavioral Neuroscience, 1, 382-387. (Pubitemid 38391259)
71. VUILLEUMIER, P., & POURTOIS, G. (2007). Distributed and interactive brain mechanisms during emotion face perception: Evidence from functional neuroimaging. Neuropsychologia, 45, 174-194. (Pubitemid 44821236)
72. WENTURA, D. (1998). Affektives Priming in der Wortentscheidungsaufgabe: Evidenz für post-lexikalische Urteilstendenzen [Affective priming in the lexical decision task: Evidence for post-lexical judgmental tendencies]. Sprache & Kognition, 17, 125-137. (Pubitemid 128778115)
73. WERHEID, K., ALPAY, G., JENTZSCH, I., & SOMMER, W. (2005). Priming emotional facial expressions as evidenced by event-related brain potentials. International Journal of Psychophysiology, 55, 209-219. (Pubitemid 40093102)
74. ZHANG, Q., LAWSON, A., GUO, C., & JIANG, Y. (2006). Electrophysiological correlates of visual affective priming. Brain Research Bulletin, 71, 316-323. (Pubitemid 44750449)