메뉴 건너뛰기




Volumn 10, Issue 5, 2015, Pages 713-720

The role of emotion in dynamic audiovisual integration of faces and voices

Author keywords

Audiovisual; Cross modal prediction; EEG; Emotion; Incongruity

Indexed keywords

ADULT; ANGER; AUDITORY STIMULATION; ELECTROENCEPHALOGRAPHY; EMOTION; EVOKED RESPONSE; FACE; FACIAL EXPRESSION; FEMALE; HUMAN; MALE; PERCEPTION; PHOTOSTIMULATION; PHYSIOLOGY; PSYCHOMOTOR PERFORMANCE; VOICE; YOUNG ADULT;

EID: 84964698645     PISSN: 17495016     EISSN: 17495024     Source Type: Journal    
DOI: 10.1093/scan/nsu105     Document Type: Article
Times cited : (49)

References (46)
  • 1
    • 19844377516 scopus 로고    scopus 로고
    • Deciphering the enigmatic face: the importance of facial dynamics in interpreting subtle facial expressions
    • Ambadar, Z., Schooler, J.W., Cohn, J.F. (2005). Deciphering the enigmatic face: the importance of facial dynamics in interpreting subtle facial expressions. Psychological Science, 16(5), 403-10.
    • (2005) Psychological Science , vol.16 , Issue.5 , pp. 403-410
    • Ambadar, Z.1    Schooler, J.W.2    Cohn, J.F.3
  • 3
    • 84889673713 scopus 로고    scopus 로고
    • Electrophysiological evidence for speechspecific audiovisual integration
    • Baart, M., Stekelenburg, J.J., Vroomen, J. (2014). Electrophysiological evidence for speechspecific audiovisual integration. Neuropsychologia, 53, 115-21.
    • (2014) Neuropsychologia , vol.53 , pp. 115-121
    • Baart, M.1    Stekelenburg, J.J.2    Vroomen, J.3
  • 4
    • 0018535728 scopus 로고
    • Emotion recognition: the role of facial movement and the relative importance of upper and lower areas of the face
    • Bassili, J.N. (1979). Emotion recognition: the role of facial movement and the relative importance of upper and lower areas of the face. Journal of Personality and Social Psychology, 37(11), 2049-58.
    • (1979) Journal of Personality and Social Psychology , vol.37 , Issue.11 , pp. 2049-2058
    • Bassili, J.N.1
  • 5
    • 4944263848 scopus 로고    scopus 로고
    • Bimodal speech: early suppressive visual effects in human auditory cortex
    • Besle, J., Fort, A., Delpuech, C., Giard, M.-H. (2004). Bimodal speech: early suppressive visual effects in human auditory cortex. The European Journal of Neuroscience, 20(8), 2225-34.
    • (2004) The European Journal of Neuroscience , vol.20 , Issue.8 , pp. 2225-2234
    • Besle, J.1    Fort, A.2    Delpuech, C.3    Giard, M.-H.4
  • 6
    • 4344698522 scopus 로고    scopus 로고
    • The Psychology of Multimodal Perception
    • Spence, C., Driver, J., editors. Oxford: Oxford University Press
    • Bertelson, P., Gelder, B. de (2004). The Psychology of Multimodal Perception. In: Spence, C., Driver, J., editors. Crossmodal Space and Crossmodal Attention. Oxford: Oxford University Press.
    • (2004) Crossmodal Space and Crossmodal Attention
    • Bertelson, P.1    Gelder, B.2
  • 9
    • 36549046939 scopus 로고    scopus 로고
    • Integrating face and voice in person perception
    • Campanella, S., Belin, P. (2007). Integrating face and voice in person perception. Trends in Cognitive Sciences, 11(12), 535-43.
    • (2007) Trends in Cognitive Sciences , vol.11 , Issue.12 , pp. 535-543
    • Campanella, S.1    Belin, P.2
  • 13
    • 0344177597 scopus 로고    scopus 로고
    • The combined perception of emotion from voice and face: early interaction revealed by human electric brain responses
    • De Gelder, B., Böcker, K.B., Tuomainen, J., Hensen, M., Vroomen, J. (1999). The combined perception of emotion from voice and face: early interaction revealed by human electric brain responses. Neuroscience Letters, 260(2), 133-6.
    • (1999) Neuroscience Letters , vol.260 , Issue.2 , pp. 133-136
    • De Gelder, B.1    Böcker, K.B.2    Tuomainen, J.3    Hensen, M.4    Vroomen, J.5
  • 14
    • 0034040864 scopus 로고    scopus 로고
    • The perception of emotions by ear and by eye
    • De Gelder, B., Vroomen, J. (2000). The perception of emotions by ear and by eye. Cognition & Emotion, 14(3), 289-311.
    • (2000) Cognition & Emotion , vol.14 , Issue.3 , pp. 289-311
    • De Gelder, B.1    Vroomen, J.2
  • 15
    • 1242283941 scopus 로고    scopus 로고
    • EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis
    • Delorme, A., Makeig, S. (2004). EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. Journal of Neuroscience Methods, 134(1), 9-21.
    • (2004) Journal of Neuroscience Methods , vol.134 , Issue.1 , pp. 9-21
    • Delorme, A.1    Makeig, S.2
  • 16
    • 33749054643 scopus 로고    scopus 로고
    • Psychoacoustic studies on the processing of vocal interjections: how to disentangle lexical and prosodic information?
    • Dietrich, S., Ackermann, H., Szameitat, D.P., Alter, K. (2006). Psychoacoustic studies on the processing of vocal interjections: how to disentangle lexical and prosodic information? Progress in Brain Research, 156, 295-302.
    • (2006) Progress in Brain Research , vol.156 , pp. 295-302
    • Dietrich, S.1    Ackermann, H.2    Szameitat, D.P.3    Alter, K.4
  • 17
    • 57149136917 scopus 로고    scopus 로고
    • Understanding the emotional expression of verbal interjections: a functional MRI study
    • Dietrich, S., Hertrich, I., Alter, K., Ischebeck, A., Ackermann, H. (2008). Understanding the emotional expression of verbal interjections: a functional MRI study. Neuroreport, 19(18), 1751-5.
    • (2008) Neuroreport , vol.19 , Issue.18 , pp. 1751-1755
    • Dietrich, S.1    Hertrich, I.2    Alter, K.3    Ischebeck, A.4    Ackermann, H.5
  • 18
    • 0003826472 scopus 로고
    • Pictures of Facial Affect
    • CA: Consulting Psychologists Press
    • Ekman, P., Friesen, W.V. (1976). Pictures of Facial Affect. Palo Alto. CA: Consulting Psychologists Press.
    • (1976) Palo Alto
    • Ekman, P.1    Friesen, W.V.2
  • 19
    • 33748771206 scopus 로고    scopus 로고
    • Impact of voice on emotional judgment of faces: an event-related fMRI study
    • Ethofer, T., Anders, S., Erb, M., et al. (2006). Impact of voice on emotional judgment of faces: an event-related fMRI study. Human Brain Mapping, 27(9), 707-14.
    • (2006) Human Brain Mapping , vol.27 , Issue.9 , pp. 707-714
    • Ethofer, T.1    Anders, S.2    Erb, M.3
  • 20
    • 79954665435 scopus 로고    scopus 로고
    • Preattentive processing of audio-visual emotional signals
    • Föcker, J., Gondan, M., Röder, B. (2011). Preattentive processing of audio-visual emotional signals. Acta Psychologica, 137(1), 36-47.
    • (2011) Acta Psychologica , vol.137 , Issue.1 , pp. 36-47
    • Föcker, J.1    Gondan, M.2    Röder, B.3
  • 21
    • 0003893572 scopus 로고
    • Cambridge, UK: Cambridge University Press
    • Frijda, N.H. (1986). The Emotions. Cambridge, UK: Cambridge University Press.
    • (1986) The Emotions
    • Frijda, N.H.1
  • 24
    • 80051800582 scopus 로고    scopus 로고
    • The temporal dynamics of processing emotions from vocal, facial, and bodily expressions
    • Jessen, S., Kotz, S.A. (2011). The temporal dynamics of processing emotions from vocal, facial, and bodily expressions. NeuroImage, 58(2), 665-74.
    • (2011) NeuroImage , vol.58 , Issue.2 , pp. 665-674
    • Jessen, S.1    Kotz, S.A.2
  • 25
    • 84933678589 scopus 로고    scopus 로고
    • On the role of crossmodal prediction in audiovisual emotion perception
    • Jessen, S., Kotz, S.A. (2013). On the role of crossmodal prediction in audiovisual emotion perception. Frontiers in Human Neuroscience, 7, 369.
    • (2013) Frontiers in Human Neuroscience , vol.7 , pp. 369
    • Jessen, S.1    Kotz, S.A.2
  • 26
    • 84860491311 scopus 로고    scopus 로고
    • How bodies and voices interact in early emotion perception
    • Jessen, S., Obleser, J., Kotz, S.A. (2012). How bodies and voices interact in early emotion perception. PloS One, 7(4), e36070.
    • (2012) PloS One , vol.7 , Issue.4
    • Jessen, S.1    Obleser, J.2    Kotz, S.A.3
  • 27
    • 38849113943 scopus 로고    scopus 로고
    • Measurement of ERP latency differences: a comparison of single-participant and jackknife-based scoring methods
    • Kiesel, A., Miller, J., Jolicoeur, P., Brisson, B. (2008). Measurement of ERP latency differences: a comparison of single-participant and jackknife-based scoring methods. Psychophysiology, 45(2), 250-74.
    • (2008) Psychophysiology , vol.45 , Issue.2 , pp. 250-274
    • Kiesel, A.1    Miller, J.2    Jolicoeur, P.3    Brisson, B.4
  • 28
    • 84868636262 scopus 로고    scopus 로고
    • Multisensory emotions: perception, combination and underlying neural processes
    • Klasen, M., Chen, Y.-H., Mathiak, K. (2012). Multisensory emotions: perception, combination and underlying neural processes. Reviews in the Neurosciences, 23(4), 381-92.
    • (2012) Reviews in the Neurosciences , vol.23 , Issue.4 , pp. 381-392
    • Klasen, M.1    Chen, Y.-H.2    Mathiak, K.3
  • 29
    • 0344196861 scopus 로고    scopus 로고
    • Electrophysiological indicators of phonetic and non-phonetic multisensory interactions during audiovisual speech perception
    • Klucharev, V., Möttönen, R., Sams, M. (2003). Electrophysiological indicators of phonetic and non-phonetic multisensory interactions during audiovisual speech perception. Brain Research. Cognitive Brain Research, 18(1), 65-75.
    • (2003) Brain Research. Cognitive Brain Research , vol.18 , Issue.1 , pp. 65-75
    • Klucharev, V.1    Möttönen, R.2    Sams, M.3
  • 32
    • 0141608682 scopus 로고    scopus 로고
    • Dynamic Perception of Facial Affect and Identity in the Human Brain
    • LaBar, K.S., Crupain, M.J., Voyvodic, J.T., McCarthy, G. (2003). Dynamic Perception of Facial Affect and Identity in the Human Brain. Cerebral Cortex, 13(10), 1023-33.
    • (2003) Cerebral Cortex , vol.13 , Issue.10 , pp. 1023-1033
    • LaBar, K.S.1    Crupain, M.J.2    Voyvodic, J.T.3    McCarthy, G.4
  • 33
    • 60049084425 scopus 로고    scopus 로고
    • Why jackknifing yields good latency estimates
    • Miller, J., Ulrich, R., Schwarz, W. (2009). Why jackknifing yields good latency estimates. Psychophysiology, 46(2), 300-12.
    • (2009) Psychophysiology , vol.46 , Issue.2 , pp. 300-312
    • Miller, J.1    Ulrich, R.2    Schwarz, W.3
  • 34
    • 70149093662 scopus 로고    scopus 로고
    • Investigating the Multimodal Nature of Human Communication
    • Paulmann, S., Jessen, S., Kotz, S.A. (2009). Investigating the Multimodal Nature of Human Communication. Journal of Psychophysiology, 23(2), 63-76.
    • (2009) Journal of Psychophysiology , vol.23 , Issue.2 , pp. 63-76
    • Paulmann, S.1    Jessen, S.2    Kotz, S.A.3
  • 35
    • 0034720189 scopus 로고    scopus 로고
    • The timecourse of intermodal binding between seeing and hearing affective information
    • Pourtois, G., de Gelder, B., Vroomen, J., Rossion, B., Crommelinck, M. (2000). The timecourse of intermodal binding between seeing and hearing affective information. Neuroreport, 11(6), 1329-33.
    • (2000) Neuroreport , vol.11 , Issue.6 , pp. 1329-1333
    • Pourtois, G.1    de Gelder, B.2    Vroomen, J.3    Rossion, B.4    Crommelinck, M.5
  • 37
    • 30044431586 scopus 로고    scopus 로고
    • Beyond the right hemisphere: brain mechanisms mediating vocal emotional processing
    • Schirmer, A., Kotz, S.A. (2006). Beyond the right hemisphere: brain mechanisms mediating vocal emotional processing. Trends in Cognitive Sciences, 10(1), 24-30.
    • (2006) Trends in Cognitive Sciences , vol.10 , Issue.1 , pp. 24-30
    • Schirmer, A.1    Kotz, S.A.2
  • 38
    • 0033259388 scopus 로고    scopus 로고
    • Measuring emotion continuously: validity and reliability of the twodimensional emotion-space
    • Schubert, E. (1999). Measuring emotion continuously: validity and reliability of the twodimensional emotion-space. Australian Journal of Psychology, 51(3), 154-65.
    • (1999) Australian Journal of Psychology , vol.51 , Issue.3 , pp. 154-165
    • Schubert, E.1
  • 40
    • 0016653813 scopus 로고
    • Two varieties of long-latency positive 35 waves evoked by unpredictable auditory stimuli in man
    • Squires, N.K., Squires, K.C., Hillyard, S.A. (1975). Two varieties of long-latency positive 35 waves evoked by unpredictable auditory stimuli in man. Electroencephalography and Clinical Neurophysiology, 38(4), 387-401.
    • (1975) Electroencephalography and Clinical Neurophysiology , vol.38 , Issue.4 , pp. 387-401
    • Squires, N.K.1    Squires, K.C.2    Hillyard, S.A.3
  • 41
    • 36849077226 scopus 로고    scopus 로고
    • Neural correlates of multisensory integration of ecologically valid audiovisual events
    • Stekelenburg, J.J., Vroomen, J. (2007). Neural correlates of multisensory integration of ecologically valid audiovisual events. Journal of Cognitive Neuroscience, 19(12), 1964-73.
    • (2007) Journal of Cognitive Neuroscience , vol.19 , Issue.12 , pp. 1964-1973
    • Stekelenburg, J.J.1    Vroomen, J.2
  • 42
    • 84863623893 scopus 로고    scopus 로고
    • Electrophysiological correlates of predictive coding of auditory location in the perception of natural audiovisual events
    • Stekelenburg, J.J., Vroomen, J. (2012). Electrophysiological correlates of predictive coding of auditory location in the perception of natural audiovisual events. Frontiers in Integrative Neuroscience, 6, 26.
    • (2012) Frontiers in Integrative Neuroscience , vol.6 , pp. 26
    • Stekelenburg, J.J.1    Vroomen, J.2
  • 43
    • 33847003029 scopus 로고    scopus 로고
    • Selective attention and audiovisual integration: is attending to both modalities a prerequisite for early integratio?
    • Talsma, D., Doty, T.J., Woldorff, M.G. (2007). Selective attention and audiovisual integration: is attending to both modalities a prerequisite for early integration? Cerebral Cortex (New York, N.Y.: 1991), Vol. 17(3), 679-90.
    • (2007) Cerebral Cortex (New York, N.Y.: 1991), Vol. , vol.17 , Issue.3 , pp. 679-690
    • Talsma, D.1    Doty, T.J.2    Woldorff, M.G.3
  • 45
    • 77953756033 scopus 로고    scopus 로고
    • Visual anticipatory information modulates multisensory interactions of artificial audiovisual stimuli
    • Vroomen, J., Stekelenburg, J.J. (2010). Visual anticipatory information modulates multisensory interactions of artificial audiovisual stimuli. Journal of Cognitive Neuroscience, 22(7), 1583-96.
    • (2010) Journal of Cognitive Neuroscience , vol.22 , Issue.7 , pp. 1583-1596
    • Vroomen, J.1    Stekelenburg, J.J.2
  • 46
    • 21144467945 scopus 로고
    • On measuring performance in category judgment studies of nonverbal behavior
    • Wagner, H.L. (1993). On measuring performance in category judgment studies of nonverbal behavior. Journal of Nonverbal Behavior, 17(1), 3-28.
    • (1993) Journal of Nonverbal Behavior , vol.17 , Issue.1 , pp. 3-28
    • Wagner, H.L.1


* 이 정보는 Elsevier사의 SCOPUS DB에서 KISTI가 분석하여 추출한 것입니다.