Electrophysiological correlates of facial conWguration and audio-visual congruency: Evidence that face processing is a visual rather than a multisensory task

Experimental Brain Research

Volumn 213, Issue 2-3, 2011, Pages 203-211

  Proctor, Barnaby J ^a   Meyer, Georg F ^a  

^a UNIVERSITY OF LIVERPOOL   (United Kingdom)

Author keywords

Auditory; Congruence; EEG; Face recognition; Multisensory; Visual

Indexed keywords

ADULT; AMPLITUDE MODULATION; ART; ARTICLE; AUDIOVISUAL CONGRUENCY; AUDITORY STIMULATION; ELECTROENCEPHALOGRAM; EVENT RELATED POTENTIAL; EVOKED RESPONSE; FACE; FACIAL CONFIGURATION; FACTORIAL DESIGN; HUMAN; HUMAN EXPERIMENT; MALE; MOUTH; NORMAL HUMAN; PRIORITY JOURNAL; REACTION TIME; RECOGNITION; SENSORIMOTOR INTEGRATION; SENSORY SYSTEM ELECTROPHYSIOLOGY; VISUAL STIMULATION;

AUDITORY PERCEPTION; BRAIN MAPPING; DISCRIMINATION (PSYCHOLOGY); ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FACE; FUNCTIONAL LATERALITY; HUMANS; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; REACTION TIME;

EID: 80053930956     PISSN: 00144819     EISSN: 14321106     Source Type: Journal    
DOI: 10.1007/s00221-011-2724-x     Document Type: Article

References (40)

1. Amedi A, von Kriegstein K, van Atteveldt NM, Beauchamp MS, Naumer MJ (2005) Functional imaging of human crossmodal identiWcation and object recognition. Exp Brain Res 166:559-571 (Pubitemid 41502099)
2. Barton JJS, Press DZ MD, Keenan JP, O'Connor M (2002) Lesions of the fusiform face area impair perception of facial conWguration in prosopagnosia. Neurology 58:71-78 (Pubitemid 34041940)
3. Bentin S, Deouell LY (2000) Structural encoding and identiWcation in face processing; ERP evidence for separate mechanisms. Cogn Neuropsychol 17:35-54 (Pubitemid 30219833)
4. Bentin S, McCarthy G, Perez E, Puce A, Allison T (1996) Electrophysiological studies of face perception in humans. J Cogn Neurosci 8:551-565 (Pubitemid 27075436)
5. Besle J, Fort A, Girard M-H (2004) Interest and validity of the additive model in electrophysiological studies of multisensory interactions. Cogn Process 5:189-192
6. Besle J, Bertrand O, Giard M-H (2009) Electrophysiological (EEG, sEEG, MEG) evidence for multiple audiovisual interactions in the human auditory cortex. Hear Res 258:143-151
7. Bötzel K, Grüsser O-J (1989) Electric brain potentials evoked by pictures of faces and non-faces: A search for "face-speciWc" EEG potentials. Exp Brain Res 77:349-360 (Pubitemid 19232035)
8. Calvert GA, Campbell R (2003) Reading speech from still and moving faces: The neural substrates of visible speech. J Cogn Neurosci 15:57-70 (Pubitemid 36106263)
9. Campbell R, Landis T, Regard M (1986) Face recognition and lipreading: A neurological dissociation. Brain 109:509-521 (Pubitemid 16100403)
10. Damasio AR, Tranel D, Damasio H (1990) Face agnosia and the neural substrates of memory. Annu Rev Neurosci 13:89-109 (Pubitemid 20100643)
11. Farah MJ (1996) Is face recognition 'special'? Evidence from neuropsychology. Behav Brain Res 76:181-189 (Pubitemid 26135409)
12. Fort A, Delpeuch C, Pernier J, Girard M-H (2002) Early auditoryvisual interactions in human cortex during non-redundant signal identiWcation. Cogn Brain Res 14:20-30 (Pubitemid 34626794)
13. George N, Evans J, Fiori N, DavidoV J, Renault B (1996) Brain events related to normal and moderately scrambled faces. Cogn Brain Res 4:65-76 (Pubitemid 26308879)
14. Ghazanfar AA, Schroeder CE (2006) Is neocortex essentially multisensory? Trends Cogn Sci 10:278-285 (Pubitemid 43870163)
15. Giard MH, Peronnet F (1999) Auditory-visual integration during multimodal object recognition in humans: A behavioral and electrophysiological study. J Cogn Neurosci 11:473-490 (Pubitemid 29520540)
16. Hillyard SA, Teder-Sälejärvi WA, Munte TF (1998) Temporal dynamics of early perceptual processing. Curr Opin Neurobiol 8:202-210 (Pubitemid 28247801)
17. Itier RJ, Taylor MJ (2002) Inversion and contrast polarity reversal aVect both encoding and recognition processes of unfamiliar faces: A repetition study using ERPs. NeuroImage 15:353-372 (Pubitemid 34852546)
18. JeVreys DA (1989) A face-responsive potential recorded from the human scalp. Exp Brain Res 78:193-202
19. JeVreys DA, Tukmachi ESA (1992) The vertex-positive scalp potential evoked by faces and by objects. Exp Brain Res 91(2):340-350
20. Joyce CA, Rossion B (2005) The face-sensitive N170 and VPP components manifest the same brain processes: The eVect of reference electrode site. Clin Neurophysiol 116:2613-2631 (Pubitemid 41543159)
21. Junghöfer M, Elbert T, Tucker M, Rockstroh B (2000) Statistical control of artifacts in dense array EEG/MEG studies. Psychophysiology 37:523-532 (Pubitemid 30625481)
22. Kanwisher N, McDermott J, Chun MM (1997) The fusiform face area: A module in human extrastriate cortex specialized for face perception. J Neurosci 17:4302-4311 (Pubitemid 27220621)
23. Klucharev M, Möttönen R, Sams M (2003) Electrophysiological indicators of phonetic and non-phonetic multisensory interactions during audiovisual speech perception. Cogn Brain Res 18:65-75 (Pubitemid 37500976)
24. Laurienti PJ, Kraft RA, Maldjian JA, Burdette JH (2004) Wallace MT (2004) Semantic congruence is a critical factor in multisensory behavioral performance. Exp Brain Res 158:405-414 (Pubitemid 39371385)
25. Lehmann D, Skrandies W (1980) Reference-free identiWcation of components of checkerboard-evoked multichannel potential Welds. Electroencephalogr Clin Neurophysiol 48:609-621 (Pubitemid 10091391)
26. Lewald J, Guski R (2003) Cross-modal perceptual integration of spatially and temporally disparate auditory and visual stimuli. Cogn Brain Res 16:468-478 (Pubitemid 36426932)
27. Meyer GF, Wuerger SM, Röhrbein F, Zetzsche C (2005) Low-level integration of auditory and visual motion signals requires spatial co-localisation. Exp Brain Res 166:538-547 (Pubitemid 41502097)
28. Meyer GF, Greenlee MW, Wuerger SM (2011) Interactions between auditory and visual semantic stimulus classes: Evidence for common processing networks for speech and biological body motion. J Cog Neurosci (in press
29. Molholm S, Ritter W, Murray MM, Javitt DC, Schroeder CE, Foxe JJ (2002) Multisensory auditory-visual interactions during early sensory processing in humans: A high-density electrical mapping study. Cogn Brain Res 14:115-128 (Pubitemid 34626802)
30. Paller KA, Gonsalves B, Grabowecky M, Bozic VS, Yamada S (2000) Electrophysiological correlates of recollecting faces of known and unknown individuals. NeuroImage 11:98-110 (Pubitemid 30141448)
31. Perez E, Meyer G, Harrison N (2008) Brain correlates of speech and nonspeech: ERPs associated with duplex perception. J Neurolinguist 21:452-471
32. Soto-Faraco S, Navarra J, Alsius A (2004) Assessing automaticity in audiovisual speech integration: Evidence from the speeded classi- Wcation task. Cognition 92:B13-B23 (Pubitemid 38270272)
33. Tanaka JW, Farah MJ (1993) Parts and wholes in face recognition. Q J Exp Psychol [A] 46A:225-245
34. Teder-Sälejärvi WA, McDonald JJ, Di Russo F, Hillyard SA (2002) An analysis of audio-visual crossmodal integration by means of event-related potential (ERP) recordings. Cogn Brain Res 14:106-114 (Pubitemid 34626801)
35. Teder-Sälejärvi WA, Di Russo F, McDonald JJ, Hillyard SA (2005) EVects of spatial congruity on audio-visual multimodal integration. J Cogn Neurosci 17:1396-1409 (Pubitemid 41291963)
36. van Atteveldt NM, Formisano E, Blomert L, Goebel R (2007) The eVect of temporal asynchrony on the multisensory integration of letters and speech sounds. Cereb Cortex 17:962-974 (Pubitemid 46434637)
37. Vatakis A, Spence C (2007) How 'special' is the human face? Evidence from an audiovisual temporal order judgment task. Neuroreport 18:1807-1811 (Pubitemid 350303756)
38. von Kriegstein K, Kleinschmidt A, Sterzer P, Giraud A-L (2005) Interaction of face and voice areas during speaker recognition. J Cogn Neurosci 17:367-376 (Pubitemid 40364526)
39. Vroomen J, Stekelenburg JJ (2009) Visual anticipatory information modulates multisensory interactions of artiWcial audiovisual stimuli. J Cogn Neurosci 22:1583-1596
40. Yin RK (1969) Looking at upside-down faces. J Exp Psychol 81:141-145