Person identification through faces and voices: An ERP study

Brain Research

Volumn 1407, Issue , 2011, Pages 13-26

  González, Ileana Quiñones ^a   León, María Antonieta Bobes ^a   Belin, Pascal ^b   Martínez Quintana, Yaiselene ^a   García, Lidice Galán ^a   Castillo, Manuel Sánchez ^a  

^a CUBAN NEUROSCIENCE CENTER   (Cuba)

^b UNIVERSITY OF GLASGOW   (United Kingdom)

Author keywords

Cross modal interaction; Faces; Person recognition; Voices

Indexed keywords

ADULT; ARTICLE; BEHAVIOR; CONTROLLED STUDY; EVENT RELATED POTENTIAL; FACE; FEMALE; HUMAN; HUMAN EXPERIMENT; MALE; NERVOUS SYSTEM ELECTROPHYSIOLOGY; PERSON IDENTIFICATION; PRIORITY JOURNAL; RECOGNITION; TASK PERFORMANCE; VOICE;

ACOUSTIC STIMULATION; ADULT; DATA INTERPRETATION, STATISTICAL; DISCRIMINATION (PSYCHOLOGY); ELECTROENCEPHALOGRAPHY; ELECTROPHYSIOLOGICAL PHENOMENA; EVENT-RELATED POTENTIALS, P300; EVOKED POTENTIALS; EVOKED POTENTIALS, VISUAL; FACE; FEMALE; HUMANS; MALE; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; RECOGNITION (PSYCHOLOGY); VOICE; YOUNG ADULT;

EID: 79960985088     PISSN: 00068993     EISSN: 18726240     Source Type: Journal    
DOI: 10.1016/j.brainres.2011.03.029     Document Type: Article

References (81)

1. Arnal, L.H., Morillon, B., Kell, C.A., Giraud, A.L., 2009. Dual neural routing of visual facilitation in speech processing. J. Neurosci. 29 (43), 13445-13453.
2. Barbeau, E.J., Taylor, M.J., Regis, J., Marquis, P., Chauvel, P., Liégeois-Chauvel, C., 2008. Spatio temporal dynamics of face recognition. Cereb. Cortex 18 (5), 997-1009.
3. Barrett, S.E., Rugg, M.D., Perrett, D.I., 1988. Event-related potentials and the matching of familiar and unfamiliar faces Neuropsychology 26, 105-117.
4. Begleiter, H., Porjesz, B.,Wang,W., 1995. Event-related brain potentials differentiate priming and recognition to familiar and unfamiliar faces. Electroencephalogr. Clin. Neurophysiol. 94, 41-49.
5. Belin, P., Zatorre, R.J., Lafaille, P., Ahad, P., Pike, B., 2000. Voice-selective areas in human auditory cortex. Nature 403, 309-312. (Pubitemid 30062386)
6. Belin, P., Fecteau, S., Bedard, C., 2004. Thinking the voice: neural correlates of voice perception. Trends Cogn. Sci. 8 (3), 129-135.
7. Benjamini, Y., Hochberg, Y., 1995. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J. R. Stat. Soc. B 57 (1), 289-300.
8. Bentin, S., Deouell, L.Y., 2000. Structural encoding and identification in face processing: ERP evidence for separate mechanisms. Cogn. Neuropsychol. 17, 35-54.
9. Bentin, S., Allison, T., Puce, A., Perez, A., Mccarthy, G., 1996. Electrophysiological studies of face perception in humans. J. Cogn. Neurosci. 8, 551-556.
10. Blair, R., Karniski, W., 1993. An alternative method for significance testing of waveform difference potential. Psychophysiology 30, 518-524. (Pubitemid 23250125)
11. Bobes, M.A., Lopera, F., García, M., Díaz-Comas, L., Galán, L., Carbonell, F., Valdés-Sosa, M., 2004. Brain potentials reflect residual face processing in a case of prosopagnosia. Cogn. Neuropsychol. 21 (7), 691-718.
12. Bobes, M.A., Quiñones, I., Perez, J., Leon, I., Valdes-Sosa, M., 2007. Brain potentials reflect access to visual and emotional memories for faces. Biol. Psychol. 75, 146-153.
13. Beauchamp, M.S., 2005. Statistical criteria in fMRI studies of multisensory integration. Neuroinformatics 3, 93-113. (Pubitemid 40905175)
14. Brett-Greena, B.A., Millera, L.J., Gavine, W.J., Daviese, P.L., 2008. Multisensory integration in children: a preliminary ERP study. Brain Res. 1242, 283-290.
15. Bruce, V., Young, A.W., 1986. Understanding face recognition. Br. J. Psychol. 77, 305-327.
16. Bushara, K.O., Grafman, J., Hallett, M., 2001. Neural correlates of auditory-visual stimulus onsets asynchrony. J. Neurosci. 21 (1), 300-304. (Pubitemid 32098753)
17. Campanella, S., Belin, P., 2007. Integrating face and voice in person perception. Trends Cogn. Sci. 11, 535-543.
18. Carmel, D., Bentin, S., 2002. Domain specificity versus expertise: factors influencing distinct processing of faces. Cognition 83 (1), 1-29. (Pubitemid 34119077)
19. Charest, I., Pernet, C.R., Rousselet, G.A., Quiñones, I., Latinus, M., Fillion-Bilodeau, S., Chartrand, J., Belin, P., 2009. Electrophysiological evidence for an early processing of human voices. BMC Neurosci. 10, 127-138.
20. Czigler, I., Balázs, L., 2000. Event-related potentials and audiovisual stimuli: multimodal interactions. Neuroreport 12 (2), 223-226.
21. Damasio, A.R., 1999. The Feeling of What Happens: Body and Emotion in the Making of Consciousness. Harcourt Brace, New York.
22. De Haan, M., Johnson, M.H., Halit, H., 2003. Development of face-sensitive event-related potentials during infancy: a review. Int. J. Psychophysiol. 51, 45-58.
23. Efron, B., 2004. Large-scale simultaneous hypothesis testing: the choice of a null hypothesis. J. Am. Stat. Assoc. 99, 96-104.
24. Eimer, M., 2000a. Event related brain potentials distinguish processing stages involved in face perception and recognition. Clin. Neurophysiol. 111, 694-705.
25. Eimer, M., 2000b. Effects of face inversion on the structural encoding and recognition of faces: evidence from event-related potentials. Cogn. Brain Res. 10, 145-158.
26. Ellis, H.D., Jones, D.M., Mosdell, N., 1997. Intra- and inter-modal repetition priming of familiar faces and voices. Br. J. Psychol. 88, 143-156.
27. Foxe, J.J., Morocz, I.A., Murray, M.M., Higgins, B.A., Javit, D.C., Schroeder, C.E., 2000. Multisensory auditory-somatosensory interaction in early cortical processing revealed by high-density electrical mapping. Cogn. Brain Res. 10, 77-83.
28. Foxe, J.J., Schroeder, C.E., 2005. The case for feedforward multisensory convergence during early cortical processing. Neuroreport 16, 419-423. (Pubitemid 40477541)
29. Galán, L., Biscay, R., Rodríguez, J.L., Pérez Abalo, M.C., Rodríguez, R., 1997. Testing topographic differences between event related brain potentials by using non-parametric combinations of permutation tests. Electroencephalogr. Clin. Neurophysiol. 102, 240-247.
30. Gauthier, I., Tarr, M.J., Moylan, J., Skudlarski, P., Gore, J.C., Anderson, A.W., 2000. The fusiform "face area" is part of a network that processes faces at the individual level. J. Cogn. Neurosci. 12, 495-504.
31. Giard, M.H., Peronnet, F., 1999. Auditory-visual integration during multimodal object recognition in humans: a behavioural and electrophysiological study. J. Cogn. Neurosci. 11, 473-490.
32. Gunnar, M.R., Nelson, C.A., 1994. Event-related potentials in year-old infants: relations with emotionality and cortisol. Child Dev. 65 (1), 80-94.
33. Haxby, J., Hoffman, E., Gobbini, I., 2000. The distributed human neural systemfor face perception. Trends Cogn. Sci. 4, 223-233.
34. Haxby, J.V., Ungerleider, L.G., Clark, V.P., Schouten, J.L., Hoffman, E.A., Martin, A., 1999. The effect of face inversion on activity in human neural systems for face and object perception. Neuron 22, 189-199. (Pubitemid 29070105)
35. Heisz, J.J., Watter, S., Shedden, J.M., 2006. Automatic face identity encoding at the N170. Vis. Res. 46, 4604-4614.
36. Hillyard, S.A., Picton, T.W., 1987. Electrophysiology of cognition. Handbook of physiology: The nervous system. Oxford University Press, New York, pp. 519-584.
37. Hughes, S.M., Nicholson, S.E., 2010. The processing of auditory and visual recognition of self-stimuli. Consciousness and Cognition 19, 1124-1134.
38. Joassin, F., Maurage, P., Bruyer, R., Crommelinck, M., Campanella, S., 2004. When audition alters vision: an event-related potential study of cross-modal interactions between faces and voices. Neurosci. Lett. 369, 132-137.
39. Kanwisher, N., Mcdermott, J., Chun, M.M., 1997. The fusiform face area: a module in human extrastriate cortex specialized for face perception. J. Neurosci. 17, 4302-4311. (Pubitemid 27220621)
40. Kreifelts, B., Ethofer, T., Grodd, W., Erb, M., Wildgruber, D., 2007. Audiovisual integration of emotional signals in voice and face: an event-related fMRI study. Neuroimage 37, 1445-1456. (Pubitemid 47385290)
41. Kutas, M., Mccarthy, G., Donchin, E., 1977. Augmenting mental chronometry: the P300 as a measure of stimulus evaluation time. Science 197, 792-795. (Pubitemid 8153410)
42. Lage-Castellanos, A., Martínez-Montes, E., Hernández- Cabrera, J.A., Galán, L., 2010. False discovery rate and permutation test: an evaluation in ERP data analysis Stat. Med. 29 (1), 63-74.
43. Ledoux, J.E., 1995. In search of an emotional system in the brain: leaping from fear to emotion consciousness. In: Gazzaniga, M. (Ed.), The Cognitive Neuroscience. MIT Press, Cambridge, MA, pp. 1049-1062.
44. Levy, D.A., Granot, R., Bentin, S., 2001. Processing specificity for human voice stimuli: electrophysiological evidence Neuroreport 12, 2653-2657.
45. Levy, D.A., Granot, R., Bentin, S., 2003. Neural sensitivity to human voices: ERP evidence of task and attentional influences. Psychophysiology 40 (3), 291-305. (Pubitemid 36336852)
46. Mazziota, J.C., Toga, A., Evans, A.C., Fox, P., Lancaster, J., 1995. A probabilistic atlas of the human brain: theory and rationale for its development. Neuroimage 2, 89-101.
47. McGurk, H., MacDonald, J., 1976. Hearing lips and seeing voices. Nature 264, 746-748.
48. Minnebuscha, D.A., Suchana, B., Köster, O., Dauma, I., 2009. A bilateral occipitotemporal network mediates face perception. Behav. Brain Res. 198, 179-185.
49. Molholm, S., Ritter, W., Murray, M.M., Javitt, D.C., Schroeder, C.H.E., Foxe, J.J., 2002. Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Cogn. Brain Res. 14, 115-128.
50. Munhall, K.G., ten Hove, M.W., Brammer, M., 2009. Audiovisual integration of speech in a bistable illusion. Curr. Biol. 19, 735-739.
51. Neumann, M.F., Schweinberger, S.R., 2009. N250r ERP repetition effects fromdistractor faceswhen attending to another face under load: evidence for a face attention resource. Brain Res. 1270, 64-77.
52. Nichols, T., Holmes, A., 2001. Nonparametric permutation tests for functional neuroimaging: a primer with examples. Hum. Brain Mapp. 15 (1), 1-25.
53. Paller, K.A., Gonsalves, B., Grabowecky, M., Bozic, V.S., Yamada, S., 2000. Electrophysiological correlates of recollecting faces of known and unknown individuals. Neuroimage 11, 98-110. (Pubitemid 30141448)
54. Paller, K.A., Voss, J.L., Boehm, S.G., 2007. Validating neural correlates of familiarity. Trends Cogn. Sci. 11 (6), 243-250.
55. Pessoa, L., 2005. To what extent are emotional visual stimuli processed without attention and awareness? Curr. Opin. Neurobiol. 15 (2), 188-196.
56. Phelps, E.A., 2006. Emotion and cognition: insights from studies of the human amygdale. Annu. Rev. Psychol. 57, 27-53.
57. Picton, T.W., 1992. The P300 wave of the human event-related potential. J. Clin. Neurophysiol. 9, 456-479.
58. Polich, J., Alexander, J.E., Bauer, L.O., Kuperman, S., Morzorati, S., O'connor, S.J., Porjesz, Rohrbaugh, J., Begleiter, H., 1997. P300 topography of amplitude/latency correlations. Brain Topogr. 9, 275-282. (Pubitemid 27331986)
59. Polich, J., 2007. Updating P300: an integrative theory of P3a and P3b. Clin. Neurophysiol. 118, 2128-2148.
60. Pourtois, G., de Gelder, B., Bol, A., Crommelinck, M., 2005. Perception of facial expressions and voices and of their combination in the human brain. Cortex 41, 49-59. (Pubitemid 39600225)
61. Regan, D., Spekreijse, H., 1986. Evoke potential in vision research. Vis. Res. 26, 1461-1480.
62. Renault, B., Signoret, J., Debruille, B., Breton, F., Bolgert, F., 1989. Brain potentials reveal covert facial recognition in prosopagnosia. Neuropsychologia 27, 905-912. (Pubitemid 19206921)
63. Robertson, D.M., Schweinberger, S.R., 2010. The role of audiovisual asynchrony in person recognition. Q. J. Exp. Psychol. 63 (1), 23-30.
64. Rossion, B., Campanella, S., Gomez, C.M., Delinte, A., Debatisse, D., Liard, L., Dubois, S., Bruyer, R., Crommelinck, M., Guerit, J.M., 1999. Task modulation of brain activity related to familiar and unfamiliar face processing: an ERP study. Clin. Neurophysiol. 110 (3), 449-462.
65. Rossion, B., Gauthier, I., Tarr, M.J., Despland, P., Bruyer, R., Linotte, S., Crommelinck, M., 2000. The N170 occipito-temporal component is delayed and enhanced to inverted faces but not to inverted objects: an electrophysiological account of face-specific processes in the human brain. Neuroreport 11, 69-74. (Pubitemid 30053392)
66. Rossion, B., Schiltz, C., Crommelinck, M., 2003. The functionally defined right occipital and fusiform "face areas" discriminate novel from visually familiar faces. Neuroimage 19, 877-883.
67. Sagiv, N., Bentin, S., 2001. Structural encoding of human and schematic faces: holistic and part-based processes. J. Cogn. Neurosci. 13, 937-951.
68. Sams, M., Aulanko, R., Hämalainen, M., Hari, R., Lounasmaa, O.V., Lu, S.T., et al., 1991. Seeing speech: visual information from lip movements modifies activity in the human auditory cortex. Neurosci. Lett. 127, 141-145.
69. Schweinberger, S.R., Pfutze, E.-M., Sommer, W., 1995. Repetition priming and associative priming of face recognition: evidence from event-related potentials. J. Exp. Psychol. Learn. Mem. Cogn. 21, 722-736.
70. Schweinberger, S.R., Pickering, E.C., Jentzsch, I., Burton, M., Kaufmann, J.M., 2002. Event-related brain potential evidence for a response of inferior temporal cortex of familiar face repetitions. Cogn. Brain Res. 14, 398-409.
71. Schweinberger, S.R., Huddy, V., Burton, M., 2004. N250r: a face-selective brain responses to stimulus repetitions Neuroreport 5 (9), 1501-1505.
72. Schweinberger, S.R., Robertson, D., Kaufmann, J.M., 2007. Hearing facial identities. Q. J. Exp. Psychol. 60 (10), 1446-1456.
73. Stevenson, R.A., James, T.W., 2009. Audiovisual integration in human superior temporal sulcus: inverse effectiveness and the neural processing of speech and object recognition Neuroimage 44, 1210-1223.
74. Swets, J.A., 1964. Signal Detection and Recognition by Human Observers. Wiley, New York.
75. Teder-Sälejärvi, W.A., McDonald, J.J., Di Ruso, F., Hylliard, S.A., 2002. An analysis of audio-visual integration by means of event-related potential (ERP) recordings. Cogn. Brain Res. 14, 106-114.
76. Van Wassenhove, V., Grant, K.W., Poeppel, D., 2005. Visual speech speeds up the neural processing of auditory speech. Proc. Natl. Acad. Sci. 102, 1181-1186.
77. Verleger, R., 1997. On the utility of P3 latency as an index of mental chronometry. Psychophysiology 34, 131-156. (Pubitemid 27143347)
78. von Kriegstein, K., Giraud, A.L., 2006. Implicit multisensory associations influence voice recognition. PLoS Biol. 4 (10), 1809-1820.
79. von Kriegstein, K., Kleinschmidt, A., Giraud, A.L., 2005a. Voice recognition and cross-modal responses to familiar speakers' voices in prosopagnosia. Cereb. Cortex 16, 1314-1322. (Pubitemid 44289104)
80. von Kriegstein, K., Kleinschmidt, A., Sterzer, P., Giraud, A.L., 2005b. Interaction of face and voice during speaker recognition. J. Cogn. Neurosci. 17, 367-376.
81. von Kriegstein, K., Smith, D.R.R., Patterson, R.D., Kiebel, S.J., Griffiths, T.D., 2010. How the human brain recognizes speech in the context of changing speakers. J. Neurosci. 30 (2), 629-638.