Neural responses elicited to face motion and vocalization pairings

Neuropsychologia

Volumn 45, Issue 1, 2007, Pages 93-106

  Puce, Aina ^a,b   Epling, James A ^a   Thompson, James C ^a,b   Carrick, Olivia K ^a  

^a WEST VIRGINIA UNIVERSITY   (United States)

^b WEST VIRGINIA UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

Biological motion; Cross modal integration; Faces; Mismatch; Multisensory; Temporal cortex

Indexed keywords

ADULT; AMPLITUDE MODULATION; ARTICLE; AUDIOVISUAL EQUIPMENT; AUDITORY STIMULATION; EVENT RELATED POTENTIAL; FACE; FACIAL EXPRESSION; FEMALE; HUMAN; HUMAN EXPERIMENT; LATENT PERIOD; MALE; NERVE POTENTIAL; NORMAL HUMAN; SOUND DETECTION; SPECIES DIFFERENCE; VISUAL INFORMATION; VISUAL STIMULATION; VOCALIZATION;

ACOUSTIC STIMULATION; ADULT; ANIMALS; AREA UNDER CURVE; BRAIN; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FACE; FEMALE; HAPLORHINI; HUMANS; MALE; MIDDLE AGED; MOTION PERCEPTION; PHOTIC STIMULATION; SOCIAL PERCEPTION; SPEECH PERCEPTION; TEMPORAL LOBE; VOCALIZATION, ANIMAL;

EID: 33751404897     PISSN: 00283932     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuropsychologia.2006.04.017     Document Type: Article

References (54)

1. Allison T., Ginter H., McCarthy G., Nobre A.C., Puce A., Luby M., et al. Face recognition in human extrastriate cortex. Journal of Neurophysiology 71 2 (1994) 821-825
2. Bach M., and Ullrich D. Motion adaptation governs the shape of motion-evoked cortical potentials. Vision Research 34 12 (1994) 1541-1547
3. Beauchamp M.S., Argall B.D., Bodurka J., Duyn J.H., and Martin A. Unraveling multisensory integration: Patchy organization within human STS multisensory cortex. Nature Neuroscience 7 11 (2004) 1190-1192
4. Beauchamp M.S., Lee K.E., Argall B.D., and Martin A. Integration of auditory and visual information about objects in superior temporal sulcus. Neuron 41 5 (2004) 809-823
5. Beauchamp M.S., Lee K.E., Haxby J.V., and Martin A. Parallel visual motion processing streams for manipulable objects and human movements. Neuron 34 1 (2002) 149-159
6. Belin P., Zatorre R.J., and Ahad P. Human temporal-lobe response to vocal sounds. Brain Research. Cognitive Brain Research 13 1 (2002) 17-26
7. Belin P., Zatorre R.J., Lafaille P., Ahad P., and Pike B. Voice-selective areas in human auditory cortex. Nature 403 6767 (2000) 309-312
8. Bentin S., Allison T., Puce A., Perez A., and McCarthy G. Electrophysiological studies of face perception in humans. Journal of Cognitive Neuroscience 8 (1996) 551-565
9. Besson M., and Macar F. An event-related potential analysis of incongruity in music and other non-linguistic contexts. Psychophysiology 24 1 (1987) 14-25
10. Binder J.R., Frost J.A., Hammeke T.A., Bellgowan P.S., Springer J.A., Kaufman J.N., et al. Human temporal lobe activation by speech and nonspeech sounds. Cerebral Cortex 10 5 (2000) 512-528
11. Bonda E., Petrides M., Ostry D., and Evans A. Specific involvement of human parietal systems and the amygdala in the perception of biological motion. Journal of Neuroscience 16 11 (1996) 3737-3744
12. Bushara K.O., Hanakawa T., Immisch I., Toma K., Kansaku K., and Hallett M. Neural correlates of cross-modal binding. Nature Neuroscience 6 2 (2003) 190-195
13. Calvert G.A., Campbell R., and Brammer M.J. Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Current Biology 10 11 (2000) 649-657
14. Carmel D., and Bentin S. Domain specificity versus expertise: Factors influencing distinct processing of faces. Cognition 83 1 (2002) 1-29
15. Chao L.L., Haxby J.V., and Martin A. Attribute-based neural substrates in temporal cortex for perceiving and knowing about objects. Nature Neuroscience 2 10 (1999) 913-919
16. Chao L.L., and Martin A. Representation of manipulable man-made objects in the dorsal stream. Neuroimage 12 4 (2000) 478-484
17. Darwin C. The expression of the emotions in man and animals. 3rd ed. (1899/1998), Oxford University Press, Oxford
18. Eggermont J.J., and Ponton C.W. The neurophysiology of auditory perception: From single units to evoked potentials. Audiology and Neurootology 7 2 (2002) 71-99
19. Eimer M., and McCarthy R.A. Prosopagnosia and structural encoding of faces: Evidence from event-related potentials. Neuroreport 10 2 (1999) 255-259
20. Fang F., and He S. Cortical responses to invisible objects in the human dorsal and ventral pathways. Nature Neuroscience 8 10 (2005) 1380-1385
21. Fecteau S., Armony J.L., Joanette Y., and Belin P. Is voice processing species-specific in human auditory cortex? An fMRI study. Neuroimage 23 3 (2004) 840-848
22. Ghazanfar A.A., Maier J.X., Hoffman K.L., and Logothetis N.K. Multisensory integration of dynamic faces and voices in rhesus monkey auditory cortex. Journal of Neuroscience 25 20 (2005) 5004-5012
23. Giard M.H., and Peronnet F. Auditory-visual integration during multimodal object recognition in humans: A behavioral and electrophysiological study. Journal of Cognitive Neuroscience 11 5 (1999) 473-490
24. Giard M.H., Perrin F., Echallier J.F., Thevenet M., Froment J.C., and Pernier J. Dissociation of temporal and frontal components in the human auditory N1 wave: A scalp current density and dipole model analysis. Electroencephalography Clinical Neurophysiology 92 3 (1994) 238-252
25. Gil-da-Costa R., Braun A., Lopes M., Hauser M.D., Carson R.E., Herscovitch P., et al. Toward an evolutionary perspective on conceptual representation: Species-specific calls activate visual and affective processing systems in the macaque. Proceedings of the National Academy of Sciences of the United States of America 101 50 (2004) 17516-17521
26. Godey B., Schwartz D., de Graaf J.B., Chauvel P., and Liegeois-Chauvel C. Neuromagnetic source localization of auditory evoked fields and intracerebral evoked potentials: A comparison of data in the same patients. Clinical Neurophysiology 112 10 (2001) 1850-1859
27. Grossman E., Donnelly M., Price R., Pickens D., Morgan V., Neighbor G., et al. Brain areas involved in perception of biological motion. Journal of Cognitive Neuroscience 12 5 (2000) 711-720
28. Jemel B., George N., Olivares E., Fiori N., and Renault B. Event-related potentials to structural familiar face incongruity processing. Psychophysiology 36 4 (1999) 437-452
29. Kubova Z., Kuba M., Spekreijse H., and Blakemore C. Contrast dependence of motion-onset and pattern-reversal evoked potentials. Vision Research 35 2 (1995) 197-205
30. Kutas M., and Hillyard S.A. Reading senseless sentences: Brain potentials reflect semantic incongruity. Science 207 4427 (1980) 203-205
31. Lewis J.W., Brefczynski J.A., Phinney R.E., Janik J.J., and DeYoe E.A. Distinct cortical pathways for processing tool versus animal sounds. Journal of Neuroscience 25 21 (2005) 5148-5158
32. McCallum W.C., Farmer S.F., and Pocock P.V. The effects of physical and semantic incongruities on auditory event-related potentials. Electroencephalography Clinical Neurophysiology 59 6 (1984) 477-488
33. Merlo S., and Mansur L.L. Descriptive discourse: Topic familiarity and disfluencies. Journal of Communication Disorders 37 6 (2004) 489-503
34. Nunez P.L. A method to estimate local skull resistance in living subjects. IEEE Transaction on Biomedical Engineering 34 11 (1987) 902-904
35. Nunez P.L., Silberstein R.B., Cadusch P.J., Wijesinghe R.S., Westdorp A.F., and Srinivasan R. A theoretical and experimental study of high resolution EEG based on surface Laplacians and cortical imaging. Electroencephalography Clinical Neurophysiology 90 1 (1994) 40-57
36. Olson I.R., Gatenby J.C., and Gore J.C. A comparison of bound and unbound audio-visual information processing in the human cerebral cortex. Brain Research Cognitive Brain Research 14 1 (2002) 129-138
37. Partan S., and Marler P. Communication goes multimodal. Science 283 5406 (1999) 1272-1273
38. Pelphrey K.A., Mitchell T.V., McKeown M.J., Goldstein J., Allison T., and McCarthy G. Brain activity evoked by the perception of human walking: Controlling for meaningful coherent motion. Journal of Neuroscience 23 17 (2003) 6819-6825
39. Perrin F., Pernier J., Bertrand O., and Echallier J.F. Spherical splines for scalp potential and current density mapping. Electroencephalography Clinical Neurophysiology 72 2 (1989) 184-187
40. Puce A., Allison T., Bentin S., Gore J.C., and McCarthy G. Temporal cortex activation in humans viewing eye and mouth movements. Journal of Neuroscience 18 6 (1998) 2188-2199
41. Puce A., and Perrett D. Electrophysiology and brain imaging of biological motion. Philosophical Transactions of the Royal Society of London. Series B: Biological Science 358 1431 (2003) 435-445
42. Puce A., Smith A., and Allison T. ERPs evoked by viewing facial movements. Coginitive Neuropsychology 17 (2000) 221-239
43. Puce A., Syngeniotis A., Thompson J.C., Abbott D.F., Wheaton K.J., and Castiello U. The human temporal lobe integrates facial form and motion: Evidence from fMRI and ERP studies. Neuroimage 19 3 (2003) 861-869
44. Riede T., Herzel H., Hammerschmidt K., Brunnberg L., and Tembrock G. The harmonic-to-noise ratio applied to dog barks. The Journal of the Acoustical Society of America 110 4 (2001) 2191-2197
45. Sams M., Aulanko R., Hamalainen M., Hari R., Lounasmaa O.V., Lu S.T., et al. Seeing speech: Visual information from lip movements modifies activity in the human auditory cortex. Neuroscience Letters 127 1 (1991) 141-145
46. Sams M., Paavilainen P., Alho K., and Naatanen R. Auditory frequency discrimination and event-related potentials. Electroencephalography Clinical Neurophysiology 62 6 (1985) 437-448
47. Schroeder C.E., and Foxe J.J. The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex. Brain Research Cognitive Brain Research 14 1 (2002) 187-198
48. Scott S.K., Blank C.C., Rosen S., and Wise R.J. Identification of a pathway for intelligible speech in the left temporal lobe. Brain 123 Pt 12 (2000) 2400-2406
49. Shettleworth S.J. Animal cognition and animal behaviour. Animal Behaviour 61 (2001) 277-286
50. Spens K.-E. Evaluation of speech tracking results: Some numerical considerations and examples. In: Plant G., and Spens K.-E. (Eds). Profound deafness and speech communication (1995), Singular Pub. Group, San Diego, California 417-437
51. Tomasello M., and Call J. Primate cognition (1997), Oxford University Press, New York
52. Walker V.G., Roberts P.M., and Hedrick D.L. Linguistic analyses of the discourse narratives of young and aged women. Folia Phoniatrica (Basel) 40 2 (1988) 58-64
53. Wheaton K.J., Pipingas A., Silberstein R.B., and Puce A. Human neural responses elicited to observing the actions of others. Visual Neuroscience 18 3 (2001) 401-406
54. Woods D.L., and Elmasian R. The habituation of event-related potentials to speech sounds and tones. Electroencephalography Clinical Neurophysiology 65 6 (1986) 447-459