The integration processing of the visual and auditory information in videos of real-world events: An ERP study

Neuroscience Letters

Volumn 461, Issue 1, 2009, Pages 7-11

  Liu, Baolin ^a   Wang, Zhongning ^a   Jin, Zhixing ^a  

^a TSINGHUA UNIVERSITY   (China)

Author keywords

Auditory; Event related potential; P400; Video; Visual

Indexed keywords

ADULT; ARTICLE; AUDITORY DISCRIMINATION; AUDITORY STIMULATION; BRAIN FUNCTION; COGNITION; CONTROLLED STUDY; ELECTROENCEPHALOGRAM; EVENT RELATED POTENTIAL; FEMALE; HUMAN; HUMAN EXPERIMENT; MALE; NORMAL HUMAN; PRIORITY JOURNAL; VIDEORECORDING; VISUAL DISCRIMINATION; VISUAL STIMULATION; WAVEFORM;

ACOUSTIC STIMULATION; AUDITORY PERCEPTION; COGNITION; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FEMALE; HUMANS; MALE; PHOTIC STIMULATION; VIDEO RECORDING; VISUAL PERCEPTION; YOUNG ADULT;

EID: 67649313163     PISSN: 03043940     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neulet.2009.05.082     Document Type: Article

References (25)

1. Besson M., and Macar F. An event-related potential analysis of incongruity in music and other non-linguistic contexts. Psychophysiology 24 1 (1987) 14-25
2. Brown C.R., Clarke A.R., and Barry R.J. Auditory processing in an inter-modal oddball task: effects of a combined auditory/visual standard on auditory target ERPs. Int. J. Psychophysiol. 65 2 (2007) 122-131
3. Giard M.H., and Peronnet F. Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study. J. Cogn. Neurosci. 11 (1999) 473-490
4. Gunter T.C., and Bach P. Communicating hands: ERPs elicited by meaningful symbolic hand postures. Neurosci. Lett. 372 (2004) 52-56
5. Hagoort P., and Brown C.M. ERP effects of listening to speech: semantic ERP effects. Neuropsychology 38 (2000) 1518-1530
6. Hagoort P., Hald L., Bastiaansen M., and Petersson K.M. Integration of word meaning and world knowledge in language comprehension. Science 304 (2004) 438-441
7. Hamm J.P., Johnson B.W., and Kirk I.J. Comparison of the N300 and N400 ERPs to picture stimuli in congruent and incongruent contexts. Clin. Neurophysiol. 113 (2002) 1339-1350
8. Kim A., and Osterhout L. The independence of combinatory semantic processing: evidence from event-related potentials. J. Mem. Lang. 52 (2005) 205-225
9. Kuperberg G.R. Neural mechanisms of language comprehension: challenges to syntax. Brain Res. 1146 (2007) 23-49
10. Kutas M., and Hillyard S.A. Reading senseless sentences: brain potentials reflect semantic incongruity. Science 207 (1980) 203-205
11. Kutas M., and Hillyard S.A. Brain potentials during reading reflect word expectancy and semantic association. Nature 307 (1984) 161-163
12. Li T. Handedness questionnaire (Chinese version). Acta Psychol. 15 (1983) 268-276
13. McPherson W.B., and Holcomb P.J. An electrophysiological investigation of semantic priming with pictures of real objects. Psychophysiology 36 (1999) 53-65
14. Molholm S., Ritter W., Murray M.M., Javitt D.C., Schroeder C.E., and Foxe J.J. Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Cogn. Brain Res. 14 (2002) 115-128
15. Osterhout L., and Holcomb P.J. Event-related brain potentials elicited by syntactic anomaly. J. Mem. Lang. 31 (1992) 785-806
16. Puce A., Epling J.A., Thompson J.C., and Carrick O.K. Neural responses elicited to face motion and vocalization pairings. Neuropsychology 45 (2007) 93-106
17. Reid V.M., and Striano T. N400 involvement in the processing of action sequences. Neurosci. Lett. 433 (2008) 93-97
18. Reinke K.S., He Y., Wang C., and Alain C. Perceptual learning modulates sensory evoked response during vowel segregation. Cogn. Brain Res. 17 (2003) 781-791
19. Sams M., Paavilainen P., Alho K., and Näätänen R. Auditory frequency discrimination and event-related potentials. Electroencephalogr. Clin. Neurophysiol. 62 6 (1985) 437-448
20. Shahin A., Roberts L.E., Pantev C., Trainorb L.J., and Ross B. Modulation of P2 auditory-evoked responses by the spectral complexity of musical sounds. Neuroreport 16 (2005) 1781-1785
21. Shibata H., Gyoba J., and Suzuki Y. Event-related potentials during the evaluation of the appropriateness of cooperative actions. Neurosci. Lett. 452 2 (2009) 189-193
22. Sitnikova T., Kuperberg G.R., and Holcomb P.J. Semantic integration in videos of real-world events: an electrophysiological investigation. Psychophysiol. Res. 40 (2003) 160-164
23. Tremblay K.L., and Kraus N. Auditory training induces asymmetrical changes in cortical neural activity. J. Speech Lang. Hear. Res. 45 (2002) 564-572
24. Vogel E.K., and Luck S.J. The visual N1 component as an index of a discrimination process. Psychophysiology 37 (2000) 190-203
25. Wu Y., and Coulson S. Meaningful gestures: electrophysiological indices of iconic gesture comprehension. Psychophysiology 42 6 (2005) 654-667