Cognitive integration of asynchronous natural or non-natural auditory and visual information in videos of real-world events: An event-related potential study

Neuroscience

Volumn 180, Issue , 2011, Pages 181-190

  Liu, B ^a   Wang, Z ^a   Wu, G ^a   Meng, X ^a  

^a TSINGHUA UNIVERSITY   (China)

Author keywords

N400 LPN; N400 P600; Sound; Speech; Video

Indexed keywords

ADULT; ARTICLE; AUDITORY MEMORY; AUDITORY STIMULATION; BRAIN FUNCTION; COGNITION; CONTROLLED STUDY; EVENT RELATED POTENTIAL; FEMALE; HUMAN; HUMAN EXPERIMENT; MALE; MEMORY CONSOLIDATION; NORMAL HUMAN; PRIORITY JOURNAL; RECOGNITION; SEMANTICS; SENSORIMOTOR INTEGRATION; SOUND; SPEECH; VIDEORECORDING; VISUAL MEMORY; VISUAL STIMULATION;

ACOUSTIC STIMULATION; ADULT; AUDITORY PERCEPTION; BRAIN; BRAIN MAPPING; COGNITION; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FEMALE; HUMANS; MALE; PHOTIC STIMULATION; VIDEO RECORDING; VISUAL PERCEPTION;

EID: 79953211483     PISSN: 03064522     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuroscience.2011.01.066     Document Type: Article

References (29)

1. Brown C.R., Clarke A.R., Barry R.J. Auditory processing in an inter-modal oddball task: effects of a combined auditory/visual standard on auditory target ERPs. Int J Psychophysiol 2007, 65:122-131.
2. Coch D., Skendzel W., Neville H.J. Auditory and visual refractory period effects in children and adults: an ERP study. Clin Neurophysiol 2005, 116:2184-2203.
3. Cummings A., Ceponiene R., Dick F., Saygin A.P., Townsend J. A developmental ERP study of verbal and non-verbal semantic processing. Brain Res 2008, 1208:137-149.
4. Guthrie D., Buchwald J.S. Significance testing of difference potentials. Psychophysiology 1991, 28:240-244.
5. Johansson M., Mecklinger A. The late posterior negativity in ERP studies of episodic memory: action monitoring and retrieval of attribute conjunctions. Biol Psychol 2003, 64:91-117.
6. Leynes P.A., Grey J.A., Crawford J.T. Event-related potential (ERP) evidence for sensory-based action memories. Int J Psychophysiol 2006, 62:193-202.
7. Liu B., Jin Z., Li W., Li Y., Wang Z. The pragmatic meanings conveyed by function words in Chinese sentences: an ERP study. J Neurolinguistics 2009, 22:548-562.
8. Liu B., Jin Z., Qing Z., Wang Z. The processing of phonological, orthographical, and lexical information of Chinese characters in sentence contexts: an ERP study. Brain Res 2011, 1372:81-91.
9. Liu B., Jin Z., Wang Z., Gong C. The influence of temporal asynchrony on multisensory integration in the processing of asynchronous audio-visual stimuli of real-world events: an event-related potential study. Neuroscience 2011, 176:254-264.
10. Liu B., Jin Z., Wang Z., Hu Y. The interaction between pictures and words: evidence from positivity offset and negativity bias. Exp Brain Res 2010, 201:141-153.
11. Liu B., Jin Z., Wang Z., Wu G. Chinese function words grammaticalized from content words: evidence from ERPs. J Neurolinguistics 2010, 23:663-675.
12. Liu B., Wang Z., Jin Z. The integration processing of the visual and auditory information in videos of real-world events: an ERP study. Neurosci Lett 2009, 461:7-11.
13. Liu B., Wang Z., Jin Z. The effects of punctuations in Chinese sentence comprehension: an ERP study. J Neurolinguistics 2010, 23:66-80.
14. Liu B., Wang Z., Jin Z., Song G. The influence on cognitive processing from the switches of shooting angles in videos of real-world events: an ERP study. Neurosci Lett 2010, 469:370-374.
15. Liu B., Wang Z., Song G., Wu G. Cognitive processing of traffic signs in immersive virtual reality environment: an ERP study. Neurosci Lett 2010, 485:43-48.
16. Liu B., Xin S., Jin Z., Hu Y., Li Y. Emotional facilitation effect in the picture-word interference task: an ERP study. Brain Cogn 2010, 72:289-299.
17. Molholm S., Rittwe W., Murray M.M., Javitt D.C., Schroeder C.E., Foxe J.J. Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Brain Res 2002, 14:115-128.
18. Niu Y., Wei J., Luo Y. Early ERP effects on the scaling of spatial attention in visual search. Prog Nat Sci 2008, 18:381-386.
19. Oldfield R.C. The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychololgia 1971, 9:97-113.
20. Plante E., Van Petten C., Senkfor A.J. Electrophysiological dissociation between verbal and nonverbal semantic processing in learning disabled adults. Neuropsychologia 2000, 38:1669-1684.
21. Puce A., Epling J.A., Thompson J.C., Carrick O.K. Neural responses elicited to face motion and vocalization pairings. Neuropsychology 2007, 45:93-106.
22. Reid V.M., Striano T. N400 involvement in the processing of action sequences. Neurosci Lett 2008, 433:93-97.
23. Senkowski D., Saint-Amour D., Kelly S.P., Foxe J.J. Multisensory processing of naturalistic objects in motion: a high-density electrical mapping and source estimation study. Neuroimage 2007, 36:877-888.
24. Sitnikova T., Holcomb P.J., Kiyonaga K.A., Kuperberg G.R. Two neurocognitive mechanisms of semantic integration during the comprehension of visual real-world events. J Cogn Neurosci 2008, 20:1-21.
25. Sitnikova T., Kuperberg G.R., Holcomb P.J. Semantic integration in videos of real-world events: an electrophysiological investigation. Psychophysiol Res 2003, 40:160-164.
26. Song W., Li X., Luo Y., Du B.Q., Ji X.M. Brain dynamic mechanisms of scale effect: in visual spatial attention. Neuroreport 2006, 15:1643-1647.
27. Van Petten C., Rheinfelder H. Conceptual relationships between spoken words and environmental sounds: event-related brain potential measures. Neuropsychologia 1995, 33:485-508.
28. Vogel E.K., Luck S.J. The visual N1 component as an index of a discrimination process. Psychophysiology 2000, 37:190-203.
29. Wu Y., Coulson S. Meaningful gestures: electrophysiological indices of iconic gesture comprehension. Psychophysiology 2005, 42:654-667.