ERP correlates of spatially incongruent object identification during scene viewing: Contextual expectancy versus simultaneous processing

Neuropsychologia

Volumn 50, Issue 7, 2012, Pages 1271-1285

  Demiral, Şükrü Bariş ^a   Malcolm, George L ^b   Henderson, John M ^c  

^a WASHINGTON UNIVERSITY SCHOOL OF MEDICINE   (United States)

^b UNIVERSITY OF GLASGOW   (United Kingdom)

^c UNIVERSITY OF SOUTH CAROLINA   (United States)

Author keywords

N300; N400; Scene object identification; Spatial congruency

Indexed keywords

ADULT; ARTICLE; BRAIN FUNCTION; COGNITION; DEPTH PERCEPTION; EVENT RELATED POTENTIAL; EXPECTANCY; FEMALE; HUMAN; HUMAN EXPERIMENT; LEFT HEMISPHERE; LOW RESOLUTION BRAIN ELECTROMAGNETIC TOMOGRAPHY; MALE; MIDDLE TEMPORAL GYRUS; NORMAL HUMAN; RIGHT HEMISPHERE; SENSORY SYSTEM PARAMETERS; SPATIAL CONGRUENCY; STIMULUS RESPONSE; SUPERIOR TEMPORAL GYRUS; VISUAL STIMULATION;

ADOLESCENT; ADULT; ANALYSIS OF VARIANCE; BRAIN; BRAIN MAPPING; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS, VISUAL; FEMALE; FUNCTIONAL LATERALITY; HUMANS; MALE; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; REACTION TIME; TIME FACTORS; YOUNG ADULT;

EID: 84861223280     PISSN: 00283932     EISSN: 18733514     Source Type: Journal    
DOI: 10.1016/j.neuropsychologia.2012.02.011     Document Type: Article

References (78)

1. Allen M., Badecker W., Osterhout L. Morphological analysis in sentence processing: An ERP study. Language and Cognitive Processes 2003, 18:405-430.
2. Anllo-Vento L., Luck S.J., Hillyard S.A. Spatio-temporal dynamics of attention to color: Evidence from human electrophysiology. Human Brain Mapping 1998, 6:216-238.
3. Baayen R.H., Davidson D.J., Bates D.M. Mixed-effects modeling with crossed random effects for subjects and items. Journal of Memory and Language 2008, 59(4):390-412.
4. Bach P., Knoblich G., Gunter T.C., Friederici A.D., Prinz W. Action comprehension: Deriving spatial and functional relations. Journal of Experimental Psychology. Human Perception and Performance 2005, 31(3):465-479. pii: 2005-06735-006. 10.1037/0096-1523.31.3.465.
5. Bar M. Visual objects in context. Nature Reviews Neuroscience 2004, 5(8):617-629. 10.1038/nrn1476.
6. Bar M., Ullman S. Spatial context in recognition. Perception 1996, 25:343-352.
7. Barrett S.E., Rugg M.D. Event-related potentials and the semantic matching of pictures. Brain and Cognition 1990, 14(2):201-212.
8. Biederman I., Mezzanotte R.J., Rabinowitz J.C. Scene perception: Detecting and judging objects undergoing relational violations. Cognitive Psychology 1982, 14:143-177.
9. Brown C., Hagoort P. The processing nature of the N400: Evidence from masked priming. Journal of Cognitive Neuroscience 1993, 5:34-44.
10. Castelhano M.S., Heaven C. The relative contribution of scene context and target features to visual search in real-world scenes. Attention, Perception, & Psychophysics 2011, 72(5):1283-1297.
11. Castelhano M.S., Henderson J.M. The influence of color on the perception of scene gist. Journal of Experimental Psychology. Human Perception and Performance 2008, 34(3):660-675.
12. Clark V.P., Fan S., Hillyard S.A. Identification of early visual evoked potential generators by retinotopic and topographic analyses. Human Brain Mapping 1994, 2(3):170-187.
13. Davenport J.L., Potter M.C. Scene consistency in object and background perception. Psychological Science 2004, 15:559-564.
14. Delorme A., Makeig S. EEGLAB: An open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. Journal of Neuroscience Methods 2004, 134(1):9-21.
15. Donchin E., Coles M.G.H. Is the P300 component a manifestation of context updating?. Behavioral and Brain Sciences 1988, 11:357-427.
16. Doninger G.M., Foxe J.J., Murray M.M., Higgins B.A., Snodgrass J.G., Schroeder C.E., et al. Activation timecourse of ventral visual stream object-recognition areas: High density electrical mapping of perceptual closure processes. Journal of Cognitive Neuroscience 2000, 12:615-621.
17. Ellison A., Schindler I., Pattison L.L., Milner A.D. An exploration of the role of the superior temporal gyrus in visual search and spatial perception using TMS. Brain 2004, 127(10):2307-2315. 10.1093/brain/awh244.
18. Federmeier K.D., Kutas M. A rose by any other name: Long-term memory structure and sentence processing. Journal of Memory and Language 1999, 41:469-495.
19. Federmeier K.D., Kutas M. Meaning and modality: Influences of context, semantic memory organization, and perceptual predictability on picture processing. Journal of Experimental Psychology Learning, Memory, and Cognition 2001, 27:202-224.
20. Federmeier K.D., Kutas M. Picture the difference: Electrophysiological investigations of picture processing in the two cerebral hemispheres. Neuropsychologia 2002, 40(7):730-747.
21. Friedman A. Framing pictures: The role of knowledge in automatized encoding and memory for gist. Journal of Experimental Psychology: General 1979, 108:316-355.
22. Friedman A., Liebelt L.S. On the time course of viewing pictures with a view towards remembering. Eye movements: Cognition and visual perception 1981, 137-155. Erlbaum, Hillsdale, NJ. D.F. Fischer, R. Monty, J.W. Senders (Eds.).
23. Ganis G., Kutas M. An electrophysiological study of scene effects on object identification. Cognitive Brain Research 2003, 16(2):123-144.
24. Ganis G., Kutas M., Sereno M.I. The search for common sense: An electrophysiological study of the comprehension of words and pictures in reading. Journal of Cognitive Neuroscience 1996, 8:89-106.
25. Gronau N., Neta M., Bar M. Integrated contextual representation for objects' identities and their locations. Journal of Cognitive Neuroscience 2008, 20(3):371-388. 10.1162/jocn.2008.20027.
26. Grossi G. Relatedness proportion effects on masked associative priming: An ERP study. Psychophysiology 2006, 43:21-30.
27. Hagoort P. The fractionation of spoken language understanding by measuring electrical and magnetic brain signals. Philosophical transactions of the Royal Society of London. Series B: Biological sciences 2008, 363:1055-1069.
28. Hamm J.P., Johnson B.W., Kirk I.J. Comparison of the N300 and N400 ERPs to picture stimuli in congruent and incongruent contexts. Clinical Neurophysiology 2002, 113(8):1339-1350.
29. Hauk O., Davis M.H., Ford M., Pulvermuller F., Marslen-Wilson W.D. The time course of visual word recognition as revealed by linear regression analysis of ERP data. Neuroimage 2006, 30:1383-1400.
30. Hauk O., Pulvermuller F. Effects of word length and frequency on the human event-related potential. Clinical Neurophysiology 1888, 115:1090-1103.
31. Hauk O., Pulvermuller F. Neurophysiological distinction of action words in the fronto-central cortex. Human Brain Mapping 2004, 21(3):191-201. 10.1002/hbm.10157.
32. Heinze H.J., Mangun G.R., Burchert W., Hinrichs H., Scholz M., Munte T.F., et al. Combined spatial and temporal imaging of brain activity during visual selective attention in humans. Nature 1994, 372:543-546.
33. Henderson J.M., Hollingworth A. High-level scene perception. Annual Review of Psychology 1999, 50:243-271.
34. Henderson J.M., Weeks P.A.J., Hollingworth A. The effects of semantic consistency on eye movements during complex scene viewing. Journal of Experimental Psychology: Human Perception and Performance 1999, 25(1):210-228.
35. Holcomb P.J. Semantic priming and stimulus degradation: Implications for the role of the N400 in language processing. Psychophysiology 1993, 30:47-61.
36. Holcomb P.J., McPherson W.B. Event-related brain potentials reflect semantic priming in an object decision task. Brain and Cognition 1994, 24(259-276).
37. Hollingworth A., Henderson J.M. Does consistent scene context facilitate object perception?. Journal of Experimental Psychology: General 1998, 127:398-415.
38. Hopf J.-M., Bader M., Meng M., Bayer J. Is human sentence parsing serial or parallel? Evidence from event-related brain potentials. Brain Research. Cognitive Brain Research 2003, 15(2):165-177.
39. Hopf J.-M., Bayer J., Bader M., Meng M. Event-related potentials and case information in syntactic ambiguities. Journal of Cognitive Neuroscience 1998, 10(2):264-280.
40. Huynh H., Feldt L. Estimation of the box correction for degrees of freedom from sample data in randomized block and split-plot designs. Journal of Educational and Behavioral Statistics 1976, 1(1):69-82.
41. Joubert O.R., Rousselet G.A., Fize D., Fabre-Thorpe M. Processing scene context: Fast categorization and object interference. Vision Research 2007, 47(26):3286-3297. 10.1016/j.visres.2007.09.013.
42. Jung T.-P., Makeig S., Humphries C., Lee T.-W., McKeown M.J., Iragui V., et al. Removing electroencephalographic artifacts by blind source separation. Psychophysiology 2000, 37(2):163-178.
43. Karnath H.-O., Ferber S., Himmelbach M. Spatial awareness is a function of the temporal not the posterior parietal lobe. Nature 2001, 411(6840):950-953.
44. Kenemans J.L., Baas J.M.P., Mangun G.R., Lijffijt M., Verbaten M.N. On the processing of spatial frequencies as revealed by evoked-potential source modeling. Clinical Neurophysiology 2000, 111(6):1113-1123.
45. Kenemans J.L., Kok A., Smulders F.T.Y. Event-related potentials to conjunctions of spatial frequency and orientation as a function of stimulus parameters and response requirements. Electroencephalography and Clinical Neurophysiology 1993, 88:51-63.
46. Kiefer M. The N400 is modulated by unconsciously perceived masked words: Further evidence for an automatic spreading activation account of N400 priming effects. Cognitive Brain Research 2002, 13:27-39.
47. Kosslyn S.M. Image and brain 1996, MIT Press, Boston, MA.
48. Kuperberg G. Neural mechanisms of language comprehension: Challenges to syntax. Brain Research 2007, 1146:23-49.
49. Kutas M. In the company of other words: Electrophysiological evidence for single-word and sentence context effects. Language and Cognitive Processes 1993, 8:533-572.
50. Kutas M. Views on how the electrical activity that the brain generates reflects the functions of different language structures. Psychophysiology 1997, 34(4):383-398.
51. Kutas M., Federmeier K.D. Electrophysiology reveals semantic memory use in language comprehension. Trends in Cognitive Sciences 2000, 4:463-470.
52. Kutas M., Hillyard S.A. Reading senseless sentences: Brain potentials reflect semantic incongruity. Science 1980, 207:203-205.
53. Kutas M., Hillyard S.A. Brain potentials during reading reflect word expectancy and semantic association. Nature 1984, 307:161-163.
54. Lau E.F., Phillips C., Poeppel D. A cortical network for semantics: (De)constructing the N400. Nature Reviews Neuroscience 2008, 9(12):920-933.
55. Loftus G.R., Mackworth N.H. Cognitive determinants of fixation location during picture viewing. Journal of Experimental Psychology: Human Perception and Performance 1978, 4(565-572).
56. Makeig S., Jung T.-P., Bell A.J., Ghahremani D., Sejnowski T.J. Blind separation of auditory event-related brain responses into independent components. Proceedings of the National Academy of Sciences 1997, 94(20):10979-10984. 10.1073/pnas. 94. 20.10979.
57. Malcolm G.L., Henderson J.M. Combining top-down processes to guide eye movements during real-world scene search. Journal of Vision 2010, 10(2):1-11.
58. McPherson W.B., Holcomb P.J. An electrophysiological investigation of semantic priming with pictures of real objects. Psychophysiology 1999, 36(01):53-65.
59. Mudrik L., Lamy D., Deouell L.Y. ERP evidence for context congruity effects during simultaneous object-scene processing. Neuropsychologia 2010, 48(2):507-517.
60. Neville H.J., Synder E., Woods D., Galambos R. Recognition and surprise alter the human visual evoked response. Proceedings of the National Academy of Sciences of the United States of America 1982, 79(6):2121-2123.
61. Oliva A., Torralba A. Building the gist of a scene: The role of global image features in recognition. Progress in Brain Research 2006, 155(Part 2):23-36.
62. Osterhout L., Holcomb P.J. Event-related brain potentials elicited by syntactic anomaly. Journal of Memory and Language 1992, 31:785-806.
63. Osterhout L., Holcomb P.J. Event-related potentials and syntactic anomaly-Evidence of anomaly detection during the perception of continuous speech. Language and Cognitive Processes 1993, 8(4):413-437.
64. Palmer S.E. The effects of contextual scenes on the identification of objects. Memory & Cognition 1975, 3:519-526.
65. Palmer S.E. Hierarchical structure in perceptual representation. Cognitive Psychology 1977, 9(441-474).
66. Pascual-Marqui R.D., Mitchel C.M., Lehmann D. Low reolution electromgneti tomography: A new method for localizing electrical activity in the brain. International Journal of Psychophysiology 1994, 18:49-65.
67. Rugg M.D. The effects of semantic priming and word repetition on event-related potentials. Psychophysiology 1985, 22:642-647.
68. Schendan H.E., Kutas M. Neurophysiological evidence for two processing times for visual object identification. Neuropsychologia 2002, 40:931-945.
69. Sereno S.C., Rayner K., Posner M.I. Establishing a time-line of word recognition: Evidence from eye movements and event-related potentials. Neuroreport 1998, 9:2195-2200.
70. Sitnikova T., Holcomb P.J., Kiyonaga K.A., Kuperberg G.R. Two neurocognitive mechanisms of semantic integration during the comprehension of visual real-world events. Journal of Cognitive Neuroscience 2008, 20:2037-2057.
71. Sitnikova T., Kuperberg G., Holcomb P.J. Semantic integration in videos of real-world events: An electrophysiological investigation. Psychophysiology 2003, 40:160-164.
72. Torralba A., Oliva A., Castelhano M.S., Henderson J.M. Contextual guidance of eye movements and attention in real-world scenes: The role of global features in object search. Psychological Review 2006, 113(4):766-786. 10.1037/0033-295x.113.4.766.
73. Ullman S. High-level vision: Object recognition and visual cognition 1996, MIT Press, Cambridge, MA.
74. Van Petten C., Kutas M. Interactions between sentence context and word frequency in event-related brain potentials. Memory & Cognition 1990, 18:380-393.
75. Van Petten C., Luka B.J. Neural localization of semantic context effects in electromagnetic and hemodynamic studies. Brain and Language 2006, 97:279-293.
76. Võ M.L.-H., Henderson J.M. Effects of semantic and syntactic inconsistencies on the allocation of attention during scene perception. Journal of Vision 2009, 9(3):1-15.
77. West W.C., Holcomb P.J. Imaginal, semantic, and surface-level processing of concrete and abstract words: An electrophysiological investigation. Journal of Cognitive Neuroscience 2000, 12:1024-1037.
78. West W.C., Holcomb P.J. Event-related potentials during discourse-level semantic integration of complex pictures. Cognitive Brain Research 2002, 13(3):363-375.