Two neurocognitive mechanisms of semantic integration during the comprehension of visual real-world events

Journal of Cognitive Neuroscience

Volumn 20, Issue 11, 2008, Pages 2037-2057

  Sitnikova, Tatiana ^a,b   Holcomb, Phillip J ^c   Kiyonaga, Kristi A ^c   Kuperberg, Gina R ^b,c  

^a HARVARD MEDICAL SCHOOL   (United States)

^b MASSACHUSETTS GENERAL HOSPITAL   (United States)

^c TUFTS UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; BRAIN FUNCTION; COGNITION; COMPARATIVE STUDY; COMPREHENSION; CONTROLLED STUDY; EVENT RELATED POTENTIAL; FEMALE; HUMAN; MALE; NEUROPHYSIOLOGY; NORMAL HUMAN; PRIORITY JOURNAL; SEMANTIC MEMORY; SEMANTICS; TASK PERFORMANCE;

ANALYSIS OF VARIANCE; BRAIN MAPPING; COMPREHENSION; CONTINGENT NEGATIVE VARIATION; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS, VISUAL; FEMALE; GOALS; HUMANS; MALE; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; SEMANTICS; TIME FACTORS; VOCABULARY; YOUNG ADULT;

EID: 55949105577     PISSN: 0898929X     EISSN: 15308898     Source Type: Journal    
DOI: 10.1162/jocn.2008.20143     Document Type: Article

References (63)

1. Barrett, S. E., & Rugg, M. D. (1990). Event-related potentials and the semantic matching of pictures. Brain and Cognition, 14, 201-212.
2. Barsalou, L. W. (1999). Perceptual symbol systems. Behavioral Brain Science, 22, 577-609; discussion 610-560.
3. Bentin, S., McCarthy, G., & Wood, C. C. (1985). Event-related potentials, lexical decision and semantic priming. Electroencephalography and Clinical Neurophysiology, 60, 343-355.
4. Bobker, L. R., & Marinis, L. (1973). Making movies: From script to screen. New York: Harcourt Brace Jovanovich.
5. Bornkessel, I., Schlesewsky, M., & Friederici, A. D. (2002). Beyond syntax: Language-related positivities reflect the revision of hierarchies. NeuroReport, 13, 361-364.
6. Bornkessel, I., Schlesewsky, M., & Friederici, A. D. (2003). Eliciting thematic reanalysis effects: The role of syntax-independent information during parsing. Language & Cognitive Processes, 18, 269-298.
7. Bower, G. H., Black, J. B., & Turner, T. J. (1979). Scripts in memory for text. Cognitive Psychology, 11, 177-220.
8. Camblin, C. C., Gordon, P. C., & Swaab, T. Y. (2007). The interplay of discourse congruence and lexical association during sentence processing: Evidence from ERPs and eye tracking. Journal of Memory and Language, 56, 103-128.
9. Carroll, J. M., & Bever, T. G. (1976). Segmentation in cinema perception. Science, 191, 1053-1055.
10. Chambers, C. G., Tanenhaus, M. K., & Magnuson, J. S. (2004). Actions and affordances in syntactic ambiguity resolution. Journal of Experimental Psychology: Learning, Memory, and Cognition, 30, 687-696.
11. Coulson, S., & Wu, Y. C. (2005). Right hemisphere activation of joke-related information: An event-related brain potential study. Journal of Cognitive Neuroscience, 17, 494-506.
12. Donchin, E., & Coles, M. G. H. (1988). Is the P300 component a manifestation of context updating? Behavioral and Brain Science, 11, 355-372.
13. Eddy, M., Schmid, A., & Holcomb, P. J. (2006). Masked repetition priming and event-related brain potentials: A new approach for tracking the time-course of object perception. Psychophysiology, 43, 564-568.
14. Federmeier, K. D., & Kutas, M. (1999). Right words and left words: Electrophysiological evidence for hemispheric differences in meaning processing. Cognitive Brain Research, 8, 373-392.
15. Federmeier, K. D., & Kutas, M. (2001). Meaning and modality: Influences of context, semantic memory organization, and perceptual predictability on picture processing. Journal of Experimental Psychology: Learning, Memory, and Cognition, 27, 202-224.
16. Fischler, I. S., & Bloom, P. A. (1985). Effects of constraint and validity of sentence contexts on lexical decisions. Memory & Cognition, 13, 128-139.
17. Freedman, D. J., Riesenhuber, M., Poggio, T., & Miller, E. K. (2001). Categorical representation of visual stimuli in the primate prefrontal cortex. Science, 291, 312-316.
18. Freedman, D. J., Riesenhuber, M., Poggio, T., & Miller, E. K. (2002). Visual categorization and the primate prefrontal cortex: Neurophysiology and behavior. Journal of Neurophysiology, 88, 929-941.
19. Freedman, D. J., Riesenhuber, M., Poggio, T., & Miller, E. K. (2003). A comparison of primate prefrontal and inferior temporal cortices during visual categorization. Journal of Neuroscience, 23, 5235-5246.
20. Fuster, J. M. (1997). Network memory. Trends in Neurosciences, 20, 451-459.
21. Ganis, G., & Kutas, M. (2003). An electrophysiological study of scene effects on object identification. Cognitive Brain Research, 16, 123-144.
22. Ganis, G., Kutas, M., & Sereno, M. I. (1996). The search for "common sense": An electrophysiological study of the comprehension of words and pictures in reading. Journal of Cognitive Neuroscience, 8, 89-106.
23. Geisser, S., & Greenhouse, S. (1959). On methods in the analysis of profile data. Psychometrika, 24, 95-112.
24. Gibson, J. J. (1979). The ecological approach to visual perception. Boston: Houghton Mifflin.
25. Grose-Fifer, J., & Deacon, D. (2004). Priming by natural category membership in the left and right cerebral hemispheres. Neuropsychologia, 42, 1948-1960.
26. Hagoort, P., Hald, L., Bastiaansen, M., & Petersson, K. M. (2004). Integration of word meaning and world knowledge in language comprehension. Science, 304, 438-441.
27. Hoeks, J. C., Stowe, L. A., & Doedens, G. (2004). Seeing words in context: The interaction of lexical and sentence level information during reading. Cognitive Brain Research, 19, 59-73.
28. Holcomb, P. J., Kounios, J., Anderson, J. E., & West, W. C. (1999). Dual-coding, context-availability, and concreteness effects in sentence comprehension: An electrophysiological investigation. Journal of Experimental Psychology: Learning, Memory, and Cognition, 25, 721-742.
29. Holcomb, P. J., & Neville, H. J. (1991). Natural speech processing: An analysis using event-related brain potentials. Psychobiology, 19, 286-300.
30. Hutchison, K. A. (2003). Is semantic priming due to association strength or feature overlap? A microanalytic review. Psychonomic Bulletin & Review, 10, 785-813.
31. Jung-Beeman, M. (2005). Bilateral brain processes for comprehending natural language. Trends in Cognitive Sciences, 9, 512-518.
32. Kaschak, M. P., & Glenberg, A. M. (2000). Constructing meaning: The role of affordances and grammatical constructions in sentence comprehension. Journal of Memory and Language, 43, 508-529.
33. Kim, A., & Osterhout, L. (2005). The independence of combinatory semantic processing: Evidence from event-related potentials. Journal of Memory and Language, 52, 205-225.
34. Kolk, H. H., Chwilla, D. J., van Herten, M., & Oor, P. J. (2003). Structure and limited capacity in verbal working memory: A study with event-related potentials. Brain and Language, 85, 1-36.
35. Kuperberg, G. R. (2007). Neural mechanisms of language comprehension: Challenges to syntax. Cognitive Brain Research, 1146, 23-49. Erratum in Brain Research 2007;1164:142.
36. Kuperberg, G. R., Caplan, D., Sitnikova, T., Eddy, M., & Holcomb, P. J. (2006). Neural correlates of processing syntactic, thematic and semantic relationships in sentences. Language and Cognitive Processes, 21, 489-530.
37. Kuperberg, G. R., Kreher, D. A., Sitnikova, T., Caplan, D. N., & Holcomb, P. J. (2007). The role of animacy and thematic relationships in processing active English sentences: Evidence from event-related potentials. Brain and Language, 100, 223-237.
38. Kuperberg, G. R., Sitnikova, T., Caplan, D., & Holcomb, P. J. (2003). Electrophysiological distinctions in processing conceptual relationships within simple sentences. Cognitive Brain Research, 17, 117-129.
39. Kutas, M. (1993). In the company of other words: Electrophysiological evidence for single-word and sentence context effects. Language and Cognitive Processes, 8, 533-572.
40. Kutas, M., & Hillyard, S. A. (1980). Reading senseless sentences: Brain potentials reflect semantic incongruity. Science, 207, 203-205.
41. Kutas, M., & Hillyard, S. A. (1984). Brain potentials during reading reflect word expectancy and semantic association. Nature, 307, 161-163.
42. Kutas, M., & Hillyard, S. A. (1989). An electrophysiological probe of incidental semantic association. Journal of Cognitive Neuroscience, 1, 38-49.
43. McPherson, W. B., & Holcomb, P. J. (1999). An electrophysiological investigation of semantic priming with pictures of real objects. Psychophysiology, 36, 53-65.
44. Miller, E. K., Freedman, D. J., & Wallis, J. D. (2002). The prefrontal cortex: Categories, concepts and cognition. Philosophical Transactions of the Royal Society of London, Series B, Biological Sciences, 357, 1123-1136.
45. Miller, E. K., Nieder, A., Freedman, D. J., & Wallis, J. D. (2003). Neural correlates of categories and concepts. Current Opinion in Neurobiology, 13, 198-203.
46. Osterhout, L., & Holcomb, P. J. (1992). Event-related potentials elicited by syntactic anomaly. Journal of Memory and Language, 31, 785-806.
47. Osterhout, L., Holcomb, P. J., & Swinney, D. A. (1994). Brain potentials elicited by garden-path sentences: Evidence of the application of verb information during parsing. Journal of Experimental Psychology: Learning, Memory, and Cognition, 20, 786-803.
48. Rehak, A., Kaplan, J. A., Weylman, S. T., Kelly, B., Brownell, H. H., & Gardner, H. (1992). Story processing in right-hemisphere brain-damaged patients. Brain and Language, 42, 320-336.
49. Robertson, D. A., Gernsbacher, M. A., Guidotti, S. J., Robertson, R. R., Irwin, W., Mock, B. J., et al. (2000). Functional neuroanatomy of the cognitive process of mapping during discourse comprehension. Psychological Science, 11, 255-260.
50. Rougier, N. P., Noelle, D. C., Braver, T. S., Cohen, J. D., & O'Reilly, R. C. (2005). Prefrontal cortex and flexible cognitive control: Rules without symbols. Proceedings of the National Academy of Sciences, U.S.A., 102, 7338-7343.
51. Schwan, S., Garsoffky, B., & Hesse, F. W. (2000). Do film cuts facilitate the perceptual and cognitive organization of activity sequences? Memory & Cognition, 28, 214-223.
52. Sitnikova, T. (2003). Comprehension of videos of real-world events: Electrophysiological evidence [Doctoral dissertation]. Medford, MA: Tufts University.
53. Sitnikova, T., Holcomb, P. J., & Kuperberg, G. R. (2008). Neurocognitive mechanisms of human comprehension. In T. F. Shipley & J. M. Zacks (Eds.), Understanding events: From perception to action (pp. 639-683). New York: Oxford University.
54. Sitnikova, T., Kuperberg, G., & Holcomb, P. J. (2003). Semantic integration in videos of real-world events: An electrophysiological investigation. Psychophysiology, 40, 160-164.
55. Sitnikova, T., West, W. C., Kuperberg, G. R., & Holcomb, P. J. (2006). The neural organization of semantic memory: Electrophysiological activity suggests feature-based segregation. Biological Psychology, 71, 326-340.
56. St George, M., Kutas, M., Martinez, A., & Sereno, M. I. (1999). Semantic integration in reading: Engagement of the right hemisphere during discourse processing. Brain, 122, 1317-1325.
57. Stanfield, R. A., & Zwaan, R. A. (2001). The effect of implied orientation derived from verbal context on picture recognition. Psychological Science, 12, 153-156.
58. van Berkum, J. J., Hagoort, P., & Brown, C. M. (1999). Semantic integration in sentences and discourse: Evidence from the N400. Journal of Cognitive Neuroscience, 11, 657-671.
59. van Berkum, J. J., Zwitserlood, P., Hagoort, P., & Brown, C. M. (2003). When and how do listeners relate a sentence to the wider discourse? Evidence from the N400 effect. Cognitive Brain Research, 17, 701-718.
60. van Herten, M., Chwilla, D. J., & Kolk, H. H. (2006). When heuristics clash with parsing routines: ERP evidence for conflict monitoring in sentence perception. Journal of Cognitive Neuroscience, 18, 1181-1197.
61. van Herten, M., Kolk, H. H., & Chwilla, D. J. (2005). An ERP study of P600 effects elicited by semantic anomalies. Cognitive Brain Research, 22, 241-255.
62. West, W. C., & Holcomb, P. J. (2002). Event-related potentials during discourse-level semantic integration of complex pictures. Cognitive Brain Research, 13, 363-375.
63. Zacks, J. M., & Tversky, B. (2001). Event structure in perception and conception. Psychological Bulletin, 127, 3-21.