Oscillatory Brain Dynamics during Sentence Reading: A Fixation-Related Spectral Perturbation Analysis

Frontiers in Human Neuroscience

Volumn 10, Issue , 2016, Pages

  Vignali, Lorenzo ^a   Himmelstoss, Nicole A ^a   Hawelka, Stefan ^a   Richlan, Fabio ^a   Hutzler, Florian ^a  

^a UNIVERSITY OF SALZBURG   (Austria)

Author keywords

brain oscillations; electroencephalography; eye movements; semantic violation; sentence processing

Indexed keywords

ADULT; ARTICLE; BRAIN; COMPREHENSION; CONTROLLED STUDY; ELECTROENCEPHALOGRAPHY; EYE MOVEMENT; FEMALE; HUMAN; HUMAN EXPERIMENT; LANGUAGE; MALE; OSCILLATION; RANDOMIZED CONTROLLED TRIAL; READING;

EID: 85012116936     PISSN: None     EISSN: 16625161     Source Type: Journal    
DOI: 10.3389/fnhum.2016.00191     Document Type: Article

References (87)

1. Altmann G. T. Kamide Y. (1999). Incremental interpretation at verbs: restricting the domain of subsequent reference. Cognition 73, 247–264. 10.1016/s0010-0277(99)00059-110585516
2. Balota D. A. Pollatsek A. Rayner K. (1985). The interaction of contextual constraints and parafoveal visual information in reading. Cogn. Psychol. 17, 364–390. 10.1016/0010-0285(85)90013-14053565
3. Bar M. Kassam K. S. Ghuman A. S. Boshyan J. Schmid A. M. Dale A. M. et al. (2006). Top-down facilitation of visual recognition. Proc. Natl. Acad. Sci. U S A 103, 449–454. 10.1073/pnas.050706210316407167
4. Barber H. A. Ben–Zvi S. Bentin S. Kutas M. (2011). Parafoveal perception during sentence reading? An ERP paradigm using rapid serial visual presentation (RSVP) with flankers. Psychophysiology 48, 523–531. 10.1111/j.1469-8986.2010.01082.x21361965
5. Barber H. Vergara M. Carreiras M. (2004). Syllable-frequency effects in visual word recognition: evidence from ERPs. Neuroreport 15, 545–548. 10.1097/00001756-200403010-0003215094520
6. Bastiaansen M. Hagoort P. (2006). Oscillatory neuronal dynamics during language comprehension. Prog. Brain Res. 159, 179–196. 10.1016/s0079-6123(06)59012-017071231
7. Bastiaansen M. Magyari L. Hagoort P. (2010). Syntactic unification operations are reflected in oscillatory dynamics during on-line sentence comprehension. J. Cogn. Neurosci. 22, 1333–1347. 10.1162/jocn.2009.2128319580386
8. Bressler S. L. (1995). Large-scale cortical networks and cognition. Brain Res. Brain Res. Rev. 20, 288–304. 10.1016/0165-0173(94)00016-i7550362
9. Bressler S. L. Richter C. G. (2015). Interareal oscillatory synchronization in top-down neocortical processing. Curr. Opin. Neurobiol. 31, 62–66. 10.1016/j.conb.2014.08.01025217807
10. Cornelissen P. L. Kringelbach M. L. Ellis A. W. Whitney C. Holliday I. E. Hansen P. C. (2009). Activation of the left inferior frontal gyrus in the first 200 ms of reading: evidence from magnetoencephalography (MEG). PLoS One 4:e5359. 10.1371/journal.pone.000535920161024
11. Dambacher M. Rolfs M. Göllner K. Kliegl R. Jacobs A. J. M. (2009). Event-Related Potentials Reveal Rapid Verification of Predicted Visual Input. Konstanz: Bibliothek der Universität.
12. Davidson D. J. Indefrey P. (2007). An inverse relation between event-related and time-frequency violation responses in sentence processing. Brain Res. 1158, 81–92. 10.1016/j.brainres.2007.04.08217560965
13. Dehaene S. Cohen L. (2011). The unique role of the visual word form area in reading. Trends Cogn. Sci. 15, 254–262. 10.1016/j.tics.2011.04.00321592844
14. DeLong K. A. Urbach T. P. Kutas M. (2005). Probabilistic word pre-activation during language comprehension inferred from electrical brain activity. Nat. Neurosci. 8, 1117–1121. 10.1038/nn150416007080
15. Delorme A. Makeig S. (2004). EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods 134, 9–21. 10.1016/j.jneumeth.2003.10.00915102499
16. Dikker S. Pylkkanen L. (2011). Before the N400: effects of lexical-semantic violations in visual cortex. Brain Lang. 118, 23–28. 10.1016/j.bandl.2011.02.00621458057
17. Dimigen O. Kliegl R. Sommer W. (2012). Trans-saccadic parafoveal preview benefits in fluent reading: a study with fixation-related brain potentials. Neuroimage 62, 381–393. 10.1016/j.neuroimage.2012.04.00622521255
18. Dimigen O. Sommer W. Hohlfeld A. Jacobs A. M. Kliegl R. (2011). Coregistration of eye movements and EEG in natural reading: analyses and review. J. Exp. Psychol. Gen. 140, 552–572. 10.1037/a002388521744985
19. Ehinger B. V. König P. Ossandón J. P. (2015). Predictions of visual content across eye movements and their modulation by inferred information. J. Neurosci. 35, 7403–7413. 10.1523/JNEUROSCI.5114-14.201525972169
20. Engel A. K. Fries P. (2010). Beta-band oscillations—signalling the status quo? Curr. Opin. Neurobiol. 20, 156–165. 10.1016/j.conb.2010.02.01520359884
21. Engel A. K. Fries P. Singer W. (2001). Dynamic predictions: oscillations and synchrony in top-down processing. Nat. Rev. Neurosci. 2, 704–716. 10.1038/3509456511584308
22. Federmeier K. D. (2007). Thinking ahead: the role and roots of prediction in language comprehension. Psychophysiology 44, 491–505. 10.1111/j.1469-8986.2007.00531.x17521377
23. Gray C. M. König P. Engel A. K. Singer W. (1989). Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties. Nature 338, 334–337. 10.1038/338334a02922061
24. Hagoort P. (2005). On broca, brain and binding: a new framework. Trends Cogn. Sci. 9, 416–423. 10.1016/j.tics.2005.07.00416054419
25. Hagoort P. (2013). MUC (memory, unification, control) and beyond. Front. Psychol. 4:416. 10.3389/fpsyg.2013.0041623874313
26. Hagoort P. (2014). Nodes and networks in the neural architecture for language: broca’s region and beyond. Curr. Opin. Neurobiol. 28, 136–141. 10.1016/j.conb.2014.07.01325062474
27. Hagoort P. Hald L. Bastiaansen M. Petersson K. M. (2004). Integration of word meaning and world knowledge in language comprehension. Science 304, 438–441. 10.1126/science.109545515031438
28. Hald L. A. Bastiaansen M. C. Hagoort P. (2006). EEG theta and gamma responses to semantic violations in online sentence processing. Brain Lang. 96, 90–105. 10.1016/j.bandl.2005.06.00716083953
29. Hawelka S. Schuster S. Gagl B. Hutzler F. (2015). On forward inferences of fast and slow readers. an eye movement study. Sci. Rep. 5:8432. 10.1038/srep0843225678030
30. Henderson J. M. Luke S. G. Schmidt J. Richards J. E. (2013). Co-registration of eye movements and event-related potentials in connected-text paragraph reading. Front. Syst. Neurosci. 7:28. 10.3389/fnsys.2013.0002823847477
31. Herrmann C. S. Munk M. H. Engel A. K. (2004). Cognitive functions of gamma-band activity: memory match and utilization. Trends Cogn. Sci. 8, 347–355. 10.1016/j.tics.2004.06.00615335461
32. Hipp J. F. Engel A. K. Siegel M. (2011). Oscillatory synchronization in large-scale cortical networks predicts perception. Neuron 69, 387–396. 10.1016/j.neuron.2010.12.02721262474
33. Howard M. W. Rizzuto D. S. Caplan J. B. Madsen J. R. Lisman J. Aschenbrenner-Scheibe R. et al. (2003). Gamma oscillations correlate with working memory load in humans. Cereb. Cortex 13, 1369–1374. 10.1093/cercor/bhg08414615302
34. Hutzler F. Bergmann J. Conrad M. Kronbichler M. Stenneken P. Jacobs A. M. (2004). Inhibitory effects of first syllable-frequency in lexical decision: an event-related potential study. Neurosci. Lett. 372, 179–184. 10.1016/j.neulet.2004.07.05015542236
35. Hutzler F. Braun M. Võ M. L. Engl V. Hofmann M. Dambacher M. et al. (2007). Welcome to the real world: validating fixation-related brain potentials for ecologically valid settings. Brain Res. 1172, 124–129. 10.1016/j.brainres.2007.07.02517803976
36. Hutzler F. Fuchs I. Gagl B. Schuster S. Richlan F. Braun M. et al. (2013). Parafoveal X-masks interfere with foveal word recognition: evidence from fixation-related brain potentials. Front. Syst. Neurosci. 7:33. 10.3389/fnsys.2013.0003323888130
37. Jung T. P. Humphries C. Lee T. W. Makeig S. McKeown M. J. Iragui V. et al. (1998). Extended ICA removes artifacts from electroencephalographic recordings. Adv. Neural Inf. Process. Syst. 10, 894–900.
38. Jung T. P. Makeig S. Westerfield M. Townsend J. Courchesne E. Sejnowski T. J. (2000). Removal of eye activity artifacts from visual event-related potentials in normal and clinical subjects. Clin. Neurophysiol. 111, 1745–1758. 10.1016/s1388-2457(00)00386-211018488
39. Jung-Beeman M. (2005). Bilateral brain processes for comprehending natural language. Trends Cogn. Sci. 9, 512–518. 10.1016/j.tics.2005.09.00916214387
40. Kamide Y. Altmann G. T. Haywood S. L. (2003). The time-course of prediction in incremental sentence processing: evidence from anticipatory eye movements. J. Mem. Lang. 49, 133–156. 10.1016/s0749-596x(03)00023-8
41. Kielar A. Meltzer J. A. Moreno S. Alain C. Bialystok E. (2014). Oscillatory responses to semantic and syntactic violations. J. Cogn. Neurosci. 26, 2840–2862. 10.1162/jocn_a_0067024893735
42. Kielar A. Panamsky L. Links K. A. Meltzer J. A. (2015). Localization of electrophysiological responses to semantic and syntactic anomalies in language comprehension with MEG. Neuroimage 105, 507–524. 10.1016/j.neuroimage.2014.11.01625463470
43. Kliegl R. Dambacher M. Dimigen O. Jacobs A. M. Sommer W. (2012). Eye movements and brain electric potentials during reading. Psychol. Res. 76, 145–158. 10.1007/s00426-011-0376-x21915693
44. Kliegl R. Nuthmann A. Engbert R. (2006). Tracking the mind during reading: the influence of past, present and future words on fixation durations. J. Exp. Psychol. Gen. 135, 12–35. 10.1037/0096-3445.135.1.1216478314
45. Kutas M. Federmeier K. D. (2007). “Event-related brain potential (ERP) studies of sentence processing,” in The Oxford Handbook of Psycholinguistics, ed. G. Gaskell (Oxford, UK: Oxford University Press), 385–406.
46. Kutas M. Federmeier K. D. (2011). Thirty years and counting: finding meaning in the N400 component of the event-related brain potential (ERP). Annu. Rev. Psychol. 62, 621–647. 10.1146/annurev.psych.093008.13112320809790
47. Lau E. F. Phillips C. Poeppel D. (2008). A cortical network for semantics: (de)constructing the N400. Nat. Rev. Neurosci. 9, 920–933. 10.1038/nrn253219020511
48. Lawrence M. A. (2011). Ez: easy analysis and visualization of factorial experiments. Computer Software Manual](R Package Version 3.0–0) Available online at: http://cran.r-project.org/package=ez. Accessed on December 22, 2011.
49. Lewis A. G. Bastiaansen M. (2015). A predictive coding framework for rapid neural dynamics during sentence-level language comprehension. Cortex 68, 155–168. 10.1016/j.cortex.2015.02.01425840879
50. Lewis A. G. Wang L. Bastiaansen M. (2015). Fast oscillatory dynamics during language comprehension: unification versus maintenance and prediction? Brain Lang. 148, 51–63. 10.1016/j.bandl.2015.01.00325666170
51. Lopez-Calderon J. Luck S. J. (2014). ERPLAB: an open-source toolbox for the analysis of event-related potentials. Front. Hum. Neurosci. 8:213. 10.3389/fnhum.2014.0021324782741
52. Luo Y. Zhang Y. Feng X. Zhou X. (2010). Electroencephalogram oscillations differentiate semantic and prosodic processes during sentence reading. Neuroscience 169, 654–664. 10.1016/j.neuroscience.2010.05.03220580785
53. Makeig S. Bell A. J. Jung T. Sejnowski T. J. (1996). Independent component analysis of electroencephalographic data. Adv. Neural Inf. Process. Syst. 8,145–151.
54. Makeig S. Jung T. P. Bell A. J. Ghahremani D. Sejnowski T. J. (1997). Blind separation of auditory event-related brain responses into independent components. Proc. Natl. Acad. Sci. U S A 94, 10979–10984. 10.1073/pnas.94.20.109799380745
55. Maris E. Oostenveld R. (2007). Nonparametric statistical testing of EEG-and MEG-data. J. Neurosci. Methods 164, 177–190. 10.1016/j.jneumeth.2007.03.02417517438
56. Martin A. Schurz M. Kronbichler M. Richlan F. (2015). Reading in the brain of children and adults: a meta–analysis of 40 functional magnetic resonance imaging studies. Hum. Brain Mapp. 36, 1963–1981. 10.1002/hbm.2274925628041
57. Metzner P. von der Malsburg T. Vasishth S. Rösler F. (2015). Brain responses to world knowledge violations: a comparison of stimulus-and fixation-triggered event-related potentials and neural oscillations. J. Cogn. Neurosci. 27, 1017–1028. 10.1162/jocn_a_0073125269112
58. Meyer L. Grigutsch M. Schmuck N. Gaston P. Friederici A. D. (2015). Frontal-posterior theta oscillations reflect memory retrieval during sentence comprehension. Cortex 71, 205–218. 10.1016/j.cortex.2015.06.02726233521
59. Meyer L. Obleser J. Friederici A. D. (2013). Left parietal alpha enhancement during working memory-intensive sentence processing. Cortex 49, 711–721. 10.1016/j.cortex.2012.03.00622513340
60. Pammer K. Hansen P. C. Kringelbach M. L. Holliday I. Barnes G. Hillebrand A. et al. (2004). Visual word recognition: the first half second. Neuroimage 22, 1819–1825. 10.1016/j.neuroimage.2004.05.00415275938
61. Peña M. Melloni L. (2012). Brain oscillations during spoken sentence processing. J. Cogn. Neurosci. 24, 1149–1164. 10.1162/jocn_a_0014421981666
62. Penolazzi B. Angrilli A. Job R. (2009). Gamma EEG activity induced by semantic violation during sentence reading. Neurosci. Lett. 465, 74–78. 10.1016/j.neulet.2009.08.06519723559
63. Pernet C. R. Latinus M. Nichols T. E. Rousselet G. A. (2015). Cluster-based computational methods for mass univariate analyses of event-related brain potentials/fields: a simulation study. J. Neurosci. Methods 250, 85–93. 10.1016/j.jneumeth.2014.08.00325128255
64. Pernet C. Uusvuori J. Salmelin R. (2007). Parafoveal-on-foveal and foveal word priming are different processes: behavioral and neurophysiological evidence. Neuroimage 38, 321–330. 10.1016/j.neuroimage.2007.07.03517851091
65. Plöchl M. Ossandón J. P. König P. (2012). Combining EEG and eye tracking: identification, characterization and correction of eye movement artifacts in electroencephalographic data. Front. Hum. Neurosci. 6:278. 10.3389/fnhum.2012.0027823087632
66. Price C. J. (2012). A review and synthesis of the first 20 years of PET and fMRI studies of heard speech, spoken language and reading. Neuroimage 62, 816–847. 10.1016/j.neuroimage.2012.04.06222584224
67. Price C. J. Devlin J. T. (2011). The interactive account of ventral occipitotemporal contributions to reading. Trends Cogn. Sci. 15, 246–253. 10.1016/j.tics.2011.04.00121549634
68. Raghavachari S. Kahana M. J. Rizzuto D. S. Caplan J. B. Kirschen M. P. Bourgeois B. et al. (2001). Gating of human theta oscillations by a working memory task. J. Neurosci. 21, 3175–3183. 11312302
69. Rayner K. (1998). Eye movements in reading and information processing: 20 years of research. Psychol. Bull. 124, 372–422. 10.1037/0033-2909.124.3.3729849112
70. Rayner K. (2009). Eye movements and attention in reading, scene perception and visual search. Q. J. Exp. Psychol. (Hove) 62, 1457–1506. 10.1080/1747021090281646119449261
71. Rayner K. Warren T. Juhasz B. J. Liversedge S. P. (2004). The effect of plausibility on eye movements in reading. J. Exp. Psychol. Learn. Mem. Cogn. 30, 1290–1301. 10.1037/0278-7393.30.6.129015521805
72. Risse S. Hohenstein S. Kliegl R. Engbert R. (2014). A theoretical analysis of the perceptual span based on SWIFT simulations of the n 2 boundary paradigm. Vis. Cogn. 22, 283–308. 10.1080/13506285.2014.88144424771996
73. Rommers J. Dijkstra T. Bastiaansen M. (2013). Context-dependent semantic processing in the human brain: evidence from idiom comprehension. J. Cogn. Neurosci. 25, 762–776. 10.1162/jocn_a_0033723249356
74. Schotter E. R. Angele B. Rayner K. (2012). Parafoveal processing in reading. Atten. Percept. Psychophys. 74, 5–35. 10.3758/s13414-011-0219-222042596
75. Schotter E. R. Reichle E. D. Rayner K. (2014). Rethinking parafoveal processing in reading: serial-attention models can explain semantic preview benefit and N 2 preview effects. Vis. Cogn. 22, 309–333. 10.1080/13506285.2013.873508
76. Schuster S. Hawelka S. Richlan F. Ludersdorfer P. Hutzler F. (2015). Eyes on words: a fixation-related fMRI study of the left occipito-temporal cortex during self-paced silent reading of words and pseudowords. Sci. Rep. 5:12686. 10.1038/srep1268626235228
77. Sereno S. C. Rayner K. (2003). Measuring word recognition in reading: eye movements and event-related potentials. Trends Cogn. Sci. 7, 489–493. 10.1016/j.tics.2003.09.01014585445
78. Singer W. (2011). Dynamic formation of functional networks by synchronization. Neuron 69, 191–193. 10.1016/j.neuron.2011.01.00821262459
79. Smith S. M. Nichols T. E. (2009). Threshold-free cluster enhancement: addressing problems of smoothing, threshold dependence and localisation in cluster inference. Neuroimage 44, 83–98. 10.1016/j.neuroimage.2008.03.06118501637
80. Taylor J. Rastle K. Davis M. H. (2013). Can cognitive models explain brain activation during word and pseudoword reading? A meta-analysis of 36 neuroimaging studies. Psychol. Bull. 139, 766–791. 10.1037/a003026623046391
81. Varela F. Lachaux J. Rodriguez E. Martinerie J. (2001). The brainweb: phase synchronization and large-scale integration. Nat. Rev. Neurosci. 2, 229–239. 10.1038/3506755011283746
82. von Stein A. Chiang C. König P. (2000). Top-down processing mediated by interareal synchronization. Proc. Natl. Acad. Sci. U S A 97, 14748–14753. 10.1073/pnas.97.26.1474811121074
83. Wang L. Jensen O. van den Brink D. Weder N. Schoffelen J. Magyari L. et al. (2012a). Beta oscillations relate to the N400m during language comprehension. Hum. Brain Mapp. 33, 2898–2912. 10.1002/hbm.2141022488914
84. Wang L. Zhu Z. Bastiaansen M. (2012b). Integration or predictability? A further specification of the functional role of gamma oscillations in language comprehension. Front. Psychol. 3:187. 10.3389/fpsyg.2012.0018724082962
85. Weiss S. Mueller H. M. Schack B. King J. W. Kutas M. Rappelsberger P. (2005). Increased neuronal communication accompanying sentence comprehension. Int. J. Psychophysiol. 57, 129–141. 10.1016/j.ijpsycho.2005.03.01315935501
86. Wheat K. L. Cornelissen P. L. Frost S. J. Hansen P. C. (2010). During visual word recognition, phonology is accessed within 100 ms and may be mediated by a speech production code: evidence from magnetoencephalography. J. Neurosci. 30, 5229–5233. 10.1523/JNEUROSCI.4448-09.201020392945
87. Woodhead Z. V. Barnes G. R. Penny W. Moran R. Teki S. Price C. J. et al. (2014). Reading front to back: MEG evidence for early feedback effects during word recognition. Cereb. Cortex 24, 817–825. 10.1093/cercor/bhs36523172772