Pupil dilation and EEG alpha frequency band power reveal load on executive functions for link-selection processes during text reading

PLoS ONE

Volumn 10, Issue 6, 2015, Pages

  Scharinger, Christian ^a   Kammerer, Yvonne ^a   Gerjets, Peter ^a  

^a KNOWLEDGE MEDIA RESEARCH CENTER   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ALPHA RHYTHM; ARTICLE; COMPREHENSION; CONTROLLED STUDY; EXECUTIVE FUNCTION; EYE TRACKING; FEMALE; HUMAN; HUMAN EXPERIMENT; HYPERMEDIA; LEFT HEMISPHERE; MALE; NORMAL HUMAN; ONLINE SYSTEM; PSYCHOMOTOR PERFORMANCE; PUPIL DILATION; READING; RIGHT HEMISPHERE; VISUAL FEEDBACK; VISUAL SYSTEM PARAMETERS; YOUNG ADULT; ELECTROENCEPHALOGRAM; ELECTROENCEPHALOGRAPHY; EVOKED RESPONSE; PHYSIOLOGY; PUPIL; SHORT TERM MEMORY;

ADULT; BRAIN WAVES; COMPREHENSION; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; EXECUTIVE FUNCTION; FEMALE; HUMANS; HYPERMEDIA; MALE; MEMORY, SHORT-TERM; PUPIL; READING; YOUNG ADULT;

EID: 84953924213     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0130608     Document Type: Article

References (85)

1. Salmerón L, Cerdán R, Naumann J. How adolescents navigate Wikipedia to answer questions / ¿Cómo navegan los adolescentes en Wikipedia para contestar preguntas? Infanc y Aprendiz. 2015; 1-37. doi: 10.1080/02103702.2015.1016750
2. DeStefano D, LeFevre J- A. Cognitive load in hypertext reading: A review. Comput Human Behav. 2007; 23: 1616-1641. doi: 10.1016/j.chb.2005.08.012
3. Kendeou P, Van Den Broek P, Helder A, Karlsson J. A cognitive view of reading comprehension: Implications for reading difficulties. Learn Disabil Res Pract. 2014; 29: 10-16. doi: 10.1111/ldrp.12025
4. Diamond A. Executive functions. Annu Rev Psychol. 2013; 64: 135-168. doi: 10.1146/annurev-psych-113011-143750 PMID: 23020641
5. Baddeley A. Exploring the central executive. Q J Exp Psychol. 1996; 49: 5-28. doi: 10.1080/713755608
6. Baddeley A. Working memory: looking back and looking forward. Nat Rev Neurosci. 2003; 4: 829-839. doi: 10.1038/nrn1201 PMID: 14523382
7. Nee DE, Brown JW, Askren MK. A meta-analysis of executive components of working memory. Cereb Cortex. 2013; 23: 264-282. doi: 10.1093/cercor/bhs007 PMID: 22314046
8. Miyake A, Friedman NP, Emerson MJ, Witzki AH, Howerter A. The unity and diversity of executive functions and their contributions to complex "frontal lobe" tasks: A latent variable analysis. Cogn Psychol. Netherlands: Elsevier Science; 2000; 41: 49-100.
9. Engle RW. Working memory capacity as executive attention. Curr Dir Psychol Sci. 2002; 11: 19-23. doi: 10.1111/1467-8721.00160
10. McNamara DS, Magliano JP. Towards a comprehensive model of comprehension. In: Ross B, editor. The psychology of learning and motivation - advances in research and theory. New York, NY, USA: Elsevier Science; 2009. pp. 297-384. doi: 10.1016/S0079-7421(09)51009-2 PMID: 24771952
11. Arrington CN, Kulesz PA, Francis DJ, Fletcher JM, Barnes MA. The contribution of attentional control and working memory to reading comprehension and decoding. Sci Stud Read. 2014; 18: 325-346. doi: 10.1080/10888438.2014.902461
12. Ericsson KA, Kintsch W. Long-term working memory. Psychol Rev. 1995; 102: 211-245. doi: 10.1037/0033-295X.102.2.211 PMID: 7740089
13. Sesma HW, Mahone EM, Levine T, Eason SH, Cutting LE. The contribution of executive skills to reading comprehension. Child Neuropsychol. 2009; 15: 232-246. doi: 10.1080/09297040802220029 PMID: 18629674
14. Kintsch W. The role of knowledge in discourse comprehension: A construction-integration model. Psychol Rev. 1988; 95: 163-182. doi: 10.1037//0033-295X.95.2.163 PMID: 3375398
15. Kintsch W. The role of knowledge in discourse comprehension: A construction-integration model. Adv Psychol. 1991; 79: 107-153. doi: 10.1016/S0166-4115(08)61551-4
16. Zwaan RA, Radvansky GA. Situation models in language comprehension and memory. Psychol Bull. 1998; 123: 162-185. doi: 10.1037/0033-2909.123.2.162 PMID: 9522683
17. Verhoeven L, Perfetti C. Advances in text comprehension: Model, process and development. Appl Cogn Psychol. 2008; 22: 293-301. doi: 10.1002/acp
18. Amadieu F, van Gog T, Paas F, Tricot A, Mariné C. Effects of prior knowledge and concept-map structure on disorientation, cognitive load, and learning. Learn Instr. 2009; 19: 376-386. doi: 10.1016/j.learninstruc.2009.02.005
19. Cangoz B, Altun A. The effects of hypertext structure, presentation and instruction types on perceived disorientation and recall performances. Contemp Educ Technol. 2012; 3: 81-98.
20. Kim H, Hirtle S. Spatial metaphors and disorientation in hypertext browsing. Behav Inf Technol. 1995; 14: 239-250.
21. Scheiter K, Gerjets P. Learner control in hypermedia environments. Educ Psychol Rev. 2007; 19: 285-307. doi: 10.1007/s10648-007-9046-3
22. Zhu E. Hypermedia Interface Design: The Effects of Number of Links and Granularity of Nodes. J Educ Multimed Hypermedia. 1999; 8: 331-358.
23. st ed. New York, NY: Norton; 2010.
24. th Annual ACM Web Science Conference. New York, NY, USA: ACM Press; 2013. pp. 65-74. doi: 10.1145/2464464.2464501
25. Ewing K, Fairclough S. The impact of working memory load on psychophysiological measures of mental effort and motivational disposition. In: de Waard D, Axelsson A, Berglund M, Peters B, Weikert C, editors. Human factors: A system view of human,technology and organisation. Maastricht: Shaker Publishing; 2010. pp. 423-433.
26. Laeng B, Ørbo M, Holmlund T, Miozzo M. Pupillary Stroop effects. Cogn Process. 2011; 12: 13-21. doi: 10.1007/s10339-010-0370-z PMID: 20865297
27. Kahneman D, Beatty J. Pupil diameter and load on memory. Science. 1966; 154: 1583-1585. PMID: 5924930
28. Van Gerven PWM, Paas F, Van Merrie¨nboer JJG, Schmidt HG. Memory load and the cognitive pupillary response in aging. Psychophysiology. 2004; 41: 167-174. doi: 10.1111/j.1469-8986.2003.00148.x PMID: 15032982
29. Piquado T, Isaacowitz D, Wingfield A. Pupillometry as a measure of cognitive effort in younger and older adults. Psychophysiology. 2010; 47: 560-569. doi: 10.1111/j.1469-8986.2009.00947.x PMID: 20070575
30. nd ed. Cambridge: Cambridge University Press; 2000. pp. 142-162.
31. Laeng B, Sirois S, Gredeback G. Pupillometry: A Window to the Preconscious? Perspect Psychol Sci. 2012; 7: 18-27. doi: 10.1177/1745691611427305
32. th ed. New Jersey: Lawrence Erlbaum; 2007. pp. 289-307.
33. Kahneman D. Attention and effort. Series in experimental psychology. New Jersey: Prentice-Hall; 1973.
34. Granholm E, Steinhauer SR. Pupillometric measures of cognitive and emotional processes. Int J Psychophysiol. 2004; 52: 1-6. doi: 10.1016/j.ijpsycho.2003.12.001 PMID: 15003368
35. Hess EH, Polt JM. Pupil size as related to interest value of visual stimuli. Science. 1960; 132: 349-350. PMID: 14401489
36. Partala T, Surakka V. Pupil size variation as an indication of affective processing. Int J Hum Comput Stud. 2003; 59: 185-198. doi: 10.1016/S1071-5819(03)00017-X
37. Iqbal ST, Zheng XS, Bailey BP. Task-evoked pupillary response to mental workload in human-computer interaction. In: Dykstra-Erickson E, Tscheligi M, editors. CHI '04 Extended Abstracts on Human Factors in Computing Systems. New York, NY: ACM; 2004. pp. 1477-1480. doi: 10.1145/985921.986094
38. Di Stasi LL, Antolí A, Gea M, Cañas JJ. A neuroergonomic approach to evaluating mental workload in hypermedia interactions. Int J Ind Ergon. 2011; 41: 298-304. doi: 10.1016/j.ergon.2011.02.008
39. st ed. Boston: Kluwer Academic Publishers Group; 2003. pp. 111-130.
40. Gevins A, Smith ME. Neurophysiological measures of working memory and individual differences in cognitive ability and cognitive style. Cereb Cortex. 2000; 10: 829-839. doi: 10.1093/cercor/10.9.829 PMID: 10982744
41. Hanslmayr S, Pastötter B, Ba¨uml K- H, Gruber S, Wimber M, Klimesch W. The electrophysiological dynamics of interference during the Stroop task. J Cogn Neurosci. 2008; 20: 215-225. doi: 10.1162/jocn.2008.20020 PMID: 18275330
42. Pfurtscheller G, Lopes da Silva FH. Event-related EEG/MEG synchronization and desynchronization: Basic principles. Clin Neurophysiol. 1999; 110: 1842-1857. PMID: 10576479
43. Gevins A, Smith ME, McEvoy CL, Yu D. High-resolution EEG mapping of cortical activation related to working memory: Effects of task difficulty, type of processing, and practice. Cereb Cortex. 1997; 7: 374-385. PMID: 9177767
44. Spironelli C, Angrilli A. Developmental aspects of language lateralization in delta, theta, alpha and beta EEG bands. Biol Psychol. 2010; 85: 258-267. doi: 10.1016/j.biopsycho.2010.07.011 PMID: 20659528
45. Pfurtscheller G, Stancák A, Neuper C. Event-related synchronization (ERS) in the alpha band - an electrophysiological correlate of cortical idling: A review. Int J Psychophysiol. 1996; 24: 39-46. PMID: 8978434
46. Klimesch W. Alpha-band oscillations, attention, and controlled access to stored information. Trends Cogn Sci. 2012; 16: 606-617. doi: 10.1016/j.tics.2012.10.007 PMID: 23141428
47. Palva S, Palva JM. New vistas for alpha-frequency band oscillations. Trends Neurosci. 2007; 30: 150-8. doi: 10.1016/j.tins.2007.02.001 PMID: 17307258
48. Klimesch W. EEG alpha and theta oscillations reflect cognitive and memory performance: A review and analysis. Brain Res Rev. 1999; 29: 169-195. PMID: 10209231
49. Klimesch W, Doppelmayr M, Hanslmayr S. Upper alpha ERD and absolute power: Their meaning for memory performance. Prog Brain Res. 2006; 159: 151-165. doi: 10.1016/S0079-6123(06)59010-7 PMID: 17071229
50. Baccino T. Eye movements and concurrent event-related potentials': Eye fixation-related potential investigations in reading. In: Liversedge S, Gilchrist I, Everling S, editors. Oxford handbook of eye movements. Oxford, UK: Oxford University Press; 2011. pp. 857-870.
51. Dimigen O, Sommer W, Hohlfeld A, Jacobs AM, Kliegl R. Coregistration of eye movements and EEG in natural reading: Analyses and review. J Exp Psychol Gen. 2011; 140: 552-572. doi: 10.1037/a0023885 PMID: 21744985
52. Kliegl R, Dambacher M, Dimigen O, Jacobs AM, Sommer W. Eye movements and brain electric potentials during reading. Psychol Res. 2012; 76: 145-158. doi: 10.1007/s00426-011-0376-x PMID: 21915693
53. Frey A, Ionescu G, Lemaire B, López-Orozco F, Baccino T, Guérin-Dugué A. Decision-making in information seeking on texts: An eye-fixation-related potentials investigation. Front Syst Neurosci. 2013; 7. doi: 10.3389/fnsys.2013.00039 PMID: 23596400
54. Antonenko P, Niederhauser DS. The influence of leads on cognitive load and learning in a hypertext environment. Comput Human Behav. 2010; 26: 140-150. doi: 10.1016/j.chb.2009.10.014
55. Kretzschmar F, Pleimling D, Hosemann J, Füssel S, Bornkessel-Schlesewsky I, Schlesewsky M. Subjective impressions do not mirror online reading effort: Concurrent EEG-eyetracking evidence from the reading of books and digital media. PLoS One. 2013; 8: e56178. doi: 10.1371/journal.pone.0056178 PMID: 23405265
56. Antonenko P, Paas F, Grabner R, Gog T. Using electroencephalography to measure cognitive load. Educ Psychol Rev. 2010; 22: 425-438. doi: 10.1007/s10648-010-9130-y
57. Gerjets P, Walter C, Rosenstiel W, Bogdan M, Zander TO. Cognitive state monitoring and the design of adaptive instruction in digital environments: Lessons learned from cognitive workload assessment using a passive brain-computer interface approach. Front Neurosci. 2014; 8. doi: 10.3389/fnins.2014.00385 PMID: 24550770
58. Schneider W, Ennemoser M, Schlagmüller M. Lesegeschwindigkeits- und-Versta¨ndnistest für die Klassen 6-12 (LGVT 6-12). In: Hasselhorn M, Marx H, Schneider W, editors. Deutsche Schultests. Göttingen: Hogrefe; 2007.
59. Duggan GB, Payne SJ. Text skimming: The process and effectiveness of foraging through text under time pressure. J Exp Psychol Appl. 2009; 15: 228-242. doi: 10.1037/A0016995 PMID: 19751073
60. Jasper HH. The ten±twenty electrode system of the International Federation. Electroencephalogr Clin Neurophysiol. 1958; 10: 371-375.
61. Delorme A, Makeig S. EEGLAB: An open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J Neurosci Methods. 2004; 134: 9-21. doi: 10.1016/j.jneumeth.2003.10.009 PMID: 15102499
62. Pfurtscheller G, Zalaudek K, Neuper C. Event-related beta synchronization after wrist, finger and thumb movement. Electroencephalogr Clin Neurophysiol. 1998; 109: 154-160. doi: 10.1016/S0924-980X(97)00070-2 PMID: 9741806
63. Duncan CC, Barry RJ, Connolly JF, Fischer C, Michie PT, Na¨a¨ta¨nen R, et al. Event-related potentials in clinical research: Guidelines for eliciting, recording, and quantifying mismatch negativity, P300, and N400. Clin Neurophysiol. 2009; 120: 1883-1908. doi: 10.1016/j.clinph.2009.07.045 PMID: 19796989
64. Gevins A, Smith ME. Neurophysiological measures of cognitive workload during human-computer interaction. Theor Issues Ergon Sci. 2003; 4: 113-131. doi: 10.1080/14639220210159717
65. Smith ME, Gevins A, Brown H, Karnik A, Du R. Monitoring task loading with multivariate EEG measures during complex forms of Human-Computer Interaction. Hum Factors J Hum Factors Ergon Soc. 2001; 43: 366-380. doi: 10.1518/001872001775898287
66. Scheiter K, Gerjets P, Heise E. Distraction during learning with hypermedia: Difficult tasks help to keep task goals on track. Front Psychol. 2014; 5. doi: 10.3389/fpsyg.2014.00268 PMID: 24478738
67. Jakob Nielsen. F-shaped pattern for reading web content [Internet]. 2006 [cited 9 Apr 2015]. Available: http://www.nngroup.com/articles/f-shaped-pattern-reading-web-content/
68. Duggan GB, Payne SJ. Skim reading by satisficing: evidence from eye tracking. CHI '11 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. New York, NY: ACM; 2011. pp. 1141-1150.
69. Reader WR, Payne SJ. Texts: Sampling and satisficing. Human-Computer Interact. 2007; 22: 263-298.
70. Başar E, Güntekin B. A short review of alpha activity in cognitive processes and in cognitive impairment. Int J Psychophysiol. 2012; 86: 25-38. doi: 10.1016/j.ijpsycho.2012.07.001 PMID: 22801250
71. Stipacek A, Grabner RH, Neuper C, Fink A, Neubauer AC. Sensitivity of human EEG alpha band desynchronization to different working memory components and increasing levels of memory load. Neurosci Lett. Elsevier; 2003; 353: 193-196. doi: 10.1016/j.neulet.2003.09.044 PMID: 14665414
72. Strauß A, Kotz S, Scharinger M, Obleser J. Alpha and theta brain oscillations index dissociable processes in spoken word recognition. Neuroimage. 2014; 97: 387-395. doi: 10.1016/j.neuroimage.2014.04.005 PMID: 24747736
73. Mehta RK, Parasuraman R. Neuroergonomics: A review of applications to physical and cognitive work. Front Hum Neurosci. 2013; 7. doi: 10.3389/fnhum.2013.00889 PMID: 23372547
74. Parasuraman R, Wilson GF. Putting the brain to work: Neuroergonomics past, present, and future. Hum Factors. SAGE Publications; 2008; 50: 468-474. doi: 10.1518/001872008X288349
75. Parasuraman R. Neuroergonomics: Brain, cognition, and performance at work. Curr Dir Psychol Sci. 2011; 20: 181-186. doi: 10.1177/0963721411409176
76. Brouwer A- M, Hogervorst M, Holewijn M, van Erp JBF. Evidence for effects of task difficulty but not learning on neurophysiological variables associated with effort. Int J Psychophysiol. 2014; 93: 242-252. doi: 10.1016/j.ijpsycho.2014.05.004 PMID: 24841994
77. John M St., Kobus DA, Morrison JG, Schmorrow D. Overview of the DARPA augmented cognition technical integration experiment. Int J Hum Comput Interact. 2004; 17: 131-149.
78. Kruger J, Hefer E, Matthew G. Measuring the impact of subtitles on cognitive load: Eye tracking and dynamic audiovisual texts. Proceedings of the 2013 Conference on Eye Tracking South Africa. 2013. pp. 62-66.
79. Hong L, Walz JM, Sajda P. Your eyes give you away: Prestimulus changes in pupil diameter correlate with poststimulus task-related EEG dynamics. PLoS One. 2014; 9. doi: 10.1371/journal.pone.0091321
80. Kuipers J-R, Thierry G. N400 amplitude reduction correlates with an increase in pupil size. Front Hum Neurosci. 2010; 5: 1-5. doi: 10.3389/fnhum.2011.00061
81. Kuipers J-R, Thierry G. ERP-pupil size correlations reveal how bilingualism enhances cognitive flexibility. Cortex. 2013; 49: 2853-2860. doi: 10.1016/j.cortex.2013.01.012 PMID: 23453792
82. Murphy PR, Robertson IH, Balsters JH, O'Connell RG. Pupillometry and P3 index the locus coeruleusnoradrenergic arousal function in humans. Psychophysiology. 2011; 48: 1532-1543. doi: 10.1111/j.1469-8986.2011.01226.x PMID: 21762458
83. Fisk JE, Sharp CA. Age-related impairment in executive functioning: updating, inhibition, shifting, and access. J Clin Exp Neuropsychol. 2004; 26: 874-890. doi: 10.1080/13803390490510680 PMID: 15742539
84. Barkley RA. Behavioral inhibition, sustained attention, and executive functions: Constructing a unifying theory of ADHD. Psychol Bull. 1997; 121: 65-94. doi: 10.1037/0033-2909.121.1.65 PMID: 9000892
85. Reiter A, Tucha O, Lange KW. Executive functions in children with dyslexia. Dyslexia. 2005; 11: 116-131. doi: 10.1002/dys.289 PMID: 15918370