Estimating workload using EEG spectral power and ERPs in the n-back task

Journal of Neural Engineering

Volumn 9, Issue 4, 2012, Pages

  Brouwer, Anne Marie ^a   Hogervorst, Maarten A ^a   Van Erp, Jan B F ^a   Heffelaar, Tobias ^b   Zimmerman, Patrick H ^b   Oostenveld, Robert ^c  

^a TNO   (Netherlands)

^b Noldus Information Technology bv   (Netherlands)

^c RADBOUD UNIVERSITY   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION ACCURACY; CLASSIFICATION MODELS; DATA SEGMENT; EVENT RELATED POTENTIALS; FUSION MODEL; MEMORY LOAD; MENTAL WORK; N-BACK TASK; SPECTRAL POWER; TRAINING AND TESTING;

ELECTROENCEPHALOGRAPHY; ESTIMATION;

COMPUTER SIMULATION;

ACCURACY; ADULT; ALPHA RHYTHM; ARTICLE; BRAIN COMPUTER INTERFACE; BRAIN ELECTROPHYSIOLOGY; CLASSIFICATION; COMPUTER LANGUAGE; ELECTROENCEPHALOGRAM; ELECTROOCULOGRAM; EVENT RELATED POTENTIAL; FEMALE; HUMAN; HUMAN EXPERIMENT; MALE; MEMORY; MODEL; NORMAL HUMAN; POWER SPECTRUM; PRIORITY JOURNAL; RESPONSE TIME; SIMULATION; STIMULUS RESPONSE; TASK PERFORMANCE; THETA RHYTHM; WORKLOAD;

ADULT; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FEMALE; HUMANS; MALE; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; WORKLOAD;

EID: 84864399874     PISSN: 17412560     EISSN: 17412552     Source Type: Journal    
DOI: 10.1088/1741-2560/9/4/045008     Document Type: Article

References (87)

1. Allison B Z and Polich J 2008 Workload assessment of computer gaming using a single-stimulus event-related potential paradigm Biol. Psychol. 77 277-83
2. Ayaz H, Izzetoglu M, Bunce S, Heiman-Patterson T and Onaral B 2007 Detecting cognitive activity related hemodynamic signal for brain computer interface using functional near infrared spectroscopy 3rd Int. IEEE/EMBS Conf. Neural Engineering (Kohala Coast, HI, USA) vol 2007 pp 342-5 (Pubitemid 47432230)
3. Bailey N R, Scerbo M W, Freeman F G, Mikulka P J and Scott L A 2006 Comparison of a brain-based adaptive system and a manual adaptable system for invoking automation Hum. Factors 48 693-709 (Pubitemid 46036199)
4. Berka C, Levendowski D J, Lumicao M N, Yau A, Davis G, Zivkovic V T, Olmstead R E, Tremoulet P D and Craven P L 2007 EEG correlates of task engagement and mental workload in vigilance, learning, and memory tasks Aviat. Space Environ. Med. 78 B231-44 (Pubitemid 46717231)
5. Blankertz B et al 2004 The BCI competition 2003: progress and perspectives in detection and discrimination of EEG single trials IEEE Trans. Biomed. Eng. 51 1044-51 (Pubitemid 38661460)
6. Blankertz B et al 2010 The Berlin brain-computer interface: non-medical uses of BCI technology Front. Neurosci. 4 198
7. Brookings J B, Wilson G F and Swain C R 1996 Psychophysiological responses to changes in workload during simulated air traffic control Biol. Psychol. 42 361-77 (Pubitemid 26068937)
8. Brouwer A-M, Hogervorst M A, Herman P and Kooi F 2009 Are you really looking? Finding the answer through fixation patterns and EEG (Lecture Notes in Artificial Intelligence vol 5638) Proc. 5th Int. Conf. on Foundations of Augmented Cognition (Berlin: Springer) pp 329-38
9. Christensen J C, Estepp J R, Wilson G F and Russell C A 2012 The effects of day-to-day variability of physiological data on operator state classification NeuroImage 59 57-63
10. Coffey E B J, Brouwer A-M, Wilschut E S and van Erp J B F 2010 Brain-machine interfaces in space: using spontaneous rather than intentionally generated brain signals Acta Astronaut. 67 1-11
11. Collet C, Averty P and Dittmar A 2009 Autonomic nervous system and subjective ratings of strain in air-traffic control Appl. Ergon. 40 23-32
12. Esposito F, Aragri A, Piccoli T, Tedeschi G, Goebel R and Di Salle F 2009 Distributed analysis of simultaneous EEG-fMRI time-series: modeling and interpretation issues Magn. Reson. Imaging 27 1120-30
13. Evans J L, Selinger C and Pollak S D 2011 P300 as a measure of processing capacity in auditory and visual domains in specific language impairment Brain Res. 1389 93-102
14. Farwell L A and Donchin E 1988 Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials Electroencephalogr. Clin. Neurophysiol. 70 510-23
15. Fink A, Grabner R H, Neuper C and Neubauer A C 2005 EEG alpha band dissociation with increasing task demands Cogn. Brain Res. 24 252-9 (Pubitemid 40922633)
16. Fournier L R, Wilson G F and Swain C R 1999 Electrophysiological, behavioral, and subjective indexes of workload when performing multiple tasks: manipulations of task difficulty and training Int. J. Psychophysiol. 31 129-45 (Pubitemid 29049405)
17. Foxe J J, Simpson G V and Ahlfors S P 1998 Parieto-occipital ∼10 Hz activity reflects anticipatory state of visual attention mechanisms Neuroreport 9 3929-33 (Pubitemid 29189329)
18. Gevins A, Smith M E, Leong H, McEvoy L, Whitfield S, Du R and Rush G 1998 Monitoring working memory load during computer-based tasks with EEG pattern recognition methods Hum. Factors 40 79-91 (Pubitemid 28194524)
19. Grimes D, Tan D S, Hudson S E, Shenoy P and Rao R P 2008 Feasibility and pragmatics of classifying working memory load with an electroencephalograph Proc. 26th Annu. SIGCHI Conf. on Human Factors in Computing Systems, ACM (Florence, Italy) pp 835-44
20. Gundel A and Wilson G F 1992 Topographical changes in the ongoing EEG related to the difficulty of mental task Brain Topogr. 5 17-25
21. Hancock P A, Meshkati N and Robertson M M 1985 Physiological reflections of mental workload Aviat. Space Environ. Med. 56 1110-4 (Pubitemid 16214701)
22. Hart S G and Staveland L E 1988 Development of a multi-dimensional workload rating scale: results of empirical and theoretical research Human Mental Workload ed P A Hancock and N Meshkati (Amsterdam: Elsevier) pp 139-83
23. Izzetoglu M, Bunce S C, Izzetoglu K, Onaral B and Pourrezaei A K 2007 Functional brain imaging using near-infrared technology IEEE Eng. Med. Biol. Mag. 26 38-46 (Pubitemid 350194208)
24. Jann K, Dierks T, Boesch C, Kottlow M, Strik W and Koenig T 2009 BOLD correlates of EEG alpha phase-locking and the fMRI default mode network Neuroimage 45 903-16
25. Jensen O, Gelfand J, Kounios J and Lisman J E 2002 Oscillations in the alpha band (9-12 Hz) increase with memory load during retention in a short-term memory task Cereb. Cortex 12 877-82 (Pubitemid 34803887)
26. Jensen O and Tesche C D 2002 Frontal theta activity in humans increases with memory load in a working memory task Eur. J. Neurosci. 15 1395-9 (Pubitemid 35478001)
27. Kalsbeek J W H and Ettema J 1963 Scored regularity of the heart rate pattern and the measurement of perceptual or mental load Ergonomics 6 306
28. Kantowitz B H 1988 Mental workload Human Factors Psychology ed P A Hancock (Amsterdam: Elsevier)
29. Keil A, Mussweiler T and Epstude K 2006 Alpha-band activity reflects reduction of mental effort in a comparison task: a source space analysis Brain Res. 1121 117-27 (Pubitemid 44708880)
30. Kida T et al 2004 Resource allocation and somatosensory P300 amplitude during dual task: effects of tracking speed and predictability of tracking direction Clin. Neurophysiol. 115 2616-28 (Pubitemid 39304156)
31. Kirchner W K 1958 Age differences in short-term retention of rapidly changing information J. Exp. Psychol. 55 352-8
32. Klimesch W 1996 Memory processes, brain oscillations and EEG synchronization Int. J. Psychophysiol. 24 61-100 (Pubitemid 27013763)
33. Klimesch W 1997 EEG-alpha rhythms and memory processes Int. J. Psychophysiol. 26 319-40 (Pubitemid 27277703)
34. Klimesch W 1999 EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis Brain Res. Rev. 29 169-95 (Pubitemid 29191338)
35. Klimesch W, Doppelmayr M, Röhm D, Pöllhuber D and Stadler W 2000 Simultaneous desynchronization and synchronization of different alpha responses in the human electroencephalograph: a neglected paradox? Neurosci. Lett. 284 97-100 (Pubitemid 30193208)
36. Kok A 2001 On the utility of P3 amplitude as a measure of processing capacity Psychophysiology 38 557-77 (Pubitemid 32422300)
37. Kramer A F, Trejo L J and Humphrey D 1995 Assessment of mental workload with task-irrelevant auditory probes Biol. Psychol. 40 83-100
38. Laine T I, Bauer K W Jr, Lanning J W, Russell C A and Wilson G F 2002 Selection of input features across subjects for classifying crewmember workload using artificial neural networks IEEE Trans. Syst. Man Cybern. Part A, Syst. Hum. 32 691-704
39. Laufs H, Krakow K, Sterzer P, Eger E, Beyerle A, Salek-Haddadi A and Kleinschmidt A 2003 Electroencephalographic signatures of attentional and cognitive default modes in spontaneous brain activity fluctuations at rest Proc. Natl Acad. Sci. USA 100 11053-8 (Pubitemid 37140151)
40. Lotte F, Congedo M, Lécuyer A, Lamarche F and Arnaldi B 2007 A review of classification algorithms for EEG-based brain-computer interfaces J. Neural Eng. 4 R1-13
41. Missonnier P, Deiber M P, Gold G, Herrmann F R, Millet P, Michon A, Fazio-Costa L, Ibañez V and Giannakopoulos P 2007 Working memory load-related electroencephalographic parameters can differentiate progressive from stable mild cognitive impairment Neuroscience 150 346-56 (Pubitemid 350198709)
42. Missonnier P, Gold G, Leonards U, Costa-Fazio L, Michel J-P, Ibáñez V and Giannakopoulos P 2004 Aging and working memory: early deficits in EEG activation of posterior cortical areas J. Neural Trans. 111 1141-54 (Pubitemid 39222774)
43. Missonnier P, Leonards U, Gold G, Palix J, Ibáñez V and Giannakopoulos P 2003 A new electrophysiological index for working memory load in humans Neuroreport 14 1451-5 (Pubitemid 37083126)
44. Miyata Y, Tanaka Y and Hono T 1990 Long term observation on Fm-theta during mental effort Neuroscience 16 145-8
45. Moore D J, Keogh E and Eccleston C 2009 Identifying experimental methods to determine the effect of pain on attention: a review of pain, caffeine, alcohol and nicotine studies Human Psychopharmacology 24 601-18
46. Moroney W F, Biers D W and Eggemeier F T 1995 Some measurement and methodological considerations in the application of subjective workload measurement techniques Int. J. Aviat. Psychol. 5 87-106
47. Müller K-R, Krauledat M, Dornhege G, Curio G and Blankertz B 2004 Machine learning techniques for brain-computer interfaces Biomed. Tech. 49 11-22
48. Nygren T E 1991 Psychometric properties of subjective workload measurement techniques: implications for their use in the assessment of perceived mental workload Hum. Factors 33 17-33
49. O'Donnell R D and Eggemeier F T 1986 Workload assessment methodology Handbook of Perception and Human Performance ed K Boff, L Kaufman and J P Thomas (New York: Wiley) pp 42.1-44.49
50. Oostenveld R, Fries P, Maris E and Schoffelen J M 2011 FieldTrip: open source software for advanced analysis of MEG, EEG, and invasive electrophysiological data Comput. Intell. Neurosci. 2011 156869
51. Owen A M, McMillan K M, Laird A R and Bullmore E 2005 N-back working memory paradigm: a meta-analysis of normative functional neuroimaging studies Hum. Brain Mapp. 25 46-59 (Pubitemid 40656192)
52. Parasuraman R and Wilson G F 2008 Putting the brain to work: neuroergonomics past, present, and future Hum. Factors 50 468-74 (Pubitemid 352029807)
53. Pfurtscheller G, Neuper C and Berger J 1994 Source localization using event related desynchronization (ERD) within the alpha band Brain Topogr. 6 269-75 (Pubitemid 24243623)
54. Pfurtscheller G, Stancak A Jr and Neuper C 1996 Event-related synchronization (ERS) in the alpha band: an electrophysiological correlate of cortical idling [review] Int. J. Psychophysiol. 24 39-46
55. Polich J 2007 Updating P300: an integrative theory of P3a and P3b Clin. Neurophysiol. 118 2128-48 (Pubitemid 47385341)
56. Polich J and Kok A 1995 Cognitive and biological determinants of P300: an integrative review Biol. Psychol. 41 103-46
57. Pratt N, Willoughby A and Swick D 2011 Effects of working memory load on visual selective attention: behavioral and electrophysiological evidence Front. Hum. Neurosci. 5 57
58. Prinzel L J, Pope A T, Freeman F G, Scerbo M W and Mikulka P J 2001 Empirical analysis of EEG and ERPs for psychophysiological adaptive task allocation NASA Technical Report TM-2001-211016
59. Raabe M, Rutschmann R M, Schrauf M and Greenlee M W 2005 Neural correlates of simulated driving: auditory oddball responses dependent on workload Foundations of Augmented Cognition ed D D Schmorrow (Mahwah, NJ: Lawrence Erlbaum Associates) pp 1067-76
60. Raghavachari S, Kahana M J, Rizzuto D S, Caplan J B, Kirschen M P, Bourgeois B, Madsen J R and Lisman J E 2001 Gating of human theta oscillations by a working memory task J. Neurosci. 21 3175-83 (Pubitemid 32323499)
61. Ray W J and Cole H W 1985 EEG activity during cognitive processing: influence of attentional factors Int. J. Psychophysiol. 3 43-8 (Pubitemid 15018952)
62. Rösler F, Heil M and Röder B 1997 Slow negative brain potentials as reflections of specific modular resources of cognition Biol. Psychol. 45 109-41 (Pubitemid 27110540)
63. Ruchkin D S, Johnson R Jr, Canoune H and Ritter W 1990 Short-term memory storage and retention: an event-related brain potential study Electroencephalogr. Clin. Neurophysiol. 76 419-39 (Pubitemid 20370125)
64. Schmorrow D, Estabrooke I V and Grootjen M 2009 Foundations of augmented cognition 5th Int. Conf. on Neuroergonomics and Operational Neuroscience (San Diego, CA, USA, July 19-24 2009) (Berlin: Springer)
65. Serby H, Yom-Tov E and Inbar G F 2005 An improved P300-based brain-computer interface IEEE Trans. Neural Syst. Rehabil. Eng. 13 89-98 (Pubitemid 40469226)
66. Sterman M B, Mann C A, Kaiser D A and Suyenobu B Y 1994 Multiband topographic EEG analysis of a simulated visuomotor aviation task Int. J. Psychophysiol. 16 49-56 (Pubitemid 24074498)
67. Taylor G, Reinerman-Jones L E, Cosenzo K and Nicholson D 2010 Comparison of multiple physiological sensors to classify operator state in adaptive automation systems Proc. 54th Annu. Meeting of the Human Factors and Ergonomics Society (HFES) pp 195-9
68. Ullsperger P, Freude G and Erdmann U 2001 Auditory probe sensitivity to mental workload changes - an event-related potential study Int. J. Psychophysiol. 40 201-9 (Pubitemid 32157070)
69. van Dijk H, Schoffelen J M, Oostenveld R and Jensen O 2008 Pre-stimulus oscillatory activity in the alpha band predicts visual discrimination ability J. Neurosci. 28 1816-23 (Pubitemid 351302670)
70. van Erp J B F, Veltman J A and Grootjen M 2010 Brain-based indices for user system symbiosis Brain-Computer Interfaces, Human-Computer Interaction Series ed D S Tan and A Nijholt (London: Springer) pp 201-19
71. van Gerven M et al 2009a The brain-computer interface cycle J. Neural Eng. 6 041001
72. van Gerven M, Hesse C, Jensen O and Heskes T 2009b Interpreting single trial data using groupwise regularisation Neuroimage 46 665-76
73. Veltman J A and Gaillard A W K 1996 Physiological indices of workload in a simulated flight task Biol. Psychol. 42 323-42 (Pubitemid 26068935)
74. Veltman J A and Gaillard A W K 1998 Physiological workload reactions to increasing levels of task difficulty Ergonomics 41 656-669 (Pubitemid 28211755)
75. Verwey W B and Veltman H A 1996 Detecting short periods of elevated workload: a comparison of nine workload assessment techniques J. Exp. Psychol. 2 270-85 (Pubitemid 126450533)
76. Vogt J, Adolph L, Ayan T, Udovic A and Kastner M 2002 Stress in modern air traffic control systems and potential influences on memory Human Factors and Aerospace Safety 2 355-78
77. Vogt J, Hagemann T and Kastner M 2006 The impact of workload on heart rate and blood pressure in en-route and tower air traffic control J. Psychophysiol. 20 297-314 (Pubitemid 44741771)
78. Watter S, Geffen G M and Geffen L B 2001 The n-back as a dual-task: P300 morphology under divided attention Psychophysiology 38 998-1003 (Pubitemid 33108366)
79. Wild-Wall N, Falkenstein M and Gajewski P D 2011 Age-related differences in working memory performance in a 2-back task Front Psychol. 2 186
80. Wilson G F and Eggemeier F T 1991 Physiological measures of workload in multi-task environments Multipletask Performance ed D Damos (London: Taylor and Francis) pp 329-60
81. Wilson G F and Fisher F 1995 Cognitive task classification based on topographic EEG data Biol. Psychol. 40 239-50
82. Wilson G F and Russell C A 2003 Operator functional state classification using multiple psychophysiological features in a simulated air traffic control task Hum. Factors 45 381-9 (Pubitemid 37509591)
83. Wilson G F and Russell C A 2007 Performance enhancement in a UAV task using psychophysiological determined adaptive aiding Hum. Factors 49 1005-19
84. Zander T O and Kothe C 2011 Towards passive brain-computer interfaces: applying brain-computer interface technology to human-machine systems in general J. Neural Eng. 8 025005
85. Zander T O, Lehne M, Ihme K, Jatzev S, Correia J, Kothe C, Picht B and Nijboer F 2011 A dry EEG-system for scientific research and brain-computer interfaces Front. Neurosci. 5 53
86. Zijlstra F R H 1993 Efficiency in work behaviour: a design approach for modern tools PhD thesis Delft University of Technology (Delft: Delft University Press)
87. Zimmerman P H, Bolhuis J E, Willemsen A, Meyer E S and Noldus L P J J 2009 The Observer XT: a tool for the integrations and synchronization of multimodal signals Behav. Res. Methods 41 731-5