EEG-based workload estimation across affective contexts

Frontiers in Neuroscience

Volumn , Issue 8 JUN, 2014, Pages

  Mühl, Christian ^a   Jeunet, Camille ^a,b   Lotte, Fabien ^a,c  

^a INRIA   (France)

^b INSERM U657   (France)

^c UNIVERSITÉ BORDEAUX 1   (France)

Author keywords

Brain computer interface; Classification; Electroencephalography; Passive brain computer interface; Stress; Workload

Indexed keywords

ADULT; AFFECTIVE CONTEXT; ARTICLE; BRAIN COMPUTER INTERFACE; ELECTROCARDIOGRAM; ELECTRODERMAL RESPONSE; ELECTROENCEPHALOGRAM; ELECTROMYOGRAM; ELECTROOCULOGRAM; FEMALE; GALVANIC SKIN RESPONSE SENSOR; HUMAN; HUMAN COMPUTER INTERACTION; HUMAN EXPERIMENT; LEISURE; MALE; MENTAL STRESS; NERVOUS SYSTEM PARAMETERS; NEUROLOGICAL DIAGNOSTIC DEVICE; NEUROPHYSIOLOGY; NORMAL HUMAN; SELF CONCEPT; SELF EVALUATION; SIGNAL PROCESSING; SOCIAL STRESS; STATE TRAIT ANXIETY INVENTORY; WORKLOAD;

EID: 84905046766     PISSN: 16624548     EISSN: 1662453X     Source Type: Journal    
DOI: 10.3389/fnins.2014.00114     Document Type: Article

References (59)

1. Ang, K. K., Chin, Z. Y., Wang, C., Guan, C., and Zhang, H. (2012). Filter bank common spatial pattern algorithm on BCI competition IV datasets 2a and 2b. Front. Neurosci. 6:39. doi: 10.3389/fnins.2012.00039
2. Blankertz, B., Lemm, S., Treder, M., Haufe, S., and Müuller, K.-R. (2010). Single-trial analysis and classification of ERP components-a tutorial. Neuroimage 56, 814-825. doi: 10.1016/j.neuroimage.2010.06.048
3. Blankertz, B., Tomioka, R., Lemm, S., Kawanabe, M., and Müller, K. R. (2008). Optimizing spatial filters for robust EEG single-trial analysis. IEEE Signal Process. Mag. 25, 41-56. doi: 10.1109/MSP.2008.4408441
4. Boucsein, W. (ed.). (1992). "Electrodermal Indices of Emotion and Stress, chapter 3," in Electrodermal Activity (New York, NY: Springer), 369-391.
5. Bradley, M. M., and Lang, P. J. (1994). Measuring emotion: the self-assessment Manikin and the semantic differential. J. Behav. Ther. Exp. Psychiatry 25, 49-59. doi: 10.1016/0005-7916(94)90063-9
6. Brouwer, A. M., Hogervorst, M. A., van Erp, J. B. F., Heffelaar, T., Zimmerman, P. H., and Oostenveld, R. (2012). Estimating workload using EEG spectral power and ERPs in the n-back task. J. Neural Eng. 9:045008. doi: 10.1088/1741-2560/9/4/045008
7. Buchanan, T. W., Etze, J. A., Adolphs, R., and Tranel, D. (2006). The influence of autonomic arousal and semantic relatedness on memory for emotional words. Int. J. Psychophysiol. 61, 23-26. doi: 10.1016/j.ijpsycho.2005.10.022
8. Crost, N. W., Pauls, C. A., and Wacker, J. (2008). Defensiveness and anxiety predict frontal EEG asymmetry only in specific situational contexts. Biol. Psychol. 78, 43-52. doi: 10.1016/j.biopsycho.2007.12.008
9. Dickerson, S. S., and Kemeny, M. E. (2004). Acute stressors and cortisol responses: a theoretical integration and synthesis of laboratory research. Psychol. Bull. 130, 355-391. doi: 10.1037/0033-2909.130.3.355
10. Duda, R. O., Hart, P. E., and Stork, D. G. (2001). Pattern Recognition, 2nd Edn. New York, NY: Wiley-Interscience
11. Erp, J. B. F., Veltman, H. J., and Grootjen, M. (2010). "Brain-Based indices for user system symbiosis, chapter 12" in Brain-Computer Interfaces: Applying Our Minds to Human-Computer Interaction, eds D. S. Tan and A. Nijholt (London: Springer), 201-219.
12. Eysenck, M. W., and Derakshan, N. (2011). New perspectives in attentional control theory. Pers. Individ. Differ. 50, 955-960. doi: 10.1016/j.paid.2010.08.019
13. Fairclough, S. H., and Roberts, J. S. (2011). Effects of performance feedback on cardiovascular reactivity and frontal EEG asymmetry. Int. J. Psychophysiol. 81, 291-298. doi: 10.1016/j.ijpsycho.2011.07.012
14. Gevins, A., Smith, M., Leong, H., McEvoy, L., Whitfield, S., Du, R., et al. (1998). Monitoring working memory load during computer-based tasks with EEG pattern recognition methods. Hum. Factors 40, 79-91. doi: 10.1518/001872098779480578
15. Goncharova, I., McFarland, D., Vaughan, T., and Wolpaw, J. (2003). EMG contamination of EEG: spectral and topographical characteristics. Clin. Neurophysiol. 114, 1580-1593. doi: 10.1016/S1388-2457(03)00093-2
16. Grimes, D., Tan, D. S., Hudson, S. E., Shenoy, P., and Rao, R. P. (2008). "Feasibility and pragmatics of classifying working memory load with an electroencephalograph," in Proceedings of CHI 2008 (New York, NY: ACM Press), 835-844.
17. Hart, S. G., and Staveland, L. (1988). "Development of NASA-TLX (Task Load Index): results of empirical and theoretical research," in Human Mental Workload eds P. A. Hancock and N. Meshkati (Amsterdam: Elsevier), 139-183.
18. Hellhammer, J., and Schubert, M. (2012). The physiological response to trier social stress test relates to subjective measures of stress during but not before or after the test. Psychoneuroendocrinology 37, 119-124. doi: 10.1016/j.psyneuen.2011.05.012
19. Hewig, J., Schlotz, W., Gerhard, F., Breitenstein, C., Luerken, A., and Naumann, E. (2008). Associations of the cortisol awakening response (CAR) with cortical activation asymmetry during the course of an exam stress period. Psychoneuroendocrinology 33, 83-89. doi: 10.1016/j.psyneuen.2007.10.004
20. Hoffmann, U., Vesin, J., and Ebrahimi, T. (2006). "Spatial filters for the classification of event-related potentials," in European Symposium on Artificial Neural Networks (ESANN 2006) (Bruges).
21. Jensen, O., Gelfand, J., Kounios, J., and Lisman, J. E. (2002). Oscillations in the alpha band (9-12 Hz) increase with memory load during retention in a short-term memory task. Cereb. Cortex 12, 877-882. doi: 10.1093/cercor/12.8.877
22. Jensen, O., and Tesche, C. D. (2002). Frontal theta activity in humans increases with memory load in a working memory task. Eur. J. Neurosci. 15, 1395-1399. doi: 10.1046/j.1460-9568.2002.01975.x
23. Jeunet, C., Lotte, F., and Mühl, C. (2014). "Design and validation of a mental and social stress induction protocol towards load-invariant physiology-based stress detection," in International Conference on Physiological Computing Systems (Lisbon).
24. Julian, L. J. (2011). Measures of anxiety: state-trait anxiety inventory (STAI), beck anxiety inventory (BAI), and hospital anxiety and depression scale-anxiety (HADS-A). Arthritis Care Res. 63, S467-S472. doi: 10.1002/acr.20561
25. Kirchner, W. K. (1958). Age differences in short-term retention of rapidly changing information. J. Exp. Psychol. 55, 352-358. doi: 10.1037/h0043688
26. Kirschbaum, C., Pirke, K.-M., and Hellhammer, D. H. (1993). The "Trier Social Stress Test": a tool for investigating psychobiological stress responses in a laboratory setting. Neuropsychobiology 28, 76-81. doi: 10.1159/000119004
27. Krout, R. E. (2007). Music listening to facilitate relaxation and promote wellness: integrated aspects of our neurophysiological response to music. Arts Psychother. 34, 134-141. doi: 10.1016/j.aip.2006.11.001
28. Krusienski, D. J., Grosse-Wentrup, M., Galán, F., Coyle, D., Miller, K. J., Forney, E., et al. (2011). Critical issues in state-of-the-art brain-computer interface signal processing. J. Neural Eng. 8:25002. doi: 10.1088/1741-2560/8/2/025002
29. Lewis, R. S., Weekes, N. Y., and Wang, T. H. (2007). The effect of a naturalistic stressor on frontal EEG asymmetry, stress, and health. Biol. Psychol. 75, 224-239. doi: 10.1016/j.biopsycho.2007.03.004
30. Loggia, M. L., Juneau, M., and Bushnell, M. C. (2011). Autonomic responses to heat pain: heart rate, skin conductance, and their relation to verbal ratings and stimulus intensity. Pain 152, 592-598. doi: 10.1016/j.pain.2010.11.032
31. Lotte, F., Congedo, M., Lecuyer, A., Lamarche, F., and Arnaldi, B. (2007). A Review of classification algorithms for EEG-based brain-computer interfaces. J. Neural Eng. 4, R1-R13. doi: 10.1088/1741-2560/4/2/R01
32. Lotte, F., and Guan, C. (2010). "Learning from other subjects helps reducing brain-computer interface calibration time," in International Conference on Audio, Speech and Signal Processing (ICASSP'2010) (Dallas), 614-617. doi: 10.1109/ICASSP.2010.5495183
33. Lotte, F., Guan, C., and Ang, K. (2009). "Comparison of designs towards a subject-independent brain-computer interface based on motor imagery," in International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) 2009 (Minneapolis), 4543-4546. doi: 10.1109/IEMBS.2009.5334126
34. Lotte, F., Larrue, F., and Mühl, C. (2013). Flaws in current human training protocols for spontaneous brain-computer interfaces: lessons learned from instructional design. Front. Hum. Neurosci. 7:568. doi: 10.3389/fnhum.2013.00568
35. Mathan, S., Feyereisen, T., and Whitlow, S. (2007). "WorkSense: exploring the feasibility of human factors assessment using electrophysiological sensors," in Proceedings of ICACS (Santa Monica).
36. Müller-Putz, G. R., Scherer, R., Brunner, C., Leeb, R., and Pfurtscheller, G. (2008). Better than random? A closer look on BCI results. Int. J. Bioelectromagn. 10, 52-55.
37. Pan, S. J., and Yang, Q. (2010). A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 22, 1345-1359. doi: 10.1109/TKDE.2009.191
38. Peck, E. M. M., Yuksel, B. F., Ottley, A., Jacob, R. J., and Chang, R. (2013). "Using fNIRS brain sensing to evaluate information visualization interfaces," in Proceedings of CHI 2013 (New York, NY: ACM Press), 473-482.
39. Peng, H., Long, F., and Ding, C. (2005). Feature selection based on mutual information: criteria of max-dependency, max-relevance, and min-redundancy. IEEE Trans. Pattern Anal. Mach. Intell. 27, 1226-1238. doi: 10.1109/TPAMI.2005.159
40. Reinhardt, T., Schmahl, C., Wüst, S., and Bohus, M. (2012). Salivary cortisol, heart rate, electrodermal activity and subjective stress responses to the Mannheim Multicomponent Stress Test (MMST). Psychiatry Res. 198, 106-111. doi: 10.1016/j.psychres.2011.12.009
41. Renard, Y., Lotte, F., Gibert, G., Congedo, M., Maby, E., Delannoy, V., et al. (2010). OpenViBE: an open-source software platform to design, test, and use brain-computer interfaces in real and virtual environments. Presence Teleop. Virt. 19, 35-53. doi: 10.1162/pres.19.1.35
42. Reuderink, B., Mühl, C., and Poel, M. (2013). Valence, arousal and dominance in the EEG during game play. Int. J. Auton. Adapt. Commun. Syst. 6:45. doi: 10.1504/IJAACS.2013.050691
43. Reuderink, B., Poel, M., and Nijholt, A. (2011). The impact of loss of control on movement BCIs. IEEE Trans. Neural Syst. Rehab. Eng. 19, 628-637. doi: 10.1109/TNSRE.2011.2166562
44. Roy, R., Bonnet, S., Charbonnier, S., and Campagne, A. (2012). "Time-on-task effect on workload level discriminability through electroencephalography," in Proceedings of BIOMAG 2012 (Paris).
45. Schlögl, A., Keinrath, C., Zimmermann, D., Scherer, R., Leeb, R., and Pfurtscheller, G. (2007). A fully automated correction method of eog artifacts in eeg recordings. Clin. Neurophysiol. 118, 98-104. doi: 10.1016/j.clinph.2006.09.003
46. Selye, H. (1936). A syndrome produced by diverse nocuous agents. Nature 138:32. doi: 10.1038/138032a0
47. Sinha, R., Talih, M., Malison, R., Cooney, N., Anderson, G.-M., and Kreek, M.-J. (2003). Hypothalamic-pituitary-adrenal axis and sympatho-adreno-medullary responses during stress-induced and drug cue-induced cocaine craving states. Psychopharmacology 170, 62-72. doi: 10.1007/s00213-003-1525-8
48. Solovey, E., Schermerhorn, P., Scheutz, M., Sassaroli, A., Fantini, S., and Jacob, R. (2012). "Brainput: enhancing interactive systems with streaming fnirs brain input," in Proceedings of CHI 2012 (Austin, TX), 2193-2202.
49. Spielberger, C. D., Gorsuch, R. L., and Lushene, R. E. (1970). Manual for the State-Trait Anxiety Inventory. Palo Alto, CA: Consulting Psychologists Press.
50. Tangermann, M., Müller, K. R., Aertsen, A., Birbaumer, N., Braun, C., Brunner, C., et al. (2012). Review of the BCI competition IV. Front. Neurosci. 6:55. doi: 10.3389/fnins.2012.00055
51. Taniguchi, K., Nishikawa, A., Sugino, T., Aoyagi, S., Sekimoto, M., Takiguchi, S., et al. (2009). Method for Objectively Evaluating Psychological Stress Resulting When Humans Interact with Robots. China: InTech.
52. Tops, M., van Peer, J. M., Wester, A. E., Wijers, A. A., and Korf, J. (2006). State-dependent regulation of cortical activity by cortisol: an EEG study. Neurosci. Lett. 404, 34-39. doi: 10.1016/j.neulet.2006.05.038
53. van Erp, J., Lotte, F., and Tangermann, M. (2012). Brain-computer interfaces: beyond medical applications. IEEE Comput. 45, 26-34. doi: 10.1109/MC.2012.107
54. Verwey, W. B., and Veltman, H. A. (1984). Detecting short periods of elevated workload: a comparison of nine workload assessment techniques. J. Exp. Psychol. Appl. 2, 270-285. doi: 10.1037/1076-898X.2.3.270
55. Walter, C., Rosenstiel, S. S., W., Gerjets, P., and Bogdan, M. (2013). "Using cross-task classification for classifying workload levels in complex learning tasks," in Proceedings of ACII 2013 (Geneva), 876-881.
56. Zander, T., and Jatzev, S. (2012). Context-aware brain-computer interfaces: exploring the information space of user, technical system and environment. J. Neural Eng. 9:016003. doi: 10.1088/1741-2560/9/1/016003
57. Zander, T. O., and Kothe, C. (2011). Towards passive brain-computer interfaces: applying brain-computer interface technology to human-machine systems in general. J. Neural Eng. 8:025005. doi: 10.1088/1741-2560/8/2/025005
58. Zarjam, P., Epps, J., Chen, F., and Lovell, N. H. (2013). Estimating cognitive workload using wavelet entropy-based features during an arithmetic task. Comput. Biol. Med. 43, 2186-2195. doi: 10.1016/j.compbiomed.2013.08.021
59. Zijlstra, F. R. H. (1993). "Efficiency in Work Behaviour: A Design Approach for Modern Tools," Ph.D. thesis, Delft University of Technology.