In silico vs. over the clouds: On-the-fly mental state estimation of aircraft pilots, using a functional near infrared spectroscopy based passive-BCI

Frontiers in Human Neuroscience

Volumn 12, Issue , 2018, Pages

  Gateau, Thibault ^a   Ayaz, Hasan ^b   Dehais, Frédéric ^a  

^a UNIVERSITÉ DE TOULOUSE   (France)

^b DREXEL UNIVERSITY   (United States)

Author keywords

BCI; fNIRS; Neuroergonomics; Prefrontal cortex; Simulated and real flight; Working memory

Indexed keywords

ACCURACY; ADULT; AIRPLANE PILOT; ARTICLE; BRAIN COMPUTER INTERFACE; BRAIN FUNCTION; COMPUTER SIMULATION; CONTROLLED STUDY; ELECTROENCEPHALOGRAM; FEMALE; FLIGHT; FUNCTIONAL NEAR-INFRARED SPECTROSCOPY; HUMAN; HUMAN EXPERIMENT; MALE; MENTAL HEALTH; MENTAL LOAD; MENTAL PERFORMANCE; NORMAL HUMAN; ONLINE MONITORING; PREFRONTAL CORTEX; RECALL; SUPPORT VECTOR MACHINE; TASK PERFORMANCE; WORKING MEMORY; YOUNG ADULT;

EID: 85052819674     PISSN: None     EISSN: 16625161     Source Type: Journal    
DOI: 10.3389/fnhum.2018.00187     Document Type: Article

References (99)

1. Anderson, M. J. (2001). A new method for non-parametric multivariate analysis of variance. Austral Ecol. 26, 32-46. doi: 10.1111/j.1442-9993.2001.01070.pp.x
2. Appel, G. (2005). Technical Analysis: Power Tools for Active Investors. FT Press.
3. Aricò, P., Borghini, G., Di Flumeri, G., Colosimo, A., Pozzi, S., and Babiloni, F. (2016). A passive brain-computer interface application for the mental workload assessment on professional air traffic controllers during realistic air traffic control tasks. Prog. Brain Res. 228, 295-328. doi: 10.1016/bs.pbr.2016.04.021
4. Ayaz, H., and Onaral, B. (2005). Analytical Software and Stimulus-Presentation Platform to Utilize, Visualize and Analyze Near-Infrared Spectroscopy Measures. Master’s thesis, Master’s Degree Thesis, Drexel University.
5. Ayaz, H., Onaral, B., Izzetoglu, K., Shewokis, P. A., McKendrick, R., and Parasuraman, R. (2013). Continuous monitoring of brain dynamics with functional near infrared spectroscopy as a tool for neuroergonomic research: empirical examples and a technological development. Front. Hum. Neurosci. 7:871. doi: 10.3389/fnhum.2013.00871
6. Ayaz, H., Shewokis, P. A., Bunce, S., Izzetoglu, K., Willems, B., and Onaral, B. (2012). Optical brain monitoring for operator training and mental workload assessment. Neuroimage 59, 36-47. doi: 10.1016/j.neuroimage.2011.06.023
7. Ayaz, H., Shewokis, P. A., Curtin, A., Izzetoglu, M., Izzetoglu, K., and Onaral, B. (2011). Using mazesuite and functional near infrared spectroscopy to study learning in spatial navigation. J. Vis. Exp. e3443. doi: 10.3791/3443
8. Baddeley, A. (1992). Working memory. Science 255, 556-559.
9. Batula, A. M., Kim, Y. E., and Ayaz, H. (2017). Virtual and actual humanoid robot control with four-class motor-imagery-based optical brain-computer interface. BioMed. Res. Int. 2017:1463512. doi: 10.1155/2017/1463512
10. Billings, C. E., and Cheaney, E. S. (1981). Information Transfer Problems in the Aviation System. NASA Technical Report 1875, 89-90.
11. Blankertz, B., Tangermann, M., Vidaurre, C., Fazli, S., Sannelli, C., Haufe, S., et al. (2010). The berlin brain-computer interface: non-medical uses of bci technology. Front. Neurosci. 4:198. doi: 10.3389/fnins.2010.00198
12. Borghini, G., Aricò, P., Di Flumeri, G., Cartocci, G., Colosimo, A., Bonelli, S., et al. (2017). EEG-based cognitive control behaviour assessment: an ecological study with professional air traffic controllers. Sci. Rep. 7:547. doi: 10.1038/s41598-017-00633-7
13. Brouwer, A.-M., Hogervorst, M. A., Van Erp, J. B., Heffelaar, T., Zimmerman, P. H., and Oostenveld, R. (2012). Estimating workload using eeg spectral power and erps in the n-back task. J. Neural Eng. 9:045008. doi: 10.1088/1741-2560/9/4/045008
14. Brouwer, A.-M., Van Erp, J., Heylen, D., Jensen, O., and Poel, M. (2013). “Effortless passive bcis for healthy users,” in Universal Access in Human-Computer Interaction. Design Methods, Tools, and Interaction Techniques for eInclusion, Vol. 8009 (Berlin; Heidelberg; Vancouver: Springer), 615-622.
15. Çakır, M. P., Vural, M., Koç, S. Ö., and Toktaş, A. (2016). “Real-time monitoring of cognitive workload of airline pilots in a flight simulator with fnir optical brain imaging technology,” in International Conference on Augmented Cognition (Springer), 147-158.
16. Callan, D. E., Durantin, G., and Terzibas, C. (2015). Classification of single-trial auditory events using dry-wireless eeg during real and motion simulated flight. Front. Syst. Neurosci. 9:11. doi: 10.3389/fnsys.2015.00011
17. Callan, D. E., Terzibas, C., Cassel, D. B., Sato, M.-A., and Parasuraman, R. (2016). The brain is faster than the hand in split-second intentions to respond to an impending hazard: a simulation of neuroadaptive automation to speed recovery to perturbation in flight attitude. Front. Hum. Neurosci. 10:187. doi: 10.3389/fnhum.2016.00187
18. Causse, M., Dehais, F., Arexis, M., and Pastor, J. (2011a). Cognitive aging and flight performances in general aviation pilots. Aging Neuropsychol. Cogn. 18, 544-561. doi: 10.1080/13825585.2011.586018
19. Causse, M., Dehais, F., and Pastor, J. (2011b). Executive functions and pilot characteristics predict flight simulator performance in general aviation pilots. Int. J. Aviat. Psychol. 21, 217-234. doi: 10.1080/10508414.2011.582441
20. Causse, M., Dehais, F., Péran, P., Sabatini, U., and Pastor, J. (2013). The effects of emotion on pilot decision-making: a neuroergonomic approach to aviation safety. Transport. Res. Part C Emerg. Technol. 33, 272-281. doi: 10.1016/j.trc.2012.04.005
21. Chad, S., Dehais, F., Roy, N. R., Harrivel, A., Last, M. C., Kennedy, K., et al. (2018). Biocybernetic Adaptation Strategies: Machine Awareness of Human Engagement for Improved Operational Performance, in HCI Conference (Las Vegas).
22. Combrisson, E., and Jerbi, K. (2015). Exceeding chance level by chance: the caveat of theoretical chance levels in brain signal classification and statistical assessment of decoding accuracy. J. Neurosci. Methods 250, 126-136. doi: 10.1016/j.jneumeth.2015.01.010
23. Cortes, C., and Vapnik, V. (1995). Support-vector networks. Mach. Learn. 20, 273-297.
24. Cui, X., Bray, S., and Reiss, A. L. (2010). Speeded near infrared spectroscopy (NIRS) response detection. PLoS ONE 5:e15474. doi: 10.1371/journal.pone.0015474
25. Cutrell, E., and Tan, D. (2008). BCI for passive input in HCI. in Proc. CHI 8, 1-3.
26. Dahlstrom, N., and Nahlinder, S. (2009). Mental workload in aircraft and simulator during basic civil aviation training. Int. J. Aviat. Psychol. 19, 309-325. doi: 10.1080/10508410903187547
27. Davranche, K., Casini, L., Arnal, P. J., Rupp, T., Perrey, S., and Verges, S. (2016). Cognitive functions and cerebral oxygenation changes during acute and prolonged hypoxic exposure. Physiol. Behav. 164, 189-197. doi: 10.1016/j.physbeh.2016.06.001
28. Dehais, F., Behrend, J., Peysakhovich, V., Causse, M., and Wickens, C. D. (2017). Pilot flying and pilot monitoring aircraft state awareness during go-around execution in aviation: a behavioral and eye tracking study. Int. J. Aerospace Psychol. 27, 15-28. doi: 10.1080/10508414.2017.1366269
29. Delpy, D. T., Cope, M., Van der Zee, P., Arridge, S., Wray, S., and Wyatt, J. (1988). Estimation of optical pathlength through tissue from direct time of flight measurement. Phys. Med. Biol. 33:1433.
30. Dijksterhuis, C., de Waard, D., Brookhuis, K., Mulder, B., and de Jong, R. (2013). Classifying visuomotor workload in a driving simulator using subject specific spatial brain patterns. Front. Neurosci. 7:149. doi: 10.3389/fnins.2013.00149
31. Durantin, G., Gagnon, J.-F., Tremblay, S., and Dehais, F. (2014a). Using near infrared spectroscopy and heart rate variability to detect mental overload. Behav. Brain Res. 259, 16-23. doi: 10.1016/j.bbr.2013.10.042
32. Durantin, G., Scannella, S., Gateau, T., Delorme, A., and Dehais, F. (2014b). “Moving average convergence divergence filter preprocessing for real-time event-related peak activity onset detection: Application to fnirs signals,” in Engineering in Medicine and Biology Society (EMBC), 2014 36th Annual International Conference of the IEEE (Chicago, IL: IEEE), 2107-2110.
33. Durantin, G., Scannella, S., Gateau, T., Delorme, A., and Dehais, F. (2015). Processing functional near infrared spectroscopy signal with a kalman filter to assess working memory during simulated flight. Front. Hum. Neurosci. 9:707. doi: 10.3389/fnhum.2015.00707
34. Frey, J., Hachet, M., and Lotte, F. (2017). EEG-based neuroergonomics for 3D user interfaces: opportunities and challenges. Le travail humain. 80, 73-92.
35. Gagnon, J.-F., Durantin, G., Vachon, F., Causse, M., Tremblay, S., and Dehais, F. (2012). “Anticipating human error before it happens: towards a psychophysiological model for online prediction of mental workload,” in Proceedings of the Human Factors and Ergonomics Society Chapter Europe.
36. Gateau, T., Durantin, G., Lancelot, F., Scannella, S., and Dehais, F. (2015). Real-time state estimation in a flight simulator using fNIRS. PLoS ONE 10:e0121279. doi: 10.1371/journal.pone.0121279
37. Gateau, T., P. Carvalho Chanel, C., Le, M.-H., and Dehais, F. (2016). “Considering human’s non-deterministic behavior and his availability state when designing a collaborative human-robots system,” in 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (Daejeon: IEEE).
38. George, L., and Lécuyer, A. (2010). “An overview of research on” passive” brain-computer interfaces for implicit human-computer interaction,” in International Conference on Applied Bionics and Biomechanics ICABB 2010-Workshop W1” Brain-Computer Interfacing and Virtual Reality (Venice).
39. Girouard, A., Solovey, E. T., and Jacob, R. J. (2013). Designing a passive brain computer interface using real time classification of functional near-infrared spectroscopy. Inte. J. Auton. Adapt. Commun. Syst. 6, 26-44. doi: 10.1504/IJAACS.2013.050689
40. Gramann, K., Fairclough, S. H., Zander, T. O., and Ayaz, H. (2017). Editorial: trends in neuroergonomics. Front. Hum. Neurosci. 11:165. doi: 10.3389/fnhum.2017.00165
41. Herff, C., Heger, D., Fortmann, O., Hennrich, J., Putze, F., and Schultz, T. (2014). Mental workload during n-back task?quantified in the prefrontal cortex using fNIRS. Front. Hum. Neurosci. 7:935. doi: 10.3389/fnhum.2013.00935.
42. Hirshfield, L. M., Gulotta, R., Hirshfield, S., Hincks, S., Russell, M., Ward, R., et al. (2011). “This is your brain on interfaces: enhancing usability testing with functional near-infrared spectroscopy,” in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (ACM), 373-382.
43. Hong, K.-S. and Naseer, N. (2016). Reduction of delay in detecting initial dips from functional near-infrared spectroscopy signals using vector-based phase analysis. Int. J. Neural syst. 26:1650012. doi: 10.1142/S012906571650012X
44. Hu, X.-S., Hong, K.-S., and Ge, S. S. (2012). fNIRS-based online deception decoding. J. Neural Eng. 9:026012. doi: 10.1088/1741-2560/9/2/026012
45. Huppert, T. J., Diamond, S. G., Franceschini, M. A., and Boas, D. A. (2009). Homer: a review of time-series analysis methods for near-infrared spectroscopy of the brain. Appl. Opt. 48, D280-D298. doi: 10.1364/AO.48.00D280
46. Izzetoglu, K., Bunce, S., Onaral, B., Pourrezaei, K., and Chance, B. (2004). Functional optical brain imaging using near-infrared during cognitive tasks. Int. J. Hum. Comput. Interact. 17, 211-227. doi: 10.1207/s15327590ijhc1702_6
47. Jasdzewski, G., Strangman, G., Wagner, J., Kwong, K., Poldrack, R., and Boas, D. (2003). Differences in the hemodynamic response to event-related motor and visual paradigms as measured by near-infrared spectroscopy. Neuroimage 20, 479-488. doi: 10.1016/S1053-8119(03)00311-2
48. Kanoh, S., Murayama, Y.-M., Miyamoto, K.-I., Yoshinobu, T., and Kawashima, R. (2009). “A NIRS-based brain-computer interface system during motor imagery: System development and online feedback training,” in 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society (Minneapolis: IEEE), 594-597.
49. Kato, T., Kamei, A., Takashima, S., and Ozaki, T. (1993). Human visual cortical function during photic stimulation monitoring by means of near-infrared spectroscopy. J. Cereb. Blood Flow Metab. 13, 516-520.
50. Kawashima, R., Matsumoto, T., and Tanimoto, Y. (2014). Cortical activity while riding motorcycles measured with a wearable near infrared topography system. Int. J. Automot. Eng. 5, 77-83. doi: 10.20485/jsaeijae.5.2_77
51. Khan, M. J., Hong, M. J., and Hong, K.-S. (2014). Decoding of four movement directions using hybrid NIRS-EEG brain-computer interface. Front. Hum. Neurosci. 8:244. doi: 10.3389/fnhum.2014.00244
52. Kikukawa, A., Kobayashi, A., and Miyamoto, Y. (2008). Monitoring of pre-frontal oxygen status in helicopter pilots using near-infrared spectrophotometers. Dyn. Med. 7:10. doi: 10.1186/1476-5918-7-10
53. Kohlmorgen, J., Dornhege, G., Braun, M., Blankertz, B., Müller, K.-R., Curio, G., et al. (2007). “Improving human performance in a real operating environment through real-time mental workload detection,” in Toward Brain-Computer Interfacing (Cambridge, MA: MIT press), 409-422.
54. Kubler, A., Mushahwar, V., Hochberg, L. R., and Donoghue, J. P. (2006). BCI meeting 2005-workshop on clinical issues and applications. IEEE Trans. Neural Syst. Rehabil. Eng. 14, 131-134. doi: 10.1109/TNSRE.2006.875585
55. León-Domínguez, U., Martín-Rodríguez, J. F., and León-Carrión, J. (2015). Executive n-back tasks for the neuropsychological assessment of working memory. Behav. Brain Res. 292, 167-173. doi: 10.1016/j.bbr.2015.06.002
56. Li, C., Gong, H., Zeng, S., and Luo, Q. (2005). Verbal Working Memory Load Affects Prefrontal Cortices Activation: Evidence from a Functional Nirs Study in Humans (San Diego, CA: In SPIE Conference on Optics and Photonics), 33-40.
57. Luo, Q., Zeng, S., Chance, B., and Nioka, S. (2002). “Monitoring of brain activity with near-infrared spectroscopy,” in Handbook of Optical Biomedical Diagnostics (Bellingham, WA: SPIE Press), 455-486. doi: 10.1117/3.2219603.ch8
58. Mackey, J. R., Harrivel, A. R., Adamovsky, G., Lewandowski, B. E., Gotti, D. J., Tin, P., et al. (2013). “Effects of varying gravity levels on fnirs headgear performance and signal recovery,” in The American Institute of Aeronautics and Astronautics (Boston, MA).
59. McKendrick, R., Ayaz, H., Olmstead, R., and Parasuraman, R. (2014). Enhancing dual-task performance with verbal and spatial working memory training: continuous monitoring of cerebral hemodynamics with NIRS. Neuroimage 85, 1014-1026. doi: 10.1016/j.neuroimage.2013.05.103
60. McKendrick, R., Parasuraman, R., and Ayaz, H. (2015). Wearable functional near infrared spectroscopy (fnirs) and transcranial direct current stimulation (tdcs): expanding vistas for neurocognitive augmentation. Front. Syst. Neurosci. 9:27. doi: 10.3389/fnsys.2015.00027
61. McKendrick, R., Parasuraman, R., Murtza, R., Formwalt, A., Baccus, W., Paczynski, M., et al. (2016). Into the wild: neuroergonomic differentiation of hand-held and augmented reality wearable displays during outdoor navigation with functional near infrared spectroscopy. Front. Hum. Neurosci. 10:216. doi: 10.3389/fnhum.2016.00216
62. Miller, G. A. (1994). The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychol. Rev. 101:343.
63. Morrow, D., Lee, A., and Rodvold, M. (1993). Analysis of problems in routine controller-pilot communication. Int. J. Aviat. Psychol. 3, 285-302.
64. Mühl, C., Jeunet, C., and Lotte, F. (2014). EEG-based workload estimation across affective contexts. Front. Neurosci. 8:114. doi: 10.3389/fnins.2014.00114
65. Müller-Putz, G., Scherer, R., Brunner, C., Leeb, R., and Pfurtscheller, G. (2008). Better than random: a closer look on bci results. Int. J. Bioelectromagnet. 10, 52-55.
66. Naseer, N., and Hong, K.-S. (2015). fNIRS-based brain-computer interfaces: a review. Front. Hum. Neurosci. 9:3. doi: 10.3389/fnhum.2015.00003
67. Naseer, N., Hong, M. J., and Hong, K.-S. (2014). Online binary decision decoding using functional near-infrared spectroscopy for the development of brain-computer interface. Exp. Brain Res. 232, 555-564. doi: 10.1007/s00221-013-3764-1
68. Parasuraman, R., and Rizzo, M. (2008). Neuroergonomics: The Brain at Work. New York, NY: Oxford University Press.
69. Parasuraman, R., and Wilson, G. F. (2008). Putting the brain to work: Neuroergonomics past, present, and future. Hum. Factors 50, 468-474. doi: 10.1518/001872008X288349
70. Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., et al. (2011). Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12, 2825-2830. doi: 10.1016/j.patcog.2011.04.006
71. Philip, P., Sagaspe, P., Taillard, J., Valtat, C., Moore, N., Akerstedt, T., et al. (2005). Fatigue, sleepiness, and performance in simulated versus real driving conditions. Sleep 28:1511. doi: 10.1093/sleep/28.12.1511
72. Piper, S. K., Krueger, A., Koch, S. P., Mehnert, J., Habermehl, C., Steinbrink, J., et al. (2014). A wearable multi-channel fNIRS system for brain imaging in freely moving subjects. Neuroimage 85, 64-71. doi: 10.1016/j.neuroimage.2013.06.062
73. Pope, A. T., Stephens, C. L., and Gilleade, K. (2014). “Biocybernetic adaptation as biofeedback training method,” in Advances in Physiological Computing, eds S. Fairclough and K. Gilleade (London: Springer), 91-115.
74. Power, S. D., Kushki, A., and Chau, T. (2012). Intersession consistency of single-trial classification of the prefrontal response to mental arithmetic and the no-control state by NIRS. PLoS ONE 7:e37791. doi: 10.1371/journal.pone.0037791
75. R Core Team (2013). R: A Language and Environment for Statistical Computing. Vienna: R Foundation for Statistical Computing.
76. Reynal, M., Colineaux, Y., Vernay, A., and Dehais, F. (2016). “Pilot flying vs. pilot monitoring during the approach phase: an eye-tracking study,” in HCI-Aero 2016, International Conference on Human-Computer Interaction in Aerospace (Paris).
77. Risser, M. R., Scerbo, M. W., Baldwin, C. L., and McNamara, D. S. (2006). “Interference timing and acknowledgement response with voice and datalink atc commands,” in Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 50 (San Francisco, CA: Sage Publications), 11-15.
78. Robinson, N., Zaidi, A. D., Rana, M., Prasad, V. A., Guan, C., Birbaumer, N., et al. (2016). Real-time subject-independent pattern classification of overt and covert movements from fNIRS signals. PLoS ONE 11:e0159959. doi: 10.1371/journal.pone.0159959
79. Rome, F., Adam, G., Condette, J., Causse, M., and Dehais, F. (2012). “Go-around manoeuver: a simulation study,” in Proceedings of the European Association For Aviation Psychology Conference (Lisboa: SAGE Publications).
80. Roy, R. N., Bonnet, S., Charbonnier, S., and Campagne, A. (2013). “Mental fatigue and working memory load estimation: interaction and implications for eeg-based passive bci,” in Engineering in Medicine and Biology Society (EMBC), 2013 35th Annual International Conference of the IEEE (Osaka: IEEE), 6607-6610.
81. Roy, R. N., Verdiere, K., Scannella, S., and Dehais, F. (2017). “Passive BCI tools for mental state estimation in aerospace applications,” in The First Biannual Neuroadaptive Technology Conference (Berlin), 79.
82. Sato, H., Fuchino, Y., Kiguchi, M., Katura, T., Maki, A., Yoro, T., et al. (2005). Intersubject variability of near-infrared spectroscopy signals during sensorimotor cortex activation. J. Biomed. Opt. 10:044001. doi: 10.1117/1.1960907
83. Scerbo, M. W., Risser, M. R., and Baldwin, C. L. (2003). “Implementing speech and simulated data link commands: the role of task interference and message length,” in Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 47 (Denver: SAGE Publications), 95-99.
84. Schreppel, T., Egetemeir, J., Schecklmann, M., Plichta, M. M., Pauli, P., Ellgring, H., Fallgatter, A. J., and Herrmann, M. J. (2008). Activation of the prefrontal cortex in working memory and interference resolution processes assessed with near-infrared spectroscopy. Neuropsychobiology, 57, 188-193.
85. Schudlo, L. C., and Chau, T. (2014). Dynamic topographical pattern classification of multichannel prefrontal NIRS signals: II. online differentiation of mental arithmetic and rest. J. Neural Eng. 11:016003. doi: 10.1088/1741-2560/11/1/016003
86. Schudlo, L. C., and Chau, T. (2015). Towards a ternary NIRS-bci: single-trial classification of verbal fluency task, stroop task and unconstrained rest. J. Neural Eng. 12:066008. doi: 10.1088/1741-2560/12/6/066008
87. Solovey, E. T., Lalooses, F., Chauncey, K., Weaver, D., Parasi, M., Scheutz, M., et al. (2011). “Sensing cognitive multitasking for a brain-based adaptive user interface,” in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC: ACM), 383-392.
88. Strait, M., Canning, C., and Scheutz, M. (2014). What we can and cannot do with near infrared spectroscopy. Front. Neurosci. 8:117. doi: 10.3389/fnins.2014.00117
89. Tai, K., and Chau, T. (2009). Single-trial classification of nirs signals during emotional induction tasks: towards a corporeal machine interface. J. Neuroeng. Rehabil. 6:39. doi: 10.1186/1743-0003-6-39
90. Taylor, J. L., O’Hara, R., Mumenthaler, M. S., Rosen, A. C., and Yesavage, J. A. (2005). Cognitive ability, expertise, and age differences in following air-traffic control instructions. Psychol. Aging 20, 117-133. doi: 10.1037/0882-7974.20.1.117
91. Taylor, J. L., Yesavage, J. A., Morrow, D. G., Dolhert, N., Brooks, J. O., and Poon, L. W. (1994). The effects of information load and speech rate on younger and older aircraft pilots’ ability to execute simulated air-traffic controller instructions. J. Gerontol. 49, 191-200.
92. Unni, A., Ihme, K., Jipp, M., and Rieger, J. W. (2017). Assessing the driver?s current level of working memory load with high density functional near-infrared spectroscopy: a realistic driving simulator study. Front. Hum. Neurosci. 11:167. doi: 10.3389/fnhum.2017.00167
93. Utsugi, K., Obata, A., Sato, H., Katsura, T., Sagara, K., Maki, A., et al. (2007). “Development of an optical brain-machine interface,” in Engineering in Medicine and Biology Society, 2007. EMBS 2007. 29th Annual International Conference of the IEEE (IEEE), 5338-5341.
94. Van Erp, J., Brouwer, A., and Zander, T. (2015). Editorial: Using neurophysiological signals that reflect cognitive or affective state. Front. Neurosci. 9:193. doi: 10.3389/fnins.2015.00193
95. Vecchiato, G., Borghini, G., Aricò, P., Graziani, I., Maglione, A. G., Cherubino, P., et al. (2016). Investigation of the effect of eeg-bci on the simultaneous execution of flight simulation and attentional tasks. Med. Biol. Eng. Comput. 54, 1503-1513. doi: 10.1007/s11517-015-1420-6
96. Verdière, K. J., Roy, R. N., and Dehais, F. (2018). Detecting pilot’s engagement using fnirs connectivity features in an automated vs manual landing scenario. Front. Hum. Neurosci. 12:6. doi: 10.3389/fnhum.2018.00006
97. Villringer, A., and Obrig, H. (2002). “Near infrared spectroscopy and imaging,” in Brain Mapping: The Methods, 2nd edn. (Sendai: Elsevier), 141-158.
98. Zander, T. O., and Kothe, C. (2011). Towards passive brain-computer interfaces: applying brain-computer interface technology to human-machine systems in general. J. Neural Eng. 8:025005. doi: 10.1088/1741-2560/8/2/025005
99. Zander, T. O., Shetty, K., Lorenz, R., Leff, D. R., Krol, L. R., Darzi, A. W., Gramann, K., and Yang, G.-Z. (2017). Automated task load detection with electroencephalography: Towards passive brain-computer interfacing in robotic surgery. J. Med. Robot. Res. 2:1750003. doi: 10.1142/S2424905X17500039