Passive BCI based on drowsiness detection: An fNIRS study

Biomedical Optics Express

Volumn 6, Issue 10, 2015, Pages 4063-4078

  Khan, M Jawad ^a   Hong, Keum Shik ^a  

^a Pusan National University   (South Korea)

Author keywords

[No Author keywords available]

Indexed keywords

BIOMEDICAL SIGNAL PROCESSING; BRAIN; DISCRIMINANT ANALYSIS; FUNCTIONAL NEUROIMAGING; HEMOGLOBIN; HIGHER ORDER STATISTICS; INFRARED DEVICES; INTERFACE STATES; INTERFACES (COMPUTER); NEAR INFRARED SPECTROSCOPY; SIGNAL DETECTION; STATISTICAL METHODS;

CONTINUOUS WAVE; DORSOLATERAL PREFRONTAL CORTEX; DRIVING SIMULATOR; DROWSINESS DETECTION; FUNCTIONAL NEAR-INFRARED SPECTROSCOPY (FNIRS); HEALTHY SUBJECTS; LINEAR DISCRIMINANT ANALYSIS; TRAINING AND TESTING;

BRAIN COMPUTER INTERFACE;

OXYHEMOGLOBIN;

ADULT; ARTICLE; BRAIN COMPUTER INTERFACE; DORSOLATERAL PREFRONTAL CORTEX; DROWSINESS; ELECTROENCEPHALOGRAM; FEMALE; HUMAN; HUMAN EXPERIMENT; MALE; NEAR INFRARED SPECTROSCOPY; NORMAL HUMAN; SIMULATOR; TASK PERFORMANCE;

EID: 84948757783     PISSN: None     EISSN: 21567085     Source Type: Journal    
DOI: 10.1364/BOE.6.004063     Document Type: Article

References (62)

1. L. F. Nicolas-Alonso and J. Gomez-Gil, "Brain computer interfaces, a review," Sensors (Basel) 12(2), 1211-1279 (2012).
2. S. Coyle, T. Ward, and C. Markham, "Brain-computer interfaces: A review," Interdiscip. Sci. Rev. 28(2), 112-118 (2003).
3. A. Turnip, K.-S. Hong, and M.-Y. Jeong, "Real-time feature extraction of P300 component using adaptive nonlinear principal component analysis," Biomed. Eng. Online 10(1), 83 (2011).
4. N. K. Logothetis, "What we can do and what we cannot do with fMRI," Nature 453(7197), 869-878 (2008).
5. M. P. van den Heuvel and H. E. Hulshoff Pol, "Exploring the brain network: A review on resting-state fMRI functional connectivity," Eur. Neuropsychopharmacol. 20(8), 519-534 (2010).
6. M. Welvaert and Y. Rosseel, "A review of fMRI simulation studies," PLoS One 9(7), e101953 (2014).
7. N. Naseer and K.-S. Hong, "fNIRS-based brain-computer interfaces: A review," Front. Hum. Neurosci. 9, 3 (2015).
8. M. Strait and M. Scheutz, "What we can and cannot (yet) do with functional near infrared spectroscopy," Front. Neurosci. 8, 117 (2014).
9. D. A. Boas, C. E. Elwell, M. Ferrari, and G. Taga, "Twenty years of functional near-infrared spectroscopy: Introduction for the special issue," Neuroimage 85(Pt 1), 1-5 (2014).
10. M. Ferrari and V. Quaresima, "A brief review on the history of human functional near-infrared spectroscopy (fNIRS) development and fields of application," Neuroimage 63(2), 921-935 (2012).
11. M. J. Khan, M. J. Hong, and K.-S. Hong, "Decoding of four movement directions using hybrid NIRS-EEG braincomputer interface," Front. Hum. Neurosci. 8, 244 (2014).
12. S. Fazli, J. Mehnert, J. Steinbrink, G. Curio, A. Villringer, K.-R. Müller, and B. Blankertz, "Enhanced performance by a hybrid NIRS-EEG brain computer interface," Neuroimage 59(1), 519-529 (2012).
13. T. O. Zander and C. Kothe, "Towards passive brain-computer interfaces: Applying brain-computer interface technology to human-machine systems in general," J. Neural Eng. 8(2), 025005 (2011).
14. N. Naseer, M. J. Hong, and K.-S. Hong, "Online binary decision decoding using functional near-infrared spectroscopy for the development of brain-computer interface," Exp. Brain Res. 232(2), 555-564 (2014).
15. N. Naseer and K.-S. Hong, "Classification of functional near-infrared spectroscopy signals corresponding to the right-and left-wrist motor imagery for development of a brain-computer interface," Neurosci. Lett. 553, 84-89 (2013).
16. K.-S. Hong, N. Naseer, and Y.-H. Kim, "Classification of prefrontal and motor cortex signals for three-class fNIRS-BCI," Neurosci. Lett. 587, 87-92 (2015).
17. R. Sitaram, H. Zhang, C. Guan, M. Thulasidas, Y. Hoshi, A. Ishikawa, K. Shimizu, and N. Birbaumer, "Temporal classification of multichannel near-infrared spectroscopy signals of motor imagery for developing a brain-computer interface," Neuroimage 34(4), 1416-1427 (2007).
18. S. M. Coyle, T. E. Ward, and C. M. Markham, "Brain-computer interface using a simplified functional nearinfrared spectroscopy system," J. Neural Eng. 4(3), 219-226 (2007).
19. L. C. Schudlo and T. Chau, "Dynamic topographical pattern classification of multichannel prefrontal NIRS signals: II. Online differentiation of mental arithmetic and rest," J. Neural Eng. 11(1), 016003 (2014).
20. S. D. Power, A. Kushki, and T. Chau, "Intersession consistency of single-trial classification of the prefrontal response to mental arithmetic and the no-control state by NIRS," PLoS One 7(7), e37791 (2012).
21. S. D. Power, A. Kushki, and T. Chau, "Towards a system-paced near-infrared spectroscopy brain-computer interface: Differentiating prefrontal activity due to mental arithmetic and mental singing from the no-control state," J. Neural Eng. 8(6), 066004 (2011).
22. H.-J. Hwang, D. Hwan Kim, C.-H. Han, and C.-H. Im, "A new dual-frequency stimulation method to increase the number of visual stimuli for multi-class SSVEP-based brain-computer interface (BCI)," Brain Res. 1515, 66-77 (2013).
23. Y. Tomita, F.-B. Vialatte, G. Dreyfus, Y. Mitsukura, H. Bakardjian, and A. Cichocki, "Bimodal BCI using simultaneously NIRS and EEG," IEEE Trans. Biomed. Eng. 61(4), 1274-1284 (2014).
24. H. Santosa, M. J. Hong, and K.-S. Hong, "Lateralization of music processing auditory cortex: An fNIRS study," Front. Behav. Neurosci. 8, UNSP 418 (2014).
25. K.-S. Hong and H.-D. Nguyen, "State-space models of impulse hemodynamic responses over motor, somatosensory, and visual cortices," Biomed. Opt. Express 5(6), 1778-1798 (2014).
26. X.-S. Hu, K.-S. Hong, and S. S. Ge, "fNIRS-based online deception decoding," J. Neural Eng. 9(2), 026012 (2012).
27. B. T. Jap, S. Lal, P. Fischer, and E. Bekiaris, "Using EEG spectral components to assess algorithms for detecting fatigue," Expert Syst. Appl. 36(2), 2352-2359 (2009).
28. W. Vanlaar, H. Simpson, D. Mayhew, and R. Robertson, "Fatigued and drowsy driving: A survey of attitudes, opinions and behaviors," J. Safety Res. 39(3), 303-309 (2008).
29. T. Liu, "Positive correlation between drowsiness and prefrontal activation during a simulated speed-control driving task," Neuroreport 25(16), 1316-1319 (2014).
30. Y. Kubota, N. N. Takasu, S. Horita, M. Kondo, M. Shimizu, T. Okada, T. Wakamura, and M. Toichi, "Dorsolateral prefrontal cortical oxygenation during REM sleep in humans," Brain Res. 1389, 83-92 (2011).
31. P. P. Caffier, U. Erdmann, and P. Ullsperger, "Experimental evaluation of eye-blink parameters as a drowsiness measure," Eur. J. Appl. Physiol. 89(3), 319-325 (2003).
32. Q. Ji, Z. W. Zhu, and P. L. Lan, "Real-time nonintrusive monitoring and prediction of driver fatigue," IEEE Trans. Vehicular Technol. 53(4), 1052-1068 (2004).
33. J. Horne and L. Reyner, "Vehicle accidents related to sleep: A review," Occup. Environ. Med. 56(5), 289-294 (1999).
34. K. Yoshino, N. Oka, K. Yamamoto, H. Takahashi, and T. Kato, "Functional brain imaging using near-infrared spectroscopy during actual driving on an expressway," Front. Hum. Neurosci. 7, 882 (2013).
35. C. T. Lin, C. H. Chuang, C. S. Huang, S. F. Tsai, S. W. Lu, Y. H. Chen, and L. W. Ko, "Wireless and wearable EEG system for evaluating driver vigilance," IEEE Trans. Biomed. Circuits Syst. 8(2), 165-176 (2014).
36. F. X. Graydon, R. Young, M. D. Benton, R. J. Genik, S. Posse, L. Hsieh, and C. Green, "Visual event detection during simulated driving: Identifying the neural correlates with functional neuroimaging," Transp. Res. Pt. FTraffic Psychol. Behav. 7, 271-286 (2004).
37. E. Horikawa, N. Okamura, M. Tashiro, Y. Sakurada, M. Maruyama, H. Arai, K. Yamaguchi, H. Sasaki, K. Yanai, and M. Itoh, "The neural correlates of driving performance identified using positron emission tomography," Brain Cogn. 58(2), 166-171 (2005).
38. Y. Uchiyama, H. Toyoda, H. Sakai, D. Shin, K. Ebe, and N. Sadato, "Suppression of brain activity related to a car-following task with an auditory task: An fMRI study," Transp. Res. Pt. F-Traffic Psychol. Behav. 15, 25-37 (2012).
39. T. A. Schweizer, K. Kan, Y. Hung, F. Tam, G. Naglie, and S. J. Graham, "Brain activity during driving with distraction: An immersive fMRI study," Front. Hum. Neurosci. 7, 53 (2013).
40. B.-G. Lee, B.-L. Lee, and W.-Y. Chung, "Mobile healthcare for automatic driving sleep-onset detection using wavelet-based EEG and respiration signals," Sensors (Basel) 14(10), 17915-17936 (2014).
41. A. Garcés Correa, L. Orosco, and E. Laciar, "Automatic detection of drowsiness in EEG records based on multimodal analysis," Med. Eng. Phys. 36(2), 244-249 (2014).
42. J. Wang, Y. Y. Wu, H. Qu, and G. H. Xu, "EEG-based fatigue driving detection using correlation dimension," J. Vibroeng. 16, 407-413 (2014).
43. S. Hu, G. Zheng, and B. Peters, "Driver fatigue detection from electroencephalogram spectrum after electrooculography artefact removal," IET Intell. Transp. Syst. 7(1), 105-113 (2013).
44. G. Li and W.-Y. Chung, "Estimation of eye closure degree using EEG sensors and its application in driver drowsiness detection," Sensors (Basel) 14(9), 17491-17515 (2014).
45. R. N. Roy, S. Charbonnier, and S. Bonnet, "Eye blink characterization from frontal EEG electrodes using source separation and pattern recognition algorithms," Biomed. Signal Process. Control 14, 256-264 (2014).
46. A. Picot, S. Charbonnier, and A. Caplier, "On-line detection of drowsiness using brain and visual information," IEEE Trans. Syst. Man Cybern. A Syst. Hum. 42(3), 764-775 (2012).
47. H. Santosa, M. J. Hong, S.-P. Kim, and K.-S. Hong, "Noise reduction in functional near-infrared spectroscopy signals by independent component analysis," Rev. Sci. Instrum. 84(7), 073106 (2013).
48. M. R. Bhutta, K.-S. Hong, B.-M. Kim, M. J. Hong, Y.-H. Kim, and S.-H. Lee, "Note: Three wavelengths nearinfrared spectroscopy system for compensating the light absorbance by water," Rev. Sci. Instrum. 85(2), 026111 (2014).
49. M. A. Kamran and K.-S. Hong, "Linear parameter-varying model and adaptive filtering technique for detecting neuronal activities: An fNIRS study," J. Neural Eng. 10(5), 056002 (2013).
50. J. W. Barker, A. Aarabi, and T. J. Huppert, "Autoregressive model based algorithm for correcting motion and serially correlated errors in fNIRS," Biomed. Opt. Express 4(8), 1366-1379 (2013).
51. J. Li and L. Qiu, "Temporal correlation of spontaneous hemodynamic activity in language areas measured with functional near-infrared spectroscopy," Biomed. Opt. Express 5(2), 587-595 (2014).
52. W. B. Baker, A. B. Parthasarathy, D. R. Busch, R. C. Mesquita, J. H. Greenberg, and A. G. Yodh, "Modified Beer-Lambert law for blood flow," Biomed. Opt. Express 5(11), 4053-4075 (2014).
53. S. Lemm, B. Blankertz, T. Dickhaus, and K. R. Müller, "Introduction to machine learning for brain imaging," Neuroimage 56(2), 387-399 (2011).
54. F. Lotte, M. Congedo, A. Lécuyer, F. Lamarche, and B. Arnaldi, "A review of classification algorithms for EEGbased brain-computer interfaces," J. Neural Eng. 4(2), R1-R13 (2007).
55. C. Bogler, J. Mehnert, J. Steinbrink, and J. D. Haynes, "Decoding vigilance with NIRS," PLoS One 9(7), e101729 (2014).
56. C. Kaufmann, R. Wehrle, T. C. Wetter, F. Holsboer, D. P. Auer, T. Pollmächer, and M. Czisch, "Brain activation and hypothalamic functional connectivity during human non-rapid eye movement sleep: an EEG/fMRI study," Brain 129(3), 655-667 (2006).
57. G. R. Poudel, C. R. H. Innes, and R. D. Jones, "Cerebral perfusion differences between drowsy and nondrowsy individuals after acute sleep restriction," Sleep 35(8), 1085-1096 (2012).
58. M. R. Bhutta, M. J. Hong, Y.-H. Kim, and K.-S. Hong, "Single-trial lie detection using a combined fNIRSpolygraph system," Front. Psychol. 6, 709 (2015).
59. N. Naseer and K.-S. Hong, "Decoding answers to four-choice questions using functional near-infrared spectroscopy," J. Near Infrared Spectrosc. 23(1), 23-31 (2015).
60. X.-S. Hu, K.-S. Hong, and S. S. Ge, "Reduction of trial-to-trial variability in functional near-infrared spectroscopy signals by accounting for resting-state functional connectivity," J. Biomed. Opt. 18(1), 017003 (2013).
61. S. Aritake, S. Higuchi, H. Suzuki, K. Kuriyama, M. Enomoto, T. Soshi, S. Kitamura, A. Hida, and K. Mishima, "Increased cerebral blood flow in the right frontal lobe area during sleep precedes self-awakening in humans," BMC Neurosci. 13(1), 153 (2012).
62. S. Fazli, J. Mehnert, J. Steinbrink, and B. Blankertz, "Using NIRS as a predictor for EEG-based BCI performance," in Proceedings of IEEE Conference of Engineering in Medicine and Biology Society (IEEE EMBC, 2012), pp. 4911-4914.