Bimodal BCI using simultaneously NIRS and EEG

IEEE Transactions on Biomedical Engineering

Volumn 61, Issue 4, 2014, Pages 1274-1284

  Tomita, Yohei ^a   Vialatte, Francois Benoit ^b   Dreyfus, Gerard ^b   Mitsukura, Yasue ^c   Bakardjian, Hovagim ^d   Cichocki, Andrzej ^e  

^a Foster Electric Company Limited   (Japan)

^b PSL RESEARCH UNIVERSITY   (France)

^c KEIO UNIVERSITY   (Japan)

^d INSERM   (France)

^e RIKEN BRAIN SCIENCE INSTITUTE   (Japan)

Author keywords

bimodal; Brain computer interface (BCI); simultaneous electroencephalographic (EEG) and near infrared spectroscopy (NIRS); steady state visual evoked potentials (SSVEP)

Indexed keywords

ELECTROENCEPHALOGRAPHY; FLICKERING; INTERFACES (COMPUTER); SIGNAL DETECTION;

BIMODAL; EEG SIGNALS; ELECTROENCEPHALOGRAPHIC SIGNALS; ERROR RATE; INFORMATION TRANSFER RATE; NIRS SYSTEM; RELIABLE DETECTION; STEADY-STATE VISUAL EVOKED POTENTIALS;

BRAIN COMPUTER INTERFACE;

ARTICLE; BLOOD OXYGENATION; BRAIN COMPUTER INTERFACE; BRAIN DEPTH STIMULATION; ELECTROENCEPHALOGRAM; EVENT RELATED POTENTIAL; EVOKED VISUAL RESPONSE; HEMODYNAMICS; HUMAN; HUMAN EXPERIMENT; NEAR INFRARED SPECTROSCOPY; NOISE REDUCTION; NORMAL HUMAN; SIGNAL NOISE RATIO; SIGNAL PROCESSING; STEADY STATE; VISUAL STIMULATION;

BRAIN-COMPUTER INTERFACES; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS, VISUAL; HEAD; HEMODYNAMICS; HUMANS; SPECTROSCOPY, NEAR-INFRARED;

EID: 84897127294     PISSN: 00189294     EISSN: 15582531     Source Type: Journal    
DOI: 10.1109/TBME.2014.2300492     Document Type: Article

References (38)

1. E. Fetz, "Operant conditioning of cortical unit activity, " Science, vol. 163, no. 3870, pp. 955-958, 1969.
2. N. Birbaumer, "Breaking the silence: Brain-computer interfaces (BCI) for communication and motor control, " Psychophysiology, vol. 43, no. 6, pp. 517-532, Nov. 2006. (Pubitemid 44657095)
3. N. Birbaumer and L. G. Cohen, "Brain-computer interfaces: Communication and restoration of movement in paralysis, " J. Physiol., vol. 579, no. 3, pp. 621-636, Mar. 2007. (Pubitemid 46404346)
4. J. R. Wolpaw, N. Birbaumer, D. J. McFarland, G. Pfurtscheller, and T. M. Vaughan, "Brain-computer interfaces for communication and control, " Clin. Neurophysiol.: Offic. J. Int. Federat. Clin. Neurophysiol., vol. 113, no. 6, pp. 767-791, Jun. 2002. (Pubitemid 34621187)
5. B.-K. Min, M. J. Marzelli, and S.-S. Yoo, "Neuroimaging-based approaches in the brain-computer interface, " Trends Biotechnol., vol. 28, no. 11, pp. 552-560, Nov. 2010.
6. C. Brunner and R. Leeb, (2014, Jan. 26). BCI Competition 2008-Graz data set A. [Online]. Available: http://www.bbci.de/competition/iv/desc-2a.pdf
7. H. Bakardjian. (2014, Jan. 26). SSVEP database (EEG) [Online]. Available: http://www.bsp.brain.riken.jp/∼hova/ssvep-data-Bakardjian- LABSP.html
8. S. Sanei and J. A. Chambers, EEG Signal Processing. London, U.K.: Wiley, 2007.
9. A. Bashashati, M. Fatourechi, R. K. Ward, and G. E. Birch, "A survey of signal processing algorithms in brain-computer interfaces based on electrical brain signals, " J. Neural Eng., vol. 4, no. 2, pp. R32-57, Jun. 2007. (Pubitemid 46603812)
10. F. Lotte, M. Congedo, A. Lécuyer, F. Lamarche, and B. Arnaldi, "A review of classification algorithms for EEG-based brain-computer interfaces, " J. Neural Eng., vol. 4, no. 2, pp. R1-R13, Jun. 2007. (Pubitemid 46603810)
11. N. J. Hill, T. N. Lal, M. Schr, T. Hinterberger, G. Widman, C. E. Elger, B. Sch, and N. Birbaumer, "Classifying event-related desynchronization in EEG, ECoG and MEG signals, " Lecture Notes Comput. Sci., vol. 4174, pp. 404-413, 2006. (Pubitemid 44608886)
12. J. D. R. Millan, J. Mourino, M. Franze, F. Cincotti, M. Varsta, J. Heikkonen, and F. Babiloni, "A local neural classifier for the recognition of EEG patterns associated to mental tasks, " IEEE Trans. Neural Netw./Publicat. IEEE Neural Netw. Council, vol. 13, no. 3, pp. 678-86, Jan. 2002. (Pubitemid 34669655)
13. M. Thulasidas, C. Guan, and J. Wu, "Robust Classification of EEG Signal for Brain-Computer Interface, " IEEE Trans. Neural Syst. Rehabil. Eng.: Publicat. IEEE Eng. Med. Biol. Soc., vol. 14, no. 1, pp. 24-29, Mar. 2006.
14. Z. Lin, C. Zhang, W. Wu, and X. Gao, "Frequency recognition based on canonical correlation analysis for SSVEP-based BCIs, " IEEE Trans. Biomed. Eng., vol. 54, no. 6, pp. 1172-1176, Jun. 2007. (Pubitemid 46815117)
15. Y. Wang, X. Gao, B. Hong, C. Jia, and S. Gao, "Brain-computer interfaces based on visual evoked potentials, " IEEE Eng. Med. Biol. Mag.: Quart. Mag. Eng. Med. Biol. Soc., vol. 27, no. 5, pp. 64-71, Sep./Oct. 2008.
16. F.-B. Vialatte, M. Maurice, J. Dauwels, and A. Cichocki, "Steady-state visually evoked potentials: Focus on essential paradigms and future perspectives, " Prog. Neurobiol., vol. 90, no. 4, pp. 418-438, Apr. 2010.
17. H. Bakardjian, T. Tanaka, and A. Cichocki, "Optimization of SSVEP brain responses with application to eight-command brain-computer interface, " Neurosci. Lett., vol. 469, no. 1, pp. 34-38, Jan. 2010.
18. G. Pfurtscheller, B. Z. Allison, C. Brunner, G. Bauernfeind, T. Solis-Escalante, R. Scherer, T. O. Zander, G. Mueller-Putz, C. Neuper, and N. Birbaumer, "The hybrid BCI, " Front. Neurosci., vol. 4, no. April, Jan. 2010.
19. S. Coyle, T. Ward, C. Markham, and G. McDarby, "On the suitability of near-infrared (NIR) systems for next-generation brain-computer interfaces, " Physiol. Meas., vol. 25, no. 4, pp. 815-822, Aug. 2004. (Pubitemid 39121166)
20. R. Sitaram, H. Zhang, C. Guan, M. Thulasidas, Y. Hoshi, A. Ishikawa, K. Shimizu, and N. Birbaumer, "Temporal classification of multichannel near-infrared spectroscopy signals of motor imagery for developing a brain-computer interface, " NeuroImage, vol. 34, no. 4, pp. 1416-1427, Feb. 2007. (Pubitemid 46187084)
21. K. Tai and T. Chau, "Single-trial classification of NIRS signals during emotional induction tasks: Towards a corporeal machine interface, " J. Neuroeng. Rehabil., vol. 6, p. 39, Jan. 2009.
22. M. Takeuchi, E. Hori, K. Takamoto, A. H. Tran, K. Satoru, A. Ishikawa, T. Ono, S. Endo, and H. Nishijo, "Brain cortical mapping by simultaneous recording of functional near infrared spectroscopy and electroencephalograms from the whole brain during right median nerve stimulation, " Brain Topogr., vol. 22, no. 3, pp. 197-214, Nov. 2009.
23. S. Fazli, J. Mehnert, J. Steinbrink, G. Curio, A. Villringer, K.-R. Müller, and B. Blankertz, "Enhanced performance by a hybrid NIRS-EEG brain computer interface, " NeuroImage, vol. 59, pp. 519-529, Aug. 2011.
24. A. M. Dale and R. L. Buckner, "Selective averaging of rapidly presented individual trials using fMRI, " Human Brain Mapp., vol. 5, no. 5, pp. 329-340, Jan. 1997. (Pubitemid 27479394)
25. M. Bianciardi, L. Bianchi, G. Garreffa, M. Abbafati, F. Di Russo, M. G. Marciani, and E. Macaluso, "Single-epoch analysis of interleaved evoked potentials and fMRI responses during steady-state visual stimulation, " Clin. Neurophysiol.: Offic. J. Int. Federat. Clin. Neurophysiol., vol. 120, no. 4, pp. 738-747, Apr. 2009.
26. N. K. Logothetis, J. Pauls, M. Augath, T. Trinath, and A. Oeltermann, "Neurophysiological investigation of the basis of the fMRI signal, " Nature, vol. 412, no. 6843, pp. 150-157, Jul. 2001. (Pubitemid 32674704)
27. Z. Liu, C. Rios, N. Zhang, L. Yang, W. Chen, and B. He, "Linear and nonlinear relationships between visual stimuli, EEG, and BOLD fMRI signals, " NeuroImage, vol. 50, no. 3, pp. 1054-1066, Apr. 2010.
28. T. J. Huppert, R. D. Hoge, S. G. Diamond, M. A. Franceschini, and D. A. Boas, "A temporal comparison of BOLD, ASL, and NIRS hemody-namic responses to motor stimuli in adult humans, " NeuroImage, vol. 29, no. 2, pp. 368-382, Jan. 2006. (Pubitemid 43065485)
29. S. P. Koch, J. Steinbrink, A. Villringer, and H. Obrig, "Synchronization between background activity and visually evoked potential is not mirrored by focal hyperoxygenation: implications for the interpretation of vascular brain imaging, " J. Neurosci.: Offic. J. Soc. Neurosci., vol. 26, no. 18, pp. 4940-4948, May 2006. (Pubitemid 44315336)
30. F. Matthews, B. Pearlmutter, T. Ward, C. Soraghan, and C. Markham, "Hemodynamics for brain-computer interfaces, " IEEE Signal Process. Mag., vol. 25, no. 1, pp. 87-94, Jan. 2008.
31. X.-S. Hu, K.-S. Hong, S. S. Ge, and M.-Y. Jeong, "Kalman estimator-and general linear model-based on-line brain activation mapping by near-infrared spectroscopy, " Biomed. Eng. Online, vol. 9, no. 1, p. 82, Jan. 2010.
32. G. Gratton and P. M. Corballis, "Removing the heart from the brain: compensation for the pulse artifact in the photon migration signal, " pp. 292-299, May 1995
33. F. C. Robertson, T. S. Douglas, and E. M. Meintjes, "Motion artifact removal for functional near infrared spectroscopy: A comparison of methods, " IEEE Trans. Biomed. Eng., vol. 57, no. 6, pp. 1377-1387, Jun. 2010.
34. Q. Zhang, G. E. Strangman, and G. Ganis, "Adaptive filtering to reduce global interferenceinnoninvasive NIRS measures of brain activation: How well and when does it work?" NeuroImage, vol. 45, no. 3, pp. 788-794, 2010.
35. Q. Zhang, E. N. Brown, and G. E. Strangman, "Adaptive filtering for global interference cancellation and real-time recovery of evoked brain activity: A Monte Carlo simulation study, " J. Biomed. Opt., vol. 12, no. 4, pp. 044 014-1-044 014-12, 2012.
36. O. Friman, I. Volosyak, and A. Gräser, "Multiple channel detection of steady-state visual evoked potentials for brain-computer interfaces, " IEEE Trans. Biomed. Eng., vol. 54, no. 4, pp. 742-750, Apr. 2007. (Pubitemid 46469933)
37. F. Lotte and C. Guan, "Regularizing common spatial patterns to improve BCI designs: Unified theory and new algorithms, " IEEE Trans. Biomed. Eng., vol. 58, no. 2, pp. 355-362, Feb. 2011.
38. O. Falzon, K. P. Camilleri, and J. Muscat, "The analytic common spatial patterns method for EEG-based BCI data, " J. Neural Eng., vol. 9, no. 4, p. 045009, Aug. 2012.