Combined EEG-fNIRS decoding of motor attempt and imagery for brain switch control: An offline study in patients with tetraplegia

IEEE Transactions on Neural Systems and Rehabilitation Engineering

Volumn 22, Issue 2, 2014, Pages 222-229

  Blokland, Yvonne ^a,b   Spyrou, Loukianos ^a,b   Thijssen, Dick ^b,c   Eijsvogels, Thijs ^b   Colier, Willy ^d   Floor Westerdijk, Marianne ^d   Vlek, Rutger ^a   Bruhn, Jorgen ^a,b   Farquhar, Jason ^a  

^a RADBOUD UNIVERSITY   (Netherlands)

^b RADBOUD UNIVERSITY MEDICAL CENTER   (Netherlands)

^c LIVERPOOL JOHN MOORES UNIVERSITY   (United Kingdom)

^d Artinis Medical Systems   (Netherlands)

Author keywords

Brain switch; electroencephalography (EEG); functional near infrared spectroscopy (fNIRS); Tetraplegia

Indexed keywords

ELECTROENCEPHALOGRAPHY; ELECTROPHYSIOLOGY;

CLASSIFICATION PERFORMANCE; CLASSIFICATION RATES; COMBINED CLASSIFIERS; CURRENT PERFORMANCE; FUNCTIONAL NEAR-INFRARED SPECTROSCOPY (FNIRS); OFF-LINE STUDIES; SENSORIMOTOR RHYTHM (SMR); TETRAPLEGIA;

FUNCTIONAL NEUROIMAGING;

ADULT; ALGORITHM; ARTICLE; BRAIN; BRAIN COMPUTER INTERFACE; COMPUTER INTERFACE; ELECTROENCEPHALOGRAPHY; EQUIPMENT; FEASIBILITY STUDY; HUMAN; IMAGINATION; MALE; METHODOLOGY; MIDDLE AGED; MOTOR CORTEX; MOVEMENT (PHYSIOLOGY); NEAR INFRARED SPECTROSCOPY; PHYSIOLOGY; PSYCHOMOTOR PERFORMANCE; QUADRIPLEGIA; SOMATOSENSORY CORTEX;

ADULT; ALGORITHMS; BRAIN; BRAIN-COMPUTER INTERFACES; ELECTROENCEPHALOGRAPHY; FEASIBILITY STUDIES; HUMANS; IMAGINATION; MALE; MIDDLE AGED; MOTOR CORTEX; MOVEMENT; PSYCHOMOTOR PERFORMANCE; QUADRIPLEGIA; SOMATOSENSORY CORTEX; SPECTROSCOPY, NEAR-INFRARED; USER-COMPUTER INTERFACE;

EID: 84896456775     PISSN: 15344320     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNSRE.2013.2292995     Document Type: Article

References (28)

1. G. Müller-Putz, R. Scherer, G. Pfurtscheller, and R. Rupp, "Eeg-based neuroprosthesis control: A step towards clinical practice," Neurosci. Lett., vol. 382, pp. 169-174, 2005. (Pubitemid 40725887)
2. R. Ortner, B. Allison, G. Korisek, H. Gaggl, and G. Pfurtscheller, "An SSVEP BCI to control a hand orthosis for persons with tetraplegia," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 19, no. 1, pp. 1-5, Feb. 2011.
3. G. Pfurtscheller and F. Lopes da Silva, "Event-related EEG/MEG synchronization and desynchronization: Basic principles," Clin. Neurophysiol., vol. 110, pp. 1842-1857, 1999. (Pubitemid 29454610)
4. D. McFarland, L. Miner, T. Vaughan, and J. Wolpaw, "Mu and beta rhythm topographies during motor imagery and actual movements," Brain Topogr., vol. 12, pp. 177-186, 2000. (Pubitemid 30232659)
5. Y. Kato, T. Yonemura, K. Samejima, T. Maeda, and H. Ando, "Development of a BCI master switch based on single-trial detection of contingent negative variation related potentials," in Proc. Annu. Int. Conf. IEEE Eng. Med. Biol. Soc., 2011, pp. 4629-4632.
6. S. Coyle, T. Ward, C. Markham, and G. McDarby, "On the suitability of near-infrared (NIR) systems for next-generation brain-computer interfaces," Physiol. Meas., vol. 25, pp. 815-822, 2004. (Pubitemid 39121166)
7. R. Sitaram,H. Zhang, C.Guan, M. Thulasidas, Y. Hoshi, A. Ishikawa, K. Shimizu, and N. Birbaumer, "Temporal classification of multichannel near-infrared spectroscopy signals of motor imagery for developing a brain-computer interface," NeuroImage, vol. 34, pp. 1416-1427, 2007. (Pubitemid 46187084)
8. H. Obrig, C. Hirth, J. Junge-Hülsing, C. Döge, T. Wolf, U. Dirnagl, and A. Villringer, "Cerebral oxygenation changes in response to motor stimulation," J. Appl. Physiol., vol. 81, pp. 1174-1183, 1996. (Pubitemid 26309125)
9. G. Pfurtscheller, B. Allison, C. Brunner, G. Bauernfeind, T. Solis-Escalante, R. Scherer, T. Zander, G. Müller-Putz, C. Neuper, and N. Birbaumer, "The hybrid BCI," Front. Neurosci., vol. 4, pp. 1-11, 2010.
10. S. Fazli, J. Mehnert, J. Steinbrink, G. Curio, A. Villringer, K. Müller, and B. Blankertz, "Enhanced performance by a hybrid NIRS-EEG brain computer interface," NeuroImage, vol. 59, pp. 519-529, 2012.
11. R. Oostenveld, P. Fries, E. Maris, and J. Schoffelen, "Fieldtrip: Open source software for advanced analysis of MEG, EEG, and invasive electrophysiological data," Computat. Intell. Neurosci., 2011, 156869.
12. R. Saager, N. Telleri, and A. Berger, "Two-detector corrected near infrared spectroscopy (c-NIRS) detects hemodynamic activation responses more robustly than single-detector NIRS," NeuroImage, vol. 55, pp. 1679-1685, 2011.
13. A. Villringer and B. Chance, "Non-invasive optical spectroscopy and imaging of human brain function," Trends Neurosci., vol. 20, pp. 435-442, 1997. (Pubitemid 27421703)
14. A. Duncan, J. Meek, M. Clemence, C. Elwell, P. Fallon, L. Tyszczuk, M. Cope, and D. Delpy, "Measurement of cranial optical path length as a function of age using phase resolved near infrared spectroscopy," Pedriatic Res., vol. 39, pp. 889-894, 1996. (Pubitemid 26130033)
15. R. Saager and A. Berger, "Direct characterization and removal of interfering absorption trends in two-layer turbid media," J. Opt. Soc. Am., vol. 22, pp. 1874-1882, 2005. (Pubitemid 41372914)
16. B. Blankertz, G. Dornhege, M. Krauledat, K. Müller, V. Kunzmann, F. Losch, and G. Curio, "The Berlin brain-computer interface: EEGbased communication without subject-training," IEEE Trans. Neural Sys. Rehabil. Eng., vol. 14, no. 2, pp. 147-152, Jun. 2006. (Pubitemid 44150229)
17. C. Bishop, Pattern Recognition and Machine Learning. NewYork: Springer, 2006.
18. J. Platt, "Probabilistic outputs for support vectormachines and comparison to regularized likelihood methods," in Advances in Large Margin Classifiers, A. Smola, P. Bartlett, B. Schölkopf, and D. Schuurmans, Eds. Cambridge, MA: MIT Press, 2000.
19. A. Agresti and B. Coull, "Approximate is better than 'exact' for interval estimation of binomial proportions," Am. Stat., vol. 52, pp. 119-126, 1998.
20. C. Vidaurre and B. Blankertz, "Towards a cure for BCI illiteracy," Brain Topogr., vol. 23, pp. 194-198, 2010.
21. N. Logothetis, "The underpinnings of the bold functional magnetic resonance imaging signal," J. Neurosci., vol. 23, pp. 3963-3971, 2003. (Pubitemid 36958412)
22. S. Power, A. Kushki, and T. Chau, "Intersession consistency of singletrial classification of the prefrontal response to mental arithmetic and the no-control state by NIRS," PLoS One, vol. 7, p. e37791, 2012.
23. L. Kauhanen, P. Jylänki, J. Lehtonen, P. Rantanen, H. Alaranta, andM. Sams, "EEG-based brain-computer interface for tetraplegics," Computat. Intell. Neurosci., no. 23864, 2007.
24. A. Muralidharan, J. Chae, and D. Taylor, "Extracting attempted hand movements from EEGS in people with complete hand paralysis following stroke," Front. Neurosci., vol. 5, pp. 1-7, 2011.
25. J. Millán, R. Rupp, G. Müller-Putz, R. Murray-Smith, C. Giugliemma, M. Tangermann, C. Vidaurre, F. Cincotti, A. Kübler, R. Leeb, C. Neuper, K.-R. Müller, and D. Mattia, "Combining brain-computer interfaces and assistive technologies: State-of-the-art and challenges," Front. Neurosci., vol. 4, p. 161, 2010.
26. S. Shoham, E. Halgren, E.Maynard, and R. Normann, "Motor-cortical activity in tetraplegics," Nature, vol. 413, p. 793, 2001. (Pubitemid 33026837)
27. P. Sabbah, S. de Schonen, C. Leveque, S. Gay, F. Pfefer, C. Nioche, J. Sarrazin, H. Barouti, M. Tadie, and Y. Cordoliani, "Sensorimotor cortical activity in patients with complete spinal cord injury: A functionalmagnetic resonance imaging study," J. Neurotrauma, vol. 19, pp. 53-60, 2002. (Pubitemid 34117096)
28. L. Hochberg, M. Serruya, G. Friehs, J. Mukand, M. Saley, A. Caplan, A. Branner, D. Chen, R. Penn, and J. Donoghue, "Neuronal ensemble control of prosthetic devices by a human with tetraplegia," Nature, vol. 442, pp. 164-171, 2006. (Pubitemid 44086558)