A hybrid brain computer interface to control the direction and speed of a simulated or real wheelchair

IEEE Transactions on Neural Systems and Rehabilitation Engineering

Volumn 20, Issue 5, 2012, Pages 720-729

  Long, Jinyi ^a   Li, Yuanqing ^a   Wang, Hongtao ^b   Yu, Tianyou ^a   Pan, Jiahui ^c   Li, Feng ^d  

^a SOUTH CHINA UNIVERSITY OF TECHNOLOGY   (China)

^b Wu Yi University   (China)

^c SOUTH CHINA NORMAL UNIVERSITY   (China)

^d CHANGSHA UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

Author keywords

Direction; hybrid brain computer interface (BCI); motor imagery; P300; speed; wheelchair

Indexed keywords

BRAIN ACTIVITY; BRAIN-COMPUTER INTERFACES (BCI); CONTINUOUS CONTROL; CONTROL SIGNAL; DIRECTION; INDEPENDENT CONTROL; MOTOR IMAGERY; MU RHYTHM; P300; P300 POTENTIAL;

GRAPHICAL USER INTERFACES; INTERFACES (COMPUTER); SPEED; VIRTUAL REALITY; WHEELCHAIRS;

BRAIN COMPUTER INTERFACE;

ARTICLE; BRAIN COMPUTER INTERFACE; COMPUTER AIDED DESIGN; COMPUTER INTERFACE; ELECTROENCEPHALOGRAPHY; EQUIPMENT DESIGN; EQUIPMENT FAILURE ANALYSIS; HUMAN; INSTRUMENTATION; MOTION; PSYCHOPHYSIOLOGY; SYSTEM ANALYSIS; THEORETICAL MODEL; WHEELCHAIR;

BIOFEEDBACK, PSYCHOLOGY; BRAIN-COMPUTER INTERFACES; COMPUTER-AIDED DESIGN; ELECTROENCEPHALOGRAPHY; EQUIPMENT DESIGN; EQUIPMENT FAILURE ANALYSIS; HUMANS; MODELS, THEORETICAL; MOTION; SYSTEMS INTEGRATION; USER-COMPUTER INTERFACE; WHEELCHAIRS;

EID: 84866114575     PISSN: 15344320     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNSRE.2012.2197221     Document Type: Article

References (31)

1. J. R. Millán, R. Rupp, G. R. Müller-Putz, R. Murray-Smith, C. Giugliemma, M. Tangermann, C. Vidaurre, F. Cincotti, A. Kübler, R. Leeb, C. Neuper, K.-R. Müller, and D. Mattia, "Combining brain-computer interfaces and assistive technologies: State-of-the-art and challenges," Front. Neurosci., vol. 4, pp. 1-15, 2010.
2. I. Iturrate, J. M. Antelis, A. Kubler, and J. Minguez, "A noninvasive brain-actuated wheelchair based on a p300 neurophysiological protocol and automated navigation," IEEE Trans. Robot., vol. 25, no. 3, pp. 614-627, Mar. 2009.
3. B. Rebsamen, C. Guan, H. Zhang, C.Wang, C. Teo, M. H. Ang, and E. Burdet, "A brain controlled wheelchair to navigate in familiar environments," IEEE Trans. Neural Syst. Rehab. Eng., vol. 18, no. 6, pp. 590-598, Jun. 2010.
4. F. Galán, M. Nuttin, E. Lew, P.W. Ferrez, G. Vanacker, J. Philips, and J. R. Millán, "A brain-actuated wheelchair: Asynchronous and noninvasive Brain-computer interfaces for continuous control of robots," Clin. Neurophysiol., vol. 119, no. 9, pp. 2159-2169, 2008.
5. K. Tanaka, K. Matsunaga, and H. O. Wang, "Electroencephalogrambased control of an electric wheelchair," IEEE Trans. Robot., vol. 21, no. 4, pp. 762-766, Apr. 2005.
6. L. A. Farwell and E. Donchin, "Talking off the top of your head: Toward a mental prosthesis utilizing event-related brain potentials," Electroencephalogr. Clin. Neurophysiol., vol. 70, no. 6, pp. 510-523, 1988.
7. M. Middendorf, G. McMillan, G. Calhoun, and K. S. Jones, "Braincomputer interfaces based on the steady-state visual-evoked response," IEEE Trans. Neural Syst. Rehab. Eng., vol. 8, no. 2, pp. 211-214, Feb. 2000. (Pubitemid 30437017)
8. G. R. Müller-Putz, R. Scherer, C. Neuper, and G. Pfurtscheller, "Steady-state somatosensory evoked potentials: Suitable brain signals for brain-computer interfaces?," IEEE Trans. Neural Syst. Rehab. Eng., vol. 14, no. 1, pp. 30-37, Jan. 2006.
9. G. Pfurtscheller and F. H. Lopes da Silva, "Event-related EEG/MEG synchronization and desynchronization: Basic principles," Clin. Neurophysiol., vol. 110, no. 11, pp. 1842-1857, 1999. (Pubitemid 29454610)
10. T. Luth, D. Ojdanic, O. Friman, O. Prenzel, and A. Graser, "Low level control in a semi-autonomous rehabilitation robotic system via a braincomputer interface," in Proc. IEEE 10th Int. Conf. Rehabil. Robot., 2007, pp. 721-728.
11. J. R. Millán, F. Renkens, J. Mouriño, and W. Gerstner, "Noninvasive brain-actuated control of a mobile robot by human eeg," IEEE Trans. Biomed. Eng., vol. 51, no. 6, pp. 1026-1033, Jun. 2004. (Pubitemid 38661458)
12. R. Scherer, F. Lee, A. Schlögl, R. Leeb, H. Bischof, and G. Pfurtscheller, "Toward self-paced brain-computer communication: Navigation through virtual worlds," IEEE Trans. Biomed. Eng., vol. 55, no. 2, pp. 675-682, Feb. 2008.
13. J. R. Wolpaw and D. J. McFarland, "Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans," Proc. Nat. Acad. Sci., vol. 101, no. 51, pp. 17 849-17 854, 2004.
14. D. J. McFarland, W. A. Sarnacki, and J. R. Wolpaw, " Electroencephalographic (EEG) control of three-dimensional movement," J. Neural Eng., vol. 7, p. 036007, 2010.
15. D. J. McFarland, D. J. Krusienski, W. A. Sarnacki, and J. R. Wolpaw, "Emulation of computer mouse control with a noninvasive brain-computer interface," J. Neural Eng., vol. 5, no. 2, pp. 101-110, 2008. (Pubitemid 351999178)
16. A. S. Royer, A. J. Doud, M. L. Rose, and B. He, "EEG control of a virtual helicopter in 3-dimensional space using intelligent control strategies," IEEE Trans. Neural Syst. Rehab. Eng., vol. 18, no. 6, pp. 581-589, Jun. 2010.
17. A. J. Doud, J. P. Lucas, M. T. Pisansky, and B. He, "Continuous threedimensional control of a virtual helicopter using a motor imagery based brain-computer interface," PLoS ONE, vol. 6, no. 10, p. e26 322, 2011, 10.1371/journal.pone.0 026 322.
18. G. Pfurtscheller, B. Z. Allison, C. Brunner, G. Bauernfeind, T. Solis-Escalante, R. Scherer, T. O. Zander, G. R. Müller-Putz, C. Neuper, and N. Birbaumer, "The hybrid BCI," Front. Neurosci., vol. 4, pp. 1-11, 2010.
19. G. Pfurtscheller, T. Solis-Escalante, R. Ortner, P. Linortner, and G. R. Müller-Putz, "Self-paced operation of an SSVEP-based orthosis with and without an imagery-based brain switch: A feasibility study towards a hybrid BCI," IEEE Trans. Neural Syst. Rehab. Eng., vol. 18, no. 4, pp. 409-414, Apr. 2010.
20. B. Z. Allison, C. Brunner, V. Kaiser, G. R.Müller-Putz, C. Neuper, and G. Pfurtscheller, "Toward a hybrid brain-computer interface based on imagined movement and visual attention," J. Neural Eng., vol. 7, no. 2, 2010.
21. Y. Li, J. Long, T. Yu, Z. Yu, C. Wang, H. Zhang, and C. Guan, "An EEG-based BCI system for 2-D cursor control by combining Mu/Beta rhythm and P300 potential," IEEE Trans. Biomed. Eng., vol. 57, no. 10, pp. 2495-2505, Oct. 2010.
22. J. Long, Y. Li, T. Yu, and Z. Gu, "Target selection with hybrid feature for BCI-based 2-D cursor control," IEEE Trans. Biomed. Eng., to be published.
23. C. Brunner, B. Z. Allison, D. J. Krusienski, V. Kaiser, G. R. Müller-Putz, G. Pfurtscheller, and C. Neuper, "Improved signal processing approaches in an offline simulation of a hybrid brain-computer interface," J. Neurosci. Methods, vol. 188, no. 1, pp. 165-173, 2010.
24. G. Blanchard and B. Blankertz, "BCI competition 2003-data set IIa: Spatial patterns of self-controlled brain rhythm modulations," IEEE Trans. Biomed. Eng., vol. 51, no. 6, pp. 1062-1066, Jun. 2004. (Pubitemid 38661463)
25. G. Dornhege, B. Blankertz, G. Curio, and K. R. Müller, "Boosting bit rates in noninvasive EEG single-trial classifications by feature combination and multiclass paradigms," IEEE Trans. Biomed. Eng., vol. 51, no. 6, pp. 993-1002, Jun. 2004. (Pubitemid 38661454)
26. Y. Li and C. Guan, "Joint feature re-extraction and classification using an iterative semi-supervised support vector machine algorithm," Mach. Learn., vol. 71, no. 1, pp. 33-53, 2008.
27. B. Blankertz, R. Tomioka, S. Lemm, M. Kawanabe, and K.-R. Müller, "Optimizing spatial filters for robust EEG single-trial analysis," IEEE Signal Process. Mag., vol. 25, no. 1, pp. 41-56, 2008.
28. E. L. Allwein, R. E. Schapire, and Y. Singer, "Reducing multiclass to binary: A unifying approach for margin classifiers," J. Mach. Learn. Res., vol. 1, pp. 113-141, 2001. (Pubitemid 33738778)
29. D. J. Krusienski, E. W. Sellers, D. J. McFarland, T. M. Vaughan, and J. R. Wolpaw, "Toward enhanced P300 speller performance," J. Neurosci. Methods, vol. 167, no. 1, pp. 15-21, 2008. (Pubitemid 350180088)
30. H. Serby, E. Yom-Tov, and G. Inbar, "An improved P300-based braincomputer interface," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 13, no. 1, pp. 89-98, Jan. 2005.
31. G. Pfurtscheller, C. Brunner, A. Schlögl, and F. Lopes da Silva, "Mu rhythm (de) synchronization and EEG single-trial classification of different motor imagery tasks," Neuroimage, vol. 31, no. 1, pp. 153-159, 2006. (Pubitemid 43729000)