Evaluation and application of a hybrid brain computer interface for real wheelchair parallel control with multi-degree of freedom

International Journal of Neural Systems

Volumn 24, Issue 4, 2014, Pages

  Li, Jie ^a   Ji, Hongfei ^a   Cao, Lei ^a   Zang, Di ^a   Gu, Rong ^a   Xia, Bin ^b,c   Wu, Qiang ^d  

^a TONGJI UNIVERSITY   (China)

^b SHANGHAI MARITIME UNIVERSITY   (China)

^c UNIVERSITY OF TÜBINGEN   (Germany)

^d SHANDONG UNIVERSITY   (China)

Author keywords

Electroencephalogram; hybrid brain computer interface; multi degree of freedom; parallel control; wheelchair

Indexed keywords

BRAIN COMPUTER INTERFACES (BCIS); CONTROL COMMAND; EVENT RELATED DESYNCHRONIZATION; MULTI-DEGREE OF FREEDOM; PARALLEL CONTROL; STEADY STATE VISUAL EVOKED POTENTIALS; WHEELCHAIR CONTROL; WHEELCHAIR NAVIGATION;

ELECTROENCEPHALOGRAPHY; INTERFACES (COMPUTER); WHEELCHAIRS;

BRAIN COMPUTER INTERFACE;

ADULT; ARTICLE; AUDITORY STIMULATION; BEHAVIOR; BRAIN COMPUTER INTERFACE; COMPUTER INTERFACE; ELECTROENCEPHALOGRAPHY; ELECTROENCEPHALOGRAPHY PHASE SYNCHRONIZATION; EVOKED VISUAL RESPONSE; FEEDBACK SYSTEM; FEMALE; FREEDOM; HUMAN; IMAGINATION; MALE; MAN MACHINE INTERACTION; PHYSIOLOGY; PSYCHOLOGICAL ASPECT; WHEELCHAIR; YOUNG ADULT;

ACOUSTIC STIMULATION; ADULT; BRAIN-COMPUTER INTERFACES; ELECTROENCEPHALOGRAPHY; ELECTROENCEPHALOGRAPHY PHASE SYNCHRONIZATION; EVOKED POTENTIALS, VISUAL; FEEDBACK, PHYSIOLOGICAL; FEMALE; FREEDOM; HUMANS; IMAGINATION; INTENTION; MALE; MAN-MACHINE SYSTEMS; USER-COMPUTER INTERFACE; WHEELCHAIRS; YOUNG ADULT;

EID: 84898066286     PISSN: 01290657     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0129065714500142     Document Type: Article

References (62)

1. B. Blankertz, G. Curio and K. R. Muller, Classifying single trial EEG: Towards brain computer interfacing, Adv. Neural Inf. Process. Syst. 1 (2002) 157-164.
2. A. Ortiz-Rosario and H. Adeli, Brain-computer interface technologies: From signal to action, Rev. Neurosci. 24(5) (2013) 537-552.
3. M. Ahmadlou and H. Adeli, Functional community analysis of brain: A new approach for EEG-based investigation of the brain pathology, Neuroimage 58(2) (2011) 401-408.
4. H. Adeli and S. Ghosh-Dastidar, Automated EEGbased Diagnosis of Neurological Disorders: Inventing the Future of Neurology (CRC Press, 2010).
5. H. Adeli, Z. Zhou and N. Dadmehr, Analysis of EEG records in an epileptic patient using wavelet transform, J. Neurosci. Methods 123(1) (2003) 69-87.
6. H. Adeli, S. Ghosh-Dastidar and N. Dadmehr, A wavelet-chaos methodology for analysis of EEGs and EEG sub-bands to detect seizure and epilepsy, IEEE Trans. Biomed. Eng. 54(2) (2007) 205-211.
7. S. Ghosh-Dastidar, H. Adeli and N. Dadmehr, Principal component analysis-enhanced cosine radial basis function neural network for robust epilepsy and seizure detection, IEEE Trans. Biomed. Eng. 55(2) (2008) 512-518.
8. H. Adeli, S. Ghosh-Dastidar and N. Dadmehr, Alzheimer's disease: Models of computation and analysis of EEGs, Clin. EEG Neurosci. 36(3) (2005) 131-140.
9. H. Adeli, S. Ghosh-Dastidar and N. Dadmehr, A spatio-temporal wavelet-chaos methodology for EEG-based diagnosis of Alzheimer's disease, Neurosci. Lett. 444(2) (2008) 190-194.
10. Z. Sankari and H. Adeli, Probabilistic neural networks for EEG-based diagnosis of Alzheimer's disease using conventional and wavelet coherence, J. Neurosci. Methods 197(1) (2011) 165-170.
11. Z. Sankari, H. Adeli and A. Adeli, Wavelet coherence model for diagnosis of Alzheimer's disease, Clin. EEG Neurosci. 43(3) (2012) 268-278.
12. V. Jelic, S. E. Johansson, O. Almkvist, M. Shigeta, P. Julin, A. Nordberg and L. O. Wahlund, Quantitative electroencephalography in mild cognitive impairment: Longitudinal changes and possible prediction of Alzheimer's disease, Neurobiol. Aging 21(4) (2000) 533-540.
13. M. Ahmadlou, A. Adeli, R. Bajo and H. Adeli, Complexity of functional connectivity networks in mild cognitive impairment patients during a working memory task, Clin. Neurophysiol. 125(4) (2014) 694-702.
14. M. Ahmadlou, H. Adeli and A. Adeli, Fractality and a wavelet-chaos-neural network methodology for EEG-based diagnosis of autistic spectrum disorder, J. Clin. Neurophysiol. 27(5) (2010) 328-333.
15. M. Ahmadlou, H. Adeli and A. Adeli, Fuzzy synchronization likelihood-wavelet methodology for diagnosis of autism spectrum disorder, J. Neurosci. Methods 211(2) (2012) 203-209.
16. M. Ahmadlou, H. Adeli and A. Adeli, Improved visibility graph fractality with application for diagnosis of Autism spectrum disorder, Phys. A, Stat. Mech. Appl. 391(20) (2012) 4720-4726.
17. M. Ahmadlou and H. Adeli, Fuzzy synchronization likelihood with application to attentiondeficit/hyperactivity disorder, Clin. EEG Neurosci. 42(1) (2011) 6-13.
18. M. Ahmadlou, H. Adeli and A. Adeli, Fractality analysis of frontal brain in major depressive disorder, Int. J. Psychophysiol. 85(2) (2012) 206-211.
19. M. Ahmadlou, H. Adeli and A. Adeli, Spatiotemporal analysis of relative convergence (STARC) of EEGs reveals differences between brain dynamics of depressive women and men, Clin. EEG Neurosci. 44 (2013) 175-181.
20. N. Birbaumer, A. Kubler, N. Ghanayim, T. Hinterberger, J. Perelmouter, J. Kaiser, I. Iversen, B. Kotchoubey, N. Neumann and H. Flor, The thought translation device (TTD) for completely paralyzed patients, IEEE Trans. Rehabil. Eng. 8(2) (2000) 190-193.
21. X. Gao, D. Xu, M. Cheng and S. Gao, A BCI-based environmental controller for the motion-disabled, IEEE Trans. Neural Syst. Rehabil. Eng. 11(2) (2003) 137-140.
22. L. Farwell and E. Donchin, Talking off the top of your head: Toward a mental prosthesis utilizing event-related brain potentials, Electroencephalogr. Clin. Neurophysiol. 70(6) (1988) 510-523.
23. G. Pfurtscheller and C. Neuper, Motor imagery and direct brain-computer communication, Proc. IEEE 89(7) (2001) 1123-1134.
24. Y. Zhang, Q. Zhao, J. Jin, X. Wang and A. Cichocki, A novel BCI based on ERP components sensitive to configural processing of human faces, J. Neural Eng. 9(2) (2012) 026018.
25. S. Mun, S. Cho, M. Whang, B. K. Ju and M. C. Park, SSVEP-based BCI for manipulating threedimensional contents and devices, Soc. Photo-Opt. Instrum. Eng. (SPIE) Conf. Ser. 8384 (2012) 25-32.
26. P. F. Diez, V. A. Mut, E. M. A. Perona and E. L. Leber, Asynchronous BCI control using high frequency SSVEP, J. Rehabil. 8(1) (2011) 39.
27. R. Singla and B. A. Haseena, BCI based wheelchair control using steady state visual evoked potentials and support vector machines, Int. J. Soft Comput. Eng. (IJSCE) 3(3) (2013) 46-52.
28. C. Mandel, T. Luth, T. Laue, T. Rofer, A. Graser and B. Krieg-Bruckner, Navigating a smart wheelchair with a brain-computer interface interpreting steady-state visual evoked potentials, IEEE/RSJ Int. Conf. Intelligent Robots and Systems, 2009, IROS, 1118-1125.
29. B. D. Seno, M. Matteucci and L. Mainardi, Online detection of P300 and error potentials in a BCI speller, Comput. Intell. Neurosci. 2010 (2010) 11.
30. J. Jin, E. Sellers and X. Wang, Targeting an efficient target-to-target interval for P300 speller brain-computer interfaces, Med. Biol. Eng. Comput. 50(3) (2012) 289-296.
31. F. Akram, M. K. Metwally, H. S. Han, H. J. Jeon and T. S. Kim, A novel P300-based BCI system for words typing, brain-computer interface (BCI), in Brain-Computer Interface (BCI) 2013 International Winter Workshop on (IEEE, Gangwon Province, South Korea), pp. 24-25.
32. I. Iturrate, J. Antelis, A. Kubler and J. Minguez, A noninvasive brain-actuated wheelchair based on a p300 neurophysiological protocol and automated navigation, IEEE Trans. Robot. 25(3) (2009) 614-627.
33. B. Rebsamen, E. Burdet, C. Guan, H. Zhang, C. L. Teo, Q. Zeng, M. Ang and C. Laugier, A brain-controlled wheelchair based on P300 and path guidance, in The First IEEE/RAS-EMBS Int. Conf. Biomedical Robotics and Biomechatronics, 2006, BioRob, pp. 1101-1106.
34. B. Rebsamen, C. Guan, H. Zhang, C. Wang, C. Teo, M. H. Ang and E. Burdet, A brain controlled wheelchair to navigate in familiar environments, IEEE Trans. Neural Syst. Rehabil. Eng. 18(6) (2010) 590-598.
35. C. Guger, B. Z. Allison, B. Großwindhager, R. Prückl, C. Hintermüller, C. Kapeller, M. Bruckner, G. Krausz and G. Edlinger, How many people could use an SSVEP BCI? Front. Neurosci. 6 (2012) 169-169.
36. A. Kaplan, S. Shishkin, I. Ganin, I. Basyul and A. Zhigalov, Adapting the P300-based brain-computer interface for gaming: A review, Computational Intelligence and AI in Games, IEEE Transactions on, 5(2) (2013) 141-149.
37. R. Leeb, D. Friedman, G. R. Muller-Putz, R. Scherer, M. Slater and G. Pfurtscheller, Selfpaced (asynchronous) BCI control of a wheelchair in virtual environments: A case study with a tetraplegic, Comput. Intell. Neurosci. 4 (2007) 1687C-5265.
38. D. Huang, K. Qian, D. Y. Fei, W. Jia, X. Chen and O. Bai, Electroencephalography (EEG)-based brain-computer interface (BCI): A 2D virtual wheelchair control based on event-related desynchronization/synchronization and state control, IEEE Trans. Neural Syst. Rehabil. Eng. 20(3) (2012) 379-388.
39. C. Tsui, J. Gan and H. Hu, A self-paced motor imagery based brain-computer interface for robotic wheelchair control, Clin. EEG Neurosci. 42(4) (2011) 225-229.
40. J. H. Li, J. Liang, Q. B. Zhao, J. Li, K. Hong and L. Q. Zhang, Design of assistive wheelchair system ditectly steered by human thoughts, Int. J. Neural Syst. 23(3) (2013) 1350013.1-1350013.12, doi: 10.1142/S0129065713500135.
41. A. Vuckovic, Non-invasive BCI: How far can we get with motor imagination? Clin. Neurophysiol. 120(8) (2009) 1422-1423.
42. G. Pfurtscheller, B. Z. Allison, C. Brunner, G. Bauernfeind, T. Solis-Escalante, R. Scherer, T. Zander, G. Mueller-Putz, C. Neuper and N. Birbaumer, The hybrid BCI, Front. Neurosci. 4 (2010).
43. B. Rebsamen, E. Burdet, Q. Zeng, H. Zhang, M. Ang, C. L. Teo, C. Guan and C. Laugier, Hybrid P300 and Mu-Beta brain computer interface to operate a brain controlled wheelchair, Proc. 2nd Int. Convention on Rehabilitation Engineering and Assistive Technology. Singapore Therapeutic, Assistive and Rehabilitative Technologies (START) Centre (2008), pp. 51-55.
44. Y. Li, J. Pan, F. Wang and Z. Yu, A hybrid BCI system combining P300 and SSVEP and its application to wheelchair control, IEEE Trans. Biomed. Eng. 60(11) (2013) 3156-3166.
45. J. Long, Y. Li, H. Wang, T. Yu, J. Pan and F. Li, A hybrid brain computer interface to control the direction and speed of a simulated or real wheelchair, IEEE Trans. Neural Syst. Rehabil. Eng. 20(5) (2012) 720-729.
46. J. Li, H. F. Ji, L. Cao, R. Gu, B. Xia and Y. Huang, Wheelchair control based on multimodal brain-computer interfaces, in Neural Information Processing 2013, in 20th International Conference on Neural Information Processing (Springer Berlin Heidelberg, Daegu, Korea, 2013), pp. 434-441.
47. P. Horki, T. Solis-Escalante, C. Neuper and G. Müller-Putz, Combined motor imagery and SSVEP based BCI control of a 2 DoF artificial upper limb, Med. Biol. Eng. Comput. 49(5) (2011) 567-577.
48. C. Brunner, B. Z. Allison, C. Altstätter and C. Neuper, A comparison of three brain-computer interfaces based on event-related desynchronization, steady state visual evoked potentials, or a hybrid approach using both signals, J. Neural Eng. 8(2) (2011) 025010.
49. B. Z. Allison, C. Brunner, V. Kaiser, G. Müller-Putz, C. Neuper and G. Pfurtscheller, Toward a hybrid brain-computer interface based on imagined movement and visual attention, J. Neural Eng. 7(2) (2010) 026007.
50. A. Delorme and S. Makeig, EEGLAB: An open source toolbox for analysis of single-trial EEG dynamics including independent component analysis, J. Neurosci. Methods 134(1) (2004) 9-21.
51. H. Ramoser, J. Muller-Gerking and G. Pfurtscheller, Optimal spatial filtering of single trial EEG during imagined hand movement, IEEE Trans. Rehabil. Eng. 8(4) (2000) 441-446.
52. Z. Lin, C. Zhang, W. Wu and X. Gao, Frequency recognition based on canonical correlation analysis for SSVEP-based BCIs, IEEE Trans. Biomed. Eng. 53(12) (2006) 2610-2614.
53. G. Bin, X. Gao, Z. Yan, B. Hong and S. Gao, An online multi-channel SSVEP-based brain-computer interface using a canonical correlation analysis method, J. Neural Eng. 6(4) (2009) 046002.
54. C. Chih-Chung and L. Chih-Jen, LIBSVM: A library for support vector machines, ACM Trans. Intell. Syst. Technol. 2(27) (2011) 1-27, http://www.csie. ntu.edu.tw/~cjlin/libsvm.
55. F. Lotte, H. Mouchere and A. Lécuyer, Pattern rejection strategies for the design of self-paced EEGbased brain-computer interfaces, pattern recognition, 19th Int. Conf. ICPR 2008, IEEE (2008), pp. 1-5.
56. R. Scherer, A. Schloegl, F. Lee, H. Bischof, J. Janša and G. Pfurtscheller, The self-paced Graz braincomputer interface: Methods and applications, Comput. Intell. Neurosci. 2007 (2007) 79826-1-79826-9, doi:10.1155/2007/79826.
57. R. Scherer, F. Lee, A. Schloegl, R. Leeb, H. Bischof and G. Pfurtscheller, Towards self-paced braincomputer communication: Navigation through virtual worlds, IEEE Trans. Biomed. Eng. 55(2) (2008) 675-682.
58. D. Zhang, Y. Wang, X. Gao, B. Hong and S. Gao, An algorithm for idle-state detection in motorimagery based brain-computer interface, Comput. Intell. Neurosc. 2007 (2007) 39714-1-39714-9, doi: 10.1155/2007/39714.
59. S. G. Mason, J. Kronegg, J. Huggins, M. Fatourechi and A. Schlögl, Evaluating the performance of selfpaced brain computer interface technology, Neil Squire Society, Vancouver, BC, Canada, Technical Report 2006.
60. J. Millan and J. Mouriñno, Asynchronous BCI and local neural classifiers: An overview of the adaptive brain interface project, IEEE Trans. Neural Syst. Rehabil. Eng. 11(2) (2003) 159-161.
61. H. Cecotti, A self-paced and calibration-less SSVEPbased brain-computer interface speller, IEEE Trans. Neural Syst. Rehabil. Eng. 18(2) (2010) 127-133.
62. T. Wu, C. Lin and R. Weng, Probability estimates for multi-class classification by pairwise coupling, J. Mach. Learn. Res. 5 (2004) 975-1005.