Toward smarter BCIs: Extending BCIs through hybridization and intelligent control

Journal of Neural Engineering

Volumn 9, Issue 1, 2012, Pages

  Allison, B Z ^a   Leeb, R ^b   Brunner, C ^a   Muller Putz G R ^a   Bauernfeind, G ^a   Kelly, J W ^c   Neuper, C ^a,d  

^a GRAZ UNIVERSITY OF TECHNOLOGY   (Austria)

^b EPFL   (Switzerland)

^c CARNEGIE MELLON UNIVERSITY   (United States)

^d UNIVERSITY OF GRAZ   (Austria)

Author keywords

[No Author keywords available]

Indexed keywords

INTELLIGENT SYSTEMS; VIRTUAL REALITY;

BRAIN COMPUTER INTERFACE;

BRAIN COMPUTER INTERFACE; CONCEPTUAL FRAMEWORK; HUMAN; HYBRID COMPUTER; NEAR INFRARED SPECTROSCOPY; PRIORITY JOURNAL; PROCESS TECHNOLOGY; REVIEW; VIRTUAL REALITY; ARTIFICIAL INTELLIGENCE; BRAIN; BRAIN MAPPING; COMPUTER INTERFACE; ELECTROENCEPHALOGRAPHY; EVOKED RESPONSE; FEEDBACK SYSTEM; METHODOLOGY; PHYSIOLOGY; PSYCHOPHYSIOLOGY;

ARTIFICIAL INTELLIGENCE; BIOFEEDBACK, PSYCHOLOGY; BRAIN; BRAIN MAPPING; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FEEDBACK, PHYSIOLOGICAL; HUMANS; USER-COMPUTER INTERFACE;

EID: 84856996839     PISSN: 17412560     EISSN: 17412552     Source Type: Journal    
DOI: 10.1088/1741-2560/9/1/013001     Document Type: Review

References (57)

1. Pfurtscheller G, Allison B Z, Bauernfeind G, Brunner C, Solis Escalante T, Scherer R, Zander T O, Müller-Putz G, Neuper C and Birbaumer N 2010 The hybrid BCI Front. Neurosci. 4 42
2. Kennedy P R, Bakay R A, Moore M M, Adams K and Goldwaithe J 2000 Direct control of a computer from the human central nervous system IEEE Trans. Rehabil. Eng. 8 198-202 (Pubitemid 30437013)
3. Junker A, Berg C and Schnider P 1995 Evaluation of the cyberlink interface as an alternative human operator controller Technical Report Wright-Patterson Air Force Base, OH
4. Nelson T W, Hettinger L J, Cunningham J A, Roe M M, Lu L G, Haas M W, Dennis L B, Pick H L and Junker A Brain-body actuated control: assessment of an alternative control technology for virtual environments Image Conf.
5. Nelson W T, Hettinger J, Cunningham J A, Roe M M, Haas M W and Dennis L B 1997 Navigating through virtual flight environments using brain-body-actuated control Virtual Reality Annu. Int. Symp. p 30
6. Leeb R, Sagha H, Chavarriaga R and Millán J d R 2011 A hybrid brain-computer interface based on the fusion of electroencephalographic and electromyographic activities J. Neural Eng. 8 025011
7. Scherer R, Müller-Putz G R and Pfurtscheller G 2007 Self-initiation of EEG-based brain-computer communication using the heart rate response J. Neural Eng. 4 L23-9 (Pubitemid 350242920)
8. Danoczy M, Fazli S, Grozea C, Muller K R and Popescu F 2008 Brain2robot: a grasping robot arm controlled by gaze and asynchronous EEG BCI Proc. 4th Int. BCI Workshop and Training Course
9. Jacob R J K, Legett J J, Myers B A and Pausch R 1993 Interaction styles and input/output devices Behav. Inf. Technol. 12 69-79
10. Moore M M 2003 Real-world applications for brain-computer interface technology IEEE Trans. Neural Syst. Rehabil. Eng. 11 162-5 (Pubitemid 36935048)
11. Zander T O, Gaertner M, Kothe C and Vilimek R 2011 Combining eye gaze input with a brain-computer interface for touchless human-computer interaction Int. J. Hum.-Comput. Interact. 27 38-51
12. Usakli A B, Gurkan S, Aloise F, Vecchiato G and Babiloni F 2009 A hybrid platform based on EOG and EEG signals to restore communication for patients afflicted with progressive motor neuron diseases Conf. Proc. IEEE Engineering in Medicine and Biology Society (Minneapolis, MN, 3-6 September 2009) pp 543-6
13. Allison B Z, Vankov A and Pineda J A 1999 EEGs and ERPs associated with real and imagined movement of single limbs and combinations of limbs and applications to brain-computer interface (BCI) systems Soc. Neurosci. Abstr. 25 1139
14. Wolpaw J R, Birbaumer N, McFarland D J, Pfurtscheller G and Vaughan T M 2002 Brain-computer interfaces for communication and control Clin. Neurophysiol. 113 767-91 (Pubitemid 34621187)
15. Allison B Z, Brunner C, Kaiser V, Müller-Putz G R, Neuper C and Pfurtscheller G 2010 Toward a hybrid brain-computer interface based on imagined movement and visual attention J. Neural Eng. 7 026007
16. Brunner C, Allison B Z, Krusienski D J, Kaiser V, Müller-Putz G R, Pfurtscheller G and Neuper C 2010 Improved signal processing approaches in an offline simulation of a hybrid brain-computer interface J. Neurosci. Methods 188 165-73
17. Pfurtscheller G, Solis-Escalante T, Ortner R, Linortner P and Muller-Putz G R 2010 Self-paced operation of an SSVEP-based orthosis with and without an imagery-based 'brain switch': a feasibility study towards a hybrid BCI IEEE Trans. Neural Syst. Rehabil. Eng. 18 409-14
18. Brunner C, Allison B Z, Altstätter C and Neuper C 2011 A comparison of three brain-computer interfaces based on event-related desynchronization, steady state visual evoked potentials, or a hybrid approach using both signals J. Neural Eng. 8 025010
19. Jin J, Allison B Z, Wang X and Neuper C 2011 A hybrid brain-computer interface based on P300 and M-VEP 5th Int. BCI Conf. (Graz) pp 224-7
20. Li Y, Long J, Yu T, Yu Z, Wang C, Zhang H and Guan C 2010 An EEG-based BCI system for 2-D cursor control by combining mu/beta rhythm and P300 potential IEEE Trans. Biomed. Eng. 57 2495-505
21. Ferrez P W and Millán J del R 2008 Simultaneous real-time detection of motor imagery and error-related potentials for improved BCI accuracy Proc. 4th Int. Brain-Computer Interface Workshop and Training Course (Graz, Austria)
22. Su Y, Qi Y, Luo J-X, Wu B, Yang F, Li Y, Zhuang Y-T, Zheng X-X and Chen W-D 2011 A hybrid brain-computer interface control strategy in a virtual environment J. Zhejiang Univ. Sci. C 12 351-61
23. Panicker R C, Puthusserypady S and Sun Y 2011 An asynchronous P300 BCI with SSVEP-based control state detection IEEE Trans. Biomed. Eng. 58 1781-8
24. Jin J, Allison B Z, Wang X and Neuper C 2011 A comparison of three brain-computer interfaces based on P300 potentials, M-VEPs or a hybrid approach using both signals IEEE Trans. Neural Syst. Rehabil. Eng. (in review)
25. Allison B Z, Brunner C, Grissmann S, Altstätter C, Wagner I and Neuper C 2011 A hybrid ERD/SSVEP BCI for continuous simultaneous two-dimensional cursor control (in review)
26. Kreilinger A, Kaiser V, Breitwieser C, Williamson J, Neuper C and Müller-Putz G R 2011 Switching between manual control and brain-computer interface using long term and short term quality measures Front. Neuroprosthetics (in revision)
27. Millán J d R et al 2010 Combining brain-computer interfaces and assistive technologies: state-of-the-art and challenges Front. Neurosci. 4 161
28. Holroyd C B and Coles M G H 2002 The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity Psychol. Rev. 109 679-709
29. Schalk G, Wolpaw J R, McFarland D J and Pfurtscheller G 2000 EEG-based communication: presence of an error potential Clin. Neurophysiol. 111 2138-44
30. Blankertz B, Dornhege G, Schäfer C, Krepki R, Kohlmorgen J, Müller K R, Kunzmann V, Losch F and Curio G 2003 Boosting bit rates and error detection for the classification of fast-paced motor commands based on single-trial EEG analysis IEEE Trans. Neural Syst. Rehabil. Eng. 11 127-31 (Pubitemid 36935038)
31. Parra L C, Spence C D, Gerson A D and Sajda P 2003 Response error correction - a demonstration of improved human-machine performance using real-time EEG monitoring IEEE Trans. Neural Syst. Rehabil. Eng. 11 173-7 (Pubitemid 36935051)
32. Buttfield A, Ferrez P W and Millán J d R 2006 Towards a robust BCI: error potentials and online learning IEEE Trans. Neural Syst. Rehabil. Eng. 14 164-8
33. Ferrez P W and Millán J del R 2008 Error-related EEG potentials generated during simulated brain-computer interaction IEEE Trans. Biomed. Eng. 55 923-9 (Pubitemid 351301222)
34. Nijholt A, Tan D, Pfurtscheller G, Brunner C, Millán J del R, Allison B Z, Graimann B, Popescu F, Blankertz B and Müller K-R 2008 Brain-computer interfacing for intelligent systems IEEE Intell. Syst. 23 72-9 (Pubitemid 351751949)
35. Bell C J, Shenoy P, Chalodhorn R and Rao R P N 2008 Control of a humanoid robot by a noninvasive brain-computer interface in humans J. Neural Eng. 5 214-20 (Pubitemid 351999188)
36. Cherubini A, Oriolo G, Macrì F, Aloise F, Cincotti F and Mattia D 2008 A multimode navigation system for an assistive robotics project Auton. Robots 25 383-404
37. Galán F, Nuttin M, Lew E, Ferrez P W, Vanacker G, Philips J and Millán J Del R 2008 A brain-actuated wheelchair: asynchronous and non-invasive brain-computer interfaces for continuous control of robots Clin. Neurophysiol. 119 2159-69
38. Graimann B, Allison B Z, Mandel C, Lüth T, Valbuena D and Gráser A 2008 Non-invasive brain-computer interfaces for semi-autonomous assistive devices Robust Intelligent Systems (London: Springer) pp 113-37
39. Tonin L, Leeb R, Tavella M, Perdikis S and Millán J del R The role of shared-control in BCI-based telepresence Proc. 2010 IEEE Int. Conf. on Systems, Man and Cybernetics pp 1462-6
40. Rebsamen B, Guan C, Zhang H, Wang C, Teo C, Ang M H and Burdet E 2010 A brain-controlled wheelchair to navigate in familiar environments IEEE Trans. Neural Syst. Rehabil. Eng. 18 590-8
41. Williamson J, Murray-Smith R, Blankertz B, Krauledat M and Müller K R 2009 Designing for uncertain, asymmetric control: interaction design for brain-computer interfaces Int. J. Human Comput. Stud. 67 827-41
42. Royer A S, Doud A J, Rose M L and He B 2010 EEG control of a virtual helicopter in 3-dimensional space using intelligent control strategies IEEE Trans. Neural Syst. Rehabil. Eng. 18 581-9
43. Wolpaw J R 2007 Brain-computer interfaces as new brain output pathways J. Physiol. 579 613-9 (Pubitemid 46404345)
44. Navarro N A, Ceccaroni L, Velickovski F, Torrellas S, Miralles F, Allison B Z, Scherer R and Faller J 2011 Context awareness as an enhancement of brain-computer interfaces Int. Workshop on Ambient Assisted Living (Malaga, Spain) pp 216-23
45. Millán J del R, Renkens F, Mouriño J and Gerstner W 2004 Noninvasive brain-actuated control of a mobile robot by human EEG IEEE Trans. Biomed. Eng. 51 1026-33 (Pubitemid 38661458)
46. Leeb R, Lee F, Keinrath C, Scherer R, Bischof H and Pfurtscheller G 2007 Brain-computer communication: motivation, aim and impact of exploring a virtual apartment IEEE Trans. Neural Syst. Rehabil. Eng. 15 473-82 (Pubitemid 350274168)
47. Leeb R, Settgast V, Fellner D W and Pfurtscheller G 2007 Self-paced exploring of the Austrian National Library through thoughts Int. J. Bioelectromagnetism 9 237-44
48. Ron-Angevin R, Diaz-Estrella A and Velasco-Alvarez F 2009 A two-class brain-computer interface to freely navigate through virtual worlds Biomed. Tech. 54 126-33
49. Scherer R, Lee F, Schlögl A, Leeb R, Bischof H and Pfurtscheller G 2008 Toward self-paced brain-computer communication: navigation through virtual worlds IEEE Trans. Biomed. Eng. 55 675-82
50. Lecuyer A, Lotte F, Reilly R B, Leeb R, Hirose M and Slater M 2008 Brain-computer interfaces, virtual reality, and videogames Computer 41 66-72
51. Leeb R, Friedman D, Müller-Putz G R, Scherer R, Slater M and Pfurtscheller G 2007 Self-paced (asynchronous) BCI control of a wheelchair in virtual environments: a case study with a tetraplegic Comput. Intell. Neurosci. 2007 79642
52. Bayliss J D 2003 Use of the evoked potential P3 component for control in a virtual apartment IEEE Trans. Neural Syst. Rehabil. Eng. 11 113-6 (Pubitemid 36935034)
53. Faller J, Müller-Putz G, Schmalstieg D and Pfurtscheller G An application framework for controlling an avatar in a desktop-based virtual environment via a software SSVEP brain-computer interface Presence: Teleoperators Virtual Environ. 19 25-34
54. Lalor E C, Kelly S P, Finucane C, Burke R, Smith R, Reilly R B and McDarby G 2005 Steady-state VEP-based brain-computer interface control in an immersive 3-d gaming environment EURASIP J. Appl. Signal Process. 19 3156-64 (Pubitemid 44796389)
55. Faller J, Allison B, Brunner C, Schmalstieg D and Pfurtscheller G 2010 A software SSVEP BCI integrating stimuli within motivating and immersive virtual and augmented reality environments Real Actions in Virtual Environments (RAVE) Conf. (Barcelona, Spain)
56. Leeb R et al 2006 Walking by thinking: the brainwaves are crucial, not the muscles! Presence: Teleoperators Virtual Environ. 15 500-14 (Pubitemid 44728702)
57. Scherer R, Friedrich E V C, Allison B Z, Pröll M, Chung M, Cheung W, Rao R P N and Neuper C 2011 Non-invasive brain-computer interfaces: enhanced gaming and robotic control Int. Workshop on Artificial Neural Networks (Malaga, Spain) pp 362-7