Toward a hybrid brain-computer interface based on imagined movement and visual attention

Journal of Neural Engineering

Volumn 7, Issue 2, 2010, Pages

  Allison, B Z ^a   Brunner, C ^a   Kaiser, V ^a   Muller Putz G R ^a   Neuper, C ^a,b   Pfurtscheller, G ^a  

^a GRAZ UNIVERSITY OF TECHNOLOGY   (Austria)

^b UNIVERSITY OF GRAZ   (Austria)

Author keywords

[No Author keywords available]

Indexed keywords

EEG PATTERN; EFFECTIVE COMMUNICATION; EVENT RELATED DESYNCHRONIZATION; HYBRID APPROACH; OFF-LINE ANALYSIS; STEADY STATE VISUAL EVOKED POTENTIALS; VISUAL ATTENTION; VISUAL STIMULUS;

COMBINES; ELECTROENCEPHALOGRAPHY; INTERFACES (COMPUTER); OPTICAL SENSORS;

BRAIN COMPUTER INTERFACE;

ADOLESCENT; ADULT; ARTICLE; BRAIN COMPUTER INTERFACE; ELECTROENCEPHALOGRAM; ELECTROENCEPHALOGRAPHY; EVOKED RESPONSE; EVOKED VISUAL RESPONSE; FEMALE; HAND MOVEMENT; HUMAN; HYBRID; MALE; PRIORITY JOURNAL; STEADY STATE; VISION; VISUAL STIMULATION; ATTENTION; BRAIN; COMPUTER INTERFACE; HAND; HEMISPHERIC DOMINANCE; IMAGINATION; METHODOLOGY; MOTOR ACTIVITY; NEUROPSYCHOLOGICAL TEST; PERIODICITY; PHOTOSTIMULATION; PHYSIOLOGY; PILOT STUDY; SIGNAL PROCESSING; VALIDATION STUDY;

ADOLESCENT; ADULT; ATTENTION; BRAIN; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS, VISUAL; FEMALE; FUNCTIONAL LATERALITY; HAND; HUMANS; IMAGINATION; MALE; MOTOR ACTIVITY; NEUROPSYCHOLOGICAL TESTS; PERIODICITY; PHOTIC STIMULATION; PILOT PROJECTS; SIGNAL PROCESSING, COMPUTER-ASSISTED; USER-COMPUTER INTERFACE; VISUAL PERCEPTION; YOUNG ADULT;

EID: 77949881203     PISSN: 17412560     EISSN: 17412552     Source Type: Journal    
DOI: 10.1088/1741-2560/7/2/026007     Document Type: Article

References (58)

1. Mason S G, Bashashati A, Fatourechi M, Navarro K F and Birch G E 2007 A comprehensive survey of brain interface technology designs Ann. Biomed. Eng. 35 137-69
2. Kübler A, Neumann N, Kaiser J, Kotchoubey B, Hinterberger T and Birbaumer N 2001 Brain-computer communication: self-regulation of slow cortical potentials for verbal communication Arch. Phys. Med. Rehabil. 82 1533-9
3. Wolpaw J R, Birbaumer N, McFarland D J, Pfurtscheller G and Vaughan T M 2002 Brain-computer interfaces for communication and control Clin. Neurophysiol. 113 767-91
4. Neuper C, Müller G R, Kübler A, Birbaumer N and Pfurtscheller G 2003 Clinical application of an EEG-based brain-computer interface: a case study in a patient with severe motor impairment Clin. Neurophysiol. 114 399-409
5. Neuper C, Müller-Putz G R, Scherer R and Pfurtscheller G 2006 Motor imagery and EEG-based control of spelling devices and neuroprostheses Event-related Dynamics of Brain Oscillations (Amsterdam: Elsevier) pp 393-409
6. Pfurtscheller G et al 2006 15 years of BCI research at Graz University of Technology: current projects IEEE Trans. Neural Syst. Rehabil. Eng. 14 205-10
7. Pfurtscheller G, Müller-Putz G, Scherer R and Neuper C 2008 Rehabilitation with brain-computer interface systems Computer 41 58-65
8. Kübler A and Müller K-R 2007 An introduction to brain-computer interfacing Toward Brain-Computer Interfacing ed G Dornhedge, del R Milln J, T Hinterberger,D J McFarland and K-R Müller (Cambridge,MA: MIT Press) pp 125
9. Sellers E W, Kübler A and Donchin E 2006 Brain-computer interface research at the University of South Florida cognitive psychophysiology laboratory: the P300 speller IEEE Trans. Neural Syst. Rehabil. Eng. 14 221-4
10. Allison B Z, Wolpaw E W and Wolpaw J R 2007 Brain-computer interface systems: progress and prospects Expert Rev. Med. Devices 4 463-74
11. Allison B Z, McFarland D J, Schalk G, Zheng S D, Jackson M M and Wolpaw J R 2008 Towards an independent brain-computer interface using steady state visual evoked potentials Clin. Neurophysiol. 119 399-408
12. Farwell L A and Donchin E 1988 Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials Electroencephalogr. Clin. Neurophysiol. 70 510-23
13. Wolpaw J R, McFarland D J and Neat G W 1991 An EEG-based brain-computer interface for cursor control Electroencephalogr. Clin. Neurophysiol. 78 252-9
14. Flotzinger D, Kalcher J and Pfurtscheller G 1992 EEG classification by learning vector quantization Biomed. Tech. 37 303-9
15. Kübler A and Neumann N 2005 Brain-computer interfaces-the key for the conscious brain locked into a paralyzed body Prog. Brain Res. 150 513-25
16. Vaughan T M and Wolpaw J R 2006 The Third International Meeting on Brain-Computer Interface Technology: making a difference IEEE Trans. Neural Syst. Rehabil. Eng. 14 126-7
17. Wang Y, Wang R, Gao X, Hong B and Gao S 2006 A practical VEP-based brain-computer interface IEEE Trans. Neural Syst. Rehabil. Eng. 14 234-40
18. Birbaumer N and Cohen L G 2007 Brain-computer interfaces: communication and restoration of movement in paralysis J. Physiol. 579 621-36
19. Nijboer F et al 2008 A P300-based brain-computer interface for people with amyotrophic lateral sclerosis Clin. Neurophysiol. 119 1909-16
20. Leeb R, Lee F, Keinrath C, Scherer R, Bischof H and Pfurtscheller G 2007 Brain-computer communication: motivation, aim and impact of exploring a virtual apartment IEEE Trans. Neural Syst. Rehabil. Eng. 15 473-82
21. Blankertz B, Losch F, Krauledat M, Dornhege G, Curio G and Müller K-R 2008 The Berlin brain-Computer Interface: accurate performance from first-session in BCI-naive subjects IEEE Trans. Biomed. Eng. 55 2452-62
22. Nijholt A, Tan D, Pfurtscheller G, Brunner C, del R Milln J, Allison B Z, Graimann B, Popescu F, Blankertz B and Müller K-R 2008 Brain-computer interfacing for intelligent systems IEEE Intell. Syst. 23 72-9
23. Sannelli C, Braun M, Tangermann M and Müller K-R 2008 Estimating noise and dimensionality in BCI data sets: towards illiteracy comprehension Proc. of the 4th Int. Brain-Computer Interface Workshop and Training Course 2008 ed G R Müller-Putz, C Brunner, R Leeb, G Pfurtscheller and C Neuper (Graz: Verlag der Technischen Universität Graz) pp 26-31
24. McFarland D J, Krusienski D J, Sarnacki W A and Wolpaw J R 2008 Emulation of computer mouse control with a noninvasive brain-computer interface J. Neural Eng. 5 101-10
25. Friedrich E V C, McFarland D J, Neuper C, Vaughan T M, Brunner P and Wolpaw J R 2009 A scanning protocol for sensorimotor rhythm-based brain-computer interface Biol. Psychol. 80 169-75
26. Neuper C, Scherer R, Reiner M and Pfurtscheller G 2005 Imagery of motor actions: differential effects of kinaesthetic versus visual-motor mode of imagery on single-trial EEG Brain Res. Cogn. Brain Res. 25 668-77
27. Nijboer F 2009 E-mail communication to B Z Allison (6 April 2009)
28. Jasper H H 1958 The ten-twenty electrode system of the International Federation Electroencephalogr. Clin. Neurophysiol. 10 371-75
29. Pudil P, Novoviov J and Kittler J 1994 Floating search methods in feature selection Pattern Recognit. Lett. 15 1119-25
30. Brunner C, Scherer R, Graimann B, Supp G and Pfurtscheller G 2006 Online control of a brain-computer interface using phase synchronization IEEE Trans. Biomed. Eng. 53 2501-6
31. Brunner C, Naeem M, Leeb R, Graimann B and Pfurtscheller G 2007 Spatial filtering and selection of optimized components in four class motor imagery EEG data using independent components analysis Pattern Recognit. Lett. 28 957-64
32. Peterson D A, Knight J N, Kirby M J, Anderson C W and Thaut M H 2005 Feature selection and blind source separation in an EEG-based brain-computer interface EURASIP J. Appl. Signal Proc. 19 3128-40
33. Lotte F, Fujisawa J, Touyama H, Ito R, Hirose M and Lécuyer A 2009 Towards ambulatory brain-computer interfaces: a pilot study with P300 signals 5th Advances in Computer Entertainment Technology Conf. (ACE) (http://portal.acm.org/citation.cfm?doid=1690388.1690452)
34. Müller-Gerking J, Pfurtscheller G and Flyvbjerg H 2000 Classification of movement-related EEG in a memorized delay task experiment Clin. Neurophysiol. 111 1353-65
35. Müller-Putz G R, Eder E, Wriessnegger S C and Pfurtscheller G 2008 Comparison of DFT and lock-in amplifier features and search for optimal electrode positions in SSVEP-based BCI J. Neurosci. Methods 168 174-81
36. Perelmouter J and Birbaumer N 2000 A binary spelling interface with random errors IEEE Trans. Rehabil. Eng. 8 227-32
37. Kübler A and Birbaumer N 2008 Brain-computer interfaces and communication in paralysis: extinction of goal directed thinking in completely paralysed patients? Clin. Neurophysiol. 119 2658-66
38. Hinterberger T, Neumann N, Pham M, Kübler A, Grether A, Hofmayer N, Wilhelm B, Flor H and Birbaumer N 2004 A multimodal brain-based feedback and communication system Exp. Brain Res. 154 521-6
39. Allison B Z and Neuper C 2010 Could anyone use a BCI? (B+H)CI: The Human in Brain-Computer Interfaces and the Brain in Human-Computer Interaction ed D S Tan and A Nijholt in press (Berlin: Springer)
40. Kandel E, Schwartz J and Jessell T 1999 Principles of Neural Science 4th edn (New York: McGraw-Hill Medical) 1414 pp
41. Gazzaniga M S, Ivry R B and Mangun G R 2009 Cognitive Neuroscience: The Biology of the Mind 3rd edn (New York: W W Norton)
42. Brunner C, Allison B Z, Krusienski D J, Kaiser V, Müller-Putz G R, Neuper C and Pfurtscheller G Improved signal processing approaches for a hybrid brain-computer interface simulation J. Neurosci. Methods submitted
43. Pfurtscheller G, Flotzinger D, Pregenzer M, Wolpaw J R and McFarland D J 1995 EEG-based brain computer interface (BCI)-search for optimal electrode positions and frequency components Med. Prog. Through Technol. 21 111-21
44. Pfurtscheller G, Solis-Escalante T, Ortner R and Linortner P 2010 Self-paced operation of an SSVEP-based orthosis with and without an imagery-based 'brain switch': a feasibility study towards a hybrid BCI IEEE Trans. Neural Syst. Rehabil. Eng. in press
45. Pfurtscheller G, Allison B Z, Bauernfeind G, Brunner C, Solis-Escalante T, Scherer R, Zander T O, Müller-Putz G, Neuper C and Birbaumer N 2010 The hybrid BCI Frontiers Neuroprosthetics in press
46. Middendorf M, McMillan G, Calhoun G and Jones K S 2000 Brain-computer interfaces based on the steady-state visual-evoked response IEEE Trans. Rehabil. Eng. 8 211-4
47. Allison B Z, Boccanfuso J B, Agocs C, McCampbell L A, Leland D S, Gosch C and Jackson M M 2006 Sustained use of an SSVEP BCI under adverse conditions (Journal of Cognitive Neuroscience supplement) (Cambridge, MA: MIT Press) p 129
48. Enzinger C, Ropele S, Fazekas F, Loitfelder M, Gorani F, Seifert T, Reiter G, Neuper C, Pfurtscheller G and Müller-Putz G 2008 Brain motor system function in a patient with complete spinal cord injury following extensive brain-computer interface training Exp. Brain Res. 190 215-23
49. Allison B Z, Vankov A and Pineda J A 1999 EEGs and ERPs associated with real and imagined movement of single limbs and combinations of limbs and applications to brain computer interface (BCI) systems Society for Neuroscience Abstract vol 25 p 1411
50. Scherer R, Müller-Putz G R and Pfurtscheller G 2007 Self-initiation of EEG-based brain-computer communication using the heart rate response J. Neural Eng. 4 L23-9
51. Usakli A B, Gurkan S, Aloise F, Vecchiato G and Babiloni F 2009 A hybrid platform based on EOG and EEG signals to restore communication for patients afflicted with progressive motor neuron diseases Conf. Proc. of the IEEE Engineering in Medicine and Biology Society pp 543-6
52. Breitwieser C, Kreilinger A, Neuper C and Müller-Putz G R 2010 The TOBI hybrid BCI-the data acquisition module Proc. of the First TOBI Workshop 2010 p 58
53. Scherer R, Müller G R, Neuper C, Graimann B and Pfurtscheller G 2004 An asynchronously controlled EEG-based virtual keyboard: improvement of the spelling rate IEEE Trans. Biomed. Eng. 51 979-84
54. Wolpaw J R and McFarland D J 2004 Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans Proc. Natl Acad. Sci. USA 101 17849-54
55. Horki P, Solis-Escalante T, Neuper C and Müller-Putz G R 2010 Hybrid motor imagery and steady-state visual evoked potential based BCI for artificial arm control Proc. of the First TOBI Workshop 2010 p 46
56. Leeb R, Tavella M, Perdikis S and del R Milln J 2010 Towards a hybrid-BCI: reliability dependent usage of either muscle or brain activity for a simple control task Proc. of the First TOBI Workshop 2010 p 19
57. Guger C, Daban S, Sellers E, Holzner C, Krausz G, Carabalona R, Gramatica F and Edlinger G 2009 How many people are able to control a P300-based brain-computer interface (BCI)? Neuroscience Lett. 462 94-8
58. Allison B, Luth T, Valbuena D, Teymourian A, Volosyak I and Gräser A 2010 BCI demographics: how many (and what kinds of) people can use an SSVEP BCI? IEEE Trans. on Neural Syst. Rehabilitation Eng. in press