Achieving a hybrid brain-computer interface with tactile selective attention and motor imagery

Journal of Neural Engineering

Volumn 11, Issue 6, 2014, Pages

  Ahn, Sangtae ^a   Ahn, Minkyu ^a   Cho, Hohyun ^a   Chan Jun, Sung ^a  

^a Gwangju Institute of Science and Technology (GIST)   (South Korea)

Author keywords

hybrid brain computer interface; motor imagery; tactile selective attention

Indexed keywords

CLASSIFICATION (OF INFORMATION); INTERFACES (COMPUTER);

CLASSIFICATION ACCURACY; CLASSIFICATION PERFORMANCE; EVENT RELATED DESYNCHRONIZATION; HAND MOVEMENT; HYBRID APPROACH; MOTOR IMAGERY; SELECTIVE ATTENTION; STEADY-STATE SOMATOSENSORY EVOKED POTENTIAL (SSSEP);

BRAIN COMPUTER INTERFACE;

ADULT; ARTICLE; BRAIN COMPUTER INTERFACE; ELECTROENCEPHALOGRAM; EVOKED SOMATOSENSORY RESPONSE; FEMALE; HAND MOVEMENT; HUMAN; HUMAN EXPERIMENT; HYBRID COMPUTER; IMAGERY; MALE; MOTOR IMAGERY; NORMAL HUMAN; SELECTIVE ATTENTION; TACTILE FEEDBACK; TACTILE STIMULATION; ATTENTION; BRAIN; CONTROLLED STUDY; IMAGINATION; MOVEMENT (PHYSIOLOGY); PHOTOSTIMULATION; PHYSIOLOGY; PROCEDURES; RANDOMIZED CONTROLLED TRIAL; TOUCH; YOUNG ADULT;

ADULT; ATTENTION; BRAIN; BRAIN-COMPUTER INTERFACES; FEMALE; HUMANS; IMAGINATION; MALE; MOVEMENT; PHOTIC STIMULATION; TOUCH; YOUNG ADULT;

EID: 84913533967     PISSN: 17412560     EISSN: 17412552     Source Type: Journal    
DOI: 10.1088/1741-2560/11/6/066004     Document Type: Article

References (73)

1. Blankertz B, Tomioka M K R, Hohlefeld F U, Nikulin V and Müller K 2008 Invariant common spatial patterns: alleviating nonstationarities in brain-computer interfacing Advances in Neural Information Processing Systems vol 20 (Cambridge, MA: MIT)
2. Ahn M, Hong J H and Jun S C 2012 Feasibility of approaches combining sensor and source features in brain-computer interface J. Neurosci. Methods 204 168-78
3. Vidaurre C, Sannelli C, Müller K-R and Blankertz B 2011 Co-adaptive calibration to improve BCI efficiency J. Neural Eng. 8 025009
4. Allison B Z, Brunner C, Kaiser V, Müller-Putz G R, Neuper C and Pfurtscheller G 2010 Toward a hybrid brain-computer interface based on imagined movement and visual attention J. Neural Eng. 7 026007
5. Blankertz B, Sannelli C, Halder S, Hammer E M, Kübler A, Müller K-R, Curio G and Dickhaus T 2010 Neurophysiological predictor of SMR-based BCI performance NeuroImage 51 1303-9
6. Allison B Z and Neuper C 2010 Could anyone use a BCI? Brain-Computer Interfaces: Human-Computer Interaction Series ed D S Tan and A Nijholt (London: Springer) 35-54
7. Pfurtscheller G, Allison B Z, Brunner C, Bauernfeind G, Solis-Escalante T, Scherer R, Zander T O, Müller -Putz G, Neuper C and Birbaumer N 2010 The hybrid BCI Front. Neurosci. 4 30
8. Müller-Putz G R, Leeb R, Millán J d R, Horki P, Kreilinger A, Bauernfeind G, Allison B Z, Brunner C and Scherer R 2013 Principles of hybrid brain-computer interfaces Towards Practical Brain-Computer Interfaces: Biological and Medical Physics, Biomedical Engineering ed B Z Allison, S Dunne, R Leeb, J D R Millán and A Nijholt (Berlin: Springer) 355-73
9. Scherer R, Müller-Putz G R and Pfurtscheller G 2007 Self-initiation of EEG-based brain-computer communication using the heart rate response J. Neural Eng. 4 L23-9
10. Zander T O, Gaertner M, Kothe C and Vilimek R 2010 Combining eye gaze input with a brain-computer interface for touchless human-computer interaction Int. J. Hum.-Comput. Interact. 27 38-51
11. Ferrez P W and del R Millan J 2008 Error-related EEG potentials generated during simulated brain-computer interaction IEEE Trans. Biomed. Eng. 55 923-9
12. Leeb R, Sagha H, Chavarriaga R and Millán J D R 2011 A hybrid brain-computer interface based on the fusion of electroencephalographic and electromyographic activities J. Neural Eng. 8 025011
13. Punsawad Y, Wongsawat Y and Parnichkun M 2010 Hybrid EEG-EOG brain-computer interface system for practical machine control Conf. Proc. Annu. Int. Conf. IEEE Eng. Med. Biol. Soc. 2010 1360-3
14. Pfurtscheller G and Lopes da Silva F H 1999 Event-related EEG/MEG synchronization and desynchronization: basic principles Clin. Neurophysiol. 110 1842-57
15. Su Y, Qi Y, Luo J, Wu B, Yang F, Li Y, Zhuang Y, Zheng X and Chen W 2011 A hybrid brain-computer interface control strategy in a virtual environment J. Zhejiang Univ. Sci. C 12 351-61
16. Li Y, Long J, Yu T, Yu Z, Wang C, Zhang H and Guan C 2010 An EEG-based BCI system for 2D cursor control by combining mu/beta rhythm and P300 potential IEEE Trans. Biomed. Eng. 57 2495-505
17. Long J, Li Y, Wang H, Yu T, Pan J and Li F 2012 A hybrid brain computer interface to control the direction and speed of a simulated or real wheelchair IEEE Trans. Neural Syst. Rehabil. Eng. 20 720-9
18. Long J, Li Y, Yu T and Gu Z 2012 Target selection with hybrid feature for BCI-based 2D cursor control IEEE Trans. Biomed. Eng. 59 132-40
19. Brunner C, Allison B Z, Krusienski D J, Kaiser V, Müller-Putz G R, Pfurtscheller G and Neuper C 2010 Improved signal processing approaches in an offline simulation of a hybrid brain-computer interface J. Neurosci. Methods 188 165-73
20. Allison B Z, Brunner C, Altstätter C, Wagner I C, Grissmann S and Neuper C 2012 A hybrid ERD/SSVEP BCI for continuous simultaneous two dimensional cursor control J. Neurosci. Methods 209 299-307
21. Kelly S P, Lalor E C, Reilly R B and Foxe J J 2005 Visual spatial attention tracking using high-density SSVEP data for independent brain-computer communication IEEE Trans. Neural Syst. Rehabil. Eng. Publ. IEEE Eng. Med. Biol. Soc. 13 172-8
22. Müller-Putz G R, Scherer R, Neuper C and Pfurtscheller G 2006 Steady-state somatosensory evoked potentials: suitable brain signals for brain-computer interfaces? IEEE Trans. Neural Syst. Rehabil. Eng. 14 30-7
23. Müller G R, Neuper C and Pfurtscheller G 2001 'Resonance-like' frequencies of sensorimotor areas evoked by repetitive tactile stimulation Biomed. Tech. (Berl) 46 186-90
24. Soria E, Fine E and Hajdu I 1989 Auditory and somatosensory evoked potentials in a case of 'locked-in' syndrome: a clinical and pathological study Electromyogr. Clin. Neurophysiol. 29 235-42
25. Hinterberger T, Neumann N, Pham M, Kübler A, Grether A, Hofmayer N, Wilhelm B, Flor H and Birbaumer N 2004 A multimodal brain-based feedback and communication system Exp. Brain Res. 154 521-6
26. Cosi V, Poloni M, Mazzini L and Callieco R 1984 Somatosensory evoked potentials in amyotrophic lateral sclerosis J. Neurol. Neurosurg. Psychiatry 47 857-61
27. Yao L, Meng J, Zhang D, Sheng X and Zhu X 2013 Selective sensation based brain-computer interface via mechanical vibrotactile stimulation PLoS ONE 8 e64784
28. Yao L, Meng J, Zhang D, Sheng X and Zhu X 2013 Combining motor imagery with selective sensation towards a hybrid-modality BCI IEEE Trans. Biomed. Eng. 61 2304-12
29. Voisin J I A, Mercier C, Jackson P L, Richards C L and Malouin F 2011 Is somatosensory excitability more affected by the perspective or modality content of motor imagery? Neurosci. Lett. 493 33-7
30. Jones S R, Kerr C E, Wan Q, Pritchett D L, Hamalainen M and Moore C I 2010 Cued spatial attention drives functionally-relevant modulation of the mu rhythm in primary somatosensory cortex J. Neurosci. 30 13760-5
31. Dockstader C, Cheyne D and Tannock R 2010 Cortical dynamics of selective attention to somatosensory events NeuroImage 49 1777-85
32. Anderson K L and Ding M 2011 Attentional modulation of the somatosensory mu rhythm Neuroscience 180 165-80
33. Van Ede F, Jensen O and Maris E 2010 Tactile expectation modulates pre-stimulus -band oscillations in human sensorimotor cortex NeuroImage 51 867-76
34. Tecchio F, Zappasodi F, Melgari J M, Porcaro C, Cassetta E and Rossini P M 2006 Sensory-motor interaction in primary hand cortical areas: a magnetoencephalography assessment Neuroscience 141 533-42
35. Pfurtscheller G and Neuper C 2001 Motor imagery and direct brain-computer communication Proc. IEEE 89 1123-34
36. Ahn M, Ahn S, Hong J H, Cho H, Kim K, Kim B S, Chang J W and Jun S C 2013 Gamma band activity associated with BCI performance: simultaneous MEG/EEG study Front. Hum. Neurosci. 7 848
37. Ahn M, Cho H, Ahn S and Jun S C 2013 High theta and low alpha powers may be indicative of BCI-illiteracy in motor imagery PLoS ONE 8 e80886
38. Neuper C, Scherer R, Reiner M and Pfurtscheller G 2005 Imagery of motor actions: differential effects of kinesthetic and visual-motor mode of imagery in single-trial EEG Brain Res. Cogn. Brain Res. 25 668-77
39. Purves D 2012 The somatic sensory system: touch and proprioception Neuroscience ed G J Augustine, D Fitzpatrick, W C Hall, A-S LaMantia and L E White (Sunderland, MA: Sinauer) 189-208
40. Breitwieser C, Kaiser V, Neuper C and Müller-Putz G R 2012 Stability and distribution of steady-state somatosensory evoked potentials elicited by vibro-tactile stimulation Med. Biol. Eng. Comput. 50 347-57
41. Schalk G, McFarland D J, Hinterberger T, Birbaumer N and Wolpaw J R 2004 BCI2000: a general-purpose brain-computer interface (BCI) system IEEE Trans. Biomed. Eng. 51 1034-43
42. Tobimatsu S, Zhang Y M and Kato M 1999 Steady-state vibration somatosensory evoked potentials: physiological characteristics and tuning function Clin. Neurophysiol. 110 1953-8
43. Müller-Putz G, Scherer R, Brunner C, Leeb R and Pfurtscheller G 2008 Better than random: a closer look on BCI results Int. J. Bioelectromagn. 10 52-5
44. Makeig S 1993 Auditory event-related dynamics of the EEG spectrum and effects of exposure to tones Electroencephalogr. Clin. Neurophysiol. 86 283-93
45. McFarland D J, McCane L M, David S V and Wolpaw J R 1997 Spatial filter selection for EEG-based communication Electroencephalogr. Clin. Neurophysiol. 103 386-94
46. Delorme A and Makeig S 2004 EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis J. Neurosci. Methods 134 9-21
47. Bauer M, Oostenveld R, Peeters M and Fries P 2006 Tactile spatial attention enhances gamma-band activity in somatosensory cortex and reduces low-frequency activity in parieto-occipital areas J. Neurosci. 26 490-501
48. Stapells D R, Makeig S and Galambos R 1987 Auditory steady-state responses: threshold prediction using phase coherence Electroencephalogr. Clin. Neurophysiol. 67 260-70
49. Regan D 1982 Comparison of transient and steady-state methods Ann. NY Acad. Sci. 388 45-71
50. Snyder A Z 1992 Steady-state vibration evoked potentials: description of technique and characterization of responses Electroencephalogr. Clin. Neurophysiol. Potentials Sect. 84 257-68
51. Giabbiconi C M, Dancer C, Zopf R, Gruber T and Müller M M 2004 Selective spatial attention to left or right hand flutter sensation modulates the steady-state somatosensory evoked potential Cogn. Brain Res. 20 58-66
52. Colon E, Legrain V and Mouraux A 2012 Steady-state evoked potentials to study the processing of tactile and nociceptive somatosensory input in the human brain Neurophysiol. Clin. Neurophysiol. 42 315-23
53. Mizuguchi N, Sakamoto M, Muraoka T, Nakagawa K, Kanazawa S, Nakata H, Moriyama N and Kanosue K 2011 The modulation of corticospinal excitability during motor imagery of actions with objects PLoS ONE 6 e26006
54. Pfurtscheller G 1989 Functional topography during sensorimotor activation studied with event-related desynchronization mapping J. Clin. Neurophysiol. 6 75-84
55. Nikouline V V, Linkenkaer-Hansen K, Wikström H, Kesäniemi M, Antonova E V, Ilmoniemi R J and Huttunen J 2000 Dynamics of mu-rhythm suppression caused by median nerve stimulation: a magnetoencephalographic study in human subjects Neurosci. Lett. 294 163-6
56. Ridding M C, Brouwer B, Miles T S, Pitcher J B and Thompson P D 2000 Changes in muscle responses to stimulation of the motor cortex induced by peripheral nerve stimulation in human subjects Exp. Brain Res. 131 135-43
57. Ridding M C, McKay D R, Thompson P D and Miles T S 2001 Changes in corticomotor representations induced by prolonged peripheral nerve stimulation in humans Clin. Neurophysiol. 112 1461-9
58. McKay D, Brooker R, Giacomin P, Ridding M and Miles T 2002 Time course of induction of increased human motor cortex excitability by nerve stimulation Neuroreport 13 1271-3
59. Smith G V, Alon G, Roys S R and Gullapalli R P 2003 Functional MRI determination of a dose-response relationship to lower extremity neuromuscular electrical stimulation in healthy subjects Exp. Brain Res. 150 33-9
60. Saito K, Yamaguchi T, Yoshida N, Tanabe S, Kondo K and Sugawara K 2013 Combined effect of motor imagery and peripheral nerve electrical stimulation on the motor cortex Exp. Brain Res. 227 333-42
61. Wei P, He W, Zhou Y and Wang L 2013 Performance of motor imagery brain-computer interface based on anodal transcranial direct current stimulation modulation IEEE Trans. Neural Syst. Rehabil. Eng. 21 404-15
62. Facchini S, Muellbacher W, Battaglia F, Boroojerdi B and Hallett M 2002 Focal enhancement of motor cortex excitability during motor imagery: a transcranial magnetic stimulation study Acta Neurol. Scand. 105 146-51
63. Fadiga L, Buccino G, Craighero L, Fogassi L, Gallese V and Pavesi G 1999 Corticospinal excitability is specifically modulated by motor imagery: a magnetic stimulation study Neuropsychologia 37 147-58
64. Ganis G, Keenan J P, Kosslyn S M and Pascual-Leone A 2000 Transcranial magnetic stimulation of primary motor cortex affects mental rotation Cereb. Cortex 10 175-80
65. Li S, Latash M L and Zatsiorsky V M 2004 Effects of motor imagery on finger force responses to transcranial magnetic stimulation Cogn. Brain Res. 20 273-80
66. Thut G, Nietzel A, Brandt S A and Pascual-Leone A 2006 Alpha-band electroencephalographic activity over occipital cortex indexes visuospatial attention bias and predicts visual target detection J. Neurosci. 26 9494-502
67. Rihs T A, Michel C M and Thut G 2007 Mechanisms of selective inhibition in visual spatial attention are indexed by alpha-band EEG synchronization Eur. J. Neurosci. 25 603-10
68. Worden M S, Foxe J J, Wang N and Simpson G V 2000 Anticipatory biasing of visuospatial attention indexed by retinotopically specific alpha-band electroencephalography increases over occipital cortex J. Neurosci. 20 RC63
69. Sauseng P, Klimesch W, Stadler W, Schabus M, Doppelmayr M, Hanslmayr S, Gruber W R and Birbaumer N 2005 A shift of visual spatial attention is selectively associated with human EEG alpha activity Eur. J. Neurosci. 22 2917-26
70. Babiloni C, Capotosto P, Brancucci A, Del Percio C, Petrini L, Buttiglione M, Cibelli G, Romani G L, Rossini P M and Arendt-Nielsen L 2008 Cortical alpha rhythms are related to the anticipation of sensorimotor interaction between painful stimuli and movements: a high-resolution EEG study J. Pain 9 902-11
71. Chatterjee A, Aggarwal V, Ramos A, Acharya S and Thakor N V 2007 A brain-computer interface with vibrotactile biofeedback for haptic information J. NeuroEngineering Rehabil. 4 1-12
72. Cincotti F et al 2007 Vibrotactile feedback for brain-computer interface operation Intell Neurosci. 2007 e48937
73. Okogbaa O G, Shell R L and Filipusic D 1994 On the investigation of the neurophysiological correlates of knowledge worker mental fatigue using the EEG signal Appl. Ergon. 25 355-65