Combining motor imagery with selective sensation toward a hybrid-modality BCI

IEEE Transactions on Biomedical Engineering

Volumn 61, Issue 8, 2014, Pages 2304-2312

  Yao, Lin ^a   Meng, Jianjun ^a   Zhang, Dingguo ^a   Sheng, Xinjun ^a   Zhu, Xiangyang ^a  

^a SHANGHAI JIAO TONG UNIVERSITY   (China)

Author keywords

BCI; hybrid modality; motor imagery (MI); selective sensation (SS)

Indexed keywords

BIOPHYSICS; MEDICAL APPLICATIONS;

BCI; COMMUNICATION AND CONTROL; HAND MOTOR IMAGERIES; HYBRID MODALITY; MOTOR IMAGERY; MULTIPLE COMPARISON TEST; SELECTIVE SENSATION (SS); SENSORY ANTICIPATION;

BRAIN COMPUTER INTERFACE;

ACCURACY; ADULT; AMPLITUDE MODULATION; ARTICLE; BRAIN COMPUTER INTERFACE; CLASSIFICATION ALGORITHM; COMPARATIVE STUDY; CONTROLLED STUDY; ELECTROENCEPHALOGRAM; ELECTROENCEPHALOGRAPH; ELECTROENCEPHALOGRAPHY; FEMALE; HUMAN; HUMAN EXPERIMENT; HYBRID COMPUTER; INTERPERSONAL COMMUNICATION; LEFT HANDEDNESS; MALE; MENTAL TASK; MOTOR SYSTEM; NERVE TRACT; NEUROIMAGING; NORMAL HUMAN; PACINI CORPUSCLE; RIGHT HANDEDNESS; SENSATION; SENSORIMOTOR CORTEX; SENSORY NERVE; STIMULATION; ALGORITHM; PHYSIOLOGY; PROCEDURES; PSYCHOTHERAPY;

ADULT; ALGORITHMS; BRAIN-COMPUTER INTERFACES; ELECTROENCEPHALOGRAPHY; FEMALE; HUMANS; IMAGERY (PSYCHOTHERAPY); MALE; SENSATION;

EID: 84904614288     PISSN: 00189294     EISSN: 15582531     Source Type: Journal    
DOI: 10.1109/TBME.2013.2287245     Document Type: Article

References (51)

1. J. Wolpaw, N. Birbaumer, D. McFarland, G. Pfurtscheller, T. Vaughan et al., "Brain-computer interfaces for communication and control," Clin. Neurophysiol., vol. 113, no. 6, pp. 767-791, 2002. (Pubitemid 34621187)
2. H. Higashi and T. Tanaka, "Simultaneous design of FIR filter banks and spatial patterns for eeg signal classification," IEEE Trans. Biomed. Eng., vol. 60, no. 4, pp. 1100-1110, Apr. 2013.
3. H. Suk and S. Lee, "A novelBayesian framework for discriminative feature extraction in brain-computer interfaces," IEEE Trans. Pattern Anal.Mach. Intell., vol. 35, no. 2, pp. 286-299, Feb. 2013.
4. J. Meng, G. Huang, D. Zhang, and X. Zhu, "Optimizing spatial spectral patterns jointly with channel configuration for brain-computer interface," Neurocomputing, vol. 104, pp. 115-126, 2012.
5. S. Makeig, C. Kothe, T. Mullen, N. Bigdely-Shamlo, Z. Zhang, and K. Kreutz-Delgado, "Evolving signal processing for brain-computer interfaces," Proc. IEEE, vol. 100, no. 13, pp. 1567-1584, May 2012.
6. B. Blankertz, G. Dornhege, M. Krauledat, K.-R. Müller, and G. Curio, "The non-invasive Berlin brain-computer interface: Fast acquisition of effective performance in untrained subjects," NeuroImage, vol. 37, no. 2, pp. 539-550, 2007. (Pubitemid 47444247)
7. B. Blankertz, F. Losch, M. Krauledat, G. Dornhege, G. Curio, and K.-R. Muller, "The Berlin brain-computer interface: Accurate performance from first-session in BCI-naive subjects," IEEE Trans. Biomed. Eng., vol. 55, no. 10, pp. 2452-2462, Oct. 2008.
8. C. Vidaurre, C. Sannelli, K.-R. Müller, and B. Blankertz, "Co-adaptive calibration to improve BCI efficiency," J. Neural Eng., vol. 8, no. 2, p. 025009, 2011.
9. B. Blankertz, C. Sannelli, S. Halder, E. M. Hammer, A. Kübler, K.-R. Müller, G. Curio, and T. Dickhaus, "Neurophysiological predictor of SMR-based BCI performance," NeuroImage, vol. 51, no. 4, pp. 1303- 1309, 2010.
10. B. Allison, C. Brunner, V. Kaiser, G. Müller-Putz, C. Neuper, and G. Pfurtscheller, "Toward a hybrid brain-computer interface based on imagined movement and visual attention," J. Neural Eng., vol. 7, no. 2, p. 026007, 2010.
11. C. Brunner, B. Z. Allison, D. J. Krusienski, V. Kaiser, G. R. Müller-Putz, G. Pfurtscheller, and C. Neuper, "Improved signal processing approaches in an offline simulation of a hybrid brain-computer interface," J. Neurosci. Methods, vol. 188, no. 1, pp. 165-173, 2010.
12. G. Pfurtscheller, C.Neuper, D. Flotzinger, andM. Pregenzer, "EEG-based discrimination between imagination of right and left hand movement," Electroencephalogr. Clin. Neurophysiol., vol. 103, no. 6, pp. 642-651, 1997. (Pubitemid 28059088)
13. M. Cheng, X. Gao, S. Gao, and D. Xu, "Design and implementation of a brain-computer interface with high transfer rates," IEEE Trans. Biomed. Eng., vol. 49, no. 10, pp. 1181-1186, Oct. 2002.
14. E. Donchin, K. M. Spencer, and R. Wijesinghe, "The mental prosthesis: Assessing the speed of a P300-based brain-computer interface," IEEE Trans. Rehabil. Eng., vol. 8, no. 2, pp. 174-179, Jun. 2000. (Pubitemid 30437006)
15. J. R. Wolpaw and D. J. McFarland, "Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans," Proc. Nat. Acad. Sci. USA, vol. 101, no. 51, pp. 17 849-17 854, 2004. (Pubitemid 40051975)
16. G. Muller-Putz, R. Scherer, C. Neuper, and G. Pfurtscheller, "Steadystate somatosensory evoked potentials: Suitable brain signals for braincomputer interfaces?," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 14, no. 1, pp. 30-37, Mar. 2006.
17. L. Yao, J. Meng, D. Zhang, X. Sheng, and X. Zhu, "Selective sensation based brain-computer interface via mechanical vibrotactile stimulation," PloS one, vol. 8, no. 6, p. e64784, 2013.
18. C. Guger, G. Edlinger, W. Harkam, I. Niedermayer, and G. Pfurtscheller, "How many people are able to operate an EEG-based brain-computer interface (BCI)?," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 11, no. 2, pp. 145-147, Jun. 2003. (Pubitemid 36935043)
19. C. Guger, S. Daban, E. Sellers, C. Holzner, G. Krausz, R. Carabalona, F. Gramatica, and G. Edlinger, "How many people are able to control a P300-based brain-computer interface (BCI)?," Neurosci. Lett., vol. 462, no. 1, pp. 94-98, 2009.
20. B. Allison, T. Luth, D. Valbuena, A. Teymourian, I. Volosyak, and A. Graser, "BCI demographics: How many (and what kinds of) people can use an SSVEP BCI?," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 18, no. 2, pp. 107-116, Apr. 2010.
21. G. Pfurtscheller, B. Z. Allison, C. Brunner, G. Bauernfeind, T. Solis- Escalante, R. Scherer, T. O. Zander, G. Mueller-Putz, C. Neuper, and N. Birbaumer, "Hybrid BCI," Front. Neurosci., vol. 4, p. 42, 2010.
22. J. Long, Y. Li, T. Yu, and Z. Gu, "Target selection with hybrid feature for BCI-based 2-D cursor control," IEEE Trans. Biomed. Eng., vol. 59, no. 1, pp. 132-140, Jan. 2012.
23. J. Long, Y. Li, H. Wang, T. Yu, J. Pan, and F. Li, "A hybrid brain computer interface to control the direction and speed of a simulated or real wheelchair," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 20, no. 5, pp. 720-729, Sep. 2012.
24. G. Pfurtscheller, T. Solis-Escalante, R. Ortner, P. Linortner, and G. R. Muller-Putz, "Self-paced operation of an SSVEP-Based orthosis with and without an imagery-based brain switch: a feasibility study towards a hybrid BCI," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 18, no. 4, pp. 409-414, Aug. 2010.
25. G. Pfurtscheller, C. Neuper et al., "Motor imagery activates primary sensorimotor area in humans," Neurosci. Lett., vol. 239, no. 2/3, pp. 65-68, 1997. (Pubitemid 28060201)
26. F. Cassim, W. Szurhaj, H. Sediri, D. Devos, J. Bourriez, I. Poirot, P. Derambure, L. Defebvre, and J. Guieu, "Brief and sustained movements: Differences in event-related (de) synchronization (ERD/ERS) patterns," Clin. Neurophysiol., vol. 111, no. 11, pp. 2032-2039, 2000.
27. G. Pfurtscheller,C.Neuper, C. Brunner, F. L. da Silva et al., "Beta rebound after different types of motor imagery in man," Neurosci. Lett., vol. 378, no. 3, pp. 156-159, 2005. (Pubitemid 40386863)
28. M. T. Jurkiewicz, W. C. Gaetz, A. C. Bostan, D. Cheyne et al., "Postmovement beta rebound is generated in motor cortex: Evidence from neuromagnetic recordings.," Neuroimage, vol. 32, no. 3, pp. 1281-1289, 2006. (Pubitemid 44278706)
29. G. Pfurtscheller, M.Woertz, G. Müller, S. Wriessnegger, K. Pfurtscheller et al., "Contrasting behavior of beta event-related synchronization and somatosensory evoked potential after median nerve stimulation during finger manipulation in man," Neurosci. Lett., vol. 323, no. 2, pp. 113-116, 2002. (Pubitemid 34310253)
30. E. Houdayer, E. Labyt, F. Cassim, J. Bourriez, and P. Derambure, "Relationship between event-related beta synchronization and afferent inputs: Analysis of finger movement and peripheral nerve stimulations," Clin. Neurophysiol., vol. 117, no. 3, pp. 628-636, 2006. (Pubitemid 43343995)
31. G. Pfurtscheller and F. Lopes da Silva, "Event-related EEG/MEG synchronization and desynchronization: Basic principles," Clin. Neurophysiol., vol. 110, no. 11, pp. 1842-1857, 1999. (Pubitemid 29454610)
32. C. Dockstader, D. Cheyne, and R. Tannock, "Cortical dynamics of selective attention to somatosensory events," Neuroimage, vol. 49, pp. 1777- 1785, 2010.
33. C. Breitwieser, V. Kaiser, C. Neuper, and G. Müller-Putz, "Stability and distribution of steady-state somatosensory evoked potentials elicited by vibro-tactile stimulation," Med. Biol. Eng.Comput., vol. 50, no. 4, pp. 347- 357, 2012.
34. K. Fukunaga, Introduction to Statistical Pattern Recognition, 2nd ed. New York, NY, USA: Academic, vol. 1, p. 2, 1990.
35. H. Ramoser, J. Muller-Gerking, and G. Pfurtscheller, "Optimal spatial filtering of single trial EEG during imagined hand movement," IEEE Trans. Rehabil. Eng., vol. 8, no. 4, pp. 441-446, Dec. 2000. (Pubitemid 32178931)
36. L. Murray, Randomized Complete Block Designs, Encyclopedia of Biostatistics, New York, USA: Wiley Online Library, 2005.
37. S. Lemm, B. Blankertz, T. Dickhaus, and K.-R. Müller, "Introduction to machine learning for brain imaging," Neuroimage, vol. 56, no. 2, pp. 387- 399, 2011.
38. R. Oostenveld, P. Fries, E. Maris, and J.-M. Schoffelen, "FieldTrip: Open source software for advanced analysis of MEG, EEG, and invasive electrophysiological data," Computat. Intell. Neurosci., vol. 2011, Index no. 156869, 2011.
39. T. H. Wonnacott and R. J. Wonnacott, Introductory Statistics. vol. 19690, New York, NY, USA: Wiley, 1990.
40. A. J. Doud, J. P. Lucas, M. T. Pisansky, and B. He, "Continuous threedimensional control of a virtual helicopter using a motor imagery based brain-computer interface," PloS one, vol. 6, no. 10, p. e26322, 2011.
41. L.Yao, X. Sheng, J. Meng, D. Zhang, andX. Zhu, "Mechanical vibrotactile stimulation effect in motor imagery based brain-computer interface," in Proc. IEEE Eng. Med. Biol. Soc. Conf., 2013, pp. 2772-2775.
42. F. Tecchio, F. Zappasodi, J. Melgari, C. Porcaro, E. Cassetta, and P. Rossini, "Sensory-motor interaction in primary hand cortical areas: A magnetoencephalography assessment," Neuroscience, vol. 141, no. 1, pp. 533-542, 2006.
43. S. N. Baker, "Oscillatory interactions between sensorimotor cortex and the periphery," Curr. Opin. Neurobiol., vol. 17, no. 6, pp. 649-655, 2007.
44. P. Bobrov, A. Frolov, C. Cantor, I. Fedulova, M. Bakhnyan, and A. Zhavoronkov, "Brain-computer interface based on generation of visual images," PloS one, vol. 6, no. 6, p. e20674, 2011.
45. G. Townsend, B. Graimann, and G. Pfurtscheller, "A comparison of common spatial patterns with complex band power features in a four-class BCI experiment," IEEE Trans. Biomed. Eng., vol. 53, no. 4, pp. 642-651, Apr. 2006.
46. P. Boord, A. Craig, Y. Tran, and H. Nguyen, "Discrimination of left and right leg motor imagery for brain-computer interfaces," Med. Biol. Eng. Comput., vol. 48, no. 4, pp. 343-350, 2010.
47. J. I. Voisin, C. Mercier, P. L. Jackson, C. L. Richards, and F. Malouin, "Is somatosensory excitability more affected by the perspective or modality content of motor imagery?," Neurosci. Lett., vol. 493, no. 1, pp. 33-37, 2011.
48. C. Giabbiconi, C. Dancer, R. Zopf, T. Gruber, and M. Müller, "Selective spatial attention to left or right hand flutter sensationmodulates the steadystate somatosensory evoked potential," Cognit. Brain Res., vol. 20, no. 1, pp. 58-66, 2004. (Pubitemid 38591364)
49. M. Severens, J. Farquhar, P. Desain, J. Duysens, and C. Gielen, "Transient and steady-state responses to mechanical stimulation of different fingers reveal interactions based on lateral inhibition," Clin. Neurophysiol., vol. 121, no. 12, pp. 2090-2096, 2010.
50. S. Tobimatsu, Y. M. Zhang, and M. Kato, "Steady-state vibration somatosensory evoked potentials: Physiological characteristics and tuning function," Clin. Neurophysiol., vol. 110, no. 11, pp. 1953-1958, 1999. (Pubitemid 29454624)
51. E. Colon, V. Legrain, and A. Mouraux, "Steady-state evoked potentials to study the processing of tactile and nociceptive somatosensory input in the human brain," Neurophysiologie Clinique/Clin. Neurophysiol., vol. 42, pp. 315-323, 2012. Municipality Municipality