Bridging the gap between motor imagery and motor execution with a brain-robot interface

NeuroImage

Volumn 108, Issue , 2015, Pages 319-327

  Bauer, Robert ^a   Fels, Meike ^a   Vukelić, Mathias ^a   Ziemann, Ulf ^b   Gharabaghi, Alireza ^a  

^a UNIVERSITY OF TÜBINGEN   (Germany)

^b UNIVERSITY OF TÜBINGEN   (Germany)

Author keywords

Brain computer interface; Brain machine interface; Brain robot interface; Effective connectivity; Functional Restoration; Motor imagery; Neurorehabilitation; Phase slope index; Resting state

Indexed keywords

ADULT; ARTICLE; BEHAVIOR; BRAIN CORTEX; BRAIN FUNCTION; BRAIN ROBOT INTERFACE; CEREBROVASCULAR ACCIDENT; FEMALE; HAND MOVEMENT; HEMIPARESIS; HUMAN; HUMAN EXPERIMENT; INFORMATION PROCESSING; KINESTHETIC IMAGERY; MALE; MENTAL FUNCTION; MOTOR CONTROL; MOTOR CORTEX; MOTOR EXECUTION; MOTOR IMAGERY; NEUROIMAGING; NORMAL HUMAN; PARIETAL CORTEX; PATIENT ASSESSMENT; PREFRONTAL CORTEX; PRINCIPAL COMPONENT ANALYSIS; PROPRIOCEPTIVE FEEDBACK; REHABILITATION CARE; RESTING STATE NETWORK; RIGHT HANDEDNESS; TACTILE FEEDBACK; TASK PERFORMANCE; VISUAL IMAGERY; VISUOMOTOR COORDINATION; BRAIN; COMPUTER INTERFACE; ELECTROENCEPHALOGRAPHY; IMAGINATION; MIDDLE AGED; MOTOR ACTIVITY; NERVE TRACT; PHYSIOLOGY; ROBOTICS; SIGNAL PROCESSING; YOUNG ADULT;

ADULT; BRAIN; ELECTROENCEPHALOGRAPHY; FEMALE; HUMANS; IMAGINATION; MALE; MIDDLE AGED; MOTOR ACTIVITY; NEURAL PATHWAYS; PRINCIPAL COMPONENT ANALYSIS; ROBOTICS; SIGNAL PROCESSING, COMPUTER-ASSISTED; USER-COMPUTER INTERFACE; YOUNG ADULT;

EID: 84922225165     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2014.12.026     Document Type: Article

References (73)

1. Airaksinen O., Rantanen P., Sihvonen T., Airaksinen K., Hänninen O., Herno A. Monitoring of muscle fatigue during isokinetic exercise. Acupunct. Electrother. Res. 2001, 26:253-261.
2. Albert N.B., Robertson E.M., Miall R.C. The resting human brain and motor learning. Curr. Biol. 2009, 19:1023-1027. 10.1016/j.cub.2009.04.028.
3. Ang K.K., Guan C., Chua K.S.G., Ang B.T., Kuah C.W.K., Wang C., Phua K.S., Chin Z.Y., Zhang H. A large clinical study on the ability of stroke patients to use an EEG-based motor imagery brain-computer interface. Clin. EEG Neurosci. 2011, 42:253-258.
4. Arai N., Müller-Dahlhaus F., Murakami T., Bliem B., Lu M.-K., Ugawa Y., Ziemann U. State-dependent and timing-dependent bidirectional associative plasticity in the human SMA-M1 network. J. Neurosci. 2011, 31:15376-15383. 10.1523/JNEUROSCI. 2271-11.2011.
5. Benjamini Y., Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J. R. Stat. Soc. Ser. B Methodol. 1995, 57:289-300.
6. Blankertz B., Sannelli C., Halder S., Hammer E.M., Kübler A., Müller K.-R., Curio G., Dickhaus T. Neurophysiological predictor of SMR-based BCI performance. Neuroimage 2010, 51:1303-1309. 10.1016/j.neuroimage.2010.03.022.
7. Braun S., Kleynen M., van Heel T., Kruithof N., Wade D., Beurskens A. The effects of mental practice in neurological rehabilitation; a systematic review and meta-analysis. Front. Hum. Neurosci. 2013, 7:390. 10.3389/fnhum.2013.00390.
8. Buch E.R., Modir Shanechi A., Fourkas A.D., Weber C., Birbaumer N., Cohen L.G. Parietofrontal integrity determines neural modulation associated with grasping imagery after stroke. Brain 2012, 135:596-614. 10.1093/brain/awr331.
9. Chen W.-H., Mima T., Siebner H.R., Oga T., Hara H., Satow T., Begum T., Nagamine T., Shibasaki H. Low-frequency rTMS over lateral premotor cortex induces lasting changes in regional activation and functional coupling of cortical motor areas. Clin. Neurophysiol. 2003, 114:1628-1637.
10. Chikazoe J. Localizing performance of go/no-go tasks to prefrontal cortical subregions. Curr. Opin. Psychiatry 2010, 23:267-272. 10.1097/YCO.0b013e3283387a9f.
11. Chouinard P.A., Paus T. The primary motor and premotor areas of the human cerebral cortex. Neuroscientist 2006, 12:143-152. 10.1177/1073858405284255.
12. Creem-Regehr S.H. Sensory-motor and cognitive functions of the human posterior parietal cortex involved in manual actions. Neurobiol. Learn. Mem. 2009, 91:166-171. 10.1016/j.nlm.2008.10.004.
13. De Vries S., Tepper M., Otten B., Mulder T. Recovery of motor imagery ability in stroke patients. Rehabil. Res. Pract. 2011, 2011:283840. 10.1155/2011/283840.
14. Decety J. Do imagined and executed actions share the same neural substrate?. Brain Res. Cogn. Brain Res. 1996, 3:87-93.
15. Dimitriou M., Edin B.B. Human muscle spindles act as forward sensory models. Curr. Biol. 2010, 20:1763-1767. 10.1016/j.cub.2010.08.049.
16. Ehrsson H.H., Geyer S., Naito E. Imagery of voluntary movement of fingers, toes, and tongue activates corresponding body-part-specific motor representations. J. Neurophysiol. 2003, 90:3304-3316. 10.1152/jn.01113.2002.
17. Gandolla M., Ferrante S., Molteni F., Guanziroli E., Frattini T., Martegani A., Ferrigno G., Friston K., Pedrocchi A., Ward N.S. Re-thinking the role of motor cortex: context-sensitive motor outputs?. Neuroimage 2014, 91:366-374.
18. Gao Q., Duan X., Chen H. Evaluation of effective connectivity of motor areas during motor imagery and execution using conditional Granger causality. Neuroimage 2011, 54:1280-1288. 10.1016/j.neuroimage.2010.08.071.
19. Gomez-Rodriguez M., Peters J., Hill J., Schölkopf B., Gharabaghi A., Grosse-Wentrup M. Closing the sensorimotor loop: haptic feedback facilitates decoding of motor imagery. J. Neural Eng. 2011, 8:036005. 10.1088/1741-2560/8/3/036005.
20. Grefkes C., Fink G.R. Reorganization of cerebral networks after stroke: new insights from neuroimaging with connectivity approaches. Brain 2011, 10.1093/brain/awr033.
21. Grefkes C., Eickhoff S.B., Nowak D.A., Dafotakis M., Fink G.R. Dynamic intra- and interhemispheric interactions during unilateral and bilateral hand movements assessed with fMRI and DCM. Neuroimage 2008, 41:1382-1394. 10.1016/j.neuroimage.2008.03.048.
22. Haller S., Chapuis D., Gassert R., Burdet E., Klarhöfer M. Supplementary motor area and anterior intraparietal area integrate fine-graded timing and force control during precision grip. Eur. J. Neurosci. 2009, 30:2401-2406. 10.1111/j.1460-9568.2009.07003.x.
23. Hamzei F., Liepert J., Dettmers C., Weiller C., Rijntjes M. Two different reorganization patterns after rehabilitative therapy: an exploratory study with fMRI and TMS. Neuroimage 2006, 31:710-720. 10.1016/j.neuroimage.2005.12.035.
24. Hogan N., Krebs H.I. Physically interactive robotic technology for neuromotor rehabilitation. Prog. Brain Res. 2011, 192:59-68. 10.1016/B978-0-444-53355-5.00004-X.
25. Horenstein C., Lowe M.J., Koenig K.A., Phillips M.D. Comparison of unilateral and bilateral complex finger tapping-related activation in premotor and primary motor cortex. Hum. Brain Mapp. 2009, 30:1397-1412. 10.1002/hbm.20610.
26. Horn J.L. A rationale and test for the number of factors in factor analysis. Psychometrika 1965, 30:179-185. 10.1007/BF02289447.
27. Hyvarinen A. Fast and robust fixed-point algorithms for independent component analysis. IEEE Trans. Neural Netw. 1999, 10:626-634. 10.1109/72.761722.
28. Ietswaart M., Johnston M., Dijkerman H.C., Joice S., Scott C.L., MacWalter R.S., Hamilton S.J.C. Mental practice with motor imagery in stroke recovery: randomized controlled trial of efficacy. Brain 2011, 134:1373-1386. 10.1093/brain/awr077.
29. Inbar G.F., Allin J., Paiss O., Kranz H. Monitoring surface EMG spectral changes by the zero crossing rate. Med. Biol. Eng. Comput. 1986, 24:10-18.
30. Isaac A., Marks D.F., Russell D.G. An instrument for assessing imagery of movement: the vividness of movement imagery questionnaire (VMIQ). J. Ment. Imag. 1986, 10:23-30.
31. Jeannerod M. Mental imagery in the motor context. Neuropsychologia 1995, 33:1419-1432.
32. Johnson-Frey S.H., Newman-Norlund R., Grafton S.T. A distributed left hemisphere network active during planning of everyday tool use skills. Cereb. Cortex 2004, 15:681-695. 10.1093/cercor/bhh169.
33. Kaiser V., Kreilinger A., Müller-Putz G.R., Neuper C. First steps toward a motor imagery based stroke BCI: new strategy to set up a classifier. Front. Neurosci. 2011, 5. 10.3389/fnins.2011.00086.
34. Krusienski D.J., McFarland D.J., Wolpaw J.R. Value of amplitude, phase, and coherence features for a sensorimotor rhythm-based brain-computer interface. Brain Res. Bull. 2012, 87:130-134. 10.1016/j.brainresbull.2011.09.019.
35. Langer N., Pedroni A., Gianotti L.R.R., Hänggi J., Knoch D., Jäncke L. Functional brain network efficiency predicts intelligence. Hum. Brain Mapp. 2012, 33:1393-1406. 10.1002/hbm.21297.
36. Langhorne P., Coupar F., Pollock A. Motor recovery after stroke: a systematic review. Lancet Neurol. 2009, 8:741-754. 10.1016/S1474-4422(09)70150-4.
37. Lee T.-W., Yu Y.W.-Y., Wu H.-C., Chen T.-J. Do resting brain dynamics predict oddball evoked-potential?. BMC Neurosci. 2011, 12:121. 10.1186/1471-2202-12-121.
38. Lefebvre S., Laloux P., Peeters A., Desfontaines P., Jamart J., Vandermeeren Y. Dual-tDCS enhances online motor skill learning and long-term retention in chronic stroke patients. Front. Hum. Neurosci. 2012, 6:343. 10.3389/fnhum.2012.00343.
39. Levy B.J., Wagner A.D. Cognitive control and right ventrolateral prefrontal cortex: reflexive reorienting, motor inhibition, and action updating. Ann. N. Y. Acad. Sci. 2011, 1224:40-62. 10.1111/j.1749-6632.2011.05958.x.
40. Lewis J.W. Cortical networks related to human use of tools. Neuroscientist 2006, 12:211-231. 10.1177/1073858406288327.
41. Lo A.C., Guarino P.D., Richards L.G., Haselkorn J.K., Wittenberg G.F., Federman D.G., Ringer R.J., Wagner T.H., Krebs H.I., Volpe B.T., Bever C.T., Bravata D.M., Duncan P.W., Corn B.H., Maffucci A.D., Nadeau S.E., Conroy S.S., Powell J.M., Huang G.D., Peduzzi P. Robot-assisted therapy for long-term upper-limb impairment after stroke. N. Engl. J. Med. 2010, 362:1772-1783. 10.1056/NEJMoa0911341.
42. Lu M.-K., Arai N., Tsai C.-H., Ziemann U. Movement related cortical potentials of cued versus self-initiated movements: double dissociated modulation by dorsal premotor cortex versus supplementary motor area rTMS. Hum. Brain Mapp. 2012, 33:824-839. 10.1002/hbm.21248.
43. Malouin F., Richards C.L., Jackson P.L., Lafleur M.F., Durand A., Doyon J. The kinesthetic and visual imagery questionnaire (KVIQ) for assessing motor imagery in persons with physical disabilities: a reliability and construct validity study. J. Neurol. Phys. Ther. 2007, 31:20-29.
44. Miller K.J., Schalk G., Fetz E.E., den Nijs M., Ojemann J.G., Rao R.P.N. Cortical activity during motor execution, motor imagery, and imagery-based online feedback. Proc. Natl. Acad. Sci. U. S. A. 2010, 107:4430-4435. 10.1073/pnas.0913697107.
45. Nolte G., Ziehe A., Nikulin V.V., Schlögl A., Krämer N., Brismar T., Müller K.-R. Robustly estimating the flow direction of information in complex physical systems. Phys. Rev. Lett. 2008, 100:234101. 10.1103/PhysRevLett.100.234101.
46. Nolte G., Ziehe A., Krämer N., Popescu F., Müller K.-R. Comparison of granger causality and phase slope index. The Journal of Machine Learning Research W&CP 2010, 6:267-276.
47. Oostenveld R., Fries P., Maris E., Schoffelen J.-M. FieldTrip: open source software for advanced analysis of MEG, EEG, and invasive electrophysiological data. Comput. Intell. Neurosci. 2011, 2011:1-9. 10.1155/2011/156869.
48. Page S.J., Dunning K., Hermann V., Leonard A., Levine P. Longer versus shorter mental practice sessions for affected upper extremity movement after stroke: a randomized controlled trial. Clin. Rehabil. 2011, 25:627-637. 10.1177/0269215510395793.
49. Plewnia C., Rilk A.J., Soekadar S.R., Arfeller C., Huber H.S., Sauseng P., Hummel F., Gerloff C. Enhancement of long-range EEG coherence by synchronous bifocal transcranial magnetic stimulation. Eur. J. Neurosci. 2008, 27:1577-1583. 10.1111/j.1460-9568.2008.06124.x.
50. Polanía R., Nitsche M.A., Paulus W. Modulating functional connectivity patterns and topological functional organization of the human brain with transcranial direct current stimulation. Hum. Brain Mapp. 2011, 32:1236-1249. 10.1002/hbm.21104.
51. Polanía R., Nitsche M.A., Korman C., Batsikadze G., Paulus W. The importance of timing in segregated theta phase-coupling for cognitive performance. Curr. Biol. 2012, 22:1314-1318. 10.1016/j.cub.2012.05.021.
52. Polanía R., Paulus W., Nitsche M.A. Reorganizing the intrinsic functional architecture of the human primary motor cortex during rest with non-invasive cortical stimulation. PLoS One 2012, 7:e30971. 10.1371/journal.pone.0030971.
53. Proske U., Gandevia S.C. The kinaesthetic senses. J. Physiol. Lond. 2009, 587:4139-4146. 10.1113/jphysiol.2009.175372.
54. Putman P. Resting state EEG delta-beta coherence in relation to anxiety, behavioral inhibition, and selective attentional processing of threatening stimuli. Int. J. Psychophysiol. 2011, 80:63-68. 10.1016/j.ijpsycho.2011.01.011.
55. Ramos-Murguialday A., Broetz D., Rea M., Läer L., Yilmaz O., Brasil F.L., Liberati G., Curado M.R., Garcia-Cossio E., Vyziotis A., Cho W., Agostini M., Soares E., Soekadar S., Caria A., Cohen L.G., Birbaumer N. Brain-machine-interface in chronic stroke rehabilitation: a controlled study. Ann. Neurol. 2013, 10.1002/ana.23879.
56. Randhawa B., Harris S., Boyd L.A. The kinesthetic and visual imagery questionnaire is a reliable tool for individuals with Parkinson disease. J. Neurol. Phys. Ther. 2010, 34:161-167.
57. Rushworth M.F.S., Johansen-Berg H., Göbel S.M., Devlin J.T. The left parietal and premotor cortices: motor attention and selection. Neuroimage 2003, 20(Suppl. 1):S89-S100.
58. Schack T., Essig K., Frank C., Koester D. Mental representation and motor imagery training. Front. Hum. Neurosci. 2014, 8:328. 10.3389/fnhum.2014.00328.
59. Schalk G., McFarland D.J., Hinterberger T., Birbaumer N., Wolpaw J.R. BCI2000: a general-purpose brain-computer interface (BCI) system. IEEE Trans. Biomed. Eng. 2004, 51:1034-1043. 10.1109/TBME.2004.827072.
60. Seiss E., Hesse C.W., Drane S., Oostenveld R., Wing A.M., Praamstra P. Proprioception-related evoked potentials: origin and sensitivity to movement parameters. Neuroimage 2002, 17:461-468.
61. Sharma N. Motor imagery: a backdoor to the motor system after stroke?. Stroke 2006, 37:1941-1952. 10.1161/01.STR.0000226902.43357.fc.
62. Shibasaki H. Cortical activities associated with voluntary movements and involuntary movements. Clin. Neurophysiol. 2012, 123:229-243. 10.1016/j.clinph.2011.07.042.
63. Swann N., Tandon N., Canolty R., Ellmore T.M., McEvoy L.K., Dreyer S., DiSano M., Aron A.R. Intracranial EEG reveals a time- and frequency-specific role for the right inferior frontal gyrus and primary motor cortex in stopping initiated responses. J. Neurosci. 2009, 29:12675-12685. 10.1523/JNEUROSCI. 3359-09.2009.
64. Szameitat A.J., Shen S., Conforto A., Sterr A. Cortical activation during executed, imagined, observed, and passive wrist movements in healthy volunteers and stroke patients. Neuroimage 2012, 62:266-280. 10.1016/j.neuroimage.2012.05.009.
65. Van den Berg F.E., Swinnen S.P., Wenderoth N. Involvement of the primary motor cortex in controlling movements executed with the ipsilateral hand differs between left- and right-handers. J. Cogn. Neurosci. 2011, 23:3456-3469. 10.1162/jocn_a_00018.
66. Vidaurre C., Blankertz B. Towards a cure for BCI illiteracy. Brain Topogr. 2010, 23:194-198. 10.1007/s10548-009-0121-6.
67. Vukelić M., Bauer R., Naros G., Naros I., Braun C., Gharabaghi A. Lateralized alpha-band cortical networks regulate volitional modulation of beta-band sensorimotor oscillations. Neuroimage 2014, 87:147-153. 10.1016/j.neuroimage.2013.10.003.
68. Wager T.D., Sylvester C.-Y.C., Lacey S.C., Nee D.E., Franklin M., Jonides J. Common and unique components of response inhibition revealed by fMRI. Neuroimage 2005, 27:323-340. 10.1016/j.neuroimage.2005.01.054.
69. Wang L., Yu C., Chen H., Qin W., He Y., Fan F., Zhang Y., Wang M., Li K., Zang Y., Woodward T.S., Zhu C. Dynamic functional reorganization of the motor execution network after stroke. Brain 2010, 133:1224-1238. 10.1093/brain/awq043.
70. Wei Q., Wang Y., Gao X., Gao S. Amplitude and phase coupling measures for feature extraction in an EEG-based brain-computer interface. J. Neural Eng. 2007, 4:120-129. 10.1088/1741-2560/4/2/012.
71. Wiese H., Stude P., Sarge R., Nebel K., Diener H.-C., Keidel M. Reorganization of motor execution rather than preparation in poststroke hemiparesis. Stroke 2005, 36:1474-1479. 10.1161/01.STR.0000170639.26891.30.
72. Wu J., Srinivasan R., Kaur A., Cramer S.C. Resting-state cortical connectivity predicts motor skill acquisition. Neuroimage 2014, 91C:84-90. 10.1016/j.neuroimage.2014.01.026.
73. Zhou G., Liu P., He J., Dong M., Yang X., Hou B., Von Deneen K.M., Qin W., Tian J. Interindividual reaction time variability is related to resting-state network topology: an electroencephalogram study. Neuroscience 2012, 202:276-282. 10.1016/j.neuroscience.2011.11.048.