A brain-machine interface enables bimanual arm movements in monkeys

Science Translational Medicine

Volumn 5, Issue 210, 2013, Pages

  Ifft, Peter J ^a,b   Shokur, Solaiman ^b,c   Li, Zheng ^b,d   Lebedev, Mikhail A ^b,d   Nicolelis, Miguel A L ^a,b,d,e  

^a Duke University   (United States)

^b DUKE UNIVERSITY   (United States)

^c EPFL   (Switzerland)

^d DUKE UNIVERSITY SCHOOL OF MEDICINE   (United States)

^e Edmond and Lily Safra International Institute of Neuroscience of Natal   (Brazil)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ANIMAL EXPERIMENT; ARM MOVEMENT; ARTICLE; BIMANUAL ARM MOVEMENT; BRAIN CELL; BRAIN MACHINE INTERFACE; FEMALE; FRONTAL CORTEX; INFORMATION PROCESSING; LEARNING; MALE; MOTOR CONTROL; MOTOR PERFORMANCE; NERVE CELL PLASTICITY; NEUROMODULATION; NONHUMAN; PARIETAL CORTEX; PRIORITY JOURNAL; RHESUS MONKEY;

ALGORITHMS; ANIMALS; ARM; BEHAVIOR, ANIMAL; BRAIN-COMPUTER INTERFACES; CEREBRAL CORTEX; ELECTRODES, IMPLANTED; FEMALE; HAPLORHINI; HUMANS; MALE; MOVEMENT; NEURONAL PLASTICITY; NEURONS; TASK PERFORMANCE AND ANALYSIS;

EID: 84888606301     PISSN: 19466234     EISSN: 19466242     Source Type: Journal    
DOI: 10.1126/scitranslmed.3006159     Document Type: Article

References (51)

1. S. P. Swinnen, J. Duysens, Neuro-Behavioral Determinants of Interlimb Coordination: A Multidisciplinary Approach (Kluwer Academic, Boston, MA, 2004).
2. M. A. Lebedev, M. A. Nicolelis, Brain-machine interfaces: Past, present and future. Trends Neurosci. 29, 536-546 (2006).
3. M. A. Nicolelis, M. A. Lebedev, Principles of neural ensemble physiology underlying the operation of brain-machine interfaces. Nat. Rev. Neurosci. 10, 530-540 (2009).
4. M. A. Lebedev, M. A. Nicolelis, Toward a whole-body neuroprosthetic. Prog. Brain Res. 194, 47-60 (2011).
5. C. A. Chestek, J. P. Cunningham, V. Gilja, P. Nuyujukian, S. I. Ryu, K. V. Shenoy, Neural prosthetic systems: Current problems and future directions. Conf. Proc. IEEE Eng. Med. Biol. Soc. 2009, 3369-3375 (2009).
6. P. G. Patil, J. M. Carmena, M. A. Nicolelis, D. A. Turner, Ensemble recordings of human subcortical neurons as a source of motor control signals for a brain-machine interface. Neurosurgery 55, 27-35 (2004).
7. J. Wessberg, C. R. Stambaugh, J. D. Kralik, P. D. Beck, M. Laubach, J. K. Chapin, J. Kim, S. J. Biggs, M. A. Srinivasan, M. A. Nicolelis, Real-time prediction of hand trajectory by ensembles of cortical neurons in primates. Nature 408, 361-365 (2000).
8. J. M. Carmena, M. A. Lebedev, R. E. Crist, J. E. O'Doherty, D. M. Santucci, D. F. Dimitrov, P. G. Patil, C. S. Henriquez, M. A. Nicolelis, Learning to control a brain-machine interface for reaching and grasping by primates. PLoS Biol. 1, E42 (2003).
9. M. D. Serruya, N. G. Hatsopoulos, L. Paninski, M. R. Fellows, J. P. Donoghue, Instant neural control of a movement signal. Nature 416, 141-142 (2002).
10. M. A. Lebedev, J. M. Carmena, J. E. O'Doherty, M. Zacksenhouse, C. S. Henriquez, J. C. Principe, M. A. Nicolelis, Cortical ensemble adaptation to represent velocity of an artificial actuator controlled by a brain-machine interface. J. Neurosci. 25, 4681-4693 (2005).
11. J. E. O'Doherty, M. A. Lebedev, T. L. Hanson, N. A. Fitzsimmons, M. A. Nicolelis, A brain-machine interface instructed by direct intracortical microstimulation. Front. Integr. Neurosci. 3, 20 (2009).
12. M. Velliste, S. Perel, M. C. Spalding, A. S. Whitford, A. B. Schwartz, Cortical control of a prosthetic arm for self-feeding. Nature 453, 1098-1101 (2008).
13. L. R. Hochberg, D. Bacher, B. Jarosiewicz, N. Y. Masse, J. D. Simeral, J. Vogel, S. Haddadin, J. Liu, S. S. Cash, P. Van Der Smagt, J. P. Donoghue, Reach and grasp by people with tetraplegia using a neurally controlled robotic arm. Nature 485, 372-375 (2012).
14. J. E. O'Doherty, M. A. Lebedev, P. J. Ifft, K. Z. Zhuang, S. Shokur, H. Bleuler, M. A. Nicolelis, Active tactile exploration using a brain-machine-brain interface. Nature 479, 228-231 (2011).
15. U. Rokni, O. Steinberg, E. Vaadia, H. Sompolinsky, Cortical representation of bimanual movements. J. Neurosci. 23, 11577-11586 (2003).
16. O. Steinberg, O. Donchin, A. Gribova, S. Cardosa De Oliveira, H. Bergman, E. Vaadia, Neuronal populations in primary motor cortex encode bimanual arm movements. Eur. J. Neurosci. 15, 1371-1380 (2002).
17. J. Tanji, K. Okano, K. C. Sato, Neuronal activity in cortical motor areas related to ipsilateral, contralateral, and bilateral digit movements of the monkey. J. Neurophysiol. 60, 325-343 (1988).
18. O. Donchin, A. Gribova, O. Steinberg, H. Bergman, E. Vaadia, Primary motor cortex is involved in bimanual coordination. Nature 395, 274-278 (1998).
19. O. Kazennikov, B. Hyland, M. Corboz, A. Babalian, E. M. Rouiller, M. Wiesendanger, Neural activity of supplementary and primary motor areas in monkeys and its relation to bimanual and unimanual movement sequences. Neuroscience 89, 661-674 (1999).
20. M. A. Nicolelis, D. Dimitrov, J. M. Carmena, R. Crist, G. Lehew, J. D. Kralik, S. P. Wise, Chronic, multisite, multielectrode recordings in macaque monkeys. Proc. Natl. Acad. Sci. U. S. A. 100, 11041-11046 (2003).
21. I. H. Stevenson, K. P. Kording, How advances in neural recording affect data analysis. Nat. Neurosci. 14, 139-142 (2011).
22. S. Shokur, J. E. O'Doherty, J. A. Winans, H. Bleuler, M. A. Lebedev, M. A. Nicolelis, Expanding the primate body schema in sensorimotor cortex by virtual touches of an avatar. Proc. Natl. Acad. Sci. U. S. A. 110, 15121-15126 (2013).
23. J. L. Collinger, B. Wodlinger, J. E. Downey, W. Wang, E. C. Tyler-Kabara, D. J. Weber, A. J. McMorland, M. Velliste, M. L. Boninger, A. B. Schwartz, High-performance neuroprosthetic control by an individual with tetraplegia. Lancet 381, 557-564 (2013).
24. Z. Li, J. E. O'Doherty, T. L. Hanson, M. A. Lebedev, C. S. Henriquez, M. A. Nicolelis, Unscented Kalman filter for brain-machine interfaces. PLoS One 4, e6243 (2009).
25. D. M. Taylor, S. I. Tillery, A. B. Schwartz, Direct cortical control of 3D neuroprosthetic devices. Science 296, 1829-1832 (2002).
26. L. R. Hochberg, M. D. Serruya, G. M. Friehs, J. A. Mukand, M. Saleh, A. H. Caplan, A. Branner, D. Chen, R. D. Penn, J. P. Donoghue, Neuronal ensemble control of prosthetic devices by a human with tetraplegia. Nature 442, 164-171 (2006).
27. R. Wahnoun, J. He, S. I. Helms Tillery, Selection and parameterization of cortical neurons for neuroprosthetic control. J. Neural Eng. 3, 162-171 (2006).
28. S. P. Kim, J. D. Simeral, L. R. Hochberg, J. P. Donoghue, G. M. Friehs, M. J. Black, Point-and-click cursor control with an intracortical neural interface system by humans with tetraplegia. IEEE Trans. Neural Syst. Rehabil. Eng. 19, 193-203 (2011).
29. M. Hauschild, G. H. Mulliken, I. Fineman, G. E. Loeb, R. A. Andersen, Cognitive signals for brain-machine interfaces in posterior parietal cortex include continuous 3D trajectory commands. Proc. Natl. Acad. Sci. U. S. A. 109, 17075-17080 (2012).
30. N. Hatsopoulos, J. Joshi, J. G. O'Leary, Decoding continuous and discrete motor behaviors using motor and premotor cortical ensembles. J. Neurophysiol. 92, 1165-1174 (2004).
31. H. Scherberger, R. A. Andersen, Target selection signals for arm reaching in the posterior parietal cortex. J. Neurosci. 27, 2001-2012 (2007).
32. D. M. Santucci, J. D. Kralik, M. A. Lebedev, M. A. Nicolelis, Frontal and parietal cortical ensembles predict single-trial muscle activity during reaching movements in primates. Eur. J. Neurosci. 22, 1529-1540 (2005).
33. J. Requin, J. C. Lecas, N. Vitton, A comparison of preparation-related neuronal activity changes in the prefrontal, premotor, primary motor and posterior parietal areas of the monkey cortex: Preliminary results. Neurosci. Lett. 111, 151-156 (1990).
34. D. J. Saha, P. Morasso, Stabilization strategies for unstable dynamics. PLoS One 7, e30301 (2012).
35. C. E. Peper, R. G. Carson, Bimanual coordination between isometric contractions and rhythmic movements: An asymmetric coupling. Exp. Brain Res. 129, 417-432 (1999).
36. A. Ridderikhoff, C. L. Peper, P. J. Beek, Unraveling interlimb interactions underlying bimanual coordination. J. Neurophysiol. 94, 3112-3125 (2005).
37. N. A. Fitzsimmons, M. A. Lebedev, I. D. Peikon, M. A. Nicolelis, Extracting kinematic parameters for monkey bipedal walking from cortical neuronal ensemble activity. Front. Integr. Neurosci. 3, 3 (2009).
38. S. I. Tillery, D. M. Taylor, Signal acquisition and analysis for cortical control of neuroprosthetics. Curr. Opin. Neurobiol. 14, 758-762 (2004).
39. A. P. Georgopoulos, R. E. Kettner, A. B. Schwartz, Primate motor cortex and free arm movements to visual targets in three-dimensional space. II. Coding of the direction of movement by a neuronal population. J. Neurosci. 8, 2928-2937 (1988).
40. M. Zacksenhouse, M. A. Lebedev, J. M. Carmena, J. E. O'Doherty, C. Henriquez, M. A. Nicolelis, Cortical modulations increase in early sessions with brain-machine interface. PLoS One 2, e619 (2007).
41. B. Olson, J. Si, Evidence of a mechanism of neural adaptation in the closed loop control of directions. Int. J. Intell. Comput. Cybern. 3, 5-23 (2008).
42. C. Gerloff, F. G. Andres, Bimanual coordination and interhemispheric interaction. Acta Psychol. 110, 161-186 (2002).
43. F. G. Andres, T. Mima, A. E. Schulman, J. Dichgans, M. Hallett, C. Gerloff, Functional coupling of human cortical sensorimotor areas during bimanual skill acquisition. Brain 122(Pt. 5), 855-870 (1999).
44. S. P. Swinnen, N. Wenderoth, Two hands, one brain: Cognitive neuroscience of bimanual skill. Trends Cogn. Sci. 8, 18-25 (2004).
45. C. L. Colby, Action-oriented spatial reference frames in cortex. Neuron 20, 15-24 (1998).
46. G. Rizzolatti, L. Fadiga, L. Fogassi, V. Gallese, The space around us. Science 277, 190-191 (1997).
47. M. S. Graziano, Where is my arm? The relative role of vision and proprioception in the neuronal representation of limb position. Proc. Natl. Acad. Sci. U. S. A. 96, 10418-10421 (1999).
48. T. Ochiai, H. Mushiake, J. Tanji, Effects of image motion in the dorsal premotor cortex during planning of an arm movement. J. Neurophysiol. 88, 2167-2171 (2002).
49. M. S. Graziano, C. G. Gross, A bimodal map of space: Somatosensory receptive fields in the macaque putamen with corresponding visual receptive fields. Exp. Brain Res. 97, 96-109 (1993).
50. Z. Kalal, K. Mikolajczyk, J. Matas, Tracking-learning-detection. IEEE Trans. Pattern Anal. Mach. Intell. 34, 1409-1422 (2012).
51. G. Lehew, M. A. L. Nicolelis, State-of-the-art microwire array design for chronic neural recordings in behaving animals, in Methods for Neural Ensemble Recordings, M. A. L. Nicolelis, Ed. (CRC Press, Boca Raton, FL, ed. 2, 2008).