Creating new functional circuits for action via brain-machine interfaces

Frontiers in Computational Neuroscience

Volumn , Issue NOV, 2013, Pages

  Orsborn, Amy L ^a   Carmena, Jose M ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Brain machine interfaces; Motor learning; Neural plasticity; Sensorimotor systems; Volitional control

Indexed keywords

BRAIN MACHINE INTERFACE; BRAIN MACHINE INTERFACE (BMIS); LEARNING AND ADAPTATION; MOTOR LEARNING; NEURAL PLASTICITY; NEURAL REPRESENTATIONS; SENSORIMOTOR APPARATUS; SENSORIMOTOR SYSTEMS;

MEDICAL COMPUTING; NEUROLOGY;

BRAIN;

ADAPTATION; ALGORITHM; BRAIN MACHINE INTERFACE; COGNITION; COMPUTER INTERFACE; LEARNING; MOTOR CONTROL; MOTOR PERFORMANCE; NERVE CELL PLASTICITY; NERVE CELL STIMULATION; REVIEW; SENSORIMOTOR FUNCTION; SENSORY SYSTEM;

EID: 84887870751     PISSN: 16625188     EISSN: None     Source Type: Journal    
DOI: 10.3389/fncom.2013.00157     Document Type: Review

References (79)

1. Berg, J. A., Dammann, J. F., Tenore, F. V., Tabot, G. A., Boback, J. L., Manfredi, L. R., et al. (2013). Behavioral demonstration of a somatosensory neuroprosthesis. IEEE Trans. Neural Syst. Rehabil. Eng. 21, 500-507. doi: 10.1109/tnsre.2013.2244616
2. Carmena, J. M., Lebedev, M. A., Crist, R. E., O'Doherty, J. E., Santucci, D. M., Dimitrov, D. F., et al. (2003). Learning to control a brain-machine interface for reaching and grasping by primates. PLoS Biol. 1:e42. doi: 10.1371/journal.pbio.0000042
3. Cerf, M., Thiruvengadam, N., Mormann, F., Kraskov, A., Quiroga, R. Q., Koch, C., et al. (2010). On-line, voluntary control of human temporal lobe neurons. Nature 467, 1104-1108. doi: 10.1038/nature09510
4. Chapin, J. K., Moxon, K. A., Markowitz, R. S., and Nicolelis, M. A. (1999). Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex. Nat. Neurosci. 2, 664-670. doi: 10.1038/10223
5. Chase, S. M., Kass, R. E., and Schwartz, A. B. (2012). Behavioral and neural correlates of visuomotor adaptation observed through a brain-computer interface in primary motor cortex. J. Neurophysiol. 108, 624-644. doi: 10.1152/jn.00371.2011
6. Collinger, J. L., Wodlinger, B., Downey, J. E., Wang, W., Tyler-Kabara, E. C., Weber, D. J., et al. (2012). High-performance neuroprosthetic control by an individual with tetraplegia. Lancet 381, 557-564. doi: 10.1016/s0140-6736(12)61816-9
7. Cunningham, J. P., Nuyujukian, P., Gilja, V., Chestek, C. A., Ryu, S. I., and Shenoy, K. V. (2011). A closed-loop human simulator for investigating the role of feedback control in brain-machine interfaces. J. Neurophysiol. 105, 1932-1949. doi: 10.1152/jn.00503.2010
8. Dadarlat, M., O'Doherty, J. E., and Sabes, P. N. (2012). Multisensory integration of vision and intracortical microstimulation for sensory substitution and augmentation. Presented at Soc. Neurosci. Annual Meeting, 2012, New Orleans, LA, Program No. 792.12/WW15.
9. Engelhard, B., Ozeri, N., Israel, Z., Bergman, H., and Vaadia, E. (2013). Inducing gamma oscillations and precise spike synchrony by operant conditioning via brain-machine interface. Neuron 77, 361-375. doi: 10.1016/j.neuron.2012.11.015
10. Ethier, C., Oby, E. R., Bauman, M. J., and Miller, L. E. (2012). Restoration of grasp following paralysis through brain-controlled stimulation of muscles. Nature 485, 368-371. doi: 10.1038/nature10987
11. Fetz, E. E. (1969). Operant conditioning of cortical unit activity. Science 163, 955-958. doi: 10.1126/science.163.3870.955
12. Fetz, E. E. (2007). Volitional control of neural activity: implications for brain-computer interfaces. J. Physiol. 579, 571-579. doi: 10.1113/jphysiol.2006.127142
13. Fetz, E. E., and Finocchio, D. V. (1971). Operant conditioning of specific patterns of neural and muscular activity. Science 174, 431-435. doi: 10.1126/science.174.4007.431
14. Fetz, E. E., and Finocchio, D. V. (1975). Correlations between activity of motor cortex cells and arm muscles during operantly conditioned response patterns. Exp. Brain Res. 23, 217-240. doi: 10.1007/bf00239736
15. Flint, R. D., Wright, Z. A., Scheid, M. R., and Slutzky, M. W. (2013). Long term, stable brain machine interface performance using local field potentials and multiunit spikes.J. Neural Eng. 10:056005. doi: 10.1088/1741-2560/10/5/056005
16. Gage, G. J., Ludwig, K. A., Otto, K. J., Ionides, E. L., and Kipke, D. R. (2005). Naive coadaptive cortical control. J. Neural Eng. 2, 52-63. doi: 10.1088/1741-2560/2/2/006
17. Gandolfo, F., Li, C., Benda, B. J., Schioppa, C. P., and Bizzi, E. (2000). Cortical correlates of learning in monkeys adapting to a new dynamical environment. Proc. Natl. Acad. Sci. U S A 97, 2259-2263. doi: 10.1073/pnas.040567097
18. Ganguly, K., and Carmena, J. M. (2009). Emergence of a stable cortical map for neuroprosthetic control. PLoS Biol. 7:e1000153. doi: 10.1371/journal.pbio.1000153
19. Ganguly, K., and Carmena, J. M. (2010). Neural correlates of skill acquisition with a cortical brain-machine interface. J. Mot. Behav. 42, 355-360. doi: 10.1080/00222895.2010.526457
20. Ganguly, K., Dimitrov, D. F., Wallis, J. D., and Carmena, J. M. (2011). Reversible large-scale modification of cortical networks during neuroprosthetic control. Nat. Neurosci. 14, 662-667. doi: 10.1038/nn.2797
21. Gilja, V., Nuyujukian, P., Chestek, C. A., Cunningham, J. P., Yu, B. M., Fan, J. M., et al. (2012). A high-performance neural prosthesis enabled by control algorithm design. Nat. Neurosci. 15, 1752-1757. doi: 10.1038/nn.3265
22. Golub, M. D., Yu, B. M., and Chase, S. M. (2012). Internal models engaged by brain-computer interface control. Conf. Proc. IEEE Eng. Med. Biol. Soc. 2012, 1327-1330. doi: 10.1109/EMBC.2012.6346182
23. Green, A. M., and Kalaska, J. F. (2011). Learning to move machines with the mind. Trends Neurosci. 34, 61-75. doi: 10.1016/j.tins.2010.11.003
24. Hochberg, L. R., Bacher, D., Jarosiewicz, B., Masse, N. Y., Simeral, J. D., Vogel, J., et al. (2012). Reach and grasp by people with tetraplegia using a neurally controlled robotic arm. Nature 485, 372-375. doi: 10.1038/nature11076
25. Hochberg, L. R., Serruya, M. D., Friehs, G. M., Mukand, J. A., Saleh, M., Caplan, A. H., et al. (2006). Neuronal ensemble control of prosthetic devices by a human with tetraplegia. Nature 442, 164-171. doi: 10.1038/nature04970
26. Hwang, E. J., Bailey, P. M., and Andersen, R. A. (2013). Volitional control of neural activity relies on the natural motor repertoire. Curr. Biol. 23, 353-361. doi: 10.1016/j.cub.2013.01.027
27. Jackson, A., and Fetz, E. E. (2011). Interfacing with the computational brain. IEEE Trans. Neural Syst. Rehabil. Eng. 19, 534-541. doi: 10.1109/TNSRE.2011.2158586
28. Jackson, A., Mavoori, J., and Fetz, E. E. (2006). Long-term motor cortex plasticity induced by an electronic neural implant. Nature 444, 56-60. doi: 10.1038/nature05226
29. Jarosiewicz, B., Chase, S. M., Fraser, G. W., Velliste, M., Kass, R. E., and Schwartz, A. B. (2008). Functional network reorganization during learning in a brain-computer interface paradigm. Proc. Natl. Acad. Sci. U S A 105, 19486-19491. doi: 10.1073/pnas.0808113105
30. Kim, S.-P., Simeral, J. D., Hochberg, L. R., Donoghue, J. P., and Black, M. J. (2008). Neural control of computer cursor velocity by decoding motor cortical spiking activity in humans with tetraplegia. J. Neural Eng. 5, 455-476. doi: 10.1088/1741-2560/5/4/010
31. Koralek, A. C., Costa, R. M., and Carmena, J. M. (2013). Temporally precise cell-specific coherence develops in corticostriatal networks during learning. Neuron 79, 865-872. doi: 10.1016/j.neuron.2013.06.047
32. Koralek, A. C., Jin, X., Long II, J. D., Costa, R. M., and Carmena, J. M. (2012). Corticostriatal plasticity is necessary for learning intentional neuroprosthetic skills. Nature 483, 331-335. doi: 10.1038/nature10845
33. Koyama, S., Chase, S. M., Whitford, A. S., Velliste, M., Schwartz, A. B., and Kass, R. E. (2009). Comparison of brain-computer interface decoding algorithms in open-loop and closed-loop control. J. Comput. Neurosci. 29, 73-87. doi: 10.1007/s10827-009-0196-9
34. Krakauer, J. W., and Mazzoni, P. (2011). Human sensorimotor learning: adaptation, skill, and beyond. Curr. Opin. Neurobiol. 21, 636-644. doi: 10.1016/j.conb.2011.06.012
35. Krakauer, J. W., Pine, Z. M., Ghilardi, M. F., and Ghez, C. (2000). Learning of visuomotor transformations for vectorial planning of reaching trajectories. J. Neurosci. 20, 8916-8924.
36. Krakauer, J. W., and Shadmehr, R. (2006). Consolidation of motor memory. Trends Neurosci. 29, 58-64. doi: 10.1016/j.tins.2005.10.003
37. Leuthardt, E. C., Schalk, G., Wolpaw, J. R., Ojemann, J. G., and Moran, D. W. (2004). A brain-computer interface using electrocorticographic signals in humans. J. Neural Eng. 1, 63-71. doi: 10.1088/1741-2560/1/2/001
38. Li, C. S., Padoa-Schioppa, C., and Bizzi, E. (2001). Neuronal correlates of motor performance and motor learning in the primary motor cortex of monkeys adapting to an external force field. Neuron 30, 593-607. doi: 10.1016/s0896-6273(01)00301-4
39. Liu, X., Mosier, K. M., Mussa-Ivaldi, F. A., Casadio, M., and Scheidt, R. A. (2010). Reorganization of finger coordination patterns during adaptation to rotation and scaling of a newly learned sensorimotor transformation. J. Neurophysiol. 105, 454-473. doi: 10.1152/jn.00247.2010
40. London, B. M., Jordan, L. R., Jackson, C. R., and Miller, L. E. (2008). Electrical stimulation of the proprioceptive cortex (area 3a) used to instruct a behaving monkey. IEEE Trans. Neural Syst. Rehabil. Eng. 16, 32-36. doi: 10.1109/tnsre.2007.907544
41. McFarland, D. J., and Wolpaw, J. R. (2011). Brain-computer interfaces for communication and control. Commun. ACM 54, 60-66. doi: 10.1145/1941487.1941506
42. Millán, J. D. R., Galan, F., Vanhooydonck, D., Lew, E., Philips, J., and Nuttin, M. (2009). Asynchronous non-invasive brain-actuated control of an intelligent wheelchair. Conf. Proc. IEEE Eng. Med. Biol. Soc. 2009, 3361-3364. doi: 10.1109/IEMBS.2009.5332828
43. Millán, J. del R., and Mouriño, J. (2003). Asynchronous BCI and local neural classifiers: an overview of the adaptive brain interface project. IEEE Trans. Neural Syst. Rehabil. Eng. 11, 159-161. doi: 10.1109/tnsre.2003.814435
44. Millán, J. D. R., Renkens, F., Mourino, J., and Gerstner, W. (2004). Noninvasive brain-actuated control of a mobile robot by human EEG. IEEE Trans. Biomed. Eng. 51, 1026-1033. doi: 10.1109/tbme.2004.827086
45. Moritz, C. T., and Fetz, E. E. (2011). Volitional control of single cortical neurons in a brain-machine interface. J. Neural Eng. 8:025017. doi: 10.1088/1741-2560/8/2/025017
46. Moritz, C. T., Perlmutter, S. I., and Fetz, E. E. (2008). Direct control of paralysed muscles by cortical neurons. Nature 456, 639-642. doi: 10.1038/nature07418
47. Mosier, K. M., Scheidt, R. A., Acosta, S., and Mussa-Ivaldi, F. A. (2005). Remapping hand movements in a novel geometrical environment. J. Neurophysiol. 94, 4362-4372. doi: 10.1152/jn.00380.2005
48. Mussa-Ivaldi, F. A., and Danziger, Z. (2009). The remapping of space in motor learning and human-machine interfaces. J. Physiol. Paris 103, 263-275. doi: 10.1016/j.jphysparis.2009.08.009
49. Nazarpour, K., Barnard, A., and Jackson, A. (2012). Flexible cortical control of task-specific muscle synergies. J. Neurosci. 32, 12349-12360. doi: 10.1523/jneurosci.5481-11.2012
50. Nuyujukian, P., Fan, J. M., Gilja, V., Kalanithi, P. S., Chestek, C. A., and Shenoy, K. V. (2011). Monkey models for brain-machine interfaces: the need for maintaining diversity. Conf. Proc. IEEE Eng. Med. Biol. Soc. 2011, 1301-1305. doi: 10.1109/IEMBS.2011.6090306
51. O'Doherty, J. E., Lebedev, M. A., Ifft, P. J., Zhuang, K. Z., Shokur, S., Bleuler, H., et al. (2011). Active tactile exploration using a brain-machine-brain interface. Nature 479, 228-231. doi: 10.1038/nature10489
52. Padoa-Schioppa, C., Li, C. R., and Bizzi, E. (2004). Neuronal activity in the supplementary motor area of monkeys adapting to a new dynamic environment. J. Neurophysiol. 91, 449-473. doi: 10.1152/jn.00876.2002
53. Paz, R., Boraud, T., Natan, C., Bergman, H., and Vaadia, E. (2003). Preparatory activity in motor cortex reflects learning of local visuomotor skills. Nat. Neurosci. 6, 882-890. doi: 10.1038/nn1097
54. Paz, R., and Vaadia, E. (2004). Learning-induced improvement in encoding and decoding of specific movement directions by neurons in the primary motor cortex. PLoS Biol. 2:E45. doi: 10.1371/journal.pbio.0020045
55. Radhakrishnan, S. M., Baker, S. N., and Jackson, A. (2008). Learning a novel myoelectric-controlled interface task. J. Neurophysiol. 100, 2397-2408. doi: 10.1152/jn.90614.2008
56. Ranganathan, R., Adewuyi, A., and Mussa-Ivaldi, F. A. (2013). Learning to be lazy: exploiting redundancy in a novel task to minimize movement-related effort. J. Neurosci. 33, 2754-2760. doi: 10.1523/jneurosci.1553-12.2013
57. Romo, R., Hernández, A., Zainos, A., Brody, C. D., and Lemus, L. (2000). Sensing without touching: psychophysical performance based on cortical microstimulation. Neuron 26, 273-278. doi: 10.1016/s0896-6273(00)81156-3
58. Rouse, A. G., Williams, J. J., Wheeler, J. J., and Moran, D. W. (2013). Cortical adaptation to a chronic micro-electrocorticographic brain computer interface. J. Neurosci. 33, 1326-1330. doi: 10.1523/jneurosci.0271-12.2013
59. Sabes, P. N. (2011). Sensory integration for reaching: models of optimality in the context of behavior and the underlying neural circuits. Prog. Brain Res. 191, 195-209. doi: 10.1016/B978-0-444-53752-2.00004-7
60. Schalk, G., Miller, K. J., Anderson, N. R., Wilson, J. A., Smyth, M. D., Ojemann, J. G., et al. (2008). Two-dimensional movement control using electrocorticographic signals in humans. J. Neural Eng. 5, 75-84. doi: 10.1088/1741-2560/5/1/008
61. Serruya, M. D., Hatsopoulos, N. G., Paninski, L., Fellows, M. R., and Donoghue, J. P. (2002). Instant neural control of a movement signal. Nature 416, 141-142. doi: 10.1038/416141a
62. Shadmehr, R., and Mussa-Ivaldi, F. A. (1994). Adaptive representation of dynamics during learning of a motor task. J. Neurosci. 14, 3208-3224.
63. Shadmehr, R., Smith, M. A., and Krakauer, J. W. (2010). Error correction, sensory prediction, and adaptation in motor control. Annu. Rev. Neurosci. 33, 89-108. doi: 10.1146/annurev-neuro-060909-153135
64. Shenoy, K. V., Sahani, M. A., and Churchland, M. M. (2013). Cortical control of arm movements: a dynamical systems perspective. Annu. Rev. Neurosci. 36, 337-359. doi: 10.1146/annurev-neuro-062111-150509
65. Shmuelof, L., Krakauer, J. W., and Mazzoni, P. (2012). How is a motor skill learned? Change and invariance at the levels of task success and trajectory control. J. Neurophysiol. 108, 578-594. doi: 10.1152/jn.00856.2011
66. Suminski, A. J., Tkach, D. C., Fagg, A. H., and Hatsopoulos, N. G. (2010). Incorporating feedback from multiple sensory modalities enhances brain-machine interface control. J. Neurosci. 30, 16777-16787. doi: 10.1523/jneurosci.3967-10.2010
67. Taylor, D. M., Helms-Tillery, S. I., and Schwartz, A. B. (2002). Direct cortical control of 3D neuroprosthetic devices. Science 296, 1829-1832. doi: 10.1126/science.1070291
68. Taylor, J. A., and Ivry, R. B. (2011). Flexible cognitive strategies during motor learning. PLoS Comp. Biol. 7:e1001096. doi: 10.1371/journal.pcbi.1001096
69. Taylor, D. M., Tillery, S. I. H., and Schwartz, A. B. (2003). Information conveyed through brain-control: cursor versus robot. IEEE Trans. Neural Syst. Rehabil. Eng.11, 195-199. doi: 10.1109/tnsre.2003.814451
70. Tehovnik, E. J., Slocum, W. M., Smirnakis, S. M., and Tolias, A. S. (2009). Microstimulation of visual cortex to restore vision. Prog. Brain Res. 175, 347-375. doi: 10.1016/s0079-6123(09)17524-6
71. Velliste, M., Perel, S., Spalding, M. C., Whitford, A. S., and Schwartz, A. B. (2008). Cortical control of a prosthetic arm for self-feeding. Nature 453, 1098-1101. doi: 10.1227/01.neu.0000335797.80384.06
72. Venkatraman, S., and Carmena, J. M. (2011). Active sensing of target location encoded by cortical microstimulation. IEEE Trans. Neural Syst. Rehabil. Eng. 19, 317-324. doi: 10.1109/tnsre.2011.2117441
73. Wander, J. D., Blakely, T., Miller, K. J., Weaver, K. E., Johnson, L. A., Olson, J. D., et al. (2013). Distributed cortical adaptation during learning of a brain-computer interface task. Proc. Natl. Acad. Sci. U S A 110, 10818-10823. doi: 10.1073/pnas.1221127110
74. Weiland, J. D., and Humayun, M. S. (2008). Visual prosthesis. Proc. IEEE 96, 1076-1084. doi: 10.1109/JPROC.2008.922589
75. Wilson, B. S., Finley, C. C., Lawson, D. T., Wolford, R. D., Eddington, D. K., and Rabinowitz, W. M. (1991). Better speech recognition with cochlear implants. Nature352, 236-238. doi: 10.1016/0196-0709(91)90011-4
76. Wise, S. P., Moody, S. L., Blomstrom, K. J., and Mitz, A. R. (1998). Changes in motor cortical activity during visuomotor adaptation. Exp. Brain Res. 121, 285-299. doi: 10.1007/s002210050462
77. Wolpaw, J. R., Birbaumer, N., McFarland, D. J., Pfurtscheller, G., and Vaughan, T. M. (2002). Brain-computer interfaces for communication and control. Clin. Neurophysiol. 113, 767-791. doi: 10.1016/S1388-2457(02)00057-3
78. Wolpaw, J. R., and McFarland, D. J. (2004). Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. Proc. Natl. Acad. Sci. U S A 101, 17849-17854. doi: 10.1073/pnas.0403504101
79. Wolpert, D. M., Diedrichsen, J., and Flanagan, J. R. (2011). Principles of sensorimotor learning. Nat. Rev. Neurosci. 12, 739-751. doi: 10.1038/nrn3112