Reprogramming movements: Extraction of motor intentions from cortical ensemble activity when movement goals change

Frontiers in Neuroengineering

Volumn , Issue JULY, 2012, Pages

  Ifft, Peter J ^a,b   Lebedev, Mikhail A ^b,c   Nicolelis, Miguel A L ^a,b,c,d  

^a Duke University   (United States)

^b DUKE UNIVERSITY   (United States)

^c DUKE UNIVERSITY SCHOOL OF MEDICINE   (United States)

^d Edmond and Lily Safra International Institute of Neuroscience of Natal   (Brazil)

Author keywords

Brain machine interfaces; Decision making; Monkey; Motor cortex; Neurophysiology; Neuroprosthetics; Sensorimotor transformation; Somatosensory cortex; Volitional inhibition

Indexed keywords

ACCURACY; ANIMAL CELL; ANIMAL EXPERIMENT; ARTICLE; BEHAVIORAL SCIENCE; BODY MOVEMENT; BRAIN CELL; BRAIN COMPUTER INTERFACE; CLASSIFIER; CONTROLLED STUDY; ELECTRODE; EXECUTIVE FUNCTION; FEMALE; LINEAR DISCRIMINANT ANALYSIS; MALE; MEAN FIRING RATE; MOTOR INTENTION; MOVEMENT (PHYSIOLOGY); MULTIELECTRODE ARRAY; NERVE CONDUCTION; NERVE POTENTIAL; NONHUMAN; PREDICTIVE VALUE; PRIMARY MOTOR CORTEX; PRIMARY SOMATOSENSORY CORTEX; REPROGRAMMING MOVEMENT; RESPONSE TIME; RHESUS MONKEY; SIGNAL PROCESSING; SWITCH SIGNAL DELAY; TASK PERFORMANCE; WEINER FILTER;

MACACA MULATTA; PRIMATES;

EID: 84875558772     PISSN: 16626443     EISSN: None     Source Type: Journal    
DOI: 10.3389/fneng.2012.00016     Document Type: Article

References (98)

1. Afshar, A., Santhanam, G., Yu, B.M., Ryu, S.I., Sahani, M., and Shenoy, K.V. (2011). Single-trial neural correlates of arm movement preparation. Neuron 71, 555-564.
2. Alexander, G.E., and Crutcher, M.D. (1990). Neural representations of the target (goal) of visually guided arm movements in three motor areas of the monkey. J Neurophysiol 64, 164-178.
3. Andersen, R.A., Musallam, S., and Pesaran, B. (2004). Selecting the ssignals for a brain-machine interface. Curr Opin Neurobiol 14, 720-726.
4. Awiszus, F. (1997). Spike train analysis. J Neurosci Methods 74, 155-166.
5. Baker, J.T., Donoghue, J.P., and Sanes, J.N. (1999). Gaze direction modulates finger movement activation patterns in human cerebral cortex. J Neurosci 19, 10044-10052.
6. Balan, P.F., and Ferrera, V.P. (2003). Effects of gaze shifts on maintenance of spatial memory in macaque frontal eye field. J Neurosci 23, 5446-5454.
7. Baldi, P., Brunak, S., Chauvin, Y., Andersen, C.A., and Nielsen, H. (2000). Assessing the accuracy of prediction algorithms for classification: an overview. Bioinformatics 16, 412-424.
8. Band, G.P., and Van Boxtel, G.J. (1999). Inhibitory motor control in stop paradigms: review and reinterpretation of neural mechanisms. Acta Psychol (Amst) 101, 179-211.
9. Basar, K., Sesia, T., Groenewegen, H., Steinbusch, H.W., Visser-Vandewalle, V., and Temel, Y. (2010). Nucleus accumbens and impulsivity. Prog Neurobiol 92, 533-557.
10. Baumann, M.A., Fluet, M.C., and Scherberger, H. (2009). Context-specific grasp movement representation in the macaque anterior intraparietal area. J Neurosci 29, 6436-6448.
11. Birbaumer, N., Murguialday, A.R., and Cohen, L. (2008). Brain-computer interface in paralysis. Curr Opin Neurol 21, 634-638.
12. Boussaoud, D., Barth, T.M., and Wise, S.P. (1993). Effects of gaze on apparent visual responses of frontal cortex neurons. Exp Brain Res 93, 423-434.
13. Boussaoud, D., and Bremmer, F. (1999). Gaze effects in the cerebral cortex: reference frames for space coding and action. Exp Brain Res 128, 170-180.
14. Carmena, J.M., Lebedev, M.A., Crist, R.E., O'doherty, J.E., Santucci, D.M., Dimitrov, D.F., Patil, P.G., Henriquez, C.S., and Nicolelis, M.A. (2003). Learning to control a brain-machine interface for reaching and grasping by primates. PLoS Biol 1, E42.
15. Chapin, J.K. (2004). Using multi-neuron population recordings for neural prosthetics. Nat Neurosci 7, 452-455.
16. Chase, S.M., and Schwartz, A.B. (2011). Inference from populations: going beyond models. Prog Brain Res 192, 103-112.
17. Chen, X., Scangos, K.W., and Stuphorn, V. (2010). Supplementary motor area exerts proactive and reactive control of arm movements. J Neurosci 30, 14657-14675.
18. Churchland, M.M., Yu, B.M., Sahani, M., and Shenoy, K.V. (2007). Techniques for extracting single-trial activity patterns from large-scale neural recordings. Curr Opin Neurobiol 17, 609-618.
19. Cisek, P., and Kalaska, J.F. (2002). Simultaneous encoding of multiple potential reach directions in dorsal premotor cortex. J Neurophysiol 87, 1149-1154.
20. Cisek, P., and Kalaska, J.F. (2005). Neural correlates of reaching decisions in dorsal premotor cortex: specification of multiple direction choices and final selection of action. Neuron 45, 801-814.
21. Cisek, P., and Kalaska, J.F. (2010). Neural mechanisms for interacting with a world full of action choices. Annu Rev Neurosci 33, 269-298.
22. Cohen, Y.E., and Andersen, R.A. (2002). A common reference frame for movement plans in the posterior parietal cortex. Nat Rev Neurosci 3, 553-562.
23. Crammond, D.J., and Kalaska, J.F. (1994). Modulation of preparatory neuronal activity in dorsal premotor cortex due to stimulus-response compatibility. J Neurophysiol 71, 1281-1284.
24. Fetz, E.E. (2007). Volitional control of neural activity: implications for brain-computer interfaces. J Physiol 579, 571-579.
25. Fisher, R.A. (1936). Statistical methods for research workers. Edinburgh, London,: Oliver & Boyd.
26. Fitzsimmons, N.A., Lebedev, M.A., Peikon, I.D., and Nicolelis, M.A. (2009). Extracting kinematic parameters for monkey bipedal walking from cortical neuronal ensemble activity. Front Integr Neurosci 3, 3.
27. Fu, Q.G., Flament, D., Coltz, J.D., and Ebner, T.J. (1995). Temporal encoding of movement kinematics in the discharge of primate primary motor and premotor neurons. J Neurophysiol 73, 836-854.
28. Genovesio, A., Brasted, P.J., Mitz, A.R., and Wise, S.P. (2005). Prefrontal cortex activity related to abstract response strategies. Neuron 47, 307-320.
29. Georgopoulos, A.P., Kalaska, J.F., Caminiti, R., and Massey, J.T. (1983). Interruption of motor cortical discharge subserving aimed arm movements. Exp Brain Res 49, 327-340.
30. Georgopoulos, A.P., Kalaska, J.F., and Massey, J.T. (1981). Spatial trajectories and reaction times of aimed movements: effects of practice, uncertainty, and change in target location. J Neurophysiol 46, 725-743.
31. Gilja, V., Chestek, C.A., Diester, I., Henderson, J.M., Deisseroth, K., and Shenoy, K.V. (2011). Challenges and opportunities for next-generation intracortically based neural prostheses. IEEE Trans Biomed Eng 58, 1891-1899.
32. Hanes, D.P., and Schall, J.D. (1995). Countermanding saccades in macaque. Vis Neurosci 12, 929-937.
33. Hanes, D.P., and Schall, J.D. (1996). Neural control of voluntary movement initiation. Science 274, 427-430.
34. Hasegawa, R.P., Hasegawa, Y.T., and Segraves, M.A. (2006). Single trial-based prediction of a go/no-go decision in monkey superior colliculus. Neural Netw 19, 1223-1232
35. Hasegawa, R.P., Hasegawa, Y.T., and Segraves, M.A. (2009). Neural mind reading of multi-dimensional decisions by monkey mid-brain activity. Neural Netw 22, 1247-1256.
36. Hernandez, A., Nacher, V., Luna, R., Zainos, A., Lemus, L., Alvarez, M., Vazquez, Y., Camarillo, L., and Romo, R. (2010). Decoding a perceptual decision process across cortex. Neuron 66, 300-314.
37. Hwang, E.J., and Andersen, R.A. (2009). Brain control of movement execution onset using local field potentials in posterior parietal cortex. J Neurosci 29, 14363-14370.
38. Ifft, P.J., Lebedev, M.A., and Nicolelis, M.A. (2011). Cortical correlates of fitts' law. Front Integr Neurosci 5, 85.
39. Ikkai, A., and Curtis, C.E. (2011). Common neural mechanisms supporting spatial working memory, attention and motor intention. Neuropsychologia 49, 1428-1434.
40. Isoda, M., and Tanji, J. (2004). Participation of the primate presupplementary motor area in sequencing multiple saccades. J Neurophysiol 92, 653-659.
41. Jackson, A., and Fetz, E.E. (2011). Interfacing with the computational brain. IEEE Trans Neural Syst Rehabil Eng 19, 534-541.
42. Kertzman, C., Schwarz, U., Zeffiro, T.A., and Hallett, M. (1997). The role of posterior parietal cortex in visually guided reaching movements in humans. Exp Brain Res 114, 170-183.
43. Kim, H.K., Biggs, S.J., Schloerb, D.W., Carmena, J.M., Lebedev, M.A., Nicolelis, M.A., and Srinivasan, M.A. (2006). Continuous shared control for stabilizing reaching and grasping with brain-machine interfaces. IEEE Trans Biomed Eng 53, 1164-1173.
44. Kim, S., and Lee, D. (2011). Prefrontal cortex and impulsive decision making. Biol Psychiatry 69, 1140-1146.
45. Krawczyk, D.C. (2002). Contributions of the prefrontal cortex to the neural basis of human decision making. Neurosci Biobehav Rev 26, 631-664.
46. Lacquaniti, F., and Caminiti, R. (1998). Visuo-motor transformations for arm reaching. Eur J Neurosci 10, 195-203.
47. Lebedev, M.A., Carmena, J.M., O'doherty, J.E., Zacksenhouse, M., Henriquez, C.S., Principe, J.C., and Nicolelis, M.A. (2005). Cortical ensemble adaptation to represent velocity of an artificial actuator controlled by a brain-machine interface. J Neurosci 25, 4681-4693.
48. Lebedev, M.A., Denton, J.M., and Nelson, R.J. (1994). Vibration-entrained and premovement activity in monkey primary somatosensory cortex. J Neurophysiol 72, 1654-1673.
49. Lebedev, M.A., Messinger, A., Kralik, J.D., and Wise, S.P. (2004). Representation of attended versus remembered locations in prefrontal cortex. PLoS Biol 2, e365.
50. Lebedev, M.A., and Nicolelis, M.A. (2006). Brain-machine interfaces: past, present and future. Trends Neurosci 29, 536-546.
51. Lebedev, M.A., and Nicolelis, M.A. (2011). Toward a whole-body neuroprosthetic. Prog Brain Res 194, 47-60.
52. Lebedev, M.A., O'doherty, J.E., and Nicolelis, M.A. (2008). Decoding of temporal intervals from cortical ensemble activity. J Neurophysiol 99, 166-186.
53. Lebedev, M.A., Tate, A.J., Hanson, T.L., Li, Z., O'doherty, J.E., Winans, J.A., Ifft, P.J., Zhuang, K.Z., Fitzsimmons, N.A., Schwarz, D.A., Fuller, A.M., An, J.H., and Nicolelis, M.A. (2011). Future developments in brain-machine interface research. Clinics (Sao Paulo) 66 Suppl 1, 25-32.
54. Lebedev, M.A., and Wise, S.P. (2000). Oscillations in the premotor cortex: single-unit activity from awake, behaving monkeys. Exp Brain Res 130, 195-215.
55. Lebedev, M.A., and Wise, S.P. (2001). Tuning for the orientation of spatial attention in dorsal premotor cortex. Eur J Neurosci 13, 1002-1008.
56. Lebedev, M.A., and Wise, S.P. (2002). Insights into seeing and grasping: distinguishing the neural correlates of perception and action. Behav Cogn Neurosci Rev 1, 108-129.
57. Lee, I.H., and Assad, J.A. (2003). Putaminal activity for simple reactions or self-timed movements. J Neurophysiol 89, 2528-2537.
58. Matsuzaka, Y., and Tanji, J. (1996). Changing directions of forthcoming arm movements: neuronal activity in the presupplementary and supplementary motor area of monkey cerebral cortex. J Neurophysiol 76, 2327-2342.
59. Matthews, B.W. (1975). Comparison of the predicted and observed secondary structure of T4 phage lysozyme. Biochim Biophys Acta 405, 442-451.
60. Mcguire, L.M., and Sabes, P.N. (2009). Sensory transformations and the use of multiple reference frames for reach planning. Nat Neurosci 12, 1056-1061.
61. Miller, E.K. (2000). The prefrontal cortex and cognitive control. Nat Rev Neurosci 1, 59-65.
62. Miller, E.K., and Wilson, M.A. (2008). All my circuits: using multiple electrodes to understand functioning neural networks. Neuron 60, 483-488.
63. Mirabella, G., Pani, P., and Ferraina, S. (2011). Neural correlates of cognitive control of reaching movements in the dorsal premotor cortex of rhesus monkeys. J Neurophysiol 106, 1454-1466.
64. Mostofsky, S.H., and Simmonds, D.J. (2008). Response inhibition and response selection: two sides of the same coin. J Cogn Neurosci 20, 751-761.
65. Musallam, S., Corneil, B.D., Greger, B., Scherberger, H., and Andersen, R.A. (2004). Cognitive control signals for neural prosthetics. Science 305, 258-262.
66. Mushiake, H., Inase, M., and Tanji, J. (1990). Selective coding of motor sequence in the supplementary motor area of the monkey cerebral cortex. Exp Brain Res 82, 208-210.
67. National Research Council (U.S.). Committee for the Update of the Guide for the Care and Use of Laboratory Animals., Institute for Laboratory Animal Research (U.S.), and National Academies Press (U.S.) (2011). Guide for the care and use of laboratory animals. 8th ed. (Washington, D.C.: National Academies Press,).
68. Nelson, R.J., Smith, B.N., and Douglas, V.D. (1991). Relationships between sensory responsiveness and premovement activity of quickly adapting neurons in areas 3b and 1 of monkey primary somatosensory cortex. Exp Brain Res 84, 75-90.
69. Nicolelis, M.A. (2001). Actions from thoughts. Nature 409, 403-407.
70. Nicolelis, M.A., Dimitrov, D., Carmena, J.M., Crist, R., Lehew, G., Kralik, J.D., and Wise, S.P. (2003). Chronic, multisite, multielectrode recordings in macaque monkeys. Proc Natl Acad Sci U S A 100, 11041-11046.
71. Nicolelis, M.A., and Lebedev, M.A. (2009). Principles of neural ensemble physiology underlying the operation of brain-machine interfaces. Nat Rev Neurosci 10, 530-540.
72. Pare, M., and Hanes, D.P. (2003). Controlled movement processing: superior colliculus activity associated with countermanded saccades. J Neurosci 23, 6480-6489.
73. Pesaran, B., Musallam, S., and Andersen, R.A. (2006). Cognitive neural prosthetics. Curr Biol 16, R77-80.
74. Pesaran, B., Nelson, M.J., and Andersen, R.A. (2008). Free choice activates a decision circuit between frontal and parietal cortex. Nature 453, 406-409.
75. Resulaj, A., Kiani, R., Wolpert, D.M., and Shadlen, M.N. (2009). Changes of mind in decision-making. Nature 461, 263-266.
76. Rickert, J., Riehle, A., Aertsen, A., Rotter, S., and Nawrot, M.P. (2009). Dynamic encoding of movement direction in motor cortical neurons. J Neurosci 29, 13870-13882.
77. Santhanam, G., Ryu, S.I., Yu, B.M., Afshar, A., and Shenoy, K.V. (2006). A high-performance brain-computer interface. Nature 442, 195-198.
78. Santucci, D.M., Kralik, J.D., Lebedev, M.A., and Nicolelis, M.A. (2005). Frontal and parietal cortical ensembles predict single-trial muscle activity during reaching movements in primates. Eur J Neurosci 22, 1529-1540.
79. Scangos, K.W., and Stuphorn, V. (2010). Medial frontal cortex motivates but does not control movement initiation in the countermanding task. J Neurosci 30, 1968-1982.
80. Schall, J.D., Stuphorn, V., and Brown, J.W. (2002). Monitoring and control of action by the frontal lobes. Neuron 36, 309-322.
81. Scherberger, H., and Andersen, R.A. (2007). Target selection signals for arm reaching in the posterior parietal cortex. J Neurosci 27, 2001-2012.
82. Shen, L., and Alexander, G.E. (1997). Neural correlates of a spatial sensory-to-motor transformation in primary motor cortex. J Neurophysiol 77, 1171-1194.
83. Snyder, L.H., Batista, A.P., and Andersen, R.A. (1998). Change in motor plan, without a change in the spatial locus of attention, modulates activity in posterior parietal cortex. J Neurophysiol 79, 2814-2819.
84. Soso, M.J., and Fetz, E.E. (1980). Responses of identified cells in postcentral cortex of awake monkeys during comparable active and passive joint movements. J Neurophysiol 43, 1090-1110.
85. Stevenson, I.H., and Kording, K.P. (2011). How advances in neural recording affect data analysis. Nat Neurosci 14, 139-142.
86. Stinear, C.M., Coxon, J.P., and Byblow, W.D. (2009). Primary motor cortex and movement prevention: where Stop meets Go. Neurosci Biobehav Rev 33, 662-673.
87. Tanji, J. (2001). Sequential organization of multiple movements: involvement of cortical motor areas. Annu Rev Neurosci 24, 631-651.
88. Thaler, L., and Goodale, M.A. (2011). Neural substrates of visual spatial coding and visual feedback control for hand movements in allocentric and target-directed tasks. Front Hum Neurosci 5, 92.
89. Tonet, O., Marinelli, M., Citi, L., Rossini, P.M., Rossini, L., Megali, G., and Dario, P. (2008). Defining brain-machine interface applications by matching interface performance with device requirements. J Neurosci Methods 167, 91-104.
90. Velliste, M., Perel, S., Spalding, M.C., Whitford, A.S., and Schwartz, A.B. (2008). Cortical control of a prosthetic arm for self-feeding. Nature 453, 1098-1101.
91. Verbruggen, F., and Logan, G.D. (2008). Response inhibition in the stop-signal paradigm. Trends Cogn Sci 12, 418-424.
92. Vickers, D., and Smith, P. (1985). Accumulator and random-walk models of psychophysical discrimination: a counter-evaluation. Perception 14, 471-497.
93. Wessberg, J., Stambaugh, C.R., Kralik, J.D., Beck, P.D., Laubach, M., Chapin, J.K., Kim, J., Biggs, S.J., Srinivasan, M.A., and Nicolelis, M.A. (2000). Real-time prediction of hand trajectory by ensembles of cortical neurons in primates. Nature 408, 361-365.
94. Wise, S.P., Boussaoud, D., Johnson, P.B., and Caminiti, R. (1997). Premotor and parietal cortex: corticocortical connectivity and combinatorial computations. Annu Rev Neurosci 20, 25-42.
95. Wise, S.P., Di Pellegrino, G., and Boussaoud, D. (1996). The premotor cortex and nonstandard sensorimotor mapping. Can J Physiol Pharmacol 74, 469-482.
96. Wise, S.P., and Murray, E.A. (2000). Arbitrary associations between antecedents and actions. Trends Neurosci 23, 271-276.
97. Wong-Lin, K., Eckhoff, P., Holmes, P., and Cohen, J.D. (2010). Optimal performance in a countermanding saccade task. Brain Res 1318, 178-187.
98. Zacksenhouse, M., and Nemets, S. (2008). Strategies for Neural Ensemble Data Analysis for Brain-Machine Interface (BMI) Applications, in Methods for Neural Ensemble Recordings, ed. M.a.L. Nicolelis. 2nd ed (Boca Raton (FL)).