Neural Decoding for Motor and Communication Prostheses

Statistical Signal Processing for Neuroscience and Neurotechnology

Volumn , Issue , 2010, Pages 219-263

  Yu, Byron M ^a   Santhanam, Gopal ^d   Sahani, Maneesh ^b   Shenoy, Krishna V ^c  

^a NATIONAL SCIENCE FOUNDATION   (United States)

^b CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

^c STANFORD UNIVERSITY   (United States)

^d NONE

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84882838944     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1016/B978-0-12-375027-3.00007-7     Document Type: Chapter

References (108)

1. Achtman N., Afshar A., Santhanam G., Yu B.M., Ryu S.I., Shenoy K.V. Free paced high-performance brain-computer interfaces. J. Neural. Eng. 2007, 4:336-347.
2. Afshar A., Yu B.M., Santhanam G., Ryu S.I., Shenoy K.V., Sahani M. Evidence for smooth and inertial dynamics in the evolution of neural state. Soc. Neurosci. Abstr. 2008, (319.8).
3. Andersen R.A., Burdick R.W., Musallam S., Pesaran B., Cham J.G. Cognitive neural prosthetics. Trends Cogn. Sci. 2004, 8:486-493.
4. Batista A.P., Santhanam G., Yu B.M., Ryu S.I., Afshar A., Shenoy K.V. Reference frames for reach planning in macaque dorsal premotor cortex. J. Neurophysiol. 2007, 98:966-983.
5. Boussaoud D., Wise S.P. Primate frontal cortex: neuronal activity following attentional versus intentional cues. Exp. Brain. Res. 1993, 95(1):15-27.
6. Brockwell A.E., Rojas A.L., Kass R.E. Recursive Bayesian decoding of motor cortical signals by particle filtering. J. Neurophysiol. 2004, 91(4):1899-1907.
7. Brown E.N., Frank L.M., Tang D., Quirk M.C., Wilson M.A. A statistical paradigm for neural spike train decoding applied to position prediction from the ensemble firing patterns of rat hippocampal place cells. J. Neurosci. 1998, 18(18):7411-7425.
8. Carmena J.M., Lebedev M.A., Crist R.E., O'Doherty J.E., Santucci D.M., Dimitrov D.F., et al. Learning to control a brain-machine interface for reaching and grasping by primates. PLoS Biol. 2003, 1(2):193-208.
9. Chan S.S., Moran D.W. Computational model of a primate arm: from hand position to joint angles, joint torques and muscle forces. J. Neural. Eng. 2006, 3:327-337.
10. Chapin J.K., Moxon K.A., Markowitz R.S., Nicolelis M.A.L. Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex. Nat. Neurosci. 1999, 2:664-670.
11. Chase S.M., Schwartz A.B., Kass R.E. Bias, optimal linear estimation, and the differences between open-loop simulation and closed-loop performance of spiking-based brain-computer interface algorithms. Neural Networks. 2009, 22(9):1203-1213.
12. Chestek C.A., Batista A.P., Santhanam G., Yu B.M., Afshar A., Cunningham J.P., et al. Single-neuron stability during repeated reaching in macaque premotor cortex. J. Neurosci. 2007, 27:10742-10750.
13. Chestek C.A., Gilja V., Nuyujukian P., Kier R.J., Solzbacher F., Ryu S.I., Harrison R.R., Shenoy K.V. HermesC: Low-power wireless neural recording system for freely moving primates. IEEE Trans Neural Syst Rehabil Eng. 2009, 17(4):330-338.
14. Churchland M.M., Afshar A., Shenoy K.V. A central source of movement variability. Neuron 2006, 52:1085-1096.
15. Churchland M.M., Santhanam G., Shenoy K.V. Preparatory activity in premotor and motor cortex reflects the speed of the upcoming reach. J. Neurophysiol. 2006, 96(6):3130-3146.
16. Churchland M.M., Shenoy K.V. Delay of movement caused by disruption of cortical preparatory activity. J. Neurophysiol. 2007, 97:348-359.
17. Churchland M.M., Shenoy K.V. Temporal complexity and heterogeneity of single-neuron activity in premotor and motor cortex. J. Neurophysiol. 2007, 97:4235-4257.
18. Churchland M.M., Yu B.M., Ryu S.I., Santhanam G., Shenoy K.V. Neural variability in premotor cortex provides a signature of motor preparation. J. Neurosci. 2006, 26(14):3697-3712.
19. Churchland M.M., Yu B.M., Sahani M., Shenoy K.V. Techniques for extracting single-trial activity patterns from large-scale neural recordings. Curr. Opin. Neurobiol. 2007, 17(5):609-618.
20. Churchland M.M., Yu B.M., Cunningham J.P., Sugrue L.P., Cohen M.R., Corrado G.S., Newsome W.T., Clark A.M., Hosseini P., Scott B.B., Bradley D.C., Smith M.A., Kohn A., Movshon J.A., Armstrong K.M., Moore T., Chang S.W., Snyder L.H., Lisberger S.G., Priebe N.J., Finn I.M., Ferster D., Ryu S.I., Santhanam G., Sahani M., Shenoy K.V. Stimulus onset quenches neural variability: a widespread cortical phenomenon. Nat Neurosci. 2010, 13(3):369-378.
21. Crammond D.J., Kalaska J.F. Prior information in motor and premotor cortex: activity during the delay period and effect on pre-movement activity. J. Neurophysiol. 2000, 84:986-1005.
22. Dempster A.P., Laird N.M., Rubin D.B. Maximum likelihood from incomplete data via the EM algorithm (with discussion). J. R. Stat. Soc. Ser. 1977, B(39):1-38.
23. Donoghue J.P. Bridging the brain to the world: a perspective on neural interface systems. Neuron 2008, 60:511-521.
24. Donoghue J.P., Nurmikko A., Black M., Hochberg L.R. Assistive technology and robotic control using motor cortex ensemble-based neural interface systems in humans with tetraplegia. J. Physiol. 2007, 579(3):603-611.
25. Everitt B.S. An Introduction to Latent Variable Models 1984, Chapman and Hill, London.
26. Faisal A.A., Selen L.P.J., Wolpert D.M. Noise in the nervous system. Nat. Rev. Neurosci. 2008, 9:292-303.
27. Fetz E.E. Operant conditioning of cortical unit activity. Science 1969, 163:955-957.
28. Fetz E.E., Baker M.A. Operantly conditioned patterns of precentral unit activity and correlated responses in adjacent cells and contralateral muscles. J. Neurophysiol. 1972, 36:179-204.
29. Fetz E.E., Finocchio D.V. Operant conditioning of specific patterns of neural and muscular activity. Science 1971, 174:431-435.
30. Ganguly K., Carmena J.M. Emergence of a stable cortical map for neuroprosthetic control. PLoS Biol. 2009, 7. e1000153.
31. Georgopoulos A.P., Schwartz A.B., Kettner R.E. Neuronal population coding of movement direction. Science 1986, 233:1416-1419.
32. Ghahramani Z., Hinton G. The EM algorithm for mixtures of factor analyzers. Technical Report CRG-TR-96-1 1997, Department of Computer Science, University of Toronto.
33. Gilja V., Kalmar R.S., Santhanam G., Ryu S.I., Yu B.M., Afshar A., et al. Trial-by-trial mean normalization improves plan period reach target decoding. Soc. Neurosci. Abstr. 2005, (519.18).
34. Godschalk M., Lemon R.N., Kuypers H.G., van der Steen J. The involvement of monkey premotor cortex neurones in preparation of visually cued arm movements. Behav. Brain Res. 1997, 18:143-157.
35. Gomez J.E., Fu Q., Flament D., Ebner T.J. Representation of accuracy in the dorsal premotor cortex. Eur. J. Neurosci. 2000, 12(10):3748-3760.
36. Harrison R.R., Kier R.J., Chestek C.A., Gilja V., Nuyujukian P., Ryu S.I., et al. Wireless neural recording with single low-power integrated circuit. IEEE Trans. Neural. Syst. Rehabil. Eng. 2009, 17(4):322-329.
37. Hastie T., Tibshirani R., Friedman J.H. The Elements of Statistical Leaning 2003, Springer, New York, NY. second ed.
38. Hatsopoulos N., Joshi J., O'Leary J.G. Decoding continuous and discrete motor behaviors using motor and premotor cortical ensembles. J. Neurophysiol. 2004, 92:1165-1174.
39. Hinterberger T., Schmidt S., Neumann N., Mellinger J., Blankertz B., Curio G., et al. Brain-computer communication and slow cortical potentials. IEEE Trans. Biomed. Eng. 2004, 51(6):1011-1018.
40. Hochberg L.R., Serruya M.D., Friehs G.M., Mukand J.A., Saleh M., Caplan A.H., et al. Neuronal ensemble control of prosthetic devices by a human with tetraplegia. Nature 2006, 442:164-171.
41. Hocherman S., Wise S.P. Effects of hand movement path on motor cortical activity in awake, behaving rhesus monkeys. Exp. Brain Res. 1991, 83:285-302.
42. Humphrey D.R., Schmidt E.M., Thompson W.D. Predicting measures of motor performance from multiple cortical spike trains. Science 1970, 170:758-762.
43. Isaacs R.E., Weber D.J., Schwartz A.B. Work toward real-time control of a cortical neural prosthesis. IEEE Trans. Rehabil. Eng. 2000, 8:196-198.
44. Jarosiewicz B., Chase S.M., Fraser G.W., Velliste M., Kass R.E., Schwartz A.B. Functional network reorganization during learning in a brain-computer interface paradigm. Proc. Natl. Acad. Sci. USA 2008, 105(49):19486-19491.
45. Kalmar R.S., Gilja V., Santhanam G., Ryu S.I., Yu B.M., Afshar A., et al. PMd delay activity during rapid sequential-movement plans. Soc. Neurosci. Abstr. 2005, (519.17).
46. Kemere C., Santhanam G., Yu B.M., Afshar A., Ryu S.I., Meng T.H., et al. Detecting neural state transitions using hidden Markov models for motor cortical prostheses. J. Neurophysiol. 2005, 100:2441-2452.
47. Kemere C., Shenoy K.V., Meng T.H. Model-based neural decoding of reaching movements: a maximum likelihood approach. IEEE Trans. Biomed. Eng. 2004, 51(6):925-932.
48. Kennedy P., Andreasen D., Ehirim P., King B., Kirby T., Mao H., et al. Using human extra-cortical local field potentials to control a switch. J. Neural. Eng. 2004, 1(2):72-77.
49. Kennedy P.R., Bakay R.A.E. Restoration of neural output from a paralyzed patient by a direct brain connection. Neuro Report 1998, 9:1707-1711.
50. Kennedy P.R., Bakay R.A.E., Moore M.M., Adams K., Goldwaithe J. Direct control of a computer from the human central nervous system. IEEE Trans. Rehabil. Eng. 2000, 8:198-202.
51. Kim S.P., Simeral J.D., Hochberg L.R., Donoghue J.P., Black M.J. Neural control of computer cursor velocity by decoding motor cortical spiking activity in humans with tetraplegia. J. Neural. Eng. 2008, 5:455-476.
52. Kulkarni J.E., Paninski L. State-space decoding of goal-directed movements. IEEE Signal. Process. Mag. 2008, 25(1):78-86.
53. Leuthardt E.C., Schalk G., Wolpaw J.R., Ojemann J.G., Moran D.W. A brain-computer interface using electrocorticographic signals in humans. J. Neural. Eng. 2004, 1:63-71.
54. Lewicki M.S. A review of methods for spike sorting: the detection and classification of neural action potentials. Network: Comput. Neural Syst. 1998, 9(4):R53-R78.
55. MacKay D.J.C. Information Theory, Inference, and Learning Algorithms 2003, Cambridge University Press, Cambridge, UK.
56. Maynard E.M., Hatsopoulos N.G., Ojakangas C.L., Acuna B.D., Sanes J.N., Normann R.A., et al. Neuronal interactions improve cortical population coding of movement direction. J. Neurosci. 1999, 19:8083-8093.
57. McFarland D.J., Sarnacki W.A., Wolpaw J.R. Brain-computer interface (BCI) operation: optimizing information transfer rates. Biol. Psychol. 2003, 63(3):237-251.
58. Messier J., Kalaska J.F. Covariation of primate dorsal premotor cell activity with direction and amplitude during a memorized-delay reaching task. J. Neurophysiol. 2000, 84:152-165.
59. Moran D.W., Schwartz A.B. Motor cortical activity during drawing movements: population representation during spiral tracing. J. Neurophysiol. 1999, 82:2693-2704.
60. Moran D.W., Schwartz A.B. Motor cortical representation of speed and direction during reaching. J. Neurophysiol. 1999, 82:2676-2692.
61. Moritz C.T., Perlmutter S.I., Fetz E.E. Direct control of paralysed muscles by cortical neurons. Nature 2008, 456:639-642.
62. Mulliken G.H., Musallam S., Andersen R.A. Decoding trajectories from posterior parietal cortex ensembles. J. Neurosci. 2008, 28(48):12913-12926.
63. Musallam S., Corneil B.D., Greger B., Scherberger H., Andersen R.A. Cognitive control signals for neural prosthetics. Science 2004, 305:258-262.
64. Ng A.Y., Jordan M.I. On Discriminative Vs. Generative Classifiers: A Comparison of Logistic Regression and Naive Bayes. Advances in Neural Information Processing Systems 14 2002, MIT Press, Cambridge, MA. T.G. Dietterich, S. Becker, Z. Ghahramani (Eds.).
65. Polikov V.S., Tresco P.A., Reichert W.M. Response of brain tissue to chronically implanted neural electrodes. J. Neurosci. Methods 2005, 148:1-18.
66. Riehle A., Requin J. Are extent and force independent movement parameters? preparation- and movement-related neuronal activity in the monkey cortex. Exp. Brain Res. 1994, 99:56-74.
67. Roweis S., Ghahramani Z. A unifying review of linear Gaussian models. Neural Comput. 1999, 11(2):305-345.
68. Ryu S.I., Shenoy K.V. Human cortical prostheses: lost in translation? Neurosurg. Focus 2009, 27(1):E5.
69. Salinas E., Abbott L.F. Vector reconstruction from firing rates. J. Comput. Neurosci. 1994, 1:89-107.
70. Santhanam G., Ryu S.I., Yu B.M., Afshar A., Shenoy K.V. A high-performance brain-computer interface. Nature 2006, 442:195-198.
71. Santhanam G., Sahani M., Ryu S.I., Shenoy K.V. An extensible infrastructure for fully automated spike sorting during online experiments 2004, 4380-4384.
72. Santhanam G., Yu B.M., Gilja V., Ryu S.I., Afshar A., Sahani M., et al. Factor-analysis methods for higher-performance neural prostheses. J. Neurophysiol. 2009, 102:1315-1330.
73. Schalk G., Miller K.J., Anderson N.R., Wilson J.A., Smyth M.D., Ojemann J.G., et al. Two-dimensional movement control using electrocorticographic signals in humans. J. Neural Eng. 2008, 5(1):75-84.
74. Schwartz A.B. Direct cortical representation of drawing. Science 1994, 265:540-542.
75. Schwartz A.B., Cui X.T., Weber D.J., Moran D.W. Brain-controlled interfaces: movement restoration with neural prosthetics. Neuron 2006, 52(1):205-220.
76. Scott S.H. Optimal feedback control and the neural basis of volitional motor control. Nat. Rev. Neurosci. 2004, 5:532-546.
77. Scott S.H. Inconvenient truths about neural processing in primary motor cortex. J. Physiol. 2008, 586:1217-1224.
78. Serby H., Yom-Tov E., Inbar G.F. An improved p300-based brain-computer interface. IEEE Trans. Neural Syst. Rehabil. Eng. 2005, 13(1):89-98.
79. Serruya M.D., Hatsopoulos N.G., Paninski L., Fellows M.R., Donoghue J.P. Instant neural control of a movement signal. Nature 2002, 416:141-142.
80. Shen L., Alexander G.E. Neural correlates of a spatial sensory-to-motor transformation in primary motor cortex. J. Neurophysiol. 1997, 77:1171-1194.
81. Shen L., Alexander G.E. Preferential representation of instructed target location versus limb trajectory in dorsal premotor area. J. Neurophysiol. 1997, 77:1195-1212.
82. Shenoy K.V., Meeker D., Cao S., Kureshi S.A., Pesaran B., Mitra P., et al. Neural prosthetic control signals from plan activity. NeuroReport 2003, 14:591-596.
83. Shoham S., Paninski L.M., Fellows M.R., Hatsopoulos N.G., Donoghue J.P., Normann R.A. Statistical encoding model for a primary motor cortical brain-machine interface. IEEE Trans. Biomed. Eng. 2005, 52(7):1313-1322.
84. Sodagar A.M., Wise K.D., Najafi K. A fully-integrated mixed-signal neural processor for implantable multi-channel cortical recording. IEEE Trans. Biomed. Eng. 2007, 54:1075-1088.
85. Srinivasan L., Eden U.T., Mitter S.K., Brown E.N. General-purpose filter design for neural prosthetic devices. J. Neurophysiol. 2007, 98:2456-2475.
86. Srinivasan L., Eden U.T., Willsky A.S., Brown E.N. A state-space analysis for reconstruction of goal-directed movements using neural signals. Neural Comput. 2006, 18(10):2465-2494.
87. Taylor D.M., Tillery S.I.H., Schwartz A.B. Direct cortical control of 3D neuroprosthetic devices. Science 2002, 296:1829-1832.
88. Taylor D.M., Tillery S.I.H., Schwartz A.B. Information conveyed through brain-control: cursor vs. robot. IEEE Trans. Neural Syst. Rehabil. Eng. 2003, 11:195-199.
89. Thacker N.A., Bromiley P.A. The Effects of a Square Root Transform on a Poisson Distributed Quantity. Technical Report 2001-010 2001, Imaging Science and Biomedical Engineering Divison, University of Manchester.
90. Vapnik V.N. The Nature of Statistical Learning Theory 1995, Springer Verlag, New York.
91. Velliste M., Perel S., Spalding M.C., Whitford A.S., Schwartz A.B. Cortical control of a prosthetic arm for self-feeding. Nature 2008, 453(7198):1098-1101.
92. Warland D.K., Reinagel P., Meister M. Decoding visual information from a population of retinal ganglion cells. J. Neurophysiol. 1997, 78:2336-2350.
93. Wessberg J., Stambaugh C.R., Kralik J.D., Beck P.D., Laubach M., Chapin J.K., et al. Real-time prediction of hand trajectory by ensembles of cortical neurons in primates. Nature 2000, 408:361-365.
94. Wise S.P., Boussaoud D., Johnson P.B., Caminiti R. Premotor and parietal cortex: corticocortical connectivity and combinatorial computations. Annu. Rev. Neurosci. 1997, 20:25-42.
95. Wolpaw J., McFarland D. Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. Proc. Natl. Acad. Sci. USA 2004, 101(51):17849-17854.
96. Wolpaw J.R., McFarland D.J. Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. Proc. Natl. Acad. Sci. USA 2004, 101(51):17849-17854.
97. Wu W., Black M.J., Mumford D., Gao Y., Bienenstock E., Donoghue J.P. Modeling and decoding motor cortical activity using a switching Kalman filter. IEEE Trans. Biomed. Eng. 2004, 51(6):933-942.
98. Wu W., Gao Y., Bienenstock E., Donoghue J.P., Black M.J. Bayesian population decoding of motor cortical activity using a Kalman filter. Neural Comput. 2006, 18(1):80-118.
99. Wu W., Hatsopoulos N.G. Real-time decoding of nonstationary neural activity in motor cortex. IEEE Trans. Neural Syst. Rehabil. Eng. 2008, 16(3):213-222.
100. Wu W., Kulkarni J.E., Hatsopoulos N.G., Paninski L. Neural decoding of hand motion using a linear state-space model with hidden states. IEEE Trans. Biomed. Eng. 2009, 17(4):370-378.
101. Wu W., Shaikhouni A., Dongohue J.P., Black M.J. Closed-loop neural control of cursor motion using a Kalman filter 2004, 4126-4129.
102. Yu B.M., Afshar A., Santhanam G., Ryu S.I., Shenoy K.V., Sahani M. Extracting dynamical structure embedded in neural activity. Adv Neural Info Processing Sys 18. 2006, 1545-1552. Y. Weiss, B. Schölkopf, J. Platt (Eds.).
103. Yu B.M., Cunningham J.P., Santhanam G., Ryu S.I., Shenoy K.V., Sahani M. Gaussian-process factor analysis for low-dimensional single-trial analysis of neural population activity. J. Neurophysiol. 2009, 102:614-635.
104. Yu B.M., Cunningham J.P., Shenoy K.V., Sahani M. Neural Decoding of Movements: From Linear to Nonlinear Trajectory Models. Volume 4984 of Lecture Notes in Computer Science 2008, 586-595. Springer Berlin/Heidelberg.
105. Yu B.M., Kemere C., Santhanam G., Afshar A., Ryu S.I., Meng T.H., et al. Mixture of trajectory models for neural decoding of goal-directed movements. J. Neurophysiol. 2007, 97:3763-3780.
106. Yu B.M., Ryu S.I., Santhanam G., Churchland M.M., Shenoy K.V. Improving neural prosthetic system performance by combining plan and peri-movement activity. Proceedings of the 26th Annual Conference of the IEEE EMBS 2004, 4516-4519.
107. Yu B.M., Shenoy K.V., Sahani M. Expectation propagation for inference in non-linear dynamical models with Poisson observations 2006.
108. Zhang K., Ginzburg I., McNaughton B.L., Sejnowski T.J. Interpreting neuronal population activity by reconstruction: unified framework with application to hippocampal place cells. J. Neurophysiol. 1998, 79:1017-1044.