Statistical signal processing and the motor cortex

Proceedings of the IEEE

Volumn 95, Issue 5, 2007, Pages 881-898

  Brockwell, A E ^a   Kass, Robert E ^a   Schwartz, A B ^b  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b UNIVERSITY OF PITTSBURGH SCHOOL OF MEDICINE   (United States)

Author keywords

Brain ndash; machine interface; Cortex; Decoding; Markov chain; Monte Carlo; Neural; Nonlinear filtering; Sequential; State space model

Indexed keywords

DECODING; INTERFACE STATES; MARKOV PROCESSES; MAXIMUM LIKELIHOOD ESTIMATION; MONTE CARLO METHODS; NONLINEAR FILTERING; SIGNAL PROCESSING; STATE SPACE METHODS;

CORTEX; MACHINE INTERFACES; NEURAL; SEQUENTIAL; STATE - SPACE MODELS;

BRAIN;

EID: 41849151349     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/JPROC.2007.894703     Document Type: Article

References (80)

1. J. M. Carmena, M. A. Lebedev, R. E. Crist, J. E. O'Doherty, D. M. Santucci, D. F. Dimitrov, P. G. Patil, C. S. Henriquez, and M. A. L. Nicolelis, "Learning to control a brain-machine interface for reaching and grasping by primates," PLoS Biol., vol. 1, pp. 193-208, 2003.
2. J. Wessberg, C. R. Stambaugh, J. D. Kralik, P. D. Beck, M. Laubach, J. K. Chapin, J. Kim, S. J. Biggs, M. A. Srinivasan, and M. A. L. Nicolelis, "Real-time prediction of hand trajectory by ensembles of cortical neurons in primates," Nature, vol. 408, no. 6810, pp. 361-365, 2000.
3. J. R. Wolpaw and D. J. McFarland, "Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans," Proc. Nat. Acad. Sci. USA, vol. 101, pp. 17 849-17 854, 2004.
4. S. Musallam, B. D. Corneil, B. Greger, H. Scherberger, and R. A. Andersen, "Cognitive control signals for neural prosthetics," Science, vol. 305, pp. 258-262, 2004.
5. M. D. Serruya, A. H. Caplan, M. Saleh, D. S. Morris, and J. P. Donoghue, "The BrainGate (TM) pilot trial: Building and testing a novel direct neural output for patients with severe motor impairment," in Abstract Viewer/Itinerary Planner. Washington, DC: Society for Neuroscience, 2004.
6. A. B. Schwartz, "Cortical neural prosthetics," Annu. Rev. Neurosci., vol. 27, pp. 487-507, 2004.
7. G. Santhanam, S. I. Ryu, ". M. Yua, A. Afshar, and K. V. Shenoy, "A high performance brain-computer interface," Nature, vol. 442, pp. 195-198, 2006.
8. L. R. Hochberg, M. D. Serruya, G. H. Friehs, J. A. Mukand, M. Saleh, A. H. Caplan, A. Branner, D. Chen, R. D. Penn, and J. P. Donoghue, "Neuronal ensemble control of prosthetic devices by a human with tetraplegia," Nature, vol. 442, pp. 164-171, 2006.
9. P. J. Rousche and R. A. Normann, "Chronic recording capability of the Utah intracortical electrode array in cat sensory cortex," J. Neurosci. Methods, vol. 82, pp. 1-15, 1998.
10. D. R. Kipke, R. J. Vetter, J. C. Williams, and J. F. Hetke, "Silicon-substrate intracortical microelectrode arrays for long-term recording of neuronal spike activity in cerebral cortex," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 11, no. 2, pp. 151-155, Jun. 2003.
11. S. Finger, The Origins of Neuroscience: A History of Explorations Into Brain Function. Oxford, U.K.: Oxford Univ. Press, 1994.
12. P. P. Broca, "Loss of speech, chronic softening and partial destruction of the anterior left lobe of the brain," Bulletin de la Socit Anthropologique, vol. 2, pp. 235-238, 1861.
13. G. Fritsch and E. Hitzig, "On the electrical excitability of the cerebrum (1870)," in Some Papers on the Cerebral Cortex, (G. von Bonin). Springfield, IL: Thomas, 1960.
14. D. Ferrier, The Functions of the Brain, 2nd ed. London, U.K.: Smith, Elder, 1876.
15. V. Mountcastle, "An organizing principle for cerebral function: The unit model and the distributed system," in The Mindful Brain. Cambridge, MA: MIT Press, 1978.
16. H. Asanuma and H. Sakata, "Functional organization of a cortical efferent system examined with focal depth stimulation in cats," J. Neurophysiol., vol. 30, 1967.
17. H. Asanuma and I. Rosen, "Topographical organization of cortical efferent zones projecting to distal forelimb muscles in the monkey," Exp. Brain Res., vol. 14, 1972.
18. E. Jankowska, Y. Padel, and R. Tanaka, "Projections of pyramidal tract cells to alpha motoneurons innervating hind-limb muscles in the monkey," J. Physiol., vol. 249, 1975.
19. E. Jankowska, Y. Padel, and R. Tanaka, "The mode of activation of pyramidal tract cells by intracortical stimuli," J. Physiol., vol. 249, no. 3, pp. 617-636, 1975.
20. J. A. Rathelot and P. L. Strick, "Muscle representation in the macaque motor cortex: An anatomical perspective," Proc. Nat. Acad. Sci. USA, vol. 103, no. 21, pp. 8257-8262, 2006.
21. E. V. Evarts, "Relation of pyramidal tract activity to force exerted during voluntary movement," J. Neurophys., vol. 31, pp. 14-27, 1968.
22. E. E. Fetz and P. D. Cheney, "Postspike facilitation of forelimb muscle activity by primate corticomotoneuronal cells," J. Neurophys., vol. 44, pp. 751-771, 1980.
23. A. P. Georgopoulos, J. F. Kalaska, R. Caminiti, and J. T. Massey, "On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex," J. Neurosci., vol. 2, pp. 1527-1537, 1982.
24. A. P. Georgopoulos, A. B. Schwartz, and R. E. Kettner, "Neuronal population coding of movement direction," Science, vol. 233, pp. 1416-1419, 1986.
25. A. B. Schwartz, D. W. Moran, and G. A. Reina, "Differential representation of perception and action in the frontal cortex," Science, vol. 303, pp. 380-383, 2003.
26. J. N. Sanes, S. Suner, and J. P. Donoghue, "Dynamic organization of primary motor cortex output to target muscles in adult rats. I. Long-term patterns of reorganization following motor or mixed peripheral nerve lesions," Exp. Brain Res., vol. 79, pp. 479-491, 1990.
27. R. J. Nudo, ". M. Wise, F. SiFuentes, and G. W. Milliken, "Neural substrates for the effects of rehabilitative training on motor recovery after ischemic infarct," Science, vol. 272, pp. 1791-1794, 1996.
28. A. Karni, G. Meyer, P. Jessard, M. M. Adams, R. Turner, and L. G. Ungerleider, "Functional mri evidence for adult motor cortex plasticity during motor skill learning," Nature, vol. 377, pp. 155-158, 1998.
29. F. Gandalfo, C. S. R. Li, ". J. Benda, C. P. Schioppa, and E. Bizzi, "Cortical correlates of learning in monkeys adapting to a new dynamical environment," Proc. Nat. Acad. Sci. USA, vol. 97, pp. 2259-2263, 2000.
30. S. P. Wise, S. L. Moody, K. J. Blomstrom, and A. R.Mitz, "Changes in motor cortical activity during visuomotor adaptation," Exp. Brain Res., vol. 121, pp. 285-299, 1998.
31. D. M. Taylor, S. I. H. Tillery, and A. B. Schwartz, "Direct cortical control of 3D neuroprosthetic devices," Science, vol. 296, pp. 1829-1832, 2002.
32. R. Paz, T. Boraud, C. Natan, H. Bergman, and E. Vaadia, "Preparatory activity in motor cortex reflects learning of local visuomotor skills," Nat. Neurosci., vol. 6, pp. 882-890, 2003.
33. G. Q. Bi and M. M. Poo, "Synaptic modifications by correlated activity: Hebb's postulate revisited," Ann. Rev. Neurosci., vol. 24, pp. 139-166, 2001.
34. M. Stopfer, X. Chen, Y. Tai, G. S. Huang, and T. J. Carew, "Site specificity of short-term and long-term habituation in the tail-elicited siphon withdrawal reflex of aplysia," J. Neurosci., vol. 16, pp. 4923-4932, 1996.
35. D. Brillinger, "Maximum likelihood analysis of spike trains of interacting nerve cells," Biol. Cybern., vol. 59, pp. 189-200, 1998.
36. H. S. Seung and H. Sompolinsky, "Simple model for reading neuronal population codes," Proc. Nat. Acad. Sci. USA, vol. 90, pp. 10 749-10 753, 1993.
37. E. Salinas and L. F. Abbott, "Vector reconstruction from firing rates," J. Comput. Neurosci., vol. 1, pp. 89-107, 1994.
38. T. D. Sanger, "Probability density estimation for the interpretation of neural population codes," J. Neurophysiol., vol. 76, no. 4, pp. 2790-2793, 1996.
39. K. Zhang, I. Ginzburg, ". L. McNaughton, and T. J. Sejnowski, "Interpreting neuronal population activity by reconstruction: Unified framework with application to hippocampal place cells," J. Neurophysiol., vol. 79, pp. 1017-1044, 1998.
40. E. N. Brown, D. P. Nguyen, L. M. Frank, M. A. Wilson, and V. Solo, "An analysis of neural receptive field plasticity by point process adaptive filtering," Proc. Nat. Acad. Sci., vol. 98, pp. 12 261-12 266, 2001.
41. R. Barbieri, M. C. Quirk, L. M. Frank, M. A. Wilson, and E. N. Brown, "Construction and analysis of non-Poisson stimulus response models of neural spike train activity," J. Neurosci. Methods, vol. 105, pp. 25-37, 2001.
42. R. Kass and V. Ventura, "A spike-train probability model," Neural Comput., vol. 13, pp. 1713-1720, 2001.
43. E. N. Brown, R. Barbieri, U. T. Eden, and L. M. Frank, Likelihood Methods for Neural Spike Train Data Analysis. Boca Raton, FL: CRC, 2003, ch. 9, pp. 253-286.
44. Y. Gao, M. J. Black, E. Bienenstock, S. Shoham, and J. P. Donoghue, "Probabilistic inference of hand motion from neural activity in motor cortex," in Advances in Neural Information Processing Systems. Cambridge, MA: The MIT Press, 2002, vol. 14.
45. C. Kemere, K. V. Shenoy, and T. H. Meng, BModel-based neural decoding of reaching movements: A maximum likelihood approach," IEEE Trans. Biomed. Eng., vol. 51, no. 6, pp. 925-932, Jun. 2003.
46. A. Brockwell, A. Rojas, and R. Kass, "Recursive Bayesian decoding of motor cortical signals by particle filtering," J. Neurophysiol., vol. 91, pp. 1899-1907, 2004.
47. L. Paninski, "Maximum likelihood estimation of cascade point-process neural encoding models," Netw. Comput. Neural Syst., vol. 15, pp. 243-262, 2004.
48. W. Truccolo, U. T. Eden, M. R. Fellos, J. P. Donoghue, and E. N. Brown, "A point process framework for relating neural spiking activity to spiking history, neural ensemble and extrinsic covariate effects," J. Neurophys. vol. 93, pp. 1074-1089, 2005.
49. J. E. Kulkarni and L. Paninski, "Common-input models for multiple neural spike-train data," Netw. Comput. Neural Syst., 2007.
50. R. E. Kass, V. Ventura, and E. N. Brown, "Statistical issues in the analysis of neuronal data," J. Neurophysiol., vol. 94, pp. 8-25, 2005.
51. S. H. Scott, "Optimal feedback control and the neural basis of volitional motor control," Nat. Rev. Neurosci., vol. 5, pp. 534-546, 2004.
52. E. Todorov, "Direct cortical control of muscle activation in voluntary arm movements; A model," Nature Neurosci., vol. 3, no. 4, pp. 391-399, 2000.
53. R. Barbieri, L. M. Frank, D. P. Nguyen, M. C. Quirk, V. Solo, M. A. Wilson, and E. N. Brown, "Dynamic analyses of information encoding by neural ensembles," Neural Comput., vol. 16, no. 2, pp. 277-307, 2004.
54. A. C. Smith and E. N. Brown, "Estimating a state-space model from point process observations," Neural Comput., vol. 15, pp. 965-991, 2003.
55. S. Shoham, L. M. Paninski, M. R. Fellows, N. G. Hatsopoulos, J. P. Donoghue, and R. A. Normann, "Statistical encoding model for a primary motor cortical brain-machine interface," IEEE Trans. Biomed. Eng., vol. 52, no. 7, pp. 1312-1322, Jul. 2005.
56. W. Wu, M. Black, Y. Gao, E. Bienenstock, M. Serruya, A. Shaikhouni, and J. Donoghue, "Neural decoding of cursor motion using a Kalman filter," in Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 2003, vol. 15.
57. A. P. Georgopoulos, R. E. Kettner, and A. B. Schwartz, "Primate motor cortex and free arm movements to visual targets in three-dimensional space. II. Coding of the direction of movement by a neuronal population," Neuroscience, vol. 8, pp. 2928-2937, 1988.
58. P. McCullagh and J. A. Nelder, Generalized Linear Models, 2nd ed. London, U.K.: Chapman & Hall, 1989.
59. M. Okatan, M. A. Wilson, and E. N. Brown, BAnalyzing functional connectivity using a network likelihood model of ensemble neural spiking activity," Neural Comput., vol. 17, pp. 1927-1961, 2005.
60. F. Rigat, M. de Gunst, and J. van Pelt, "Bayesian modelling and analysis of spatio-temporal neuronal networks," Bayesian Anal., vol. 1, pp. 733-764, 2006.
61. O. Cappé, E. Moulines, and T. Ryden, Inference in Hidden Markov Models. New York: Springer, 2005.
62. A. E. Brockwell, "Likelihood based analysis of a class of generalized long memory models," J. Time Series Anal., 2007.
63. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the em algorithm," J. Royal Statistical Society, Ser. B, vol. 39, pp. 1-38, 1977.
64. W. R. Gilks, S. Richardson, and D. J. Spiegelhalter, Markov Chain Monte Carlo in Practice. London, U.K.: Chapman & Hall/CRC, 1996.
65. C. P. Robert and G. Casella, Monte Carlo Statistical Methods. New York: Springer, 1999.
66. E. N. Brown, R. Barbieri, V. Ventura, R. Kass, and L. M. Frank, "A note on the time-rescaling theorem and its implications for neural data analysis," Neural Comput., vol. 14, no. 2, pp. 325-346, 2002.
67. M. C. Wiener, "An adjustment to the time-rescaling method for application to short-trial spike train data," Neural Comput., vol. 15, no. 11, pp. 2565-2576, 2003.
68. P. J. Brockwell and R. A. Davis, Time Series: Theory and Methods, 2nd ed. New York: Springer, 1991.
69. A. E. Brockwell, "Universal residuals: A multivariate transformation," Stat. Probab. Lett., 2007, to appear.
70. R. E. Kalman, "A new approach to linear prediction and filtering problems," J. Basic Eng. (ASME), vol. 82D, pp. 35-45, 1960.
71. N. J. Gordon, D. J. Salmond, and A. F. M. Smith, "Novel approach to nonlinear/non-Gaussian Bayesian state estimation," IEE Proc. F, vol. 140, pp. 107-113, 1993.
72. G. Kitagawa, "Monte Carlo filter and smoother for non-Gaussian nonlinear state space models," J. Comput. Graph. Stat., vol. 5, no. 1, pp. 1-25, 1996.
73. U. T. Eden, L. M. Frank, V. Solo, and E. N. Brown, "Dynamic analyses of neural encoding by point process adaptive filtering," Neural Comput., vol. 16, no. 5, pp. 971-998, 2004.
74. O. Cappé, S. Godsill, and E. Moulines, "An overview of existing methods and recent advances in sequential Monte Carlo," Proc. IEEE, vol. 95, no. 5, pp. xxx-xxx, May 2007.
75. A. Doucet, N. de Freitas, and N. Gordon, Eds. Sequential Monte Carlo Methods in Practice. New York: Springer, 2001.
76. J. K. Chapin, K. A. Moxon, R. S. Markowitz, and M. A. L. Nicolelis, "Realtime control of a robot arm using simultaneously recorded neurons in the motor cortex," Nature Neurosci., vol. 2, pp. 664-670, 1999.
77. P. G. Patil, J. M. Carmena, M. A. L. Nicolelis, and D. A. Turner, "Ensembles of subcortical neurons as a source of motor control signals for a brainmachine interface in humans," Neurosurgery, vol. 55, no. 1, pp. 27-35, 2004.
78. M. J. Black, E. Bienenstock, J. P. Donoghue, M. Serruya, W. Wu, and Y. Gao, "Connecting brains with machines: The neural control of 2d cursor movement," in Proc. 1st Int. IEEE/EMBS Conf. Neural Engineering, 2003, pp. 580-583.
79. M. D. Serruya, N. G. Hatsopoulos, L. Paninski, M. R. Fellows, and J. P. Donoghue, "Instant neural control of a movement signal," Nature, vol. 416, pp. 141-142, 2002.
80. W. Wu, A. Shaikhouni, J. P. Donoghue, and M. J. Black, "Closed-loop neural control of cursor motion using a kalman filter," in Proc. IEEE Engineering in Medicine and Biology Society, 2004, pp. 4126-4129.