Feedback-controlled parallel point process filter for estimation of goal-directed movements from neural signals

IEEE Transactions on Neural Systems and Rehabilitation Engineering

Volumn 21, Issue 1, 2013, Pages 129-140

  Shanechi, Maryam M ^a,b,c   Wornell, Gregory W ^d   Williams, Ziv M ^e   Brown, Emery N ^e,f  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c School of Operations Research and Industrial Engineering   (United States)

^d Department of Electrical Engineering and Computer Science   (United States)

^e MASSACHUSETTS GENERAL HOSPITAL   (United States)

^f Massachusetts Institute of Technology   (United States)

Author keywords

Brain machine interfaces (BMIs); motor control; neural decoding; optimal feedback control; point processes

Indexed keywords

BRAIN MACHINE INTERFACE; MOTOR CONTROL; NEURAL DECODING; OPTIMAL FEEDBACK CONTROL; POINT PROCESS;

ESTIMATION; FEEDBACK CONTROL; KINEMATICS; MEAN SQUARE ERROR; NEURONS; OPTIMIZATION; REAL TIME CONTROL; SENSORY FEEDBACK;

PROCESS CONTROL;

ALGORITHM; ANIMAL; ARTICLE; BRAIN MAPPING; EVOKED MUSCLE RESPONSE; FEEDBACK SYSTEM; METHODOLOGY; MOTIVATION; MOTOR CORTEX; MOVEMENT (PHYSIOLOGY); PHYSIOLOGY; RHESUS MONKEY; SIGNAL PROCESSING; TASK PERFORMANCE;

ALGORITHMS; ANIMALS; BRAIN MAPPING; EVOKED POTENTIALS, MOTOR; FEEDBACK; GOALS; MACACA MULATTA; MOTOR CORTEX; MOVEMENT; SIGNAL PROCESSING, COMPUTER-ASSISTED; TASK PERFORMANCE AND ANALYSIS;

MLCS; MLOWN;

EID: 84872162213     PISSN: 15344320     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNSRE.2012.2221743     Document Type: Article

References (47)

1. A. Georgopoulos, J. F. Kalaska, R. Caminiti, and J. T.Massey, "On the relations between the direction of two-dimensional arm movement and cell discharge in primate motor cortex," J. Neurosci., vol. 2, no. 11, pp. 1527-1537, Nov. 1982. (Pubitemid 13178240)
2. D. W. Moran and A. B. Schwartz, "Motor cortical representation of speed and direction during reaching," J. Neurophysiol., vol. 82, pp. 2676-2692, 1999.
3. R. Caminiti, P. B. Johnson, C. Galli, S. Ferraina, and Y. Burnod, "Making arm movements within different parts of space: The premotor and motor cortical representation of a coordinate system for reaching to visual targets," J. Neurosci., vol. 11, no. 5, pp. 1182-1197, May 1991.
4. G.H.Mulliken, S.Musallam, andR.A.Andersen, "Forward estimation of movement state in posterior parietal cortex," Proc. Nat. Acad. Sci. USA, vol. 105, pp. 8170-8177, 2008. (Pubitemid 351904768)
5. J. Wessberg, C. R. Stambaugh, J. D. Kralik, P. D. Beck, M. Laubach, J. K. Chapin, J. Kim, S. J. Biggs, M. A. Srinivsan, and M. Nicolelis, "Real-time prediction of hand trajectory by ensembles of cortical neurons in primates," Nature, vol. 408, pp. 361-365, Nov. 2000.
6. L. H. Snyder, A. P. Batista, and R. A. Andersen, "Coding of intention in the posterior parietal cortex," Nature, vol. 386, pp. 167-170, Mar. 1997. (Pubitemid 27131442)
7. A. P. Batista, C. A. Buneo, L. H. Snyder, and R. A. Andersen, "Reach plans in eye-centered coordinates," Sci., vol. 285, pp. 257-260, Jul. 1999. (Pubitemid 29329999)
8. J. Messier and J. F. Kalaska, "Covariation of primate dorsal premotor cell activity with direction and amplitude during a memorized-delay reaching task," J. Neurophysiol., vol. 84, pp. 152-165, 2000. (Pubitemid 30490039)
9. M. M. Shanechi, "Real-time brain-machine interface architectures: Neural decoding from plan to movement," Ph.D. dissertation, Massachusetts Institute of Technology, Cambridge, 2011.
10. J. K. Chapin, K. A. Moxon, R. S. Markowitz, and M. A. L. Nicolelis, "Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex," Nat. Neurosci., vol. 2, no. 7, pp. 664-670, Jul. 1999. (Pubitemid 30491219)
11. M. D. Serruya, N. G. Hatsopoulos, L. Paninski, M. R. Fellows, and J. P. Donoghue, "Instant neural control of a movement signal," Nature, vol. 416, pp. 141-142, Mar. 2002. (Pubitemid 34246464)
12. D. M. Taylor, S. I. H. Tillery, and A. B. Schwartz, "Direct cortical control of 3D neuroprosthetic devices," Sci., vol. 296, pp. 1829-1832, Jun. 2002. (Pubitemid 34596262)
13. J. M. Carmena, M. A. Lebedev, R. E. Crist, J. E. O'Doherty, D. M. Santucci, D. F. Dimitrov, P. G. Patil, C. S. Henriquez, and M. A. L. Nicolelis, "Learning to control a brain-machine interface for reaching and grasping by primates," PLoS Biol., vol. 1, no. 2, pp. 193-208, 2003.
14. J. R. Wolpaw and D. J. McFarland, "Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans," Proc. Nat. Acad. Sci. USA, vol. 101, no. 51, pp. 17849-17854, Dec. 2004. (Pubitemid 40051975)
15. L. R. Hochberg, M. D. Serruya, G. M. Friehs, J. A. Mukand, M. Saleh, A. H. Caplan, A. Branner, D. Chen, R. D. Penn, and J. P. Donoghue, "Neuronal ensemble control of prosthetic devices by a human with tetraplegia," Nature, vol. 442, pp. 164-171, Jul. 2006. (Pubitemid 44086558)
16. M. Velliste, S. Perel, M. C. Spalding, A. S. Whitford, and A. B. Schwartz, "Cortical control of a prosthetic arm for self-feeding," Nature, vol. 453, pp. 1098-1101, Jun. 2008. (Pubitemid 351871735)
17. C. T. Moritz, S. I. Perlmutter, and E. E. Fetz, "Direct control of paralysed muscles by cortical neurons," Nature, vol. 456, pp. 639-643, Dec. 2008.
18. G. H. Mulliken, S. Musallam, and R. A. Andersen, "Decoding trajectories from posterior parietal cortex ensembles," J. Neurosci., vol. 28, no. 48, pp. 12913-12926, Nov. 2008.
19. S.-P. Kim, J. D. Simeral, L. R. Hochberg, J. P. Donoghue, and M. J. Black, "Neural control of computer cursor velocity by decoding motor cortical spiking activity in humans with tetraplegia," J. Neural Eng., vol. 5, pp. 455-476, 2008.
20. K. Ganguly and J. M. Carmena, "Emergence of a stable cortical map for neuroprosthetic control," PLoS Biol., vol. 7, no. 7, pp. 1-13, Jul. 2009.
21. Z. Li, J. E. O'Doherty, T. L.Hanson,M. A. Lebedev, C. S.Henriquez, and M. A. L. Nicolelis, "Unscented Kalman filter for brain-machine interfaces," PLoS ONE, vol. 4, no. 7, pp. 1-18, Jul. 2009.
22. S. M. Chase, A. B. Schwartz, and R. E. Kass, "Bias, optimal linear estimation, and the differences between open-loop simulation and closed-loop performance of spiking-based brain-computer interface algorithms," Neural Netw., vol. 22, pp. 1203-1213, 2009.
23. S. Musallam, B. D. Corneil, B. Greger, H. Scherberger, and R. A. Andersen, "Cognitive control signals for neural prosthetics," Sci., vol. 305, pp. 258-262, Jul. 2004. (Pubitemid 38886742)
24. G. Santhanam, S. I. Ryu, B. M. Yu, A. Afshar, and K. V. Shenoy, "A high-performance brain-computer interface," Nature, vol. 442, pp. 195-198, Jul. 2006. (Pubitemid 44086565)
25. W. Wu, Y. Gao, E. Bienenstock, J. P. Donoghue, and M. J. Black, "Bayesian population decoding of motor cortical activity using a Kalman filter," Neural Comput., vol. 19, pp. 80-118, 2006. (Pubitemid 43543852)
26. M.M. Shanechi, R. C. Hu,M. Powers, G. W.Wornell, E. N. Brown, and Z. M. Williams, "Neural population partitioning and a concurrent brain-machine interface for sequentialmotor function," Nat. Neurosci., vol. 15, no. 12, pp. 1715-1722, Dec. 2012.
27. B.M.Yu, C. Kemere,G. Santhanam,A.Afshar, S. I. Ryu, T. H. Meng, N. Sahani, and K. V. Shenoy, "Mixture of trajectory models for neural decoding of goal-directed movements," J. Neurophysiol., vol. 97, pp. 3763-3780, 2007. (Pubitemid 47084787)
28. L. Srinivasan, U. T. Eden, A. S. Willsky, and E. N. Brown, "A statespace analysis for reconstruction of goal-directed movements using neural signals," Neural Comput., vol. 18, pp. 2465-2494, 2006. (Pubitemid 44511771)
29. J. E. Kulkarni and L. Paninski, "State-space decoding of goal-directed movements," IEEE Signal Process. Mag., vol. 25, no. 4, pp. 78-86, Jan. 2008.
30. C. Kemere and T. Meng, "Optimal estimation of feed-forward- controlled linear systems," Proc. ICASSP, pp. 353-356, Mar. 2005.
31. E. Todorov and M. I. Jordan, "Optimal feedback control as a theory of motor coordination," Nat. Neurosci., vol. 5, no. 11, pp. 1226-1235, Nov. 2002. (Pubitemid 35247183)
32. E. Todorov, "Optimality principles in sensorimotor control," Nat. Neurosci., pp. 907-915, Sep. 2004. (Pubitemid 39129496)
33. M. M. Shanechi, G.W.Wornell, Z. M.Williams, and E. N. Brown, "A parallel point-process filter for estimation of goal-directed movements from neural signals," Proc. ICASSP, Mar. 2010.
34. L. Srinivasan andM. da Silva, "Breaking the fixed-arrival-time restriction in reaching movements of neural prosthetic devices," IEEE Trans. Biomed. Eng., vol. 58, no. 6, pp. 1555-1564, Jun. 2011.
35. W. Truccolo, U. T. Eden, M. R. Fellows, J. P. Donoghue, and E. N. Brown, "A point process framework for relating neural spiking activity to spiking history, neural ensemble, and extrinsic covariate effects," J. Neurophysiol., vol. 93, pp. 1074-1089, 2005.
36. M. M. Shanechi, Z. M. Williams, G. W. Wornell, and E. N. Brown, "A brain-machine interface combining target and trajectory information using optimal feedback control," presented at the Computat. Syst. Neurosci. (COSYNE) Meeting, Salt Lake City, UT, Feb. 2011.
37. M. M. Shanechi, Z. M. Williams, G. W. Wornell, R. Hu, M. Powers, and E. N. Brown, "A real-time brain-machine interface combining motor target and trajectory intent using an optimal feedback control design," PLOS One, submitted for publication.
38. U. T. Eden, L. M. Frank, R. Barbieri, V. Solo, and E. N. Brown, "Dynamic analysis of neural encoding by point process adaptive filtering," Neural Comput., vol. 16, pp. 971-998, 2004. (Pubitemid 38483047)
39. D. Bertsekas, Dynamic Programming and Optimal Control. Nashua, NH: Athena Scientific, 2005.
40. E. Todorov, "Stochastic optimal control and estimation methods adapted to the noise characteristics of the sensorimotor system," Neural Comput., vol. 17, pp. 1084-1108, 2005. (Pubitemid 40551615)
41. D. Liu and E. Todorov, "Evidence for the flexible sensorimotor strategies predicted by optimal feedback control," J. Neurosci., pp. 9354-9368, Aug. 2007. (Pubitemid 47358214)
42. G. A. Ackerson and K. S. Fu, "On state estimation in switching environments," IEEE Trans. Autom. Control, vol. 15, no. 1, pp. 10-17, Feb. 1970.
43. R. Chen and J. S. Liu, "Mixture Kalman filters," J. Roy. Stat. Soc. B, vol. 62, pp. 493-508, 2000.
44. E. N. Brown, R. Barbieri, V. Ventura, R. Kass, and L. Frank, "The time-rescaling theorem and its application to neural spike train data analysis," Neural Comput., vol. 14, pp. 325-346, 2001.
45. V. Ventura, "Spike train decoding without spike sorting," Neural Comput., vol. 20, pp. 923-963, 2008.
46. C. Kemere, K. V. Shenoy, and T. H. Meng, "Model-based neural decoding of reaching movements: A maximum likelihood approach," IEEE Trans. Biomed. Eng., vol. 51, no. 6, pp. 925-932, Jun. 2004. (Pubitemid 38661444)
47. J. P. Cunningham, P. Nuyujukian, V. Gilja, C. A. Chestek, S. I. Ryu, and K. V. Shenoy, "A closed-loop human simulator for investigating the role of feedback control in brain-machine interfaces," J. Neurophysiol., vol. 105, pp. 1932-1949, 2011.