A Real-Time Brain-Machine Interface Combining Motor Target and Trajectory Intent Using an Optimal Feedback Control Design

PLoS ONE

Volumn 8, Issue 4, 2013, Pages

  Shanechi, Maryam M ^a,b,c,d,e   Williams, Ziv M ^d,e   Wornell, Gregory W ^c   Hu, Rollin C ^d,e   Powers, Marissa ^d   Brown, Emery N ^d,e,f  

^a School of Operations Research and Industrial Engineering   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c Department of Electrical Engineering and Computer Science   (United States)

^d MASSACHUSETTS GENERAL HOSPITAL   (United States)

^e HARVARD MEDICAL SCHOOL   (United States)

^f MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY; ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ARTICLE; BEHAVIOR CONTROL; BRAIN COMPUTER INTERFACE; CELL ACTIVITY; COMPARATIVE STUDY; CONTROLLED STUDY; EXPERIMENTAL DESIGN; KINEMATICS; MALE; MATHEMATICAL MODEL; NONHUMAN; OPTICAL FEEDBACK CONTROL DESIGN MODEL; PREDICTION; PROCESS DEVELOPMENT; PROCESS MODEL; RHESUS MONKEY; SENSORIMOTOR FUNCTION; SENSORY FEEDBACK; TASK PERFORMANCE;

ANIMALS; BRAIN-COMPUTER INTERFACES; FEEDBACK; FEMALE; MOTOR CORTEX; OBSERVER VARIATION; PLACENTA; PREGNANCY; RATS; RATS, SPRAGUE-DAWLEY;

EID: 84876064360     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0059049     Document Type: Article

References (73)

1. Chapin JK, Moxon KA, Markowitz RS, Nicolelis MAL, (1999) Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex. Nat Neurosci 2: 664-670.
2. Wessberg J, Stambaugh CR, Kralik JD, Beck PD, Laubach M, et al. (2000) Real-time prediction of hand trajectory by ensembles of cortical neurons in primates. Nature 408: 361-365.
3. Serruya MD, Hatsopoulos NG, Paninski L, Fellows MR, Donoghue JP, (2002) Instant neural control of a movement signal. Nature 416: 141-142.
4. Hochberg LR, Serruya MD, Friehs GM, Mukand JA, Saleh M, et al. (2006) Neuronal ensemble control of prosthetic devices by a human with tetraplegia. Nature 442: 164-171.
5. Carmena JM, Lebedev MA, Crist RE, O'Doherty JE, Santucci DM, et al. (2003) Learning to control a brain-machine interface for reaching and grasping by primates. PLoS Biol 1: 193-208.
6. Taylor DM, Tillery SIH, Schwartz AB, (2002) Direct cortical control of 3D neuroprosthetic devices. Science 296: 1829-1832.
7. Ganguly K, Carmena JM, (2009) Emergence of a stable cortical map for neuroprosthetic control. PLoS Biol 7: 1-13.
8. Wolpaw JR, McFarland DJ, (2004) Control of a two-dimensional movement signal by a non-invasive brain-computer interface in humans. Proc Natl Acad Sci USA 101: 17849-17854.
9. Velliste M, Perel S, Spalding MC, Whitford AS, Schwartz AB, (2008) Cortical control of a prosthetic arm for self-feeding. Nature 453: 1098-1101.
10. Moritz CT, Perlmutter SI, Fetz EE, (2008) Direct control of paralysed muscles by cortical neurons. Nature 456: 639-643.
11. Mulliken GH, Musallam S, Andersen RA, (2008) Decoding trajectories from posterior parietal cortex ensembles. J Neurosci 28: 12913-12926.
12. Kim SP, Simeral JD, Hochberg LR, Donoghue JP, Black MJ, (2008) Neural control of computer cursor velocity by decoding motor cortical spiking activity in humans with tetraplegia. J Neural Eng 5: 455-476.
13. Li Z, O'Doherty JE, Hanson TL, Lebedev MA, Henriquez CS, et al. (2009) Unscented Kalman filter for brain-machine interfaces. PLoS ONE 4: 1-18.
14. Chase SM, Schwartz AB, Kass RE, (2009) Bias, optimal linear estimation, and the differences between open-loop simulation and closed-loop performance of spiking-based brain-computer interface algorithms. Neural Networks 22: 1203-1213.
15. Musallam S, Corneil BD, Greger B, Scherberger H, Andersen RA, (2004) Cognitive control signals for neural prosthetics. Science 305: 258-262.
16. Santhanam G, Ryu SI, Yu BM, Afshar A, Shenoy KV, (2006) A high-performance brain-computer interface. Nature 442: 195-198.
17. O'Doherty JE, Lebedev MA, Ifft PJ, Zhuang KZ, Shokur S, et al. (2011) Active tactile exploration using a brain-machine-brain interface. Nature 479: 228-231.
18. DiGiovanna J, Mahmoudi B, Fortes J, Principe JC, Sanchez JC, (2009) Coadaptive brain-machine interface via reinforcement learning. IEEE Trans Biomed Eng 56: 54-64.
19. Hauschild M, Mulliken GH, Fineman I, Loeb GE, Andersen RA, (2012) Cognitive signals for brainmachine interfaces in posterior parietal cortex include continuous 3D trajectory commands. Proc Natl Acad Sci USA 109: 17075-17080.
20. Shanechi MM, Hu RC, Powers M, Wornell GW, Brown EN, et al. (2012) Neural population partitioning and a concurrent brain-machine interface for sequential motor function. Nat Neurosci 15: 1715-1722.
21. Mussa-Ivaldi FA, Alford ST, Chiappalone M, Fadiga L, Karniel A, et al. (2010) New perspectives on the dialogue between brains and machines. Front Neurosci 4: 44-52.
22. Pohlmeyer EA, Miller LE, Mussa-Ivaldi FA, Perreault EJ, Solla SA (2003) Prediction of EMG from multiple electrode recordings in primary motor cortex. In: Proc. IEEE EMBS. 17-21.
23. Georgopoulos A, Kalaska JF, Caminiti R, Massey JT, (1982) On the relations between the direction of two-dimensional arm movement and cell discharge in primate motor cortex. J Neurosci 2: 1527-1537.
24. Georgopoulos A, Schwartz AB, Kettner RE, (1986) Neural population coding of movement direction. Science 233: 1416-1419.
25. Ashe J, Georgopoulos AP, (1994) Movement parameters and neural activity in motor cortex and area 5. Cereb Cortex 6: 590-600.
26. Moran DW, Schwartz AB, (1999) Motor cortical representation of speed and direction during reaching. J Neurophysiol 82: 2676-2692.
27. Paninski L, Fellows MR, Hatsopoulos NG, Donoghue JP, (2004) Spatiotemporal tuning of motor cortical neurons for hand position and velocity. J Neurophysiol 91: 515-532.
28. Crammond DJ, Kalaska JF, (1996) Dierential relation of discharge in primary motor cortex and premotor cortex to movements versus actively maintained postures during a reaching task. Exp Brain Res 108: 45-61.
29. Caminiti R, Johnson PB, Galli C, Ferraina S, Burnod Y, (1991) Making arm movements within different parts of space: The premotor and motor cortical representation of a coordinate system for reaching to visual targets. J Neurosci 11: 1182-1197.
30. Kurata K, (1993) Premotor cortex of monkeys: Set- and movement-related activity reecting amplitude and direction of wrist movements. J Neurophysiol 69: 187-200.
31. Mulliken GH, Musallam S, Andersen RA, (2008) Forward estimation of movement state in posterior parietal cortex. Proc Natl Acad Sci USA 105: 8170-8177.
32. Averbeck BB, Chafee MV, Crowe DA, Georgopoulos AP, (2005) Parietal representation of hand velocity in a copy task. J Neurophysiol 93: 508-518.
33. Snyder LH, Batista AP, Andersen RA, (1997) Coding of intention in the posterior parietal cortex. Nature 386: 167-170.
34. Batista AP, Buneo CA, Snyder LH, Andersen RA, (1999) Reach plans in eye-centered coordinates. Science 285: 257-260.
35. Buneo CA, Jarvis MR, Batista AP, Andersen RA, (2002) Direct visuomotor transformations for reaching. Nature 416: 632-636.
36. Andersen RA, Burdick JW, Musallam S, Pesaran B, Cham JG, (2004) Cognitive neural prosthetics. Trends in Cognitive Sciences 8: 486-493.
37. Messier J, Kalaska JF, (2000) Covariation of primate dorsal premotor cell activity with direction and amplitude during a memorized-delay reaching task. J Neurophysiol 84: 152-165.
38. Crammond DJ, Kalaska JF, (1994) Modulation of preparatory neuronal activity in dorsal premotor cortex due to stimulus-response compatibility. J Neurophysiol 71: 1281-1284.
39. Boussaoud D, Bremmer F, (1999) Gaze effects in the cerebral cortex: reference frames for space coding and action. Exp Brain Res 128: 170-180.
40. Kakei S, Hoffman DS, Strick PL, (2003) Sensorimotor transformations in cortical motor areas. Neurosci Res 46: 1-10.
41. Churchland MM, Santhanam G, Shenoy KV, (2006) Preparatory activity in premotor and motor cortex reects the speed of the upcoming reach. J Neurophysiol 96: 3130-3146.
42. Crammond DJ, Kalaska JF, (2000) Prior information in motor and premotor cortex: Activity during the delay period and effect on pre-movement activity. J Neurophysiol 84: 986-1005.
43. Crutcher MD, Russo GS, Ye S, Backus DA, (2004) Target-, limb-, and context-dependent neural activity in the cingulate and supplementary motor areas of the monkey. Exp Brain Res 158: 278-288.
44. Todorov E, Jordan MI, (2002) Optimal feedback control as a theory of motor coordination. Nat Neurosci 5: 1226-1235.
45. Todorov E (2004) Optimality principles in sensorimotor control. Nat Neurosci: 907-915.
46. Srinivasan L, Eden UT, Willsky AS, Brown EN, (2006) A state-space analysis for reconstruction of goal-directed movements using neural signals. Neural Comput 18: 2465-2494.
47. Kemere C, Meng T (2005) Optimal estimation of feed-forward-controlled linear systems. In: Proc. IEEE international conference on acoustics, speech, and signal processing (ICASSP). 353-356.
48. Srinivasan L, Eden UT, Mitter SK, Brown EN, (2007) General-purpose filter design for neural prosthetic devices. J Neurophysiol 98: 2456-2475.
49. Shanechi MM, Wornell GW, Williams ZM, Brown EN (2010) A parallel point-process filter for estimation of goal-directed movements from neural signals. In: Proc. IEEE international conference on acoustics, speech, and signal processing (ICASSP). Dallas, TX, 521-524.
50. Shanechi MM, Wornell GW, Williams ZM, Brown EN (2012) Feedback-controlled parallel point process filter for estimation of goal-directed movements from neural signals. IEEE Trans Neural Syst Rehabil Eng, published online, doi: 10.1109/TNSRE.2012.2221743.
51. Yu BM, Kemere C, Santhanam G, Afshar A, Ryu SI, et al. (2007) Mixture of trajectory models for neural decoding of goal-directed movements. J Neurophysiol 97: 3763-3780.
52. Shanechi MM, Williams ZM, Wornell GW, Brown EN (2010) A real-time brain-machine interface combining plan and peri-movement activities. In: Research in Encoding And Decoding of Neural Ensembles (AREADNE) Meeting. Santorini, Greece.
53. Shanechi MM, Williams ZM, Wornell GW, Brown EN (2010) Combining plan and peri-movement activities improves the performance of brain-machine interfaces. In: Society for Neuroscience (SFN) Meeting. San Diego, USA.
54. Shanechi MM, Williams ZM, Wornell GW, Brown EN (2011) A brain-machine interface combining target and trajectory information using optimal feedback control. In: Computational and Systems Neuroscience (COSYNE) Meeting. Salt Lake City, USA.
55. Loeb GE, Levine WS, He J, (1990) Understanding sensorimotor feedback through optimal control. Cold Spring Harb Symp Quant Biol 55: 791-803.
56. Todorov E, (2005) Stochastic optimal control and estimation methods adapted to the noise characteristics of the sensorimotor system. Neural Comput 17: 1084-1108.
57. Liu D, Todorov E (2007) Evidence for the exible sensorimotor strategies predicted by optimal feedback control. J Neurosci: 9354-9368.
58. Shanechi MM (2011) Real-Time Brain-Machine Interface Architectures: Neural Decoding from Plan to Movement. Ph.D. thesis, Massachusetts Institute of Technology.
59. Shadmehr R, Krakauer JW (2008) A computational neuroanatomy for motor control. Exp Brain Res: 359-381.
60. Truccolo W, Eden UT, Fellows MR, Donoghue JP, Brown EN, (2005) A point process framework for relating neural spiking activity to spiking history, neural ensemble, and extrinsic covariate effects. J Neurophysiol 93: 1074-1089.
61. Marquardt DW, Snee RD, (1975) Ridge regression in practice. Am Stat 29: 3-20.
62. Kim SP, Sanchez JC, Rao YN, Erdogmus D, Carmena JM, et al. (2006) A comparison of optimal MIMO linear and nonlinear models for brain-machine interfaces. J Neural Eng 3: 145-161.
63. Sanchez J, Kim SP, Erdogmus D, Rao Y, Principe J, et al. (2002) Input-output mapping performance of linear and nonlinear models for estimating hand trajectories from cortical neuronal firing patterns. In: Proceedings of the 12th IEEE Workshop on Neural Networks for Signal Processing. 139-148.
64. Bloomfield P (2000) Fourier analysis of time series. Hoboken, NJ: Wiley.
65. Scott SH, (2004) Optimal feedback control and the neural basis of volitional motor control. Nat Rev Neurosci 5: 532-546.
66. Cunningham JP, Nuyujukian P, Gilja V, Chestek CA, Ryu SI, et al. (2011) A closed-loop human simulator for investigating the role of feedback control in brain-machine interfaces. J Neurophysiol 105: 1932-1949.
67. Kulkarni JE, Paninski L, (2008) State-space decoding of goal-directed movements. IEEE Signal Process Mag 25: 78-86.
68. Bertsekas D (2005) Dynamic Programming and Optimal Control. Belmont, MA: Athena Scientific.
69. Eden UT, Frank LM, Barbieri R, Solo V, Brown EN, (2004) Dynamic analysis of neural encoding by point process adaptive filtering. Neural Comput 16: 971-998.
70. Srinivasan L, da Silva M, (2011) Breaking the fixed-arrival-time restriction in reaching movements of neural prosthetic devices. IEEE Trans Biomed Eng 58: 1555-1564.
71. Ackerson GA, Fu KS, (1970) On state estimation in switching environments. IEEE Trans Autom Control AC-15: 10-17.
72. Chen R, Liu JS, (2000) Mixture Kalman filters. J Roy Statist Soc B 62: 493-508.
73. Kemere C, Santhanam G, Yu BM, Afshar A, Ryu SI, et al. (2008) Detecting neural-state transitions using hidden Markov models for motor cortical prostheses. J Neurophysiol 100: 2441-2452.