Stochastic optimal control as a theory of brain-machine interface operation

Neural Computation

Volumn 25, Issue 2, 2013, Pages 374-417

  Lagang, Manuel ^a,b   Srinivasan, Lakshminarayan ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ANIMAL; BRAIN COMPUTER INTERFACE; HUMAN; LETTER; THEORETICAL MODEL;

ALGORITHMS; ANIMALS; BRAIN-COMPUTER INTERFACES; HUMANS; MODELS, THEORETICAL;

EID: 84877809427     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/NECO_a_00394     Document Type: Letter

References (40)

1. Berens, P. (2009). CircStat: AMATLAB toolbox for circular statistics.Wiley Interdisciplinary Reviews: Computational Statistics, 1, 128-129.
2. Bertsekas, D. P. (2005). Dynamic programming and optimal control (3rd ed.). Belmont, MA: Athena Scientific.
3. Brockwell, A. E., Rojas, A. L., & Kass, R. E. (2004). Recursive Bayesian decoding of motor cortical signals by particle filtering. J. Neurophysiol., 91(4), 1899-1907.
4. Carmena, J. M., Lebedev, M. A., Crist, R. E., O'Doherty, J. E., Santucci, D. M., et al. (2003). Learning to control a brain-machine interface for reaching and grasping by primates. PLoS Biol., 1, E42.
5. Chase, S. M., Schwartz, A. B., & Kass, R. E. (2009). Bias, optimal linear estimation, and the differences between open-loop simulation and closed-loop performance of spiking-based brain-computer interface algorithms. Neural Netw., 22(9), 1203-1213.
6. Cunningham, J. P., Nuyujukian, P., Gilja, V., Chestek, C. A., Ryu, S. I., & Shenoy, K. V. (2011). A closed-loop human simulator for investigating the role of feedback control in brain-machine interfaces. J. Neurophysiol., 105(4), 1932-1949. doi:10.1152/jn.00503.2010
7. Dangi, S., Gowda, S., Heliot, R., & Carmena, J. M. (2011). Adaptive Kalman filtering for closed-loop brain-machine interface systems. In Proceedings of the 5th IEEE EMBS Conference on Neural Engineering (pp. 609-612). Piscataway, NJ: IEEE.
8. Diedrichsen, J., Shadmehr, R., & Ivry, R. B. (2009). The coordination of movement: Optimal feedback control and beyond. Trends Cogn. Sci., 14(1), 31-39.
9. Eden, U. T., Frank, L.M., Barbieri, R., Solo, V., & Brown, E. N. (2004). Dynamic analysis of neural encoding by point process adaptive filtering. Neural Computation, 16, 971-998.
10. Fetz, E. E. (1969). Operant conditioning of cortical unit activity. Science, 163(870), 955-958.
11. Gage, G. J., Ludwig, K. A., Otto, K. J., Ionides, E. L., & Kipke, D. R. (2005). Naive coadaptive cortical control. J. Neural Eng., 2(2), 52-63.
12. Ganguly, K., & Carmena, J. M. (2009). Emergence of a stable cortical map for neuroprosthetic control. PLoS Biol., 7(7), e1000153.
13. Ganguly, K., Dimitrov, D. F.,Wallis, J. D., & Carmena, J. M. (2011). Reversible largescale modification of cortical networks during neuroprosthetic control. Nat. Neurosci., 14(5), 662-667.
14. Georgopoulos, A. P., Schwartz, A. B., & Kettner, R. E. (1986). Neuronal population coding of movement direction. Science, 233(4771), 1416-1419.
15. Gilja, V., Nuyujukian, P., Chestek, C. A., Cunningham, J. P., Yu, B. M., Ryu, S. I., et al. (2010). A high-performance continuous cortically-controlled prosthesis enabled by feedback control design. SfNAbstractViewer/Itinerary Planner. Program/Poster 20.26.
16. Golub, M. D., Yu, B. M., Schwartz, A. B., & Chase, S. M. (2011). Improving cursor stops in closed-loop brain-computer interfaces by leveraging trajectory curvature. Society for Neuroscience Abstract Viewer/Itinerary Planner, 142.18.
17. Heliot, R., Ganguly, K., Jimenez, J., & Carmena, J. M. (2010). Learning in closed-loop brain-machine interfaces: Modeling and experimental validation. IEEE Trans. Syst. Man. Cybern. B Cybern., 40(5), 1387-1397.
18. Jarosiewicz, B., Chase, S. M., Fraser, G.W., Velliste, M., Kass, R. E., & Schwartz, A. B. (2008). Functional network reorganization during learning in a brain-computer interface paradigm. Proc. Natl. Acad. Sci. USA, 105(49), 19486-19491.
19. Jarzebowski, J., Srinivasan, L., & Coleman, T. P. (2008). Using stochastic control with data compression perspectives to enhance P300 neural communication prostheses. Proc. IEEE Information Theory Workshop (pp. 109-113). Piscataway, NJ: IEEE.
20. Kemere, C., & Meng, T. H. (2005). Optimal estimation of feed-forward-controlled linear systems. In Proc. IEEE International Conference on Acoustics, Speech and Signal Processing (Vol. 5, pp. 353-356). Piscataway, NJ: IEEE.
21. Kim, S., & Coleman, T. P. (2011). Team decision theory and brain-machine interfaces. In Proceedings of the 5th International IEEE EMBS Conference on Neural Engineering (pp. 605-608). Piscataway, NJ: IEEE.
22. Koyama, S., Chase, S. M., Whitford, A. S., Velliste, M., Schwartz, A. B., & Kass, R. E. (2010). Comparison of brain-computer interface decoding algorithms in open-loop and closed-loop control. J. Comput. Neurosci., 29(1-2), 73-87.
23. Ma, R., Aghasadeghi, N., Jarzebowski, J., Bretl, T., & Coleman, T. P. (2012). A stochastic control approach to optimally designing hierarchical flash sets in P300 communication prostheses. IEEE Trans. Neural Syst. Rehabil. Eng., 20(1), 102-112. doi:10.1109/TNSRE.2011.2179560
24. Moran, D. W., & Schwartz, A. B. (1999). Motor cortical representation of speed and direction during reaching. J. Neurophysiol., 82(5), 2676-2692.
25. Omar, C., Akce, A., Johnson, M., Bretl, T., Ma, R., Maclin, E., et al. (2011). A feedback information-theoretic approach to the design of brain-computer interfaces. International Journal on Human-Computer Interaction, 27(1), 5-23.
26. Orsborn, A. L., Dangi, S., Moorman, H. G., & Carmena, J. M. (2012). Closed-loop decoder adaptation on intermediate time-scales facilitates rapid BMI performance improvements independent of decoder initialization conditions. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 20, 468-477.
27. Richardson, A. G., Borghi, T., & Bizzi, E. (2012). Activity of the same motor cortex neurons during repeated experience with perturbed movement dynamics. J. Neurophysiol., 107, 3144-3154. doi:10.1152/jn.00477.2011
28. Scott, S. H. (2004). Optimal feedback control and the neural basis of volitionalmotor control. Nat. Rev. Neurosci., 5(7), 532-546.
29. Serruya, M. D., Hatsopoulos, N. G., Paninski, L., Fellows, M. R., & Donoghue, J. P. (2002). Instant neural control of a movement signal. Nature, 416(6877), 141-142.
30. Shanechi, M. M.,Wornell, G.W.,Williams, Z.,&Brown, E. N. (2010).Aparallel pointprocess filter for estimation of goal-directed movements from neural signals. In Proceedings of the IEEE Conference on Acoustics, Speech, and Signal Processing (pp. 521-524). Piscataway, NJ: IEEE.
31. Srinivasan, L., Eden, U. T., Willsky, A. S., & Brown, E. N. (2006). A state-space analysis for reconstruction of goal-directed movements using neural signals. Neural Computation, 18, 2465-2494.
32. Stengel, R. F. (1994). Optimal control and estimation. New York: Dover.
33. Taylor, D. M., Tillery, S. I., & Schwartz, A. B. (2002). Direct cortical control of 3D neuroprosthetic devices. Science, 296(5574), 1829-1832.
34. Todorov, E. (2004).Optimality principles in sensorimotor control. Nat. Neurosci., 7(9), 907-915.
35. Todorov, E., & Jordan, M. I. (2002). Optimal feedback control as a theory of motor coordination. Nat. Neurosci., 5(11), 1226-1235.
36. Truccolo, W., Eden, U. T., Fellows, M. R., Donoghue, J. P., & Brown, E. N. (2005). A point process framework for relating neural spiking activity to spiking history, neural ensemble, and extrinsic covariate effects. J. Neurophysiol., 93(2), 1074-1089.
37. Vargas-Irwin, C. E., Shakhnarovich, G., Yadollahpour, P., Mislow, J. M., Black, M. J., & Donoghue, J. P. (2010). Decoding complete reach and grasp actions from local primary motor cortex populations. J. Neurosci., 30(29), 9659-9669.
38. Wahnoun, R., He, J., & Helms Tillery, S. I. (2006). Selection and parameterization of cortical neurons for neuroprosthetic control. J. Neural Eng., 3(2), 162-171.
39. Wang, J., Wagner, F., Borton, D. A., Zhang, J., Ozden, I., Burwell, R. D., et al. (2012). Integrated device for combined optical neuromodulation and electrical recording for chronic in vivo applications. J. Neural. Eng., 9(1), 016001. doi:10.1088/1741-2560/9/1/016001
40. Wu,W., Gao, Y., Bienenstock, E., Donoghue, J. P., & Black,M. J. (2006). Bayesian population decoding of motor cortical activity using a Kalman filter. Neural Comput., 18(1), 80-118