Control of a center-out reaching task using a reinforcement learning Brain-Machine Interface

2011 5th International IEEE/EMBS Conference on Neural Engineering, NER 2011

Volumn , Issue , 2011, Pages 525-528

  Sanchez, Justin C ^a   Tarigoppula, Aditya ^b   Choi, John S ^b   Marsh, Brandi T ^b   Chhatbar, Pratik Y ^b   Mahmoudi, Babak ^a   Francis, Joseph T ^b  

^a UNIVERSITY OF MIAMI   (United States)

^b SUNY Downstate Medical Center   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BRAIN MACHINE INTERFACE; FUNCTIONAL MODEL; NEURAL RECORDINGS; NEURONAL ACTIVATION; PRIMARY MOTOR CORTEX; PRIORI KNOWLEDGE; REACHING TASK;

DECODING; EQUIPMENT TESTING; REINFORCEMENT LEARNING;

COUPLINGS;

EID: 79960354527     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/NER.2011.5910601     Document Type: Conference Paper

References (18)

1. K. V. Shenoy, D. Meeker, S. Cao, S. A. Kureshi, B. Pesaran, C. A. Buneo, A. P. Batista, P. P. Mitra, J. W. Burdick, and R. A. Andersen, "Neural prosthetic control signals from plan activity", NeuroReport, vol. 14, pp. 591-597, 2003.
2. K. D. Anderson, "Targeting recovery: Priorities of the spinal cord-injured population", Journal of Neurotrauma, vol. 21, pp. 1371-1383, Oct. 2004.
3. S. P. Kim, J. C. Sanchez, Y. N. Rao, D. Erdogmus, J. C. Principe, J. M. Carmena, M. A. Lebedev, and M. A. L. Nicolelis, "A Comparison of Optimal MIMO Linear and Nonlinear Models for Brain-Machine Interfaces", J. Neural Engineering, vol. 3, pp. 145-161, 2006.
4. E. N. Brown, R. E. Kass, and P. P. Mitra, "Multiple Neural Spike Train Data Analysis: State-of-the-art and Future Challenges", Nature Neuroscience, vol. 7, pp. 456-461, 2004.
5. M. D. Serruya, N. G. Hatsopoulos, L. Paninski, M. R. Fellows, and J. P. Donoghue, "Brain-machine interface: Instant neural control of a movement signal", Nature, vol. 416, pp. 141-142, 2002.
6. S. I. Helms Tillery, D. M. Taylor, and A. B. Schwartz, "Training in cortical control of neuroprosthetic devices improves signal extraction from small neuronal ensembles", Reviews in the Neurosciences, vol. 14, pp. 107-119, 2003.
7. D. W. Moran and A. B. Schwartz, "Motor cortical representation of speed and direction during reaching", Journal of Neurophysiology, vol. 82, pp. 2676-2692, 1999/11 1999.
8. D. M. Taylor, S. I. H. Tillery, and A. B. Schwartz, "Direct cortical control of 3D neuroprosthetic devices", Science, vol. 296, pp. 1829-1832, 2002.
9. W. Wu, M. J. Black, Y. Gao, E. Bienenstock, M. Serruya, and J. P. Donoghue, "Inferring hand motion from multi-cell recordings in motor cortex using a Kalman filter", in SAB Workshop on Motor Control in Humans and Robots: on the Interplay of Real Brains and Artificial Devices, University of Edinburgh, Scotland, 2002, pp. 66-73.
10. Y. Gao, M. J. Black, E. Bienenstock, W. Wu, and J. P. Donoghue, "A quantitative comparison of linear and non-linear models of motor cortical activity for the encoding and decoding of arm motions", in The 1st International IEEE EMBS Conference on Neural Engineering, Capri, Italy, 2003.
11. J. C. Sanchez, S. P. Kim, D. Erdogmus, Y. N. Rao, J. C. Principe, J. Wessberg, and M. A. L. Nicolelis, "Input-output mapping performance of linear and nonlinear models for estimating hand trajectories from cortical neuronal firing patterns", in International Work on Neural Networks for Signal Processing, Martigny, Switzerland, 2002, pp. 139-148.
12. R. S. Sutton, Andrew G. Barto, Reinforcement learning: an introduction. Cambridge: The MIT Press, 1998.
13. J. C. Sanchez, B. Mahmoudi, J. DiGiovanna, and J. C. Principe, "Exploiting co-adaptation for the design of symbiotic neuroprosthetic assistants", Neural Networks special issue on Goal-Directed Neural Systems, vol. 22, pp. 305-315, 2009.
14. J. M. Fuster, "Upper processing stages of the perception-action cycle", Trends in Cognitive Sciences, vol. 8, pp. 143-145, 2004.
15. P. Y. Chhatbar, L. M. von Kraus, M. Semework, and J. T. Francis, "A bio-friendly and economical technique for chronic implantation of multiple microelectrode arrays", J Neurosci Methods, vol. 188, pp. 187-94, May 15 2010.
16. S. I. H. Tillery, D. M. Taylor, and A. B. Schwartz, "Training in cortical control of neuroprosthetic devices improves signal extraction from small neuronal ensembles", Reviews in the Neurosciences, vol. 14, pp. 107-119, 2003.
17. J. DiGiovanna, B. Mahmoudi, J. Fortes, J. C. Principe, and J. C. Sanchez, "Co-adaptive Brain-Machine Interface via Reinforcement Learning", IEEE Trans. Biomed. Eng., 2008.
18. R. Sutton, "Learning to predict by the methods of temporal differences", Machine Learning, vol. 3, pp. 9-44, 1988.