Properties of a temporal difference reinforcement learning brain machine interface driven by a simulated motor cortex

Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS

Volumn , Issue , 2012, Pages 3284-3287

  Tarigoppula, Aditya ^a   Rotella, Nick ^b   Francis, Joseph T ^a  

^a Downstate Health Sciences University   (United States)

^b The Cooper Union for the Advancement of Science and Art   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BRAIN MACHINE INTERFACE; MOTOR CORTEX; STABILITY AND CONVERGENCE; TEMPORAL DIFFERENCE REINFORCEMENT LEARNING; TEMPORAL DIFFERENCES;

ENGINEERING; INDUSTRIAL ENGINEERING;

REINFORCEMENT LEARNING;

ARTICLE; BRAIN COMPUTER INTERFACE; CYTOLOGY; LEARNING; MOTOR CORTEX; NERVE CELL; PHYSIOLOGY; SIGNAL NOISE RATIO;

BRAIN-COMPUTER INTERFACES; LEARNING; MOTOR CORTEX; NEURONS; SIGNAL-TO-NOISE RATIO;

EID: 84870789234     PISSN: 1557170X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/EMBC.2012.6346666     Document Type: Conference Paper

References (16)

1. Eugene M. Izhikevich, "Simple Model of Spiking Neurons.," IEEE Trans. on NEURAL NETWORKS, Vol. 14, NO. 6, NOVEMBER 2003.
2. J. DiGiovanna, B. Mahmoudi, J. Fortes, J. C. Principe, and J. C. Sanchez, "Co-adaptive Brain-Machine Interface via Reinforcement Learning.," IEEE Trans. Biomed. Eng., 2008.
3. th International IEEE/EMBS conference on Neural Engineering (NER), 2011.
4. J. C. Sanchez, B. Mahmoudi, J. DiGiovanna, and J. C. Principe, "Exploiting co-adaptation for the design of symbiotic neuroprosthetic assistants," Neural Networks special issue on Goal-Directed Neural Systems, Vol. 22, pp. 305-315, 2009.
5. R. S. Sutton, Andrew G. Barto. "Reinforcement learning: an introduction.," The MIT Press, 1998.
6. Bagrat Amirikian, Apostolos P. Georgopulos, "Directional tuning profiles of motor cortical cells.," Neuroscience Research, Volume 36, Issue 1, January 2000, Pages 73-79
7. Miguel A. L. Nicolelis, "Actions from thought,", Nature, 2001.
8. Chapin, J. K., and Markowitz., R. A., Moxon, K. A., and Nicolelis, M. A. L. "Direct real-time control of a robot arm using signals derived from neuronal population recordings in motor cortex.," Nature Neuroscience 2, 664-670.
9. Johan Wessberg, Christopher R. Stambaugh, Jerald D. Kralik, Pamela D. Beck, Mark Laubach, John K. Chapin, Jung Kim, S. James Biggs, Mandayam A. Srinivasan & Miguel A. L. Nicolelis, "Real-time prediction of hand trajectory by ensembles of cortical neurons in primates,", Nature 408, 361-365, 2000
10. Mijail D. Serruya, Nicholas G. Hatsopoulos, Liam Paninski, Matthew R. Fellows & John P. Donoghue, "Brain-machine interface: Instant neural control of a movement signal.," Nature 416, 141-142, 2002.
11. Shenoy, Krishna V; Meeker, Daniella; Cao, Shiyan; Kureshi, Sohaib A; Pesaran, Bijan; Buneo, Christopher A; Batista, Aaron P; Mitra, Partha P; Burdick, Joel W; Andersen, Richard A, "Neural prosthetic control signals from plan activity," Neuroreport- Volume 14 - Issue 4 - pp 591-596 Motor Systems, 24 March 2003.
12. J. M. Carmena, M. A. Lebedev, R. E. Crist, J. E. O'Doherty, D. M. Santucci, D. F. Dimitrov, P. G. Patil, and C. S. Henriquez, Miguel A. L. Nicolelis "Learning to control a brain-machine interface for reaching and grasping by primates," PLoS Biology, Vol. 1, no. 2, pp. 193-208, Nov. 2003.
13. W. Wu, M. J. Black, Y. Gao, E. Bienenstock, M. Serruya, and J. P. Donoghue, "Inferring hand motion from multi-cell recordings in motor cortex using a kalman filter," presented at the SAB Workshop on Motor Control in Humans and Robots: On the Interplay of Real Brains and Artificial Devices, Edinburgh, Scotland, 2002
14. Justin C. Sanchez, Deniz Erdogmus, Jose C. Principe, "A Comparison between Nonlinear Mappings and Linear State Estimation to Model the Relation from Motor Cortical Neuronal Firing to Hand Movements.," Proceedings of SAB Workshop on Motor Control in Humans and Robots: On the Interplay of Real Brains and Artificial Devices, 2002.
15. Justin C. Sanchez, Sung-Phil Kim, Deniz Erdogmus, Yadunandana N. Rao, Jose C. Principe, Johan Wessberg, Miguel Nicolelis, "Input-output mapping performance of linear and nonlinear models for estimating hand trajectories from cortical neuronal firing patterns.," 2002.
16. K. Ganguly and J.M. Carmena, "Emergence of a cortical map for neuroprosthetic control," PLOS Biol., Vol. 7, no. 7, p. e1 000 153, Jul. 2009.