Brain-machine interface control of a robot arm using actor-critic rainforcement learning

Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS

Volumn , Issue , 2012, Pages 4108-4111

  Pohlmeyer, Eric A ^a   Mahmoudi, Babak ^a   Geng, Shijia ^a   Prins, Noeline ^a   Sanchez, Justin C ^a  

^a UNIVERSITY OF MIAMI   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACTOR CRITIC; BRAIN MACHINE INTERFACE; CONTROL APPLICATIONS; CURRENT PERFORMANCE; DECISION TASK; DECODING METHODS; FEEDBACK SIGNAL; INPUT SPACE; MODEL PARAMETERS; NEURAL ENSEMBLES; NEURAL STATE; REACHING TASK; ROBOT ACTIONS; ROBOT ARMS; ROBOT MOVEMENTS; STATIC CONTROL; TRAINING DATA;

ALGORITHMS; DECODING; REAL TIME CONTROL; REINFORCEMENT LEARNING;

ROBOTIC ARMS;

ALGORITHM; ANIMAL; ARM; ARTICLE; BRAIN COMPUTER INTERFACE; BRAIN MAPPING; CALLITHRIX; EXPERT SYSTEM; MAN MACHINE INTERACTION; METHODOLOGY; PHYSIOLOGY; PSYCHOPHYSIOLOGY; REINFORCEMENT; ROBOTICS; TASK PERFORMANCE;

ALGORITHMS; ANIMALS; ARM; BIOFEEDBACK, PSYCHOLOGY; BRAIN MAPPING; BRAIN-COMPUTER INTERFACES; CALLITHRIX; EXPERT SYSTEMS; MAN-MACHINE SYSTEMS; REINFORCEMENT (PSYCHOLOGY); ROBOTICS; TASK PERFORMANCE AND ANALYSIS;

MLCS; MLOWN;

EID: 84880955826     PISSN: 1557170X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/EMBC.2012.6346870     Document Type: Conference Paper

References (14)

1. M. Velliste, S. Perel, M. C. Spalding, A. S. Whitford, and A. B. Schwartz, "Cortical control of a prosthetic arm for self-feeding." Nature, vol. 453, pp. 1098-101, Jun 19 2008.
2. E. A. Pohlmeyer, E. R. Oby, E. J. Perreault, S. A. Solla, K. L. Kilgore, R. F. Kirsch, and L. E. Miller, "Toward the restoration of hand use to a paralyzed monkey: brain-controlled functional electrical stimulation of forearm muscles," PLoS ONE, vol. 4, p. e5924, 2009.
3. J. R. Wolpaw and D. J. McFarland, "Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans," Proc Natl Acad Sci USA, vol. 101, pp. 17849-54, Dec 21 2004.
4. L. R. Hochberg, M. D. Serruya, G. M. Friehs, J. A. Mukand, M. Saleh, A. H. Caplan, A. Branner, D. Chen, R. D. Penn, and J. P. Donoghue, "Neuronal ensemble control of prosthetic devices by a human with tetraplegia," Nature, vol. 442, pp. 164-71, Jul 13 2006.
5. L. A. Farwell and E. Donchin, "Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials," Electroencephalogr Clin Neurophysiol, vol. 70, pp. 510-23, Dec 1988.
6. J. M. Carmena, M. A. Lebedev, R. E. Crist, J. E. O'Doherty, D. M. Santucci, D. Dimitrov, P. G. Patil, C. S. Henriquez, and M. A. Nicolelis, "Learning to Control a Brain-Machine Interface for Reaching and Grasping by Primates," PLoS Bioi, vol. I, pp. 193-208, Nov 2003.
7. G. Santhanam, S. I. Ryu, B. M. Yu, A. Afshar, and K. V. Shenoy, "A high-performance brain-computer interface," Nature, vol. 442, pp. 195-8, Jul 13 2006.
8. M. D. Serruya, N. G. Hatsopoulos, L. Paninski, M. R. Fellows, and J. P. Donoghue, "Instant neural control of a movement signal," Nature, vol. 416, pp. 141-2, Mar 14 2002.
9. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction. Cambridge, Mass.: MIT Press" 1998.
10. J. DiGiovanna, B. Mahmoudi, J. Fortes, J. C. Principe, and J. C. Sanchez, "Coadaptive brain-machine interface via reinforcement learning," IEEE Trans Biomed Eng, vol. 56, pp. 54-64, Jan 2009.
11. B. Mahmoudi and J. C. Sanchez, "A symbiotic brain-machine interface through value-based decision making," PLoS ONE, vol. 6, p. e14760, 2011.
12. P. Mazzoni, R. A. Andersen, and M. I. Jordan, "A more biologically plausible learning rule than backpropagation applied to a network model of cortical area 7a," Cereb Cortex, vol. I, pp. 293-307, Jul-Aug 1991.
13. P. Mazzoni, R. A. Andersen, and M. I. Jordan, "A more biologically plausible learning rule for neural networks," Proc Natl Acad Sci USA, vol. 88, pp. 4433-7, May 15 1991.
14. P. M. Pilarski, M. R. Dawson, T. Degris, F. Fahimi, J. P. Carey, and R. S. Sutton, "Online human training of a myoelectric prosthesis controller via actor-critic reinforcement learning," IEEE Int Conf Rehabil Robot, vol. 2011, pp. 1-7, Jun 2011.