Online human training of a myoelectric prosthesis controller via actor-critic reinforcement learning

IEEE International Conference on Rehabilitation Robotics

Volumn , Issue , 2011, Pages

  Pilarski, Patrick M ^a   Dawson, Michael R ^a   Degris, Thomas ^a   Fahimi, Farbod ^b   Carey, Jason P ^a   Sutton, Richard S ^a  

^a UNIVERSITY OF ALBERTA   (Canada)

^b University of Alabama in Huntsville ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACTOR-CRITIC REINFORCEMENT LEARNING; APPLICATION DOMAINS; CLINICAL STAFF; CONTROL APPROACH; FEEDBACK SIGNAL; MACHINE-LEARNING; MULTI-FUNCTIONS; MYOELECTRIC PROSTHESIS; ONLINE LEARNING; TASK DOMAIN; TRAINING SIGNAL;

ARTIFICIAL LIMBS; CONTROLLERS; E-LEARNING; REINFORCEMENT LEARNING; ROBOTICS; ROBOTS;

MYOELECTRICALLY CONTROLLED PROSTHETICS;

ARTICLE; ARTIFICIAL INTELLIGENCE; HUMAN; LIMB PROSTHESIS; THEORETICAL MODEL;

ARTIFICIAL INTELLIGENCE; ARTIFICIAL LIMBS; HUMANS; MODELS, THEORETICAL;

EID: 80055045785     PISSN: 19457898     EISSN: 19457901     Source Type: Conference Proceeding    
DOI: 10.1109/ICORR.2011.5975338     Document Type: Conference Paper

References (22)

1. P. Parker, K. B. Englehart, and B. Hudgins, "Myoelectric signal processing for control of powered limb prostheses," J. Electromyography Kinesiol., vol. 16, no. 6, pp. 541-548, 2006.
2. K. Englehart and B. Hudgins, "A robust, real-time control scheme for multifunction myoelectric control." IEEE Trans. Biomed. Eng., vol. 50, no. 7, pp. 848-854, 2003.
3. P. K. Artemiadis and K. J. Kyriakopoulos, "EMG-based control of a robot arm using low-dimensional embeddings," IEEE Trans. Rob., vol. 26, no. 2, pp. 393-398, 2010.
4. B. Hudgins, P. Parker, and R. N. Scott, "A new strategy for multifunction myoelectric control," IEEE Trans. Biomed. Eng., vol. 40, no. 1, pp. 82-94, 1993.
5. M. A. Oskoei and H. Hu, "Support vector machine-based classification scheme for myoelectric control applied to upper limb," IEEE Trans. Biomed. Eng., vol. 55, no. 8, pp. 1956-1965, 2008.
6. J. Sensinger, B. Lock, and T. Kuiken, "Adaptive pattern recognition of myoelectric signals: exploration of conceptual framework and practical algorithms," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 17, no. 3, pp. 270-278, 2009.
7. D. Nishikawa, W. Yu, H. Yokoi, and Y. Kakazu, "On-line learning method for EMG prosthetic hand control," Electronics and Communications in Japan, Part III: Fundamental Electronic Science, vol. 84, no. 10, pp. 35-46, 2001.
8. M. A. Oskoei and H. Hu, "Myoelectric control systems-a survey," Biomed. Signal Process. Control, vol. 2, no. 4, pp. 275-294, 2007.
9. R. S. Sutton, "Temporal credit assignment in reinforcement learning," Ph.D. dissertation, University of Massachusetts, Amherst, 1984.
10. J. Peters and S. Schaal, "Natural actor-critic," Neurocomputing, vol. 71, no. 7-9, pp. 1180-1190, 2008.
11. R. S. Sutton and A. G. Barto, Reinforcement learning: an introduction. MIT Press Cambridge, Massachusetts; London, England, 1998.
12. S. Singh and R. S. Sutton, "Reinforcement learning with replacing eligibility traces," Mach. Learn., vol. 22, no. 1, pp. 123-158, 1996.
13. P. Thomas, M. Branicky, A. van den Bogert, and K. Jagodnik, "Application of the actor-critic architecture to functional electrical stimulation control of a human arm," Twenty First Innovative Applications of Artificial Intelligence Conference, pp. 1-9, 2009.
14. W. B. Knox and P. Stone, "Interactively shaping agents via human reinforcement: The TAMER framework," Proceedings of the Fifth Int. Conf. on Knowledge Capture (K-CAP'09), pp. 9-16, 2009.
15. J. Peters and S. Schaal, "Reinforcement learning of motor skills with policy gradients," Neural Networks, vol. 21, no. 4, pp. 682-697, 2008.
16. J. Izawa, T. Kondo, and K. Ito, "Biological arm motion through reinforcement learning," Biol. Cybern., vol. 91, no. 1, pp. 10-22, 2004.
17. T. Tamei and T. Shibata, "Policy gradient learning of cooperative interaction with a robot using user's biological signals," Proceedings of ICONIP 2008, Part II, LNCS 5507, pp. 1029-1037, Springer, 2009.
18. R. Williams, "Simple statistical gradient-following algorithms for connectionist reinforcement learning," Mach. Learn., vol. 8, no. 3-4, pp. 229-256, 1992.
19. R. S. Sutton, D. McAllester, S. Singh, and Y. Mansour, "Policy gradient methods for reinforcement learning with function approximation," Adv. in Neural Info. Proc. Sys. (NIPS) 12, pp. 1057-1063, 2000.
20. T. D. Sanger, "Neural network learning control of robot manipulators using gradually increasing task difficulty," IEEE Trans. Robot. Auto., vol. 10, no. 3, pp. 323-333, 1994.
21. T. A. Kuiken, G. Li, B. A. Lock, R. D. Lipschutz, L. A. Miller, K. A. Stubblefield, K. B. Englehart, "Targeted muscle reinnervation for real-time myoelectric control of multifunction artificial arms," JAMA-J. Am. Med. Assoc., vol. 301, no. 6, pp. 619-628, 2009.
22. J. DiGiovanna, B. Mahmoudi, J. Fortes, J. C. Principe, and J. C. Sanchez, "Coadaptive brain-machine interface via reinforcement learning," IEEE Trans. Biomed. Eng., vol. 56, no. 1, pp. 54-64, 2009.