Assist-as-needed robotic trainer based on reinforcement learning and its application to dart-throwing

Neural Networks

Volumn 53, Issue , 2014, Pages 52-60

  Obayashi, Chihiro ^a   Tamei, Tomoya ^a   Shibata, Tomohiro ^a  

^a NARA INSTITUTE OF SCIENCE AND TECHNOLOGY   (Japan)

Author keywords

Assist as needed; Assistive robotics; Motor skill learning; Reinforcement learning

Indexed keywords

ADULT; BIOLOGICAL MODEL; CASE CONTROL STUDY; DEVICES; EXERCISE; FEEDBACK SYSTEM; FEMALE; HUMAN; MALE; MOTOR PERFORMANCE; PROCEDURES; REINFORCEMENT; ROBOTICS;

ADULT; CASE-CONTROL STUDIES; EXERCISE; FEEDBACK, PHYSIOLOGICAL; FEMALE; HUMANS; MALE; MODELS, NEUROLOGICAL; MOTOR SKILLS; REINFORCEMENT (PSYCHOLOGY); ROBOTICS;

EID: 84894061021     PISSN: 08936080     EISSN: 18792782     Source Type: Journal    
DOI: 10.1016/j.neunet.2014.01.012     Document Type: Article

References (27)

1. Cai L., Fong A., Otoshi C., Liang Y., Burdick J., Roy R., Edgerton V. Implications of assist-as-needed robotic step training after a complete spinal cord injury on intrinsic strategies of motor learning. The Journal of Neuroscience 2006, 26:10564-10568.
2. Crespo L., Reinkensmeyer D. Haptic guidance can enhance motor learning of a steering task. Journal of Motor Behavior 2008, 40:545-557.
3. d'Avella A., Bizzi E. Shared and specific muscle synergies in natural motor behaviors. Proceedings of the National Academy of Sciences of the United States of America 2005, 102:3076-3081.
4. d'Avella A., Saltiel P., Bizzi E. Combinations of muscle synergies in the construction of a natural motor behavior. Nature Neuroscience 2003, 6:300-308.
5. Duschau-Wicke, A., Brunsch, T., Lunenburger, L., & Riener, R. (2008). Adaptive support for patient-cooperative gait rehabilitation with the Lokomat. In IEEE/RSJ International conference on IEEE, intelligent robots and systems, 2008, IROS 2008. (pp. 2357-2361).
6. Duschau-Wicke A., Caprez A., Riener R. Patient-cooperative control increases active participation of individuals with SCI during robot-aided gait training. Journal of NeuroEngineering and Rehabilitation 2010, 7:43.
7. Emken J., Reinkensmeyer D. Robot-enhanced motor learning: accelerating internal model formation during locomotion by transient dynamic amplification. IEEE Transactions on Neural Systems and Rehabilitation Engineering 2005, 13:33-39.
8. Hemami H., Dariush B. Central mechanisms for force and motion-towards computational synthesis of human movement. Neural Networks 2012, 36:167-178.
9. Ijspeert A.J. Central pattern generators for locomotion control in animals and robots: a review. Neural Networks 2008, 21:642-653.
10. Jezernik S., Schärer R., Colombo G., Morari M. Adaptive robotic rehabilitation of locomotion: a clinical study in spinally injured individuals. Spinal Cord 2003, 41:657-666.
11. Krebs H.I., Ferraro M., Buerger S.P., Newbery M.J., Makiyama A., Sandmann M., et al. Rehabilitation robotics: pilot trial of a spatial extension for mit-manus. Journal of NeuroEngineering and Rehabilitation 2004, 1:5.
12. Krebs H.I., Palazzolo J.J., Dipietro L., Ferraro M., Krol J., Rannekleiv K., et al. Rehabilitation robotics: performance-based progressive robot-assisted therapy. Autonomous Robots 2003, 15:7-20.
13. Lum P.S., Burgar C.G., Van der Loos M., Shor P.C., Majmundar M., Yap R. Mime robotic device for upper-limb neurorehabilitation in subacute stroke subjects: a follow-up study. Journal of Rehabilitation Research and Development 2006, 43:631-642.
14. Mitsunaga N., Smith C., Kanda T., Ishiguro H., Hagita N. Adapting robot behavior for human-robot interaction. IEEE Transactions on Robotics 2008, 24:911-916.
15. Murai, A., Yamane, K., & Nakamura, Y. (2009). Characterization of motor skill based on musculoskeletal model. In Annual international conference of the IEEE engineering in medicine and biology society (pp. 6542-6545).
16. Mylonas G., Kwok K., James D., Leff D., Orihuela-Espina F., Darzi A., et al. Gaze-contingent motor channelling, haptic constraints and associated cognitive demand for robotic mis. Medical Image Analysis 2012, 16:612-631.
17. Obayashi, C., Tamei, T., Imai, A., & Shibata, T. (2009). Comparison of experts and non-experts in throwing darts based on optimization criteria. In Annual international conference of the IEEE, engineering in medicine and biology society (pp. 2647-2650).
18. Peters J., Schaal S. Reinforcement learning of motor skills with policy gradients. Neural Networks 2008, 21:682-697.
19. Schmidt R., Wrisberg C. Motor learning and performance: a situation-based learning approach 2008, Human Kinetics Publishers.
20. Squeri V., Basteris A., Sanguineti V. Adaptive regulation of assistance 'as needed' in robot-assisted motor skill learning and neuro-rehabilitation. 2011 IEEE international conference on rehabilitation robotics 2011, 1-6. IEEE.
21. Sutton R., Barto A. Reinforcement learning: an introduction, volume 1 1998, Cambridge Univ. Press.
22. Tamei T., Shibata T. Policy gradient learning of cooperative interaction with a robot using user's biological signals. Advances in Neuro-Information Processing 2009, 1029-1037.
23. Tapus A., Ţǎpuş C., Matarić M. User-robot personality matching and assistive robot behavior adaptation for post-stroke rehabilitation therapy. Intelligent Service Robotics 2008, 1:169-183.
24. Tsuji T., Morasso P., Goto K., Ito K. Human hand impedance characteristics during maintained posture. Biological Cybernetics 1995, 72:475-485.
25. Weaver, L., & Tao, N. (2001). The optimal reward baseline for gradient-based reinforcement learning. In The seventeenth conference on uncertainty in artificial intelligence (pp. 538-545).
26. Williamson M.M. Neural control of rhythmic arm movements. Neural Networks 1998, 11:1379-1394.
27. Wulf G., Shea C., Lewthwaite R. Motor skill learning and performance: a review of influential factors. Medical Education 2010, 44:75-84.