Learning assistive strategies from a few user-robot interactions: Model-based reinforcement learning approach

Proceedings - IEEE International Conference on Robotics and Automation

Volumn 2016-June, Issue , 2016, Pages 3346-3351

  Hamaya, Masashi ^a,b   Matsubara, Takamitsu ^a,c   Noda, Tomoyuki ^a   Teramae, Tatsuya ^a   Morimoto, Jun ^a  

^a ATR CNS   (Japan)

^b OSAKA UNIVERSITY   (Japan)

^c NARA INSTITUTE OF SCIENCE AND TECHNOLOGY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

DATA ACQUISITION; ELECTROMYOGRAPHY; EXOSKELETON (ROBOTICS); ROBOTIC ARMS; ROBOTICS; ROBOTS;

EXPERIMENTAL PLATFORM; INVERTED PENDULUM MODEL; MEASUREMENT SYSTEM; MECHANICAL MODEL; MODEL-BASED REINFORCEMENT LEARNING; RIGIDBODY DYNAMICS; ROBOT INTERACTIONS; ZERO MOMENT POINT;

REINFORCEMENT LEARNING;

EID: 84977536783     PISSN: 10504729     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICRA.2016.7487509     Document Type: Conference Paper

References (28)

1. K. Suzuki, G. Mito, H. Kawamoto, Y. Hasegawa, and Y. Sankai, "Intention-based walking support for paraplegia patient with robot suithal, " Advanced Robotics, vol. 21, no. 12, pp. 1441-1469, 2007.
2. X. Zhang and M. Hashimoto, "SBC for motion assist using neural oscillator, " in Proc. IEEE Int'l Conf. on Robotics and Automation, 2009, pp. 659-664.
3. S. Jacobsen, "On the development of XOS, a powerful exoskeletal robot, " in Plenary Talk IEEE/RSJ Int'l Conf. on Intelligent Robots and System, 2007.
4. K. Kazerooni, A. Chu, and R. Steger, "That which does not stabilize, will only make us stronger, " The Int'l J. of Robotics Research, vol. 26, no. 1, pp. 75-89, 2007.
5. H. Kwa, J. Noorden, M. Missel, T. Craig, J. Pratt, and P. Neuhans, "Development of the ihmc mobility assist exoskeleton, " in Proc. IEEE Int'l Conf. on Robotics and Automation, 2009, pp. 2556-2562.
6. K. Yamamoto, K. Hyodo, M. Ishii, and T. Matsuo, "Development of power assisting suit for assisting nurse labor, " JSME Int'l J. Series C, vol. 45, no. 3, pp. 703-711, 2002.
7. S. Hyon, J. Morimoto, T. Matsubara, T. Noda, and M. Kawato, "XoR: Hybrid Drive Exoskeleton Robot That Can Balance, " in Proc. IEEE/RSJ Int'l Conf. on Intelligent Robots and Systems, 2011, pp. 2715-2722.
8. A. Asbeck, S. De Rossi, I. Galiana, Y. Ding, and C. Walsh, "Stronger, smarter, softer: Next-generation wearable robots, " IEEE Robotics Automation Magazine, vol. 21, no. 4, pp. 22-33, Dec 2014.
9. S. Wang, L. Wang, C. Meijneke, E. van Asseldonk, T. Hoellinger, G. Cheron, Y. Ivanenko, V. La Scaleia, F. Sylos-Labini, M. Molinari, F. Tamburella, I. Pisotta, F. Thorsteinsson, M. Ilzkovitz, J. Gancet, Y. Nevatia, R. Hauffe, F. Zanow, and H. van der Kooij, "Design and control of the mindwalker exoskeleton, " IEEE Trans. on Neural Systems and Rehabilitation Engineering, vol. 23, no. 2, pp. 277-286, March 2015.
10. R. Farris, H. Quintero, and M. Goldfarb, "Preliminary evaluation of a powered lower limb orthosis to aid walking in paraplegic individuals, " IEEE Trans. on Neural Systems and Rehabilitation Engineering, vol. 19, no. 6, pp. 652-659, Dec 2011.
11. S. Banala, S. Agrawal, A. Fattah, V. Krishnamoorthy, W.-L. Hsu, J. Scholz, and K. Rudolph, "Gravity-balancing leg orthosis and its performance evaluation, " IEEE Trans. on Robotics, vol. 22, no. 6, pp. 1228-1239, 2006.
12. C. J. Walsh, K. Endo, and H. Herr, "A quasi-passive leg exoskeleton for load-carrying augmentation, " Int'l J. of Humanoid Robotics, vol. 4, no. 3, pp. 487-506, 2007.
13. H. Kawamoto, S. Kanbe, and Y. Sankai, "Power assist method for HAL-3 using EMG-based feedback controller, " in Proc. Int'l Conf. on Systems, Man and Cybernetics, 2003, pp. 1648-1653.
14. C. Fleischer, C. Reinicke, and G. Hommel, "Predicting the intended motion with EMG signals for an exoskeleton orthosis controller, " in Proc. IEEE/RSJ Int'l Conf. on Intelligent Robots and Systems, 2005, pp. 2029-2034.
15. T. Kagawa and Y. Uno, "Gait pattern generation for a power-assist device of paraplegic gait, " in IEEE Int'l Symposium on Robot and Human Interactive Communication, 2009, pp. 633-638.
16. R. Ronsse, N. Vitiello, T. Lenzi, J. van den Kieboom, M. Carrozza, and A. Ijspeert, "Adaptive oscillators with human-in-the-loop: Proof of concept for assistance and rehabilitation, " in Proc. IEEE/RAS-EMBS Int'l Conf. on Biomedical Robotics and Biomechatronics, 2010, pp. 668-674.
17. T. Matsubara, A. Uchikata, and J. Morimoto, "Full-body exoskeleton robot control for walking assistance by style-phase adaptive pattern generation, " in Proc. IEEE/RSJ Int'l Conf. on Intelligent Robots and Systems, 2012, pp. 3914-3920.
18. T. Matsubara, D. Uto, T. Noda, T. Teramae, and J. Morimoto, "Stylephase adaptation of human and humanoid biped walking patterns in real systems, " in Proc. IEEE/RAS Int'l Conf. on Humanoid Robots, 2014, pp. 128-133.
19. T. Yan, M. Cempini, C. M. Oddo, and N. Vitiello, "Review of assistive strategies in powered lower-limb orthoses and exoskeletons, " Robotics and Autonomous Systems, vol. 64, pp. 120-136, 2015.
20. M. P. Deisenroth, D. Fox, and C. E. Rasmussen, "Gaussian processes for data-efficient learning in robotics and control, " IEEE Trans. on Pattern Recognition and Machine Intelligence, vol. 37, no. 2, pp. 408-423, 2015.
21. T. Tamei and T. Shibata, "Fast Reinforcement Learning for Three-Dimensional Kinetic Human-Robot Cooperation with an EMG-to-Activation Model, " Advanced Robotics, vol. 25, no. 5, pp. 563-580, 2011.
22. P. Pilarski, M. Dawson, T. Degris, F. Fahimi, J. Carey, and R. Sutton, "Online human training of a myoelectric prosthesis controller via actor-critic reinforcement learning, " in Proc. IEEE/RAS-EMBS Int'l Conf. on Rehabilitation Robotics, 2011, pp. 1-7.
23. W. Xu, J. Huang, Y. Wang, and H. Cai, "Study of reinforcement learning based shared control of walking-aid robot, " in Proc. IEEE/SICE Int'l Symposium on System Integration, 2013, pp. 282-287.
24. C. Obayashi, T. Tamei, and T. Shibata, "Assist-as-needed robotic trainer based on reinforcement learning and its application to dartthrowing, " Neural Networks, vol. 53, pp. 52-60, 2014.
25. T. Matsubara, T. Hasegawa, and K. Sugimoto, "Reinforcement Learning of Shared Control for Dexterous Telemanipulation: Application to a Page Turning Skill, " in Proc. IEEE Int'l Symposium on Robot and Human Interactive Communication, 2015, pp. 343-348.
26. C. Rasmussen and C. Williams, Gaussian Processes for Machine Learning. Springer, 2006.
27. "Pilco web site. " [Online]. Available: http: //mlg. eng. cam. Ac. uk/pilco/
28. "Openhrp. " [Online]. Available: http: //fkanehiro. github. io/openhrp3-doc/