Learning robot stiffness for contact tasks using the natural actor-critic

Proceedings - IEEE International Conference on Robotics and Automation

Volumn , Issue , 2008, Pages 3832-3837

  Kim, Byungchan ^a   Kang, Byungduk ^a   Park, Shinsuk ^a   Kang, Sungchul ^b  

^a Korea University   (South Korea)

^b Korea Institute of Science and Technology   (South Korea)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; CONTROL THEORY; INDUSTRIAL ENGINEERING; LEARNING SYSTEMS; LEAST SQUARES APPROXIMATIONS; MOTORS; REINFORCEMENT; REINFORCEMENT LEARNING; ROBOTICS; ROBOTS;

ACTOR-CRITIC; CONTACT TASK; IMPEDANCE PARAMETERS; INTERNATIONAL CONFERENCES;

EDUCATION;

EID: 51649113734     PISSN: 10504729     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ROBOT.2008.4543799     Document Type: Conference Paper

References (21)

1. T. Flash, "The Control of Hand Equilibrium Trajectories in Multi-Joint Arm Movement," Biol. Cybern. vol. 57, pp. 257-274, 1987.
2. S. Park and T. B. Sheridan, "Enhanced Human-Machine Interface in Braking," IEEE Trans. Sys. Man, and Cyber., - Part A: Sys., and Humans, vol. 34, no. 5, pp. 615-629, 2004.
3. N. Hogan, "Impedance control: An approach to manipulation: Part I. Theory, Part II. Implementaion, Part III. Application," ASME J. Dynamic Syst. Measurement Control, vol. 107, pp. 12-24, 1985.
4. M. Cohen and T. Flash, "Learning Impedance Parameters for Robot control using Associative Search Network," IEEE Trans. Robot. Automat., vol. 7, no. 3, pp. 382-390, 1991.
5. J. Izawa, T. Kondo, and K. Ito, "Biological Robot Arm Motion through Reinforcement Learning," In Proc. of IEEE Int . Conf. on Robotics and Automat., vol. 4, pp. 3398-3403, 2002.
6. S. Jung, S. B. Yim and T. C. Hsia, "Experimental Studies of Neural Network Impedance Force Control of Robot Manipulator," In Proc. of IEEE Int . Conf. on Robotics and Automat., pp. 3453-3458, 2001.
7. T. Tsuji, M. Terauchi, and Y. Tanaka, "Online Learning of Virtual Impedance Parameters in Non-Contact Impedance Control Using Neural Networks," IEEE Trans. Sys. Man, and Cyber., - Part B: Cyber., vol. 34, no. 5, pp. 2112-2118, 2004.
8. R. S. Sutton and A. G. Barto, Reinforcement learning: An Introduction, MIT Press, 1998.
9. R. J. Williams, "Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning," Machine Learning, vol. 8, pp. 229-256. 1992.
10. J. Peters and S. Schaal, "Policy Gradient Methods for Robotics," In Proc. of IEEE/RSJ Int. Conf. on Intel. Robots and Systems, pp. , 2006.
11. th Int. Conf. on Machine Learning, pp. 154-161, 2003.
12. J. Peters, S. Vijayakumar, and Schaal, "Natural Actor-Critic," In Proc. of the 16th Euro. Conf. on Machine Learning, vol. 3720, pp.280-291, 2005.
13. J. Park, J. Kim, and D. Kang, "An RLS-Based Natural Actor-Critic Algorithm for Locomotion of a Two-Linked Robot Arm," In Proc. of Int. Conf. CIS, Part I, LNAI, vol. 3801, pp. 65-72, 2005.
14. H. Asada and J-J. E. Slotine, Robot Analysis and Control, John Wiley & Sons, Inc., 1986.
15. J. Won, "The Control of Constrained and Partially Constrained Arm Movement," S. M. Thesis, Dep. Of Mechanical Engineering, MIT, Cambridge, MA, 1993.
16. H. Kazeroni, P. K. Houpt, and T. B. Sheridan, "The Fundamental Concepts of Robust Compliant Motion for Robot Manipulators," In Proc. of IEEE Int. Conf. on Intel. Robotics and Automat., vol. 1, pp. 418-427, 1986.
17. T. Flash and N. Hogan, "The Coordination of Arm Movements: An Experimentally Confirmed Mathematical Model," J.of Neurosci., vol. 5, n. 7, pp. 1688-1703, 1985.
18. S. Amari, "Natural Gradient Works Efficiently in Learning," Neural Computation, vol. 10, 1998.
19. T. K. Moon and W. C. Stirling, Mathematical Methods and Algorithm for Signal Processing, Prentice Hall, Upper Saddle River, NJ, 2000.
20. B. Kang, B. Kim, S. Park, and H. Kim, "Modeling of Artificial Neural Network for the Prediction of the Multi-Joint Stiffness in Dynamic Condition," In Proc. of IEEE/RSJ Int. Conf. on Intel. Robots and Systems, pp. 1840-1845, 2007.
21. D. W. Franklin, U. So, M. Kawato, and T. E. Milner, "Impedance Control Balances Stability With Metabolically Costly Muscle Activation," J. of Neurophysiol., vol 92, pp. 3097-3105, 2004.