A Q-learning based Cartesian model reference compliance controller implementation for a humanoid robot arm

IEEE Conference on Robotics, Automation and Mechatronics, RAM - Proceedings

Volumn , Issue , 2011, Pages 214-219

  Khan, Said G ^a   Herrmann, Guido ^a   Lewis, Frank ^a   Pipe, Tony ^a   Melhuish, Chris ^a  

^a NONE

Author keywords

[No Author keywords available]

Indexed keywords

CARTESIAN MODEL; CARTESIANS; CONTROLLER IMPLEMENTATION; DISCRETE MODELS; HUMANOID ROBOT ARM; MODEL FREE; MODEL REFERENCE; OPTIMAL POLICIES; Q-LEARNING; REAL TIME; TRACKING CONTROLLER; TWO-LINK;

ANTHROPOMORPHIC ROBOTS; COMPUTER SIMULATION; CONTROLLERS; REINFORCEMENT LEARNING; ROBOTICS;

ROBOTIC ARMS;

EID: 82955228032     PISSN: 2158219X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/RAMECH.2011.6070484     Document Type: Conference Paper

References (30)

1. P. Werbos, "Using ADP to understand and replicate brain intelligence: The next level design," in Neurodynamics of Cognition and Consciousness, ser. Understanding Complex Systems, L. Perlovsky and R. Kozma, Eds. Springer Berlin / Heidelberg, 2007, vol. 25, pp. 109-123.
2. P. J. Werbos, "Intelligence in the brain: A theory of how it works and how to build it," Neural Networks, vol. 22, no. 3, pp. 200-212, 2009, goal-Directed Neural Systems.
3. S. Komada and K. Ohnishi, "Robust force and compliance control of robotics manipulators," in Proceedings of the International Conference on Industrial Electronics, Hyatt Regency, Singapore, October 1988.
4. Z. Peng and N. Adachi, "Compliant motion control of kinematically redundant manipulators," IEEE Transactions on Robotics and Automation, vol. 9, pp. 831-837, Febuarary 1993.
5. B. Shetty and M. Ang, "Active compliance control of a puma 560 robot," in Proceedings of the IEEE International Conference on of Robotics and Automation, Minneapolis, Minnesota, Canada, 1996.
6. M. Al-Jarrah and Y. Zheng, "Intelligent compliant motion control,"IEEE Transaction on System, Man, and Cybernetics-Part B Cybernetics, vol. 28, pp. 116-122, Febuarary 1998.
7. C. Albrichsfeld and H. Tolle, "A self-adjusting active compliance controller for multiple robots handling an object," Control Engineering Practice, vol. 10, pp. 165-173, February 2002. (Pubitemid 34143788)
8. L. Zollo, S. B., C. Laschi, G. Teti, and P. Dario, "An experimental study on compliance control for a redundant personal robot arm,"Robotics and Autonomous Systems, vol. 44, pp. 101-129, 2003.
9. A. Bichi and G. Tonietti, "Design, realization and control of soft robot arms for intrinsically safe interaction with humans," in Proc. IARP/RAS Workshop on Technical Challenges for Dependable Robots in Human Environments, October 2002, pp. 79-87.
10. W. Zhang, Q. Huang, P. Du, J. Li, and K. Li, "Compliance control of a humanoid arm based on forced feedback," in Proceedings of the 2005 IEEE International Conference on Information Acquisition, Hong Kong and Macau, China, July 2005.
11. A. Albu-Scha{combining double acute accent}ffer, Haddadin, C. Ott, T. Stemmer, G. Wimbck, and Hirzinger, "The dlr lightweight robot: design and control concepts for robots in human environments," Control Engineering Practice, vol. 34, pp. 376-385, 2007.
12. C. Ott, A. Albu-Scha{combining double acute accent}ffer, A. Kugi, and G. Hirzinger, "Decoupling based cartesian impedance control of flexible joint robots," in Proceedings of the IEEE International Conference on Robotics and Automation, Taipei, Taiwan, 2003.
13. C. Albrichsfeld, M. Svinin, and H. Tolle, "Learning approach to the active compliance control of multi-arm robots coupled through a flexible object," in Proc. of 3rd European Control Conference, 1995.
14. D. Formica, L. Zollo, and Gulielmelli, "Torque-dependent compliance control in the joint space of an operational robotic machine for motor therapy," in Proceedings of the 2005 IEEE 9th International Conference on Rehabilitation Robotics, Chicago, IL, USA, June 2005, pp. 341-344.
15. M. Abu-Khalaf and F. L. Lewis, "Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network hjb approach," Automatica, vol. 41, no. 5, pp. 779-791, 2005. (Pubitemid 40352391)
16. ∞ Constrained Feedback Control: A Practical Approach Using Neural Networks. UK: Springer Verlag, 2006.
17. S. Khan, G. Herrmann, F. Lewis, T. Pipe, and C. Melhuish, "A novel q-learning based adaptive optimal controller implementation for a humanoid robotic arm," in Accepted at IFAC 2011 World Congress, Milan,Italy, August 2011.
18. P. Stingu and F. Lewis, "Adaptive dynamic programming applied to a 6dof quadrotor," in Computational Modeling and Simulation of Intellect: Current State and Future Perspectives, B. Igelnik, Ed. IGI Global, 2010.
19. F. L. Lewis and D. Vrabie, "Reinforcement learning and adaptive dynamic programming for feedback control," Cir. and Sys. Mag., vol. 09, no. 3, pp. 32-50, 2009.
20. J. Sarangapani, Neural Network Control of Nonlinear Discrete-Time Systems. USA: Taylor & Francis, 2006.
21. ∞ control," Automatica, vol. 43, no. 3, pp. 47-481, 2007.
22. C.-P. Kuan and K.-Y. Young, "Reinforcement learning and robust control for robot compliance tasks," J. Intell. Robotics Syst., vol. 23, pp. 165-182, October 1998. (Pubitemid 128512208)
23. B. Kim, J. Park, S. Park, and S. Kang, "Impedance learning for robotic contact task using natural actor-critic algorithm," IEEE Transaction on System, Man and Cybernetics, part B: Cybernetics, vol. 4, no. 2, 2010.
24. J. Buchli, E. Theodorou, F. Stulp, and S. Schaal, "variable impedance control - a reinforcement learning approach," in robotics science and systems, 2010.
25. R. Doe. (2011, Feb.) Vicon tracker @ONLINE. [Online]. Available: http://www.vicon.com/products/ViconTracker.html
26. F. Lewis, D. Dawson, and C. Abdallah, Robot Manipulator Control: Theory and Practice. New York, USA: Marcel Dekker Inc., 2003.
27. S. Khan, G. Herrmann, T. Pipe, C. Melhuish, and A. Spiers, "Safe adaptive compliance control of a humanoid robotic arm with antiwindup compensation and posture control," International Journal of Social Robotics, vol. 2, pp. 305-319, 2010.
28. S. Khan, G. Herrmann, T. Pipe, and C. Melhuish, "Adaptive multi-dimensional compliance control of a humanoid robotic arm with antiwindup compensation," in Intelligent Robots and Systems (IROS), 2010 IEEE/RSJ International Conference on, 2010, pp. 2218 -2223.
29. R. Colbaugh, K. Glass, and K. Wedeward, "Adaptive compliance control of electrically-driven manipulators," in Proceedings of the 35th Conference on Decision and Control, Kobe,Japan, December 1996, pp. 394-399.
30. R. Colbaugh, H. Seraji, and K. Glass, "Adaptive compliant motion control for dextrous manipulators," The International Journal of Robotic Research, vol. 14, no. 3, pp. 270-280, 1995.