A novel method for learning policies from variable constraint data

Autonomous Robots

Volumn 27, Issue 2, 2009, Pages 105-121

  Howard, Matthew ^a   Klanke, Stefan ^a   Gienger, Michael ^b   Goerick, Christian ^b   Vijayakumar, Sethu ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

^b HONDA RESEARCH INSTITUTE EUROPE GMBH   (Germany)

Author keywords

Constrained motion; Direct policy learning; Imitation; Nullspace control

Indexed keywords

CONSTRAINED MOTION; CONTROL POLICY; DEGREES OF FREEDOM; DIRECT POLICY LEARNING; HUMAN SKILLS; HUMANOID ROBOT; IMITATION; KINEMATIC DATA; LEARNING POLICY; NOVEL METHODS; NULLSPACE CONTROL; UNOBSERVABLE;

ANTHROPOMORPHIC ROBOTS; RISK PERCEPTION;

EDUCATION;

EID: 70349330652     PISSN: 09295593     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10514-009-9129-8     Document Type: Article

References (50)

1. A. Alissandrakis C. Nehaniv K. Dautenhahn 2007 Correspondence mapping induced state and action metrics for robotic imitation IEEE Transactions on Systems, Man and Cybernetics 37 2 299 307 10.1109/TSMCB.2006.886947 (Pubitemid 46523220)
2. Antonelli, G., Arrichiello, F., & Chiaverini, S. (2005). The null-space-based behavioral control for soccer-playing mobile robots. In IEEE int. conf. advanced intelligent mechatronics, 2005.
3. Atkeson, C., & Schaal, S. (1997). Robot learning from demonstration. In Int. conf. machine learning, 1997.
4. Billard, A., Calinon, S., Dillmann, R., & Schaal, S. (2007). Robot programming by demonstration. In Handbook of robotics. Cambridge: MIT Press.
5. Bolder, B., Dunn, M., Gienger, M., Janssen, H., Sugiura, H., & Goerick, C. (2007). Visually guided whole body interaction. In IEEE int. conf. robotics and automation, 2007.
6. Calinon, S., & Billard, A. (2007). Learning of gestures by imitation in a humanoid robot. In Imitation and social learning in robots, humans & animals: behavioural, social & communicative dimensions, 2007.
7. Chalodhorn, R., Grimes, D. B., Maganis, G. Y., Rao, R. P., & Asada, M. (2006). Learning humanoid motion dynamics through sensory-motor mapping in reduced dimensional space. In IEEE int. conf. robotics and automation, 2006.
8. F. Chaumette A. Marchand 2001 A redundancy-based iterative approach for avoiding joint limits: application to visual servoing IEEE Transactions on Robotics and Automation 17 719 730 10.1109/70.964671 (Pubitemid 33137786)
9. S. Choi B. Kim 2000 Obstacle avoidance control for redundant manipulators using collidability measure Robotica 18 143 151 10.1017/S0263574799001861 (Pubitemid 30584190)
10. Conner, D., Rizzi, A., & Choset, H. (2003). Composition of local potential functions for global robot control and navigation. In IEEE int. conf. intelligent robots and systems, 2003.
11. D'Souza, A., Vijayakumar, S., & Schaal, S. (2001). Learning inverse kinematics. In IEEE int. conf. intelligent robots and systems, 2001.
12. Gienger, M., Janssen, H., & Goerick, C. (2005). Task-oriented whole body motion for humanoid robots. In IEEE int. conf. humanoid robots, 2005.
13. Grimes, D., Chalodhorn, R., & Rao, R. (2006). Dynamic imitation in a humanoid robot through nonparametric probabilistic inference. In Robotics: science and systems, 2006.
14. Grimes, D., Rashid, D., & Rao, R. (2007). Learning nonparametric models for probabilistic imitation. In: Adv. neural information processing systems, 2007.
15. F. Guenter M. Hersch S. Calinon A. Billard 2007 Reinforcement learning for imitating constrained reaching movements RSJ Advanced Robotics 21 1521 1544 Special Issue on Imitative Robots
16. Howard, M., & Vijayakumar, S. (2007). Reconstructing null-space policies subject to dynamic task constraints in redundant manipulators. In W.S. robotics and mathematics, 2007.
17. Howard, M., Klanke, S., Gienger, M., Goerick, C., & Vijayakumar, S. (2008). Learning potential-based policies from constrained motion. In: IEEE int. conf. on humanoid robots, 2008.
18. Ijspeert, A., Nakanishi, J., & Schaal, S. (2002). Movement imitation with nonlinear dynamical systems in humanoid robots. In IEEE int. conf. robotics and automation, 2002.
19. Ijspeert, A., Nakanishi, J., & Schaal, S. (2003). Learning attractor landscapes for learning motor primitives. In Adv. neural information processing systems, 2003.
20. T. Inamura I. Toshima H. Tanie Y. Nakamura 2004 Embodied symbol emergence based on mimesis theory International Journal of Robotics Research 23 363 377 10.1177/0278364904042199
21. Kajita, S., Kanehiro, F., Kaneko, K., Fujiwara, K., Harada, K., Yokoi, K., & Hirukawa, H. (2003). Resolved momentum control: humanoid motion planning based on the linear and angular momentum. In IEEE int. conf. intelligent robots and systems, 2003.
22. Khatib, O. (1985). Real-time obstacle avoidance for manipulators and mobile robots. In IEEE int. conf. robotics and automation, 1985.
23. O. Khatib 1987 A unified approach for motion and force control of robot manipulators: The operational space formulation IEEE Journal of Robotics and Automation RA-3 43 53 10.1109/JRA.1987.1087068
24. A. Liégeois 1977 Automatic supervisory control of the configuration and behavior of multibody mechanisms IEEE Transactions on Systems, Man and Cybernetics 7 868 871 0412.93005 10.1109/TSMC.1977.4309644
25. Martinez-Cantin, R., de Freitas, N., Castellanos, J. A., & Docet, A. (2009). A Bayesian exploration-exploitation approach for optimal online sensing and planning with a visually guided mobile robot. Autonomous Robots, 27 (this issue).
26. Mattikalli, R., & Khosla, P. (1992). Motion constraints from contact geometry: representation and analysis. In IEEE int. conf. robotics and automation, 1992.
27. Murray, R., Li, Z., & Sastry, S. (1994). A mathematical introduction to robotic manipulation. Boca Raton: CRC Press.
28. Mussa-Ivaldi, F. (1997). Nonlinear force fields: A distributed system of control primitives for representing and learning movements. In IEEE int. sympos. computational intelligence in robotics and automation, 1997.
29. J. Nakanishi J. Morimoto G. Endo G. Cheng S. Schaal M. Kawato 2004 Learning from demonstration and adaptation of biped locomotion Robotics and Autonomous Systems 47 79 91 10.1016/j.robot.2004.03.003
30. K. Ohta M. Svinin Z. Luo S. Hosoe R. Laboissiere 2004 Optimal trajectory formation of constrained human arm reaching movements Biological Cybernetics 91 23 36 1060.92012 10.1007/s00422-004-0491-5 (Pubitemid 40877308)
31. Park, J., & Khatib, O. (2006). Contact consistent control framework for humanoid robots. In IEEE int. conf. robotics and automation, 2006.
32. J. Peters S. Schaal 2008 Learning to control in operational space International Journal of Robotics Research 27 197 212 10.1177/0278364907087548 (Pubitemid 351169714)
33. J. Peters S. Schaal 2008 Natural actor-critic Neurocomputing 71 7-9 1180 1190 10.1016/j.neucom.2007.11.026
34. J. Peters M. Mistry F. Udwadia J. Nakanishi S. Schaal 2008 A unifying framework for robot control with redundant DOFs Autonomous Robots Journal 24 1 12 10.1007/s10514-007-9051-x (Pubitemid 350276040)
35. N. D. Ratliff D. Silver J. A. Bagnell 2009 Learning to search: Functional gradient techniques for imitation learning Autonomous Robots 27 1 25 53 10.1007/s10514-009-9121-3
36. M. Riedmiller T. Gabel R. Hafner S. Lange 2009 Reinforcement learning for robot soccer Autonomous Robots 27 1 55 73 10.1007/s10514-009-9120-4
37. V. D. Sapio J. Warren O. Khatib S. Delp 2005 Simulating the task-level control of human motion: A methodology and framework for implementation The Visual Computer 21 5 289 302 10.1007/s00371-005-0284-4 (Pubitemid 40920860)
38. V. D. Sapio O. Khatib S. Delp 2006 Task-level approaches for the control of constrained multibody systems Multibody System Dynamics 16 73 102 1126.70012 10.1007/s11044-006-9017-3 2250957 (Pubitemid 44127402)
39. S. Schaal C. Atkeson 1998 Constructive incremental learning from only local information Neural Computation 10 2047 2084 10.1162/089976698300016963
40. S. Schaal A. Ijspeert A. Billard 2003 Computational approaches to motor learning by imitation Actions of the Royal Society B: Biological Sciences 358 537 547 10.1098/rstb.2002.1258 (Pubitemid 36380533)
41. Sentis, L., & Khatib, O. (2004). Task-oriented control of humanoid robots through prioritization. In IEEE int. conf. on humanoid robots, 2004.
42. L. Sentis O. Khatib 2005 Synthesis of whole-body behaviors through hierarchical control of behavioral primitives International Journal of Humanoid Robotics 2 505 518 10.1142/S0219843605000594
43. Sentis, L., & Khatib, O. (2006). A whole-body control framework for humanoids operating in human environments. In IEEE int. conf. robotics and automation, 2006.
44. Stolle, M., & Atkeson, C. (2009). Finding and transferring policies using stored behaviors. Autonomous Robots, 27 (this issue).
45. Sugiura, H., Gienger, M., Janssen, H., & Goerick, C. (2007). Real-time collision avoidance with whole body motion control for humanoid robots. In IEEE int. conf. intelligent robots and systems, 2007.
46. Svinin, M., Odashima, T., Ohno, S., Luo, Z., & Hosoe, S. (2005). An analysis of reaching movements in manipulation of constrained dynamic objects. In IEEE int. conf. intelligent robots and systems, 2005.
47. Takano, W., Yamane, K., Sugihara, T., Yamamoto, K., & Nakamura, Y. (2006). Primitive communication based on motion recognition and generation with hierarchical mimesis model. In IEEE int. conf. robotics and automation, 2006.
48. Udwadia, F., & Kalaba, R. (1996). Analytical dynamics: a new approach. Cambridge: Cambridge University Press.
49. Vlassis, N., Toussaint, M., Kontes, G., & Piperidis, S. (2009). Learning model-free robot control using a Monte Carlo em algorithm. Autonomous Robots, 27 (this issue).
50. T. Yoshikawa 1985 Manipulability of robotic mechanisms International Journal of Robotics Research 4 3 9