Teacher feedback to scaffold and refine demonstrated motion primitives on a mobile robot

Robotics and Autonomous Systems

Volumn 59, Issue 3-4, 2011, Pages 243-255

  Argall, Brenna D ^a   Browning, Brett ^a   Veloso, Manuela M ^b  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b Carnegie Mellon University   (United States)

Author keywords

Demonstration learning; Policy reuse; Robot motion control; Teacher feedback

Indexed keywords

COMPLEX TASK; CONTROL DOMAINS; LEARNING APPROACH; MOTION PRIMITIVES; NOVEL TASK; POLICY DEVELOPMENT; POLICY REUSE; ROBOT MOTION CONTROL; SIMULATED ROBOT; TEACHER FEEDBACK;

ALGORITHMS; CONTROL THEORY; MOTION CONTROL; ROBOTS;

DEMONSTRATIONS;

EID: 79952041268     PISSN: 09218890     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.robot.2010.11.004     Document Type: Article

References (25)

1. B. Argall, S. Chernova, M. Veloso, and B. Browning A survey of robot learning from demonstration Robotics and Autonomous Systems 57 2009 469 483
2. A. Billard, S. Callinon, R. Dillmann, and S. Schaal Robot programming by demonstration B. Siciliano, O. Khatib, Handbook of Robotics 2008 Springer New York, NY, USA (Chapter 59)
3. C.L. Nehaniv, and K. Dautenhahn The correspondence problem K. Dautenhahn, C.L. Nehaniv, Imitation in Animals and Artifacts 2002 MIT Press Cambridge, MA, USA (Chapter 2)
4. A. Ng, A. Coates, M. Diel, V. Ganapathi, J. Schulte, B. Tse, E. Berger, E. Liang, Inverted autonomous helicopter flight via reinforcement learning, in: International Symposium on Experimental Robotics, Singapore, 2004.
5. P.K. Pook, D.H. Ballard, Recognizing teleoperated manipulations, in: Proceedings of the IEEE International Conference on Robotics and Automation, ICRA'93, Atlanta, Georgia, USA, 1993.
6. J.D. Sweeney, R.A. Grupen, A model of shared grasp affordances from demonstration, in: Proceedings of the IEEE-RAS International Conference on Humanoids Robots, Humanoids'07, Tokyo, Japan, 2007.
7. W.D. Smart, Making reinforcement learning work on real robots, Ph.D. Thesis, Department of Computer Science, Brown University, Providence, RI, 2002.
8. R. Aler, O. Garcia, and J.M. Valls Correcting and improving imitation models of humans for robosoccer agents Evolutionary Computation 3 25 2005 2402 2409 (Pubitemid 41496148)
9. R.S. Sutton, and A.G. Barto Reinforcement Learning: An Introduction 1998 The MIT Press Cambridge, MA, London, England
10. T. Hastie, R. Tibshirani, and J. Friedman The Elements of Statistical Learning: Data Mining, Inference, and Prediction 2001 Springer New York, NY, USA
11. P. Abbeel, A.Y. Ng, Exploration and apprenticeship learning in reinforcement learning, in: Proceedings of the 22nd International Conference on Machine Learning, ICML'05, 2005.
12. M. Stolle, C.G. Atkeson, Knowledge transfer using local features, in: Proceedings of IEEE International Symposium on Approximate Dynamic Programming and Reinforcement Learning, ADPRL'07, Honolulu, Hawaii, USA, 2007.
13. S. Chernova, M. Veloso, Multi-thresholded approach to demonstration selection for interactive robot learning, in: Proceedings of the 3rd ACM/IEEE International Conference on HumanRobot Interaction, HRI'08, Amsterdam, The Netherlands, 2008.
14. D.H. Grollman, O.C. Jenkins, Dogged learning for robots, in: Proceedings of the IEEE International Conference on Robotics and Automation, ICRA'07, Rome, Italy, 2007.
15. S. Calinon, A. Billard, Incremental learning of gestures by imitation in a humanoid robot, in: Proceedings of the 2nd ACM/IEEE International Conference on HumanRobot Interaction, HRI'07, Arlington, Virginia, USA, 2007.
16. B.D. Argall, Learning mobile robot motion control from demonstration and corrective feedback, Ph.D. Thesis, Robotics Institute, Carnegie Mellon University, Pittsburgh, PA, 2009.
17. S. Chernova, M. Veloso, Learning equivalent action choices from demonstration, in: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS'08, Nice, France, 2008.
18. M.N. Nicolescu, M.J. Mataric, Methods for robot task learning: demonstrations, generalization and practice, in: Proceedings of the Second International Joint Conference on Autonomous Agents and Multi-Agent Systems, AAMAS'03, Melbourne, Victoria, Australia, 2003.
19. D.C. Bentivegna, Learning from observation using primitives, Ph.D. Thesis, College of Computing, Georgia Institute of Technology, Atlanta, GA, July 2004.
20. J. Saunders, C.L. Nehaniv, K. Dautenhahn, Teaching robots by moulding behavior and scaffolding the environment, in: First Annual Conference on HumanRobot Interactions, HRI'06, Salt Lake City, Utah, USA, 2006.
21. B. Argall, B. Browning, M. Veloso, Learning mobile robot motion control from demonstrated primitives and human feedback, in: Proceedings of the 14th International Symposium on Robotics Research, ISRR'09, Luzern, Switzerland, 2009.
22. C.G. Atkeson, A.W. Moore, and S. Schaal Locally weighted learning for control Artificial Intelligence Review 11 1997 75 113 (Pubitemid 127508234)
23. H.G. Nguyen, J. Morrell, K. Mullens, A. Burmeister, S. Miles, K. Thomas, D.W. Gage, Segway robotic mobility platform, in: SPIE Mobile Robots XVII, Philadelphia, Pennsylvania, USA, 2004.
24. B. Argall, Y. Gu, B. Browning, M. Veloso, The first segway soccer experience: towards peer-to-peer humanrobot teams, in: First Annual Conference on HumanRobot Interactions, HRI'06, Salt Lake City, Utah, USA, 2006.
25. R. Simmons, D. Apfelbaum, A task description language for robot control, in: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS'98, Victoria, Canada, 1998.