A Practical Comparison of Three Robot Learning from Demonstration Algorithm

International Journal of Social Robotics

Volumn 4, Issue 4, 2012, Pages 319-330

  Suay, Halit Bener ^a   Toris, Russell ^a   Chernova, Sonia ^a  

^a WORCESTER POLYTECHNIC INSTITUTE   (United States)

Author keywords

Human robot interaction; Learning from demonstration; Robotics

Indexed keywords

ANTHROPOMORPHIC ROBOTS; BEHAVIORAL RESEARCH; DEMONSTRATIONS; HUMAN COMPUTER INTERACTION; HUMAN ROBOT INTERACTION; REINFORCEMENT LEARNING; ROBOT LEARNING; ROBOTICS;

BEHAVIOR NETWORK; BROAD SPECTRUM; INTERACTIVE REINFORCEMENT LEARNING; LEARNING FROM DEMONSTRATION; POLICY LEARNING; REAL WORLD DOMAIN; ROBOT LEARNING FROM DEMONSTRATIONS; SMALL HUMANOID ROBOTS;

LEARNING ALGORITHMS;

EID: 84868024755     PISSN: 18754791     EISSN: 18754805     Source Type: Journal    
DOI: 10.1007/s12369-012-0158-7     Document Type: Article

References (30)

1. Abbeel P, Ng AY (2004) Apprenticeship learning via inverse reinforcement learning. In: Proceedings of the 21st international conference on machine learning (ICML '04), Baniff, Canada.
2. Akgun B, Cakmak M, Yoo JW, Thomaz AL (2012) Trajectories and keyframes for kinesthetic teaching: a human-robot interaction perspective. In: Proceedings of the international conference on human-robot interaction (HRI).
3. Aleotti J, Caselli S (2005) Trajectory clustering and stochastic approximation for robot programming by demonstration. In: 2005 IEEE/RSJ international conference on intelligent robots and systems (IROS 2005).
4. Argall BD, Chernova S, Veloso M, Browning B (2009) A survey of robot learning from demonstration. Robot Auton Syst 57: 469-483.
5. Atkeson CG, Schaal S (1997) Robot learning from demonstration. In: Fisher DH Jr (ed) Machine learning: proceedings of the fourteenth international conference (ICML '97), San Francisco, CA, pp 12-20.
6. Bentivegna DC, Ude A, Atkeson CG, Cheng G (2002) Humanoid robot learning and game playing using PC-based vision. In: Proceedings of the IEEE/RSJ international conference on intelligent robots and systems (IROS '02), Swiss Federal Institute of Technology Lausanne (EPFL), Switzerland, October.
7. Billing E, Hellström T (2010) A formalism for learning from demonstration. Paladyn J Behav Robot 1: 1-13. doi: 10. 2478/s13230-010-0001-5.
8. Bradski G, Kaehler A (2008) Learning OpenCV. O'Reilly Media.
9. Cakmak M, Chao C, Thomaz AL (2010) Designing interactions for robot active learners. IEEE Trans Auton Ment Dev 2(2): 108-118.
10. Calinon S, Billard A (2007) Incremental learning of gestures by imitation in a humanoid robot. In: Second annual conference on human-robot interactions (HRI '07), Arlington, VA, March.
11. Chella A, Dindo H, Infantino I (2006) A cognitive framework for imitation learning. Robot Auton Syst (Special issue on the social mechanisms of robot programming by demonstration) 54(5): 403-408.
12. Chernova S, Veloso M (2007) Confidence-based learning from demonstration using Gaussian mixture models. In: Proceedings of the international conference on autonomous agents and multiagent systems (AMMAS '07).
13. Chernova S, Veloso M (2009) Interactive policy learning through confidence-based autonomy. J Artificial Intelligence Research 1-25.
14. Grollman DH, Jenkins OC (2007) Dogged learning for robots. In: International conference on robotics and automation, Rome, Italy, April, pp 2483-2488.
15. Ijspeert AJ, Nakanishi J, Schaal S (2002) Movement imitation with nonlinear dynamical systems in humanoid robots. In: Proceedings of the IEEE international conference on robotics and automation (ICRA '02) (Received the ICRA '02 best paper award).
16. Kim ES, Leyzberg D, Tsui KM, Scassellati B (2009) How people talk when teaching a robot. In: Proceedings of the international conference on human robot interaction (HRI '09).
17. Bradley Knox W, Stone P (2010) Combining manual feedback with subsequent mdp reward signals for reinforcement learning. In: Proceedings of the international conference on autonomous agents and multiagent systems.
18. Mataric MJ (2002) Sensory-motor primitives as a basis for learning by imitation: linking perception to action and biology to robotics. In: Dautenhahn K, Nehaniv C (eds) Imitation in animals and artifacts. MIT Press, Cambridge, pp 392-422.
19. Nehmzow U, Akanyeti O, Weinrich C, Kyriacou T, Billings SA (2007) Robot programming by demonstration through system identification. In: IEEE/RSJ international conference on intelligent robots and systems (IROS 2007).
20. Nicolescu MN, Mataric MJ (2001) Learning and interacting in human-robot domains. IEEE Trans Syst Man Cybern, Part A, Syst Hum 31(5): 419-430.
21. Nicolescu MN, Matarić MJ (2002) A hierarchical architecture for behavior-based robots. In: Proceedings of the first international joint conference on autonomous agents and multiagent systems, Part 1 (AAMAS '02), New York, NY, USA. ACM, New York, pp 227-233.
22. Nicolescu MN, Mataric MJ (2003) Natural methods for robot task learning: instructive demonstrations, generalization and practice. In: Proceedings of the second international joint conference on autonomous agents and multiagent systems (AAMAS '03), New York, NY, USA. ACM, New York, pp 241-248.
23. Smart WD (2002) Making reinforcement learning work on real robots. PhD thesis, Department of Computer Science, Brown University, Providence, RI.
24. Suay HB, Chernova S (2011) A comparison of two algorithms for robot learning from demonstration. In: IEEE international conference on systems, man, and cybernetics.
25. Sutton RS, Barto AG (1998) Reinforcement learning: an introduction. MIT Press, Cambridge.
26. Thomaz AL, Breazeal C (2007) Asymmetric interpretations of positive and negative human feedback for a social learning agent. In: Proceedings of the 16th IEEE international symposium on robot and human interactive communication (RO-MAN).
27. Thomaz AL, Breazeal C (2008) Experiments in socially guided exploration: lessons learned in building robots that learn with and without human teachers. Connect Sci 20: 91-110.
28. Thomaz AL, Breazeal C (2006) Reinforcement learning with human teachers: evidence of feedback and guidance with implications for learning performance. In: Proceedings of the 21st national conference on artificial intelligence (AAAI).
29. van Lent M, Laird JE (2001) Learning procedural knowledge through observation. In: Proceedings of the 1st international conference on knowledge capture (K-CAP '01), New York, NY, USA. ACM, New York, pp 179-186.
30. Voyles RM, Khosla PK (2001) A multi-agent system for programming robots by human demonstration. Integr Comput-Aided Eng 8(1): 59-67.