Confidence-based policy learning from demonstration using Gaussian mixture models

Proceedings of the International Conference on Autonomous Agents

Volumn , Issue , 2007, Pages 1315-1322

  Chernova, Sonia ^a   Veloso, Manuela ^a  

^a Carnegie Mellon University   (United States)

Author keywords

Imitation; Learning from demonstration; Robotics

Indexed keywords

GAUSSIAN COMPONENTS; GAUSSIAN MIXTURE MODELS; GAUSSIAN MIXTURES; IMITATION; LEARNING FROM DEMONSTRATION; REAL ROBOTS; STATE SPACES; STATISTICAL ANALYSIS; TRAINING DATUM; TRAINING TIME;

AGENTS; AUTONOMOUS AGENTS; BIPED LOCOMOTION; COMMUNICATION CHANNELS (INFORMATION THEORY); FUZZY CLUSTERING; MIXTURES; OBJECT RECOGNITION; ROBOTICS; ROBOTS; TRELLIS CODES; UNCERTAINTY ANALYSIS;

DEMONSTRATIONS;

EID: 60349110367     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1329125.1329407     Document Type: Conference Paper

References (25)

1. P. Abbeel and A. Y. Ng. Apprenticeship learning via inverse reinforcement learning. In International Conference on Machine learning, New York, NY, USA, 2004. ACM Press.
2. H. Akaike. A new look at the statistical model identification. IEEE Transaction on Automatic Control, 19:716-722, 1974.
3. C. G. Atkeson and S. Schaal. Robot learning from demonstration. In International Conference on Machine Learning, pages 12-20, San Francisco, CA, USA, 1997. Morgan Kaufmann Publishers Inc.
4. D. C. Bentivegna, C. G. Atkeson, and G. Cheng. Learning from observation and practice using primitives. AAAI Fall Symposium Series, 'Symposium on Real-life Reinforcement Learning', 2004.
5. D. C. Bentivegna, G. Cheng, and C. G. Atkeson. Learning from observation and from practice using behavioral primitives. 11th International Symposium of Robotics Research, 2003.
6. D. C. Bentivegna, A. Ude, C. G. Atkeson, and G. Cheng. Learning to act from observation and practice. International Journal of Humanoid Robotics, 1(4), 2004.
7. C. Breazeal, G. Hoffman, and A. Lockerd. Teaching and working with robots as a collaboration. In AAMAS '04: Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, pages 1030-1037, Washington, DC, USA, 2004. IEEE Computer Society.
8. A. Dempster, N.M.Laird, and D. Rubin. Maximum likelihood from incomplete data via the em algorithm. Journal of Royal Statistical Society, 8(1), 1977.
9. G. Hayes and J. Demiris. A robot controller using learning by imitation. In 2nd International Symposium on Intelligent Robotic Systems, 1994.
10. T. Inamura, M. Inaba, and H. Inoue. Acquisition of probabilistic behavior decision model based on the interactive teaching method. In Ninth International Conference on Advanced Robotics (ICAR), pages 523-528, 1999.
11. A. Lockerd and C. Breazeal. Tutelage and socially guided robot learning. In IEEE/RSJ International Conference on Intelligent Robots and Systems, 2004.
12. T. Mitchell. Machine Learning. McGraw Hill, 1997.
13. A. W. Moore and C. G. Atkeson. Prioritized sweeping: Reinforcement learning with less data and less time. Machine Learning, 13(1):103-130, 1993.
14. M. N. Nicolescu and M. J. Mataric. Learning and interacting in human-robot domains. In IEEE Transaction on Systems, Man and Cybernetics, pages 419-430, 2001.
15. M. N. Nicolescu and M. J. Mataric. Natural methods for robot task learning: instructive demonstrations, generalization and practice. In Second International Joint Conference on Autonomous Agents and Multiagent Systems, pages 241-248, New York, NY, USA, 2003. ACM Press.
16. J. Pearl. Probabilistic Reasoning in Intelligent Systems. Morgan Kaufmann.
17. R. Ros and J. L. Arcos. Acquiring a robust case base for the robot soccer domain. In International Joint Conferences on Artificial Intelligence, 2007.
18. J. Saunders, C. L. Nehaniv, and K. Dautenhahn. Teaching robots by moulding behavior and scaffolding the environment. In HRI '06: Proceeding of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction, pages 118-125, New York, NY, USA, 2006. ACM Press.
19. P. Scerri, D. Pynadath, and M. Tambe. Towards adjustable autonomy for the real world, 2003.
20. S. Schaal, A. Ijspeert, and A. Billard. Computational Approaches to Motor Learning by Imitation, pages 199-218. Number 1431. Oxford University Press, 2004.
21. M. Sierhuis, J. Bradshaw, A. Acquisti, R. Hoof, R. Jeffers, and A. Uszok. Human-agent teamwork and adjustable autonomy in practice, 2003.
22. W. D. Smart and L. P. Kaelbling. Effective reinforcement learning for mobile robots. In IEEE International Conference on Robotics and Automation, 2002.
23. A. L. Thomaz, G. Hoffman, and C. Breazeal. Reinforcement learning with human teachers: Understanding how people want to teach robots. In 15th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), 2006.
24. D. M. Titterington, A. Smith, and U. E. Makov. Statistical Analysis of Finite Mixture Distributions. Wiley, New York, NY, 1985.
25. M. van Lent and J. E. Laird. Learning procedural knowledge through observation. In K-CAP '01: Proceedings of the 1st international conference on Knowledge capture, pages 179-186, New York, NY, USA, 2001. ACM Press.