Efficient Model Learning from Joint-Action Demonstrations for Human-Robot Collaborative Tasks

ACM/IEEE International Conference on Human-Robot Interaction

Volumn 2015-March, Issue , 2015, Pages 189-196

  Nikolaidis, Stefanos ^a   Ramakrishnan, Ramya ^a   Gu, Keren ^a   Shah, Julie ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

human robot collaboration; mixed observability markov decision process; model learning

Indexed keywords

AGRICULTURAL ROBOTS; EDUCATIONAL ROBOTS; LEARNING SYSTEMS; MAN MACHINE SYSTEMS; MARKOV PROCESSES; OBSERVABILITY; REINFORCEMENT LEARNING; SOCIAL ROBOTS;

COLLABORATIVE TASKS; HUMAN SUBJECT EXPERIMENTS; HUMAN-ROBOT COLLABORATION; INVERSE REINFORCEMENT LEARNING; MARKOV DECISION PROCESSES; MIXED OBSERVABILITIES; MODEL LEARNING; OBSERVABLE VARIABLES;

LEARNING ALGORITHMS;

EID: 84943534743     PISSN: None     EISSN: 21672148     Source Type: Conference Proceeding    
DOI: 10.1145/2696454.2696455     Document Type: Conference Paper

References (30)

1. P. Abbeel and A. Y. Ng. Apprenticeship learning via inverse reinforcement learning. In Proc. ICML, 2004.
2. B. Akgun, M. Cakmak, J. W. Yoo, and A. L. Thomaz. Trajectories and keyframes for kinesthetic teaching: a human-robot interaction perspective. In HRI, 2012.
3. B. D. Argall, S. Chernova, M. Veloso, and B. Browning. A survey of robot learning from demonstration. Robot. Auton. Syst., May 2009.
4. C. G. Atkeson and S. Schaal. Robot learning from demonstration. In ICML, pages 12-20, 1997.
5. T. Bandyopadhyay, K. S. Won, E. Frazzoli, D. Hsu, W. S. Lee, and D. Rus. Intention-Aware motion planning. In WAFR. Springer, 2013.
6. S. Boyd, L. El Ghaoui, E. Feron, and V. Balakrishnan. Linear Matrix Inequalities in System and Control Theory. Stud. Appl. Math. SIAM, June 1994.
7. F. Broz, I. Nourbakhsh, and R. Simmons. Designing pomdp models of socially situated tasks. In RO-MAN, 2011.
8. S. Chernova and M. Veloso. Teaching multi-robot coordination using demonstration of communication and state sharing. In Proc. AAMAS, 2008.
9. F. Doshi and N. Roy. Efficient model learning for dialog management. In Proc. HRI, March 2007.
10. A. Dragan, R. Holladay, and S. Srinivasa. An analysis of deceptive robot motion. In RSS, 2014.
11. M. C. Gombolay, R. A. Gutierrez, G. F. Sturla, and J. A. Shah. Decision-making authority, team e-ciency and human worker satisfaction in mixed human-robot teams. In RSS, 2014.
12. G. Homan and C. Breazeal. Effects of anticipatory action on human-robot teamwork e-ciency, uency, and perception of team. In Proc. HRI, 2007.
13. V. Jääskinen, V. Parkkinen, L. Cheng, and J. Corander. Bayesian clustering of dna sequences using markov chains and a stochastic partition model. Stat. Appl. Genet. Mol., 2013.
14. L. P. Kaelbling, M. L. Littman, and A. R. Cassandra. Planning and acting in partially observable stochastic domains. Artificial Intelligence, 1998.
15. B. Kim and J. Pineau. Maximum mean discrepancy imitation learning. In Proceedings of RSS, 2013.
16. H. Kurniawati, D. Hsu, and W. S. Lee. Sarsop: Efficient point-based pomdp planning by approximating optimally reachable belief spaces. In Robotics: Science and Systems, pages 65-72, 2008.
17. O. Macindoe, L. P. Kaelbling, and T. Lozano-Perez. Pomcop: Belief space planning for sidekicks in cooperative games. In AIIDE, 2012.
18. J. I. Marden. Analyzing and modeling rank data. CRC Press, 1995.
19. T. B. Murphy and D. Martin. Mixtures of distance-based models for ranking data. Computational statistics & data analysis, 2003.
20. T.-H. D. Nguyen, D. Hsu, W. S. Lee, T.-Y. Leong, L. P. Kaelbling, T. Lozano-Perez, and A. H. Grant. Capir: Collaborative action planning with intention recognition. In AIIDE, 2011.
21. M. N. Nicolescu and M. J. Mataric. Natural methods for robot task learning: Instructive demonstrations, generalization and practice. In Proc. AAMAS, 2003.
22. S. Nikolaidis and J. Shah. Human-robot cross-training: computational formulation, modeling and evaluation of a human team training strategy. In Proc. HRI, 2013.
23. S. C. Ong, Y. Grinberg, and J. Pineau. Mixed observability predictive state representations. In AAAI, 2013.
24. S. C. Ong, S. W. Png, D. Hsu, and W. S. Lee. Planning under uncertainty for robotic tasks with mixed observability. IJRR, 29(8):1053-1068, 2010.
25. Phasespace, http://www.phasespace.com, 2012.
26. J. Pineau, G. Gordon, S. Thrun, et al. Point-based value iteration: An anytime algorithm for pomdps. In IJCAI, volume 3, pages 1025-1032, 2003.
27. G. Shani, J. Pineau, and R. Kaplow. A survey of point-based pomdp solvers. In Proc. AAMAS, 2013.
28. U. Syed and R. E. Schapire. A game-theoretic approach to apprenticeship learning. In Proc. NIPS, 2007.
29. R. Tibshirani, G. Walther, and T. Hastie. Estimating the number of clusters in a data set via the gap statistic. J. Roy. Statist. Soc. Ser. B, 2003.
30. K. Waugh, B. D. Ziebart, and J. A. D. Bagnell. Computational rationalization: The inverse equilibrium problem. In Proc. ICML, June 2011.