Imitation learning in relational domains: A functional-gradient boosting approach

IJCAI International Joint Conference on Artificial Intelligence

Volumn , Issue , 2011, Pages 1414-1420

  Natarajan, Sriraam ^a   Joshi, Saket ^b   Tadepalli, Prasad ^b   Kersting, Kristian ^c   Shavlik, Jude ^d  

^a WAKE FOREST SCHOOL OF MEDICINE   (United States)

^b OREGON STATE UNIVERSITY   (United States)

^c FRAUNHOFER IAIS   (Germany)

^d UNIVERSITY OF WISCONSIN MADISON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BOOSTING APPROACH; DIFFERENT DOMAINS; FUNCTIONAL GRADIENT; HUMAN TEACHERS; IMITATION LEARNING; RELATIONAL REGRESSION TREE; RELATIONAL REPRESENTATIONS;

FORESTRY; GRADIENT METHODS;

ARTIFICIAL INTELLIGENCE;

FORESTRY; REGRESSION ANALYSIS; TREES;

EID: 84872856015     PISSN: 10450823     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.5591/978-1-57735-516-8/IJCAI11-239     Document Type: Conference Paper

References (36)

1. P. Abbeel and A. Ng. Apprenticeship learning via inverse reinforcement learning. In ICML, 2004.
2. B. Argall, S. Chernova, M. Veloso, and B. Browning. A survey of robot learning from demonstration. Robotics and Autonomous Systems, 57:469-483, 2009.
3. H. Blockeel. Top-down induction of first order logical decision trees. AI Commun., 12(1-2), 1999.
4. C. Boutilier. Symbolic dynamic programming for first-order mdps. In IJCAI, 2001.
5. S. Calinon. Robot Programming By Demonstration: A probabilistic approach. EPFL Press, 2009.
6. J. Davis and M. Goadrich. The relationship between precision-recall and ROC curves. In ICML, 2006.
7. T.G. Dietterich, A. Ashenfelter, and Y. Bulatov. Training conditional random fields via gradient tree boosting. In ICML, 2004.
8. R. Fikes and N. Nilsson. STRIPS: A new approach to the application of theorem proving to problem solving. Artificial Intelligence, 2:189-208, 1971.
9. Y. Freund and R. Schapire. Experiments with a new boosting algorithm. In ICML, 1996.
10. J.H. Friedman. Greedy function approximation: A gradient boosting machine. Annals of Statistics, 29, 2001.
11. L. Getoor and B. Taskar. Introduction to Statistical Relational Learning. MIT Press, 2007.
12. C. Gretton and S. Thibaux. Exploiting first-order regression in inductive policy selection. In UAI, 2004.
13. B. Gutmann and K. Kersting. Tilde-CRF: Conditional random fields for logical sequences. In ECML, 2006.
14. S. Joshi and R. Khardon. Stochastic planning with first order decision diagrams. In ICAPS, 2008.
15. A. Karwath, K. Kersting, and N. Landwehr. Boosting relational sequence alignments. In ICDM, 2008.
16. K. Kersting and K. Driessens. Non-parametric policy gradients: A unified treatment of propositional and relational domains. In ICML, 2008.
17. K. Kersting, M. Van Otterlo, and L. De Raedt. Bellman goes relational. In In ICML, 2004.
18. R. Khardon. Learning action strategies for planning domains. Artificial Intelligence, 113:125-148, 1999. (Pubitemid 30542740)
19. L. Li, V. Bulitko, and R. Greiner. Batch reinforcement learning with state importance. In ECML - Poster, 2004.
20. H. Lieberman. Programming by example (introduction). Communications of the ACM, 43:72-74, 2000.
21. S. Minton. Learning Search Control Knowledge: An Explanation-based Approach. Kluwer Publishers, 1988.
22. S. Natarajan, T. Khot, K. Kersting, B. Guttmann, and J. Shavlik. Gradient-based boosting for Statistical Relational Learning: The Relational Dependency Network Case. MLJ, 2011.
23. G. Neu and C. Szepesvari. Apprenticeship learning using inverse reinforcement learning and gradient methods. In Proceedings of UAI, pages 295-302, 2007.
24. A. Ng and S. Russell. Algorithms for inverse reinforcement learning. In ICML, 2000.
25. N. Ratliff, A. Bagnell, and M. Zinkevich. Maximum margin planning. In ICML, 2006.
26. N. Ratliff, D. Silver, and A. Bagnell. Learning to search: Functional gradient techniques for imitation learning. Autonomous Robots, pages 25-53, 2009.
27. C. Sammut, S. Hurst, D. Kedzier, and D. Michie. Learning to fly. In ICML, 1992.
28. A. Segre and G. DeJong. Explanation-based manipulator learning: Acquisition of planning ability through observation. In Conf on Robotics and Automation, 1985.
29. J. Shavlik and G. DeJong. BAGGER: An EBL system that extends and generalizes explanations. In AAAI, 1987.
30. A. Srinivasan. The Aleph Manual, 2004.
31. P. Stone and R. Sutton. Scaling reinforcement learning toward RoboCup soccer. In ICML, 2001.
32. R. Sutton, D. McAllester, S. Singh, and Y. Mansour. Policy gradient methods for reinforcement learning with function approximation. In NIPS, 2000.
33. U. Syed and R. Schapire. A gametheoretic approach to apprenticeship learning. In NIPS, 2007.
34. L. Torrey, J. Shavlik, T. Walker, and R. Maclin. Relational macros for transfer in reinforcement learning. In ILP, 2007.
35. S. Yoon, A. Fern, and R. Givan. Inductive policy selection for first-order mdps. In UAI, 2002.
36. H. Younes, M. Littman, D. Weissman, and J. Asmuth. The first probabilistic track of the international planning competition. JAIR, 24:851-887, 2005. (Pubitemid 43130951)