Algorithmic and Human Teaching of Sequential Decision Tasks

Proceedings of the 26th AAAI Conference on Artificial Intelligence, AAAI 2012

Volumn , Issue , 2012, Pages 1536-1542

  Cakmak, Maya ^a   Lopes, Manuel ^b  

^a GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

^b INRIA   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE;

ALGORITHMICS; CLASSIFICATION TASKS; DECISION TASK; LEARNING AGENTS; LEARNING RATES; NAVIGATION TASKS; NOVEL METHODS; SEQUENTIAL DECISIONS; TEACHERS'; TEACHING ALGORITHMS;

TEACHING;

EID: 84959210949     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (30)

1. Abbeel, P., and Ng, A. Y. 2004. Apprenticeship learning via inverse reinforcement learning. In Proceedings of the 21st International Conference on Machine Learning (ICML'04), 1-8.
2. Angluin, D. 1988. Queries and concept learning. Machine Learning 2:319-342.
3. Anthony, M.; Brightwell, G.; and Shawe-Taylor, J. 1995. On specifying boolean functions by labelled examples. Discrete Applied Mathematics 61(1):1-25.
4. Argall, B.; Chernova, S.; Browning, B.; and Veloso, M. 2009. A survey of robot learning from demonstration. Robotics and Autonomous Systems 57(5):469-483.
5. Balbach, F. J., and Zeugmann, T. 2009. Recent developments in algorithmic teaching. In 3rd International Conference on Language and Automata Theory and Applications, LATA'09, 1-18.
6. Balbach, F. 2008. Measuring teachability using variants of the teaching dimension. Theoretical Computer Science 397(1-3):94-113.
7. Bengio, Y.; Louradour, J.; Collobert, R.; and Weston, J. 2009. Curriculum learning. In Proceedings of the 26th annual international conference on machine learning, 41-48.
8. Cakmak, M., and Thomaz, A. 2010. Optimality of human teachers for robot learners. In Proceedings of the IEEE International Conference on Development and Learning (ICDL).
9. Chernova, S., and Veloso, M. 2007. Confidence-based policy learning from demonstration using gaussian mixture models. In Proc. of Autonomous Agents and Multi-Agent Systems (AAMAS).
10. Cohn, R.; Durfee, E.; and Singh, S. 2011. Comparing action-query strategies in semi-autonomous agents. In The 10th International Conference on Autonomous Agents and Multiagent Systems-Volume 3, 1287-1288.
11. Elman, J. L. 1993. Learning and development in neural networks: The importance of starting small. Cognition 48(1):71-9.
12. Fürnkranz, J., and Hüllermeier, E. 2010. Preference learning: An introduction. Preference Learning 1.
13. Goldman, S., and Kearns, M. 1995. On the complexity of teaching. Computer and System Sciences 50(1):20-31.
14. Grollman, D., and Jenkins, O. 2007. Dogged learning for robots. In IEEE Intl. Conf. on Robotics and Automation (ICRA).
15. Khan, F.; Zhu, X.; and Mutlu, B. 2011. How do humans teach: On curriculum learning and teaching dimension. In Advances in Neural Information Processing Systems (NIPS).
16. Krause, A., and Guestrin, C. 2005a. Near-optimal nonmyopic value of information in graphical models. In Uncertainty in AI.
17. Krause, A., and Guestrin, C. 2005b. A note on the budgeted maximization of submodular functions.
18. Lopes, M.; Melo, F. S.; and Montesano, L. 2009. Active learning for reward estimation in inverse reinforcement learning. In Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases: Part II, ECML PKDD'09, 31-46.
19. Natarajan, B. K. 1987. On learning boolean functions. In 19th Annual ACM symposium on Theory of computing, STOC'87, 296-304.
20. Nemhauser, G.; Wolsey, L.; and Fisher, M. 1978. An analysis of approximations for maximizing submodular set functions. Mathematical Programming 14(1):265-294.
21. Neu, G., and Szepesvári, C. 2007. Apprenticeship learning using inverse reinforcement learning and gradient methods. In Uncertainty in Artificial Intelligence (UAI), 295-302.
22. Neu, G., and Szepesvári, C. 2009. Training parsers by inverse reinforcement learning. Machine learning 77(2):303-337.
23. Ng, A. Y., and Russell, S. J. 2000. Algorithms for inverse reinforcement learning. In Proc. 17th Int. Conf. Machine Learning.
24. Settles, B. 2010. Active learning literature survey. Computer Sciences Technical Report 1648, University of Wisconsin-Madison.
25. Shafto, P., and Goodman, N. 2008. Teaching games: Statistical sampling assumptions for learning in pedagogical situations. In Proceedings of the 30th Annual Conference of the Cognitive Science Society, 1-6.
26. Sutton, R., and Barto, A. 1998. Reinforcement Learning: An Introduction. Cambridge, MA, USA: MIT Press.
27. Taylor, M. E. 2009. Assisting transfer-enabled machine learning algorithms: Leveraging human knowledge for curriculum design. In Proc. AAAI Spring Symposium on Agents that Learn from Human Teachers.
28. Viappiani, P., and Boutilier, C. 2010. Optimal bayesian recommendation sets and myopically optimal choice query sets. Advances in Neural Information Processing Systems 23:2352-2360.
29. Warner, R.; Stoess, T.; and Shafto, P. 2011. Reasoning in teaching and misleading situations. In Proceedings of the 33rd Annual Conference of the Cognitive Science Society, 1430-1435.
30. Zang, P.; Irani, A.; Zhou, P.; Isbell, C.; and Thomaz, A. 2010. Using training regimens to teach expanding function approximators. In Proc. of Autonomous Agents and Multi-Agent Systems (AAMAS).