Preference elicitation and inverse reinforcement learning

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 6913 LNAI, Issue PART 3, 2011, Pages 34-48

  Rothkopf, Constantin A ^a   Dimitrakakis, Christos ^a  

^a EPFL   (Switzerland)

Author keywords

Bayesian inference; decision theory; Inverse reinforcement learning; preference elicitation

Indexed keywords

BAYESIAN INFERENCE; INVERSE REINFORCEMENT LEARNING; POSTERIOR DISTRIBUTIONS; PREFERENCE ELICITATION; STATISTICAL FORMULATION;

BAYESIAN NETWORKS; DECISION THEORY; INFERENCE ENGINES; REINFORCEMENT LEARNING;

INVERSE PROBLEMS;

EID: 80052420104     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-23808-6_3     Document Type: Conference Paper

References (22)

1. Abbeel, P., Ng, A.Y.: Apprenticeship learning via inverse reinforcement learning. In: Proceedings of the 21st International Conference on Machine Learning, ICML 2004 (2004)
2. Bonilla, E.V., Guo, S., Sanner, S.: Gaussian process preference elicitation. In: NIPS 2010 (2010)
3. Boutilier, C.: A POMDP formulation of preference elicitation problems. In: AAAI 2002, pp. 239-246 (2002)
4. Braziunas, D., Boutilier, C.: Preference elicitation and generalized additive utility. In: AAAI 2006 (2006)
5. Casella, G., Fienberg, S., Olkin, I. (eds.): Monte Carlo Statistical Methods. Springer Texts in Statistics. Springer, Heidelberg (1999)
6. Chu, W., Ghahramani, Z.: Preference learning with gaussian processes. In: Proceedings of the 22nd International Conference on Machine Learning, pp. 137-144. ACM, New York (2005)
7. DeGroot, M.H.: Optimal Statistical Decisions. John Wiley & Sons, Chichester (1970)
8. Dimitrakakis, C., Rothkopf, C.A.: Bayesian multitask inverse reinforcement learning (2011), under review
9. Duff, M.O.: Optimal Learning Computational Procedures for Bayes-adaptive Markov Decision Processes. PhD thesis, University of Massachusetts at Amherst (2002)
10. Friedman, M., Savage, L.J.: The expected-utility hypothesis and the measurability of utility. The Journal of Political Economy 60(6), 463 (1952)
11. Furmston, T., Barber, D.: Variational methods for reinforcement learning. In: AISTATS, pp. 241-248 (2010)
12. Grünwald, P.D., Philip Dawid, A.: Game theory, maximum entropy, minimum discrepancy, and robust bayesian decision theory. Annals of Statistics 32(4), 1367-1433 (2004)
13. Guo, S., Sanner, S.: Real-time multiattribute bayesian preference elicitation with pairwise comparison queries. In: AISTATS 2010 (2010)
14. Ng, A.Y., Russell, S.: Algorithms for inverse reinforcement learning. In: Proc. 17th International Conf. on Machine Learning, pp. 663-670. Morgan Kaufmann, San Francisco (2000)
15. Poupart, P., Vlassis, N., Hoey, J., Regan, K.: An analytic solution to discrete Bayesian reinforcement learning. In: ICML 2006, pp. 697-704. ACM Press, New York (2006)
16. Puterman, M.L.: Markov Decision Processes: Discrete Stochastic Dynamic Programming. John Wiley & Sons, New Jersey (2005)
17. Ramachandran, D.: Personal communication (2010)
18. Ramachandran, D., Amir, E.: Bayesian inverse reinforcement learning. In: 20th Int. Joint Conf. Artificial Intelligence, vol. 51, pp. 2856-2591 (2007)
19. Rothkopf, C.A.: Modular models of task based visually guided behavior. PhD thesis, Department of Brain and Cognitive Sciences, Department of Computer Science, University of Rochester (2008)
20. Syed, U., Schapire, R.E.: A game-theoretic approach to apprenticeship learning. In: Advances in Neural Information Processing Systems, vol. 10 (2008)
21. Syed, U., Schapire, R.E.: A reduction from apprenticeship learning to classification. In: NIPS 2010 (2010)
22. Ziebart, B.D., Andrew Bagnell, J., Dey, A.K.: Modelling interaction via the principle of maximum causal entropy. In: Proceedings of the 27th International Conference on Machine Learning (ICML 2010), Haifa, Israel (2010)