Computational rationalization: The inverse equilibrium problem

Proceedings of the 28th International Conference on Machine Learning, ICML 2011

Volumn , Issue , 2011, Pages 1169-1176

  Waugh, Kevin ^a   Ziebart, Brian D ^a   Bagnell, J Andrew ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DECISION PROBLEMS; DECISION-THEORETIC; INVERSE EQUILIBRIUM; INVERSE-OPTIMAL CONTROL; OPTIMAL SOLUTIONS; PRINCIPLE OF MAXIMUM ENTROPY; REWARD FUNCTION; SINGLE-AGENT; UTILITY FUNCTIONS;

GAME THEORY; LEARNING SYSTEMS; OPTIMIZATION;

INVERSE PROBLEMS;

EID: 80053454559     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. Abbeel, P. and Ng, A. Y. Apprenticeship learning via inverse reinforcement learning. In Proceedings of the International Conference on Machine Learning, 2004.
2. Berry, S., Levinsohn, J., and Pakes, A. Automobile prices in market equilibrium. Econometrica, 63(4):841-90, July 1995.
3. Blum, A. and Mansour, Y. Algorithmic Game Theory, chapter Learning, Regret Minimization and Equilibria, pp. 79-102. Cambridge University Press, 2007.
4. Della Pietra, S., Della Pietra, V., and Lafferty, J. Inducing features of random fields. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(4):380-393, 2002. ISSN 0162-8828.
5. Grünwald, P. D. and Dawid, A. P. Game theory, maximum entropy, minimum discrepancy, and robust bayesian decision theory. Annals of Statistics, 32:1367-1433, 2003. (Pubitemid 41250271)
6. Henry, P., Vollmer, C., Ferris, B., and Fox, D. Learning to navigate through crowded environments. In Proceedings of Robotics and Automation, 2010.
7. Jaynes, E. T. Information theory and statistical mechanics. Physical Review, 106(4):620-630, May 1957.
8. Kakade, S., Kearns, M., Langford, J., and Ortiz, L. Correlated equilibria in graphical games. In Proceedings of Electronic Commerce, pp. 42-47, 2003.
9. Kivinen, J. and Warmuth, M. K. Exponentiated gradient versus gradient descent for linear predictors. Information and Computation, 132:1-63, 1995. (Pubitemid 127454001)
10. Nevo, A. Measuring market power in the ready-to-eat cereal industry. Econometrica, 69(2):307-342, March 2001. (Pubitemid 33645351)
11. Ng, A. and Russell, S. Algorithms for inverse reinforcement learning. In Proceedings of the International Conference on Machine Learning, 2000.
12. Ortiz, L. E., Shapire, R. E., and Kakade, S. M. Maximum entropy correlated equilibrium. In Proceedings of Artificial Intelligence and Statistics, pp. 347-354, 2007.
13. Osborne, M.J. and Rubinstein, A. A course in game theory. The MIT press, 1994. ISBN 0262650401.
14. Ratliff, N., Bagnell, J. A., and Zinkevich, M. Maximum margin planning. In Proceedings of the International Conference on Machine Learning, 2006.
15. Ratliff, N. D., Silver, D., and Bagnell, J. A. Learning to search: Functional gradient techniques for imitation learning. Autonomous Robots, 27(1):25-53, 2009.
16. Silver, D., Bagnell, J. A., and Stentz, A. Learning from demonstration for autonomous navigation in complex unstructured terrain. International Journal of Robotics Research, 29(1):1565-1592, October 2010.
17. Waugh, K., Ziebart, B., and Bagnell, J. A. Computational rationalization: The inverse equilibrium problem. arXiv, abs/1103.5254, 2011.
18. Yang, Z. Correlated equilibrium and the estimation of discrete games of complete information. Working paper, http://www.econ.vt.edu/faculty/2008vitas- research/joeyang-.research.htm, 2009.
19. Ziebart, B. D., Maas, A., Bagnell, J. A., and Dey, A. Maximum entropy inverse reinforcement learning. In Proceeding of the AAAI Conference on Artificial Intelligence, 2008a.
20. Ziebart, B. D., Maas, A., Dey, A. K., and Bagnell, J. A. Navigate like a cabbie: Probabilistic reasoning from observed context-aware behavior. In Proceedings of the International Conference on Ubiquitous Computing, 2008b.
21. Ziebart, B. D., Bagnell, J. A., and Dey, A. K. Modeling interaction via the principle of maximum causal entropy. In Proceedings of the International Conference on Machine Learning, 2010.