Apprenticeship learning for model parameters of partially observable environments

Proceedings of the 29th International Conference on Machine Learning, ICML 2012

Volumn 2, Issue , 2012, Pages 1495-1502

  Makino, Takaki ^a   Takeuchi, Johane ^b  

^a INSTITUTE OF INDUSTRIAL SCIENCE   (Japan)

^b HONDA RESEARCH INSTITUTE JAPAN CO LTD   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ACTION SELECTION; APPRENTICESHIP LEARNING; DIALOGUE SYSTEMS; ENVIRONMENT MODELS; EXPLICIT MODELING; MODEL PARAMETERS; OPTIMAL ACTIONS; PARTIALLY OBSERVABLE ENVIRONMENTS;

LEARNING SYSTEMS; SPEECH PROCESSING;

APPRENTICES;

EID: 84867126700     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (24)

1. Abbeel, P. and Ng, A. Apprenticeship learning via inverse reinforcement learning. In Greiner, R. and Schuurmans, D. (eds.), Proc. of 21st International Conference on Machine Learning (ICML 2004). ACM Press, 2004.
2. Abbeel, P., Coates, A., and Ng, A. Y. Autonomous helicopter aerobatics through apprenticeship learning. International Journal of Robotics Research, 29 (13):1608-1639, 2010.
3. Argali, B. D., Chernova, S., Veloso, M., and Browning, B. A survey of robot learning from demonstration. Robotics and Autonomous Systems, 57(5):469-483, 2009.
4. Asmuth, J., Li, L., Littman, M., Nouri, A., and Wingate, D. A bayesian sampling approach to exploration in reinforcement learning. In Proc. of the 25th Annual Conference on Uncertainty in Artificial Intelligence (UAI'09), pp. 19-26. AUAI Press, 2009.
5. Bengio, Y. and Frasconi, P. Input-output HMM's for sequence processing. IEEE Transactions on Neural Networks, 7(5):1231-1249, 1996.
6. Boularias, A., Kober, J., and Peters, J. Relative entropy inverse reinforcement learning. Journal of Machine Learning Research: Workshop and Conference Proceedings (AISTATS 2011), 15:182-189, 2011.
7. Choi, J. and Kim, K.-E. Inverse reinforcement learning in partially observable environments. Journal of Machine Learning Research, 12:691-730, 2011.
8. Gilks, W., Richardson, S., and Spiegelhalter, D. Markov Chain Monte Carlo in Practice. Chapman&Hall/CRC, 1996.
9. Henry, P., Vollmer, C., Ferris, B., and Fox, D. Learning to navigate through crowded environments. In Proc. of 2010 IEEE International Conference of Robotics and Automation (ICRA 2010), pp. 981-986, 2010.
10. Hsu, D., Lee, W. S., and Rong, N. What makes some POMDP problems easy to approximate? In Platt, J., Koller, D., Singer, Y., and Roweis, S. (eds.), Advances in Neural Information Processing Systems 20, pp. 689-696. MIT Press, Cambridge, MA, 2008.
11. Johnson, S. G. The NLopt nonlinear-optimization package. http://ab-initio.mit.edu/nlopt, 2008.
12. Kaelbling, L. P., Littman, M. L., and Cassandra, A. R. Planning and acting in partially observable stochastic domains. Artificial Intelligence, 101:99-134, 1998.
13. Kim, K., Lee, C., Jung, S., and Lee, G. G. A frame-based probabilistic framework for spoken dialog management using dialog examples. In Proc. of the 9th SIGdial Workshop on Discourse and Dialogue, pp. 120-127, 2008.
14. Kurniawati, H., Hsu, D., and Lee, W. S. SARSOP: Efficient point-based POMDP planning by approximating optimally reachable belief spaces. In Proc. Robotics: Science and Systems, 2008.
15. Meguro, T., Higashinaka, R., Minami, Y., and Dohsaka, K. Controlling Listening-oriented Dialogue using Partially Observable Markov Decision Processes. In Proc. of the 23rd International Conference on Computational Linguistics (COLING 2010), pp. 761-769. ACL, 2010.
16. Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H., and Teller, E. Equations of state calculations by fast computing machines. Journal of Chemical Physics, 21:1087-1092, 1953.
17. Neu, G. and Szepesvári, C. Training parsers by inverse reinforcement learning. Machine Learning, 77(2-3): 303-337, 2009.
18. Powell, M. J. D. Direct search algorithms for optimization calculations. Acta Numerica, 7:287-336, 1998.
19. Ramachandran, D. and Amir, E. Bayesian inverse reinforcement learning. In Proc. of International Joint Conference of Artifical Intelligence (IJCAI-2007), pp. 2586-2591, 2007.
20. Ross, S., Chaib-draa, B., and Pineau, J. Bayes-adaptive POMDPs. In Platt, J. C., Koller, D., Singer, Y., and Roweis, S. T. (eds.), Advances in Neural Information Processing Systems 20, 2008.
21. Smallwood, R. and Sondik, E. The optimal control of partially observable Markov processes over a finite horizon,. Operations Research, 21:1071-1088, 1973.
22. Thomson, B., Jurčíček, F., Gašić, M., Keizer, S., Mairesse, F., Yu, K., and Young, S. Parameter learning for POMDP spoken dialogue models. In Proc. of the 3rd IEEE Workshop on Spoken Language Technology (SLT 2010), pp. 271-276. IEEE, 2010.
23. Williams, J. D., Poupart, P., and Young, S. Partially observable Markov decision processes with continuous observations for dialogue management. In Proc. of the 6th SIGdial Workshop on Discourse and Dialogue, pp. 25-34. 2005.
24. Ziebart, B., Bragnell, J. A., and Dey, A. K. Modeling interaction via the principle of maximum causal entropy. In Fürnkranz, J. and Joachims, T. (eds.), Proc. of the 27th International Conference on Machine Learning (ICML 2010), pp. 1255-1262. Omnipress, 2010.