Optimism-driven exploration for nonlinear systems

Proceedings - IEEE International Conference on Robotics and Automation

Volumn 2015-June, Issue June, 2015, Pages 3239-3246

  Moldovan, Teodor Mihai ^a   Levine, Sergey ^a   Jordan, Michael I ^a   Abbeel, Pieter ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AGRICULTURAL ROBOTS; NONLINEAR SYSTEMS; REINFORCEMENT LEARNING; ROBOTICS;

BENCH-MARK PROBLEMS; COMPUTATIONAL REQUIREMENTS; DIRICHLET PROCESS MIXTURE; EFFICIENT LEARNING; EXPLORATION STRATEGIES; SAMPLE COMPLEXITY; SYSTEM INTERACTIONS; TRAJECTORY OPTIMIZATION;

MODEL PREDICTIVE CONTROL;

EID: 84938265627     PISSN: 10504729     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICRA.2015.7139645     Document Type: Conference Paper

References (30)

1. J. Kober, J. A. Bagnell, and J. Peters, "Reinforcement learning in robotics: A survey," International Journal of Robotic Research, vol. 32, no. 11, pp. 1238-1274, 2013.
2. K. Astrom and B. Wittenmark, Adaptive control. Boston, MA, USA: Addison-Wesley Longman Publishing Co., Inc., 1994.
3. M. P. Deisenroth and C. E. Rasmussen, "PILCO: A model-based and data-efficient approach to policy search," in Proceedings of the 28th International Conference on Machine Learning, L. Getoor and T. Scheffer, Eds. Bellevue, Washington, USA: Omnipress, 2011, pp. 465-472.
4. Y. Abbasi-Yadkori, C. Szepesvári, S. Kakade, and U. V. Luxburg, "Regret bounds for the adaptive control of linear quadratic systems," in Proceedings of the 24th Annual Conference on Learning Theory, 2011.
5. S. Kuindersma, R. Grupen, and A. Barto, "Variational Bayesian optimization for runtime risk-sensitive control," in Robotics: Science and Systems VIII (RSS), Sydney, Australia, July 2012.
6. M. Araya, O. Buffet, and V. Thomas, "Near-optimal BRL using optimistic local transitions," in Proceedings of the 29th International Conference on Machine Learning (ICML-12), ser. ICML '12, J. Langford and J. Pineau, Eds. New York, NY, USA: Omnipress, Jul. 2012, pp. 97-104.
7. P. L. B. Ambuj Tewari, "Optimistic linear programming gives logarithmic regret for irreducible MDPs," in Proceedings of Neural Information Processing Systems Conference, 2007.
8. D. M. Blei and M. I. Jordan, "Variational inference for Dirichlet process mixtures," Bayesian Analysis, vol. 1, no. 1, pp. 121-143, Mar. 2006.
9. D. A. Benson, G. T. Huntington, T. P. Thorvaldsen, and A. V. Rao, "Direct trajectory optimization and costate estimation via an orthogonal collocation method," Journal of Guidance, Control, and Dynamics, vol. 29, no. 6, pp. 1435-1440, Nov. 2006.
10. M. Deisenroth, G. Neumann, and J. Peters, "A survey on policy search for robotics," Foundations and trends in robotics, vol. 2, no. 1-2, pp. 1-142, 2013.
11. T. Broderick, N. Boyd, A. Wibisono, A. C. Wilson, and M. I. Jordan, "Streaming variational Bayes," in Advances in Neural Information Processing Systems 26 (NIPS 2013), 2013.
12. J.-Y. Audibert, R. Munos, and C. Szepesvári, "Exploration-exploitation tradeoff using variance estimates in multi-armed bandits," Theoretical Computer Science, vol. 410, no. 19, pp. 1876-1902, Apr. 2009.
13. Y. W. Teh, "Dirichlet process," in Encyclopedia of Machine Learning, C. Sammut and G. I. Webb, Eds. Springer, 2010, pp. 280-287.
14. M. Morari and J. H Lee, "Model predictive control: past, present and future," Computers & Chemical Engineering, vol. 23, no. 4, pp. 667-682, 1999.
15. J. T. Betts, Practical methods for optimal control and estimation using nonlinear programming. Society for Industrial & Applied Mathematics, 2010, vol. 19.
16. C. E. Garcia, D. M. Prett, and M. Morari, "Model predictive control: theory and practicea survey," Automatica, vol. 25, no. 3, pp. 335-348, 1989.
17. E. F. Camacho and C. Bordons, Model predictive control. Springer Berlin, 1999, vol. 303.
18. A. Aswani and P. Bouffard, "Extensions of learning-based model predictive control for real-time application to a quadrotor helicopter," in Proc. American Control Conference (ACC), 2012.
19. F. Palacios-Gomez, L. Lasdon, and M. Engquist, "Nonlinear optimization by successive linear programming," Management Science, vol. 28, no. 10, pp. 1106-1120, 1982.
20. S. M. Khansari-Zadeh and A. Billard, "BM: An iterative algorithm to learn stable non-linear dynamical systems with Gaussian mixture models," in International Conference on Robotics and Automation (ICRA), 2010.
21. S. P. Chatzis, D. Korkinof, and Y. Demiris, "A nonparametric Bayesian approach toward robot learning by demonstration," Robotics and Autonomous Systems, vol. 60, no. 6, pp. 789-802, Jun. 2012.
22. T. Strutz, Data Fitting and Uncertainty: A practical introduction to weighted least squares and beyond. Vieweg+Teubner Verlag, 2010.
23. M. P. Deisenroth, D. Fox, and C. E. Rasmussen, "Gaussian processes for data-efficient learning in robotics and control," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 99, 2013.
24. R. Koppejan and S. Whiteson, "Neuroevolutionary reinforcement learning for generalized helicopter control," in Proceedings of the 11th Annual conference on Genetic and evolutionary computation, ser. GECCO '09. New York, NY, USA: ACM, 2009, pp. 145-152.
25. P. Abbeel, A. Coates, and A. Y. Ng, "Autonomous helicopter aerobatics through apprenticeship learning," The International Journal of Robotics Research, Jun. 2010.
26. P. Abbeel, A. Coates, T. Hunter, and A. Ng, "Autonomous autorotation of an RC helicopter," Experimental Robotics, pp. 385-394, 2009.
27. I. Manchester, U. Mettin, F. Iida, and R. Tedrake, "Stable dynamic walking over uneven terrain," International Journal of Robotics Research, vol. 30, no. 3, pp. 265-279, 2011.
28. T. Erez, K. Lowrey, Y. Tassa, V. Kumar, S. Kolev, and E. Todorov, "An integrated system for real-time model-predictive control of humanoid robots," in IEEE/RAS International Conference on Humanoid Robots (Humanoids), 2013.
29. S. Vichik and F. Borrelli, "Solving linear and quadratic programs with an analog circuit," Computers and Chemical Engineering, 2014.
30. M. Bodson and J. E. Groszkiewicz, "Multivariable adaptive algorithms for reconfigurable flight control," IEEE Transactions on Control Systems Technology, vol. 5, no. 2, pp. 217-229, 1997.