Reinforcement learning with multi-fidelity simulators

Proceedings - IEEE International Conference on Robotics and Automation

Volumn , Issue , 2014, Pages 3888-3895

  Cutler, Mark ^a   Walsh, Thomas J ^a   How, Jonathan P ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

REMOTE CONTROL; SIMULATORS;

MULTI FIDELITIES; NEAR-OPTIMAL POLICIES; NUMBER OF SAMPLES; Q-VALUES; REAL-WORLD; REAL-WORLD LEARNING; SAMPLE COMPLEXITY;

REINFORCEMENT LEARNING;

EID: 84929191082     PISSN: 10504729     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICRA.2014.6907423     Document Type: Conference Paper

References (18)

1. P. Abbeel, M. Quigley, and A. Y. Ng, "Using inaccurate models in reinforcement learning, " in ICML, 2006.
2. P. Abbeel, A. Coates, M. Quigley, and A. Y. Ng, "An application of reinforcement learning to aerobatic helicopter flight, " in NIPS, 2006.
3. J. Z. Kolter and A. Y. Ng, "Policy search via the signed derivative, " in RSS, 2009.
4. M. E. Taylor, P. Stone, and Y. Liu, "Transfer learning via intertask mappings for temporal difference learning, " Journal of Machine Learning Research, vol. 8, no. 1, pp. 2125-2167, 2007.
5. T. A. Mann and Y. Choe, "Directed exploration in reinforcement learning with transferred knowledge, " in European Workshop on Reinforcement Learning (EWRL), 2012.
6. T. D. Robinson, K. E. Willcox, M. S. Eldred, and R. Haimes, "Multifidelity optimization for variable-complexity design, " in AIAA/ISSMO Multidisciplinary Analysis and Optimization Conference, 2006.
7. L. Li, M. L. Littman, T. J. Walsh, and A. L. Strehl, "Knows what it knows: A framework for self-aware learning, " Machine Learning, vol. 82, no. 3, pp. 399-443, 2011.
8. E. Winner and M. M. Veloso, "Multi-fidelity robotic behaviors: Acting with variable state information, " in AAAI, 2000.
9. E. J. Schlicht, R. Lee, D. H. Wolpert, M. J. Kochenderfer, and B. Tracey, "Predicting the behavior of interacting humans by fusing data from multiple sources, " in UAI, 2012.
10. B. Fernández-Gauna, J. M. López-Guede, and M. Graña, "Transfer learning with partially constrained models: Application to reinforcement learning of linked multicomponent robot system control, " Robotics and Autonomous Systems, vol. 61, no. 7, pp. 694-703, 2013.
11. F. A. Viana, V. Steffen, Jr., S. Butkewitsch, and M. Freitas Leal, "Optimization of aircraft structural components by using natureinspired algorithms and multi-fidelity approximations, " Journal of Global Optimization, vol. 45, no. 3, pp. 427-449, 2009.
12. A. Molina-Cristobal, P. R. Palmer, B. A. Skinner, and G. T. Parks, "Multi-fidelity simulation modelling in optimization of a submarine propulsion system, " in Vehicle Power and Propulsion Conf., 2010.
13. R. S. Sutton and A. G. Barto, Introduction to Reinforcement Learning. Cambridge, MA, USA: MIT Press, 1998.
14. L. Li, "A unifying framework for computational reinforcement learning theory, " Ph.D. dissertation, Rutgers University, New Brunswick, NJ, 2009.
15. T. K. Lau and Y.-h. Liu, "Stunt driving via policy search, " in ICRA, 2012.
16. S. Park, J. Deyst, and J. P. How, "Performance and lyapunov stability of a nonlinear path following guidance method, " Journal of Guidance, Control, and Dynamics, vol. 30, no. 6, pp. 1718-1728, 2007.
17. G. M. Hoffmann, C. J. Tomlin, M. Montemerlo, and S. Thrun, "Autonomous automobile trajectory tracking for off-road driving: Controller design, experimental validation and racing, " in ACC, 2007.
18. E. Velenis, E. Frazzoli, and P. Tsiotras, "Steady-state cornering equilibria and stabilisation for a vehicle during extreme operating conditions, " International Journal of Vehicle Autonomous Systems, vol. 8, no. 2, pp. 217-241, 2010.