Hoeffding and Bernstein races for selecting policies in evolutionary direct policy search

Proceedings of the 26th International Conference On Machine Learning, ICML 2009

Volumn , Issue , 2009, Pages 401-408

  Verena, Heidrich Meisner ^a   Igel, Christian ^a  

^a RUHR UNIVERSITY BOCHUM   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

DIRECT POLICY SEARCH; EVOLUTION STRATEGIES; LEARNING SPEED; PERFORMANCE ESTIMATION; ROLL-OUTS; UNCERTAINTY HANDLING;

AMBER; EDUCATION; REINFORCEMENT; ROBOT LEARNING;

LEARNING ALGORITHMS;

EID: 71149099672     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. Audibert, J.-Y., Munos, R., & Szepesvári, C. (2007). Tuning bandit algorithms in stochastic environments. 18th International Conference on Algorithmic Learning Theory (ALT) (pp. 150-165). Springer-Verlag.
2. Beyer, H.-G. (2007). Evolution strategies. Scholarpedia, 2, 1965.
3. Birattari, M., Stutzle, T., Paquete, L., & Varrentrapp, K. (2002). A racing algorithm for configuring meta-heuristics. Genetic and Evolutionary Computation Conference (GECCO 2002) (pp. 11-18). Morgan Kaufmann Publishers.
4. Coulom, R. (2002). Apprentissage par renforcement utilisant des reseaux de neurones, avec des applications au controle moteur. These de doctorat, Institut National Polytechnique de Grenoble.
5. Gomez, F., Schmidhuber, J., & Miikkulainen, R. (2008). Accelerated neural evolution through cooperatively coevolved synapses. Journal of Machine Learning Research, 9, 937-965.
6. Hansen, N., Müller, S. D., & Koumoutsakos, P. (2003). Reducing the time complexity of the derandomized evolution strategy with covariance matrix adaptation (CMA-ES). Evolutionary Computation, 11, 1-18.
7. Hansen, N., Niederberger, A. S. P., Guzzella, L., & Koumoutsakos, P. (2009). A method for handling uncertainty in evolutionary optimization with an application to feedback control of combustion. IEEE Transactions on Evolutionary Computation, 13, 180-197.
8. Heidrich-Meisner, V., & Igel, C. (2008). Variable metric reinforcement learning methods applied to the noisy mountain car problem. European Workshop on Reinforcement Learning (EWRL 2008) (pp. 136-150). Springer-Verlag.
9. Heidrich-Meisner, V., & Igel, C. (2009). Uncertainty handling CMA-ES for reinforcement learning. Genetic and Evolutionary Computation Conference (GECCO 2009). ACM Press.
10. Maron, O., & Moore, A. W. (1994). Hoeffding races: Accelerating model selection search for classification and function approximation. Advances in Neural Information Processing Systems (pp. 59-66). Morgan Kaufmann Publishers.
11. Maron, O., & Moore, A. W. (1997). The racing algorithm: Model selection for lazy learners. Artificial Intelligence Review, 11, 193-225.
12. Mnih, V., Szepesvári, C., & Audibert, J. (2008). Empirical Bernstein stopping. Proceedings of the 25th International Conference on Machine Learning (ICML 2008) (pp. 672-679).
13. Pellecchia, A., Igel, C., Edelbrunner, J., & Schöner, G. (2005). Making driver modeling attractive. IEEE Intelligent Systems, 20, 8-12.
14. Peters, J., & Schaal, S. (2008). Natural actor-critic. Neurocomputing, 71, 1180-1190.
15. Schmidt, C., Branke, J., & Chick, S. (2006). Integrating techniques from statistical ranking into evolutionary algorithms. Applications of Evolutionary Computing (pp. 752-763). Springer-Verlag.
16. Siebel, N. T., & Sommer, G. (2007). Evolutionary reinforcement learning of artificial neural networks. International Journal of Hybrid Intelligent Systems, 4, 171-183.
17. Stagge, P. (1998). Averaging efficiently in the presence of noise. Parallel Problem Solving from Nature (PPSN V) (pp. 188-197). Springer-Verlag.
18. Sutton, R., & Barto, A. (1998). Reinforcement learning: An introduction. MIT Press.
19. Suttorp, T., Hansen, N., & Igel, C. (2009). Efficient covariance matrix update for variable metric evolution strategies. Machine Learning, 75, 167-197.
20. Whiteson, S., & Stone, P. (2006). Evolutionary function approximation for reinforcement learning. Journal of Machine Learning Research, 7, 877-917.
21. Yuan, B., & Gallagher, M. (2004). Statistical racing techniques for improved empirical evaluation of evolutionary algorithms. Parallel Problem Solving from Nature (PPSN VIII) (pp. 172-181). Springer-Verlag.