Extreme compass and dynamic multi-armed bandits for adaptive operator selection

2009 IEEE Congress on Evolutionary Computation, CEC 2009

Volumn , Issue , 2009, Pages 365-372

  Maturana, Jorge ^a   Fialho, Álvaro ^b   Saubion, Frédéric ^a   Schoenauer, Marc ^b,c   Sebag, Miche'le ^b,c  

^a LERIA   (France)

^b Parc Orsay Université   (France)

^c INRIA SACLAY   (France)

Author keywords

[No Author keywords available]

Indexed keywords

EVOLUTIONARY ALGORITHMS;

ADAPTIVE OPERATOR SELECTIONS; CREDIT ASSIGNMENT; EXPLOITATION AND EXPLORATIONS; MULTI ARMED BANDIT; OPERATOR SELECTIONS; SATISFIABILITY PROBLEMS; SYNERGETIC EFFECT; VARIATION OPERATOR;

QUALITY CONTROL;

EID: 70449920961     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CEC.2009.4982970     Document Type: Conference Paper

References (25)

1. F. Lobo, C. Lima, and Z. Michalewicz, Eds., Parameter Setting in Evolutionary Algorithms, ser. Studies in Computational Intelligence. Springer, 2007, vol.54.
2. L. Da Costa and M. Schoenauer, "GUIDE, a Graphical User Interface for Evolutionary Algorithms Design, " in GECCO Workshop on Open-Source Software (SoftGEC), J. H. Moore, Ed. ACM Press, 2007, software available at http://guide.gforge.inria.fr/.
3. A. Eiben, Z. Michalewicz, M. Schoenauer, and J. Smith, Parameter Setting in Evolutionary Algorithms, ser. Studies in Computational Intelligence. Springer, 2007, vol.54, ch. Parameter Control in Evolutionary Algorithms, pp. 19-46.
4. V. Maniezzo, R. Battiti, and J.-P. Watson, Eds., Learning and Intelligent Optimization, ser. Foundations of Computing. Springer Verlag, 2008.
5. E. K. Burke, G. Kendall, J. Newall, E. Hart, P. Ross, and S. Schulenburg, Handbook of Meta-heuristics. Kluwer, 2003, ch. Hyperheuristics: An Emerging Direction in Modern Search Technology, pp. 457-474.
6. J. Maturana and F. Saubion, "A compass to guide genetic algorithms." in Proc. PPSN'08, G. Rudolph et al., Ed. Springer, 2008, pp. 256-265.
7. D. Goldberg, "Probability Matching, the Magnitude of Reinforcement, and Classifier System Bidding, " Machine Learning, vol.5, no.4, pp. 407-426, 1990.
8. A. Fialho, L. Da Costa, M. Schoenauer, and M. Sebag, "Extreme value based adaptive operator selection, " in Proc. PPSN'08, G. Rudolph et al., Ed. Springer, 2008, pp. 175-184.
9. L. Da Costa, A. Fialho, M. Schoenauer, and M. Sebag, "Adaptive operator selection with dynamic multi-armed bandits, " in Proc. GECCO'08, M. Keijzer et al., Ed. ACM Press, 2008, pp. 913-920.
10. L. Davis, "Adapting operator probabilities in genetic algorithms, " in Proc. ICGA'89, J. D. Schaffer, Ed. Morgan Kaufmann, 1989, pp. 61-69.
11. F. Lobo and D. Goldberg, "Decision making in a hybrid genetic algorithm, " in Proc. ICEC'97, T. Bäck et al., Ed. IEEE Press, 1997, pp. 121-125.
12. A. Tuson and P. Ross, "Adapting operator settings in genetic algorithms, " Evolutionary Computation, vol.6, no.2, pp. 161-184, 1998.
13. H. J. C. Barbosa and A. M. Śa, "On adaptive operator probabilities in real coded genetic algorithms, " in Proc. XX Intl. Conf. of the Chilean Computer Science Society, 2000.
14. B. A. Julstrom, "What have you done for me lately? adapting operator probabilities in a steady-state genetic algorithm on genetic algorithms, " in Proc. ICGA'95, L. J. Eshelman, Ed. Morgan Kaufmann, 1995, pp. 81-87.
15. J. M. Whitacre, T. Q. Pham, and R. A. Sarker, "Use of statistical outlier detection method in adaptive evolutionary algorithms, " in Proc. GECCO'06, M. Cattolico, Ed. ACM, 2006, pp. 1345-1352.
16. D. Thierens, "An adaptive pursuit strategy for allocating operator probabilities, " in Proc. GECCO'05, H.-G. Beyer, Ed. ACM Press, 2005, pp. 1539-1546.
17. Wong, Lee, Leung, and Ho, "A novel approach in parameter adaptation and diversity maintenance for GAs, " Soft Computing, vol.7, no.8, pp. 506-515, 2003.
18. P. Auer, N. Cesa-Bianchi, and P. Fischer, "Finite-time analysis of the multiarmed bandit problem, " Machine Learning, vol. 47, no. 2/3, pp. 235-256, 2002.
19. C. Hartland, S. Gelly, N. Baskiotis, O. Teytaud, and M. Sebag, "Multiarmed bandit, dynamic environments and meta-bandits, " in Online Trading of Exploration and Exploitation Workshop, NIPS, 2006.
20. E. Page, "Continuous inspection schemes, " Biometrika, vol.41, pp. 100-115, 1954.
21. A. Fialho, L. Da Costa, M. Schoenauer, and M. Sebag, "Dynamic multi-armed bandits and extreme value-based rewards for adaptive operator selection in evolutionary algorithms, " in Proc. LION'09, 2009.
22. S. A. Cook, "The complexity of theorem-proving procedures, " in STOC '71: Proceedings of the third annual ACM symposium on Theory of computing. New York, USA: ACM, 1971, pp. 151-158.
23. H. Hoos and T. Stützle, SATLIB: An Online Resource for Research on SAT. www.satlib.org: IOS Press, 2000, pp. 283-292.
24. M. Birattari, "The problem of tuning metaheuristics as seen from a machine learning perspective, " Ph.D. dissertation, Universit́e Libre de Bruxelles, Brussels, Belgium, 2004.
25. B. Yuan and M. Gallagher, "Statistical racing techniques for improved empirical evaluation of evolutionary algorithms, " in Proc. PPSN'04, Xin Yao et al., Ed. Springer Verlag, 2004, pp. 172-181.