Meta-optimization for parameter tuning with a flexible computing budget

GECCO'12 - Proceedings of the 14th International Conference on Genetic and Evolutionary Computation

Volumn , Issue , 2012, Pages 1245-1252

  Branke, Juergen ^a   Elomari, Jawad Asem ^a  

^a UNIVERSITY OF WARWICK   (United Kingdom)

Author keywords

meta optimization; offline parameter tuning; parameter tuning

Indexed keywords

COMPUTATIONAL BUDGET; FLEXIBLE COMPUTING; META-OPTIMIZATION; OPTIMAL PARAMETER SETTINGS; OPTIMIZATION PROBLEMS; PARAMETER SETTING; PARAMETER-TUNING; TUNING ALGORITHM;

ALGORITHMS; BUDGET CONTROL; OPTIMIZATION;

PARAMETER ESTIMATION;

EID: 84864719029     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2330163.2330336     Document Type: Conference Paper

References (31)

1. P. Pellegrini, T. Stützle, and M. Birattari, "Off-line vs. Online Tuning: A Study on MAX-MIN Ant System for the TSP." vol. 6234, M. Dorigo, M. Birattari, G. Di Caro, R. Doursat, A. Engelbrecht, D. Floreano, L. Gambardella, R. Groß, E. Sahin, H. Sayama, and T. Stützle, Eds., Springer Berlin / Heidelberg, 2010, pp. 239-250.
2. G. Francesca, P. Pellegrini, T. Stützle, and M. Birattari, "Off-line and On-line Tuning: A Study on Operator Selection for a Memetic Algorithm Applied to the QAP," in Evolutionary Computation in Combinatorial Optimization. vol. 6622, P. Merz and J.-K. Hao, Eds., Berlin / Heidelberg: Springer, 2011, pp. 203-214.
3. M. Birattari, Z. Yuan, P. Balaprakash, and T. Stützle, "F-Race and Iterated F-Race: An Overview," T. Bartz-Beielstein, M. Chiarandini, L. Paquete, and M. Preuss, Eds., Springer Berlin Heidelberg, 2010, pp. 311-336.
4. F. Hutter, H. Hoos, K. Leyton-brown, and T. Stützle, "ParamILS: An automatic algorithm configuration framework," Journal of Artificial Intelligence Research, vol. 36, pp. 267-306, 2009.
5. B. Adenso-Diaz and M. Laguna, "Fine-Tuning of Algorithms Using Fractional Experimental Designs and Local Search," Operations Research, vol. 54, pp. 99-114, 2006.
6. T. Bartz-Beielstein, C. W. G. Lasarczyk, and M. Preuss, "Sequential parameter optimization," in Congress on Evolutionary Computation, Los Alamitos, IEEE Press, 2005, pp. 773-780.
7. T. Bartz-Beielstein and M. Preuss, Experimental research in evolutionary computation, 1 ed. vol. 1: ACM, 2007.
8. Hutter, F., H. Hoos, and K. Leyton-Brown, Sequential Model-Based Optimization for General Algorithm Configuration, in Learning and Intelligent Optimization, C. Coello, Editor. 2011, Springer Berlin / Heidelberg. p. 507-523.
9. T. Bäck, "Parallel optimization of evolutionary algorithms," in Parallel Problem Solving from Nature - PPSN III. vol. 866, Y. Davidor, H.-P. Schwefel, and R. Männer, Eds., Springer Berlin / Heidelberg, 1994, pp. 418-427.
10. F. Hutter, "Automated Configuration of Algorithms for Solving Hard Computational Problems," PhD, Department of Computer Science, University Of British Columbia, Vancouver, 2009.
11. A. Fialho, "Adaptive Operator Selection for Optimization," PhD, Ecole Doctorale d'Informatique, Université Paris-Sud, Paris, 2010.
12. M. Gagliolo, "Online Dynamic Algorithm Portfolios, Minimizing the computational cost of problem solving," PhD, Informatics, Università della Svizzera Italiana, Lugano, 2010.
13. R. E. Mercer and J. R. Sampson, "Adaptive search using a reproductive meta-plan," The International Journal of Systems and Cybernetics, vol. 7, pp. 215-228, 1977.
14. J. J. Grefenstette, "Optimization of Control Parameters for Genetic Algorithms," IEEE Transactions on Systems Man and Cybernetics, vol. 16, pp. 122-128, 1986.
15. K. Shahookar and P. Mazumder, "A genetic approach to standard cell placement using meta-genetic parameter optimization," IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, vol. 9, pp. 500-511, 1990.
16. C. Sechen and A. Sangiovanni-Vincentelli, "The TimberWolf placement and routing package," IEEE Journal of Solid-State Circuits, vol. 20, pp. 510-522, 1985.
17. S. Stanhope and J. Daida, "Optimal mutation and crossover rates for a genetic algorithm operating in a dynamic environment." vol. 1447, V. Porto, N. Saravanan, D. Waagen, and A. Eiben, Eds., Springer Berlin / Heidelberg, 1998, pp. 693-702.
18. P. Cortez, M. Rocha, and J. Neves, "A meta-genetic algorithm for time series forecasting," in Proceedings of Workshop on Artificial Intelligence Techniques for Financial Time Series Analysis (AIFTSA-01), 10th Portuguese Conference on Artificial Intelligence (EPIA'01), Oporto, Portugal, 2001, pp. 21-31.
19. M. Stephenson, S. Amarasinghe, M. Martin, and U.-M. O'Reilly, "Meta optimization: improving compiler heuristics with machine learning," SIGPLAN Notices, vol. 38, pp. 77-90, 2003.
20. M. Meissner, M. Schmuker, and G. Schneider, "Optimized Particle Swarm Optimization (OPSO) and its application to artificial neural network training," BMC bioinformatics, vol. 7, p. 125, 2006.
21. M. Clerc and J. Kennedy, "The particle swarm-explosion, stability, and convergence in a multidimensional complex space," IEEE Transactions on Evolutionary Computation, vol. 6, pp. 58-73, 2002.
22. V. Nannen and A. E. Eiben, "A method for parameter calibration and relevance estimation in evolutionary algorithms," presented at the Proceedings of the 8th Annual Conference on Genetic and Evolutionary Computation, Seattle, Washington, ACM, USA, 2006.
23. V. Nannen and A. E. Eiben, "Relevance estimation and value calibration of evolutionary algorithm parameters," presented at the Proceedings of the 20th international Joint Conference on Artifical Intelligence, Kufmann Publishing Inc. Hyderabad, India, 2007.
24. K. Deb, A. Pratap, S. Agarwal, and T. Meyarivan, "A fast and elitist multiobjective genetic algorithm: NSGA-II," IEEE Transactions on Evolutionary Computation, vol. 6, pp. 182-197, 2002.
25. N. Hansen and S. Kern, "Evaluating the CMA evolution strategy on multimodal test functions," in Genetic and Evolutionary Computation Conference, Seattle, Washington, 2004, pp. 282-291.
26. C. Igel, V. Heidrich-Meisner, and T. Glasmachers, "Shark," Journal of Machine Learning Research, vol. 9, pp. 993-996, 2008.
27. Kruskal, W.H. and W.A. Wallis, Use of Ranks in One-Criterion Variance Analysis. Journal of the American Statistical Association, 1952. 47(260): p. 583-621.
28. Mann, H.B. and D.R. Whitney, On a test of whether one of two random variables is stochastically larger than the other. The annals of mathematical statistics, 1947. 18(1): p. 50-60.
29. D. Sheskin, Handbook of Parametric and Nonparametric Statistical Procedures, 5th ed. NY: Chapman and Hall/CRC, 2011.
30. N. Hansen, A. Auger, S. Finck, and R. Ros, "Real-Parameter Black-Box Optimization Benchmarking 2010: Experimental Setup," INRIA, 2010.
31. E. Burke, T. Curtois, M. Hyde, G. Ochoa, and J. A. Vazquez-Rodriguez, "HyFlex: A Benchmark Framework for Cross-domain Heuristic Search," The Automated Scheduling, Optimisation and Planning (ASAP) Research Group, 2011.