A numerical evaluation of several stochastic algorithms on selected continuous global optimization test problems

Journal of Global Optimization

Volumn 31, Issue 4, 2005, Pages 635-672

  Ali, M Montaz ^a   Khompatraporn, Charoenchai ^b   Zabinsky, Zelda B ^b  

^a UNIVERSITY OF THE WITWATERSRAND   (South Africa)

^b UNIVERSITY OF WASHINGTON   (United States)

Author keywords

Controlled random search; Differential evolution; Empirical comparison of algorithms; Genetic algorithm; Global optimization; Hide and Seek; Improving Hit and Run; Performance profile and Test problems; Population set based global optimization

Indexed keywords

BENCHMARKING; GENETIC ALGORITHMS; NUMERICAL ANALYSIS; PROBLEM SOLVING; RANDOM PROCESSES; SIMULATED ANNEALING;

CONTROLLED RANDOM SEARCH; DIFFERENTIAL EVOLUTION; EMPIRICAL COMPARISON OF ALGORITHMS; HIDE-AND-SEEK; IMPROVING HIT-AND-RUN; PERFORMANCE PROFILE AND TEST PROBLEMS; POPULATION SET BASED GLOBAL OPTIMIZATION;

GLOBAL OPTIMIZATION;

EID: 22044435106     PISSN: 09255001     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10898-004-9972-2     Document Type: Conference Paper

References (46)

1. Ali, M.M. and Storey, C. (1994), Modified controlled random search algorithms. International Journal of Computer Mathematics 54, 229-235.
2. Ali, M.M., Storey, C. and Törn, A. (1997), Application of some stochastic global optimization algorithms to practical problems. Journal of Optimization Theory and Applications 95, 545-563.
3. Ali, M.M. and Törn, A. (2004), Population set based global optimization algorithms: Some modifications and numerical studies. Computers and Operations Research 31,(10), 1703-1725.
4. Ali, M.M. and Törn, A. (2002), Topographical differential evolution Algorithm using pre-calculated differentials. In: Zilinskas, A., Dzemyda, G. and Saltenis, V. (eds.), Stochastic and Global Optimization, pp. 1-17. Kluwer Academic Publishers, Dordrecht/Boston/ London.
5. Aluffi-Pentini, F., Parisi, V. and Zirilli, F. (1985), Global optimization and stochastic differential equations. Journal of Optimization Theory and Applications 47, 1-16.
6. Benke, K.K. and Skinner, D.R. (1991), A direct search algorithm for global optimization of multivariate functions. The Australian Computer Journal 23, 73-85.
7. Bersini, H., Dorigo, M., Langerman, S., Seront, G. and Gambardella, L. (1996), Results of the first International Contest on Evolutionary Optimization (1st ICEO). In: Proceedings of the IEEE International Conference on Evolutionary Computation (ICEC), pp. 611-615 IEEE Press, New York.
8. Bohachevsky, M.E., Johnson, M.E. and Stein, M.L. (1986), Generalized simulated annealing for function optimization. Technometrics 28, 209-217.
9. Breiman, L. and Cutler, A. (1993), A deterministic algorithm for global optimization, Mathematical Programming 58, 179-199.
10. Dekkers, A. and Aarts, E. (1991), Global optimization and simulated annealing. Mathematical Programming 50, 367-393.
11. Dixon, L. and Szegö, G. (1975), Towards Global Optimization, North Holland, New York.
12. Dixon, L. and Szegö, G. (1978), Towards Global Optimization, Vol. 2, North Holland, New York.
13. Dolan, D. and Moré, J. (2002), Benchmarking Optimization Software with Performance Profiles. Mathematical Programming Series A. 91, 201-213.
14. Floudas, C.A. and Pardalos, P.M. (1990), A Collection of Test Problems for Constrained Global Optimization Algorithms, Lecture Notes in Computer Science, Vol. 455, Springer-Verlag, Berlin/Heidelberg/New York.
15. Floudas, C.A., Pardalos, P.M., Adjiman, C.S., Esposito, W.R., Gümüs, Z.H., Harding, S.T., Klepeis, J.L., Meyer, C.A. and Schweiger, C.A. (1999), Handbook of Test Problems in Local and Global Optimization, Kluwer Academic Publishers, Dordrecht/Boston/London.
16. GAMS World (2002), GLOBAL Library, WWW-document, http://www.gamsworld. org/ global/globallib.htm.
17. Goldberg, D. (1989), Genetic Algorithm in Search, Optimization and Machine Learning, Addison-Wesley Publishing Company, Reading.
18. Gould, N.I.M, Orban, D. and Toint, P.L. (2001), CUTEr, a constrained and unconstrained testing environment, revisited, WWW-document, http://cuter.rl.ac. uk/cuter-www/problems.html.
19. Griewank, A.O. (1981), Generalized Descend for Global Optimization. Journal of Optimization Theory and Applications 34, 11-39.
20. Himmelblau, D.M. (1972), Applied Nonlinear Programming, McGraw-Hill, New York.
21. Jansson, C. and Knüppel, O. (1995), A Branch and Bound Algorithm for Bound Constrained Optimization Problems without Derivatives. Journal of Global Optimization 7, 297-331.
22. Khompatraporn, C., Pintér, J.D. and Zabinsky, Z.B. (2005), Comparative Assessment of Algorithms and Software for Global Optimization. Journal of Global Optimization 31, 613-633.
23. Levy, A.V. and Montalvo, A. (1985), The tunneling algorithm for the global minimization of functions. Society for Industrial and Applied Mathematics 6, 15-29.
24. McCormick, G.P. (1982), Applied Nonlinear Programming, Theory, Algorithms and Applications, John Wiley and Sons, New York.
25. Metropolis, N., Rosenbluth, A.W., Rosenbluth, M.N., Teller, A.H. and Teller, E. (1953), Equation of state Calculations by fast computing machines. Journal of Chemical Physics 21, 1087-1092.
26. Michalewicz, Z. (1996), Genetic Algorithms + Data Structures = Evolution Programs, Springer-Verlag, Berlin/Heidelberg/New York.
27. Moré, J., Garbow, B. and Hillstrom, K. (1981), Testing Unconstrained Optimization Software, ACM Transaction on Mathematical Software 7, 17-41.
28. Muhlenbein, H., Schomisch, S. and Born, J. (1991), The parallel genetic algorithm as function optimizer, In: Belew R. and Booker, L. (eds.), Proceedings of the Fourth International Conference on Genetic Algorithms, Morgan Kaufman pp. 271-278.
29. Neumaier, A. (2003a), COCONUT benchmark, WWW-document, http://www.mat.univie.ac.at/~neum/glopt/coconut/benchmark.html
30. Neumaier, A. (2003b), Global and Local Optimization, WWW-document, http:// solon.cma.univie.ac.at/~neum/glopt.html.
31. Price, W.L. (1977), Global optimization by controlled random search. Computer Journal 20, 367-370.
32. Price, W.L. (1983), Global optimization by controlled random search. Journal of Optimization Theory and Applications 40, 333-348.
33. Price, W.L. (1987), Global optimization algorithms for a CAD workstation. Journal of Optimization Theory and Applications 55, 133-146.
34. Price, K.V. (2002), Private Communication, 836 Owl Circle, Vacaville, CA 95687.
35. Romeijn, H.E. and Smith, R.L. (1994), Simulated annealing for constrained global optimization. Journal of Global Optimization 5, 101-126.
36. Salomon, R. (1995), Reevaluating genetic algorithms performance under coordinate rotation of benchmark functions, BioSystems 39(3): 263-278.
37. Schwefel, H.P. (1995), Evolution and Optimum Seeking, John Wiley and Sons, New York.
38. Second (2nd) ICEO: Second International Contest on Evolutionary Optimization, WWW-document, http://iridia.ulb.ac.be/langerman/2ndICEO.html.
39. Smith, R.L. (1984), Efficient Monte Carlo procedures for generating random feasible points uniformly over bounded regions. Operations Research 32, 1296-1308.
40. Storn, R. and Price, K. (1997), Differential evolution: A simple and efficient heuristic for global optimization over continuous spaces. Journal of Global Optimization 11, 341-359.
41. Törn, A. and Žilinskas, A. (1989), Global Optimization, Lecture Notes in Computer Science, Vol. 350, Springer-Verlag, Berlin/Heidelberg/New York.
42. Wolfe, M.A. (1978), Numerical Methods for Unconstrained Optimization, Van Nostrand Reinhold Company, New York.
43. Wood, G.R. and Zabinsky, Z.B. (2002), Stochastic adaptive search. In: Pardalos, P. and Romeijn, E. (eds.), Handbook of Global Optimization, pp. 231-249 Kluwer Academic Publishers, Dordrecht/Boston/London.
44. Zabinsky, Z.B. Graesser, D.L., Tuttle, M.E. and Kim, G.I. (1992), Global optimization of composite laminates using improving hit and run, In: Floudas C. and Pardalos P. (eds.), pp. 343-368. Recent Advances in Global Optimization, Princeton University Press.
45. Zabinsky, Z.B., Smith, R.L., McDonald, J.F., Romeijn, H.E. and Kaufman, D.E. (1993), Improving hit-and-run for global optimization. Journal of Global Optimization 3, 171-192.
46. Zabinsky, Z.B. and Wood, G.R. (2002), Implementation of stochastic adaptive search with hit-and-run for a generator, In: Pardolos, P. and Romeijn, E. (eds.), Handbook of Global Optimization, pp. 251-273. Kluwer Academic Publishers, Dordrecht/Boston/London: