A literature survey of benchmark functions for global optimisation problems

International Journal of Mathematical Modelling and Numerical Optimisation

Volumn 4, Issue 2, 2013, Pages 150-194

  Jamil, Momin ^a   Yang, Xin She ^b  

^a BLEKINGE INSTITUTE OF TECHNOLOGY   (Sweden)

^b MIDDLESEX UNIVERSITY   (United Kingdom)

Author keywords

Global optimisation; Multimodal; Non separable.; Separable; Test functions; Unimodal

Indexed keywords

EID: 84890464528     PISSN: 20403607     EISSN: 20403615     Source Type: Journal    
DOI: 10.1504/IJMMNO.2013.055204     Document Type: Article

References (90)

1. Ackley, D.H. (1987) A Connectionist Machine for Genetic Hill-Climbing, Kluwer, Boston.
2. Adjiman, C.S., Sallwig, S., Flouda, C.A. and Neumaier, A. (1998) 'A global optimization method, aBB for general twice-differentiable NLPs-1, theoretical advances', Computers Chemical Engineering, Vol. 22, No. 9, pp.1137-1158.
3. Adorio, E.P. and Dilman, U.P. (2005) 'MVF -multivariate test function library in c for unconstrained global optimization methods' [online] http://www.geocities.ws/eadorio/mvf.pdf (accessed 20 January 2013
4. Ali, M.M., Khompatraporn, C. and Zabinsky, Z.B. (2005) 'A numerical evaluation of several stochastic algorithms on selected continuous global optimization test problems', Journal of Global Optimization, Vol. 31, No. 4, pp.635-672.
5. Andrei, N. (2008) 'An unconstrained optimization test functions collection', Advanced Modeling and Optimization, Vol. 10, No. 1, pp.147-161.
6. Auger, A., Hansen, N., Mauny, N., Ros, R. and Schoenauer, M. (2007) Bio-Inspired Continuous Optimization: The Coming of Age, Invited Lecture, IEEE Congress on Evolutionary Computation, NJ, USA.
7. Averick, B.M., Carter, R.G. and More, J.J. (1991) The MINIPACK-2 Test Problem Collection, Mathematics and Computer Science Division, Agronne National Laboratory, Technical Memorandum No. 150.
8. Averick, B.M., Carter, R.G., More, J.J. and Xue, G.L. (1992) The MINIPACK-2 Test Problem Collection, Mathematics and Computer Science Division, Agronne National Laboratory, Preprint MCS-P153-0692.
9. Back, T. and Schwefel, H.P. (1993) 'An overview of evolutionary algorithm for parameter optimization', Evolutionary Computation, Vol. 1, No. 1, pp.1-23.
10. Begambre, O. and Laier, J.E. (2009) 'A hybrid particle swarm optimization -simplex algorithm (PSOS) for structural damage identification', Journal of Advances in Engineering Software, Vol. 40, No. 9, pp.883-891.
11. Bekey, G.A. and Ung, M.T. (1974) 'A comparative evaluation of two global search algorithms', IEEE Transaction on Systems, Man and Cybernetics, Vol. 4, No. 1, pp.112-116.
12. Bersini, H., Dorigo, M. and Langerman, S. (1996) 'Results of the first international contest on evolutionary optimization', IEEE International Conf. on Evolutionary Computation, Nagoya, Japan, pp.611-615.
13. Biggs, M.C. (1971) 'A new variable metric technique taking account of non-quadratic behaviour of the objective function', IMA Journal of Applied Mathematics, Vol. 8, No. 3, pp.315-327.
14. Bohachevsky, I.O., Johnson, M.E. and Stein, M.L. (1986) 'General simulated annealing for function optimization', Technometrics, Vol. 28, No. 3, pp.209-217.
15. Boyer, D.O., Martfnez, C.H. and Pedrajas, N.G. (2005) 'Crossover operator for evolutionary algorithms based on population features', Journal of Artificial Intelligence Research, Vol. 24, No. 1, pp.1-48.
16. Brad, Y. (1970) 'Comparison of gradient methods for the solution of nonlinear parametric estimation problem', SIAM Journal on Numerical Analysis, Vol. 7, No. 1, pp.157-186.
17. Branin Jr., F.H. (1972) 'Widely convergent method of finding multiple solutions of simultaneous nonlinear equations', IBM Journal of Research and Development, Vol. 16, No. 5, pp.504-522.
18. Chen, Y. (2003) Computer Simulation of Electron Positron Annihilation Processes, Technical Report SLAC-Report-646, Stanford Linear Accelerator Center, Stanford University [online] http://www.slac.stanford.edu/pubs/slacreports/ slac-r-646.html.
19. Chung, C.J. and Reynolds, R.G. (1998) 'CAEP: an evolution-based tool for real-valued function optimization using cultural algorithms', International Journal on Artificial Intelligence Tool, Vol. 7, No. 3, pp.239-291.
20. Clerc, M. (1999) The Swarm and the Queen, Towards a Deterministic and Adaptive Particle Swarm Optimization, IEEE Congress on Evolutionary Computation, Washington DC, USA, pp.1951-1957.
21. Corana, A., Marchesi, M., Martini, C. and Ridella, S. (1987) 'Minimizing multimodal functions of continuous variables with simulated annealing algorithms', ACM Transactions on Mathematical Software, Vol. 13, No. 3, pp.262-280.
22. Courrieu, P. (1997) 'The hyperbell algorithm for global optimization: a random walk using Cauchy densities', Journal of Global Optimization, Vol. 10, No. 1, pp.111-133.
23. Cragg, E.E. and Levy, A.V. (1969) 'Study on supermemory gradient method for the minimization of functions', Journal of Optimization Theory and Applications, Vol. 4, No. 3, pp.191-205.
24. Csendes,T. and Ratz, D. (1997) 'Subdivision-direction selection in interval methods for global optimization', SIAM Journal on Numerical Analysis, Vol. 34, No. 3, pp.922-938.
25. Damavandi, N. and Safavi-Naeini, S. (2005) 'A hybrid evolutionary programming method for circuit optimization', IEEE Transaction on Circuit and Systems I, Vol. 52, No. 5, pp.902-910.
26. deVillers, N. and Glasser, D. (1981) 'A continuation method for nonlinear regression', SIAM Journal on Numerical Analysis, Vol. 18, No. 6, pp.1139-1154.
27. Dixon, L.C.W. and Price, R.C. (1989) 'The truncated Newton method for sparse unconstrained optimisation using automatic differentiation', Journal of Optimization Theory and Applications, Vol. 60, No. 2, pp.261-275.
28. Dixon, L.C.W. and Szego, G.P. (Eds.) (1978) Towards Global Optimization 2, Elsevier, Boston/Dordrecht/London.
29. El-Attar, R.A., Vidyasagar, M. and Dutta, S.R.K. (1979) 'An algorithm for II-norm minimization with application to nonlinear II-approximation', SIAM Journal on Numerical Analysis, Vol. 16, No. 1, pp.70-86.
30. Fletcher, R. and Powell, M.J.D. (1963) 'A rapidly convergent descent method for minimization', Computer Journal, Vol. 62, No. 2, pp.163-168 [online] http://galton.uchicago.edu/lekheng/courses/302/classics/fletcher-powell.pdf.
31. Flouda, C.A., Pardalos, P.M., Adjiman, C.S., Esposito, W.R., Gumus, Z.H., Harding, S.T., Klepeis, J.L., Meyer, C.A. and Schweiger, C.A. (1999) Handbook of Test Problems in Local and Global Optimization, Kluwer, Boston.
32. Fraley, C. (1989) Software Performances on Nonlinear Least-Squares Problems, Technical Report No. STAN-CS-89-1244, Department of Computer Science, Stanford University [online] http://www.dtic.mil/dtic/tr/fulltext/u2/a204526. pdf.
33. Fu, M.C., Hu, J. and Marcus, S.I. (2006) 'Model-based randomized methods for global optimization', Proc. 17th International Symp. Mathematical Theory Networks Systems, Kyoto, Japan, pp.355-365.
34. GAMS World (2000) GLOBAL Library [online] http://www.gamsworld.org/ global/globallib.html.
35. GEATbx -The Genetic and Evolutionary Algorithm Toolbox for Matlab [online] http://www.geatbx.com
36. Goldstein, A.A. and Price, J.F. (1971) 'On descent from local minima', Mathematics and Computation, Vol. 25, No. 115, pp.569-574.
37. Gordon, V.S. and Whitley, D. (1993) 'Serial and parallel genetic algorithms as function optimizers', in S. Forrest (Ed.): 5th Intl. Conf. on Genetic Algorithms, pp.177-183, Morgan Kaufmann.
38. Gould, N.I.M., Orban, D. and Toint, P.L. (2001) CUTEr, A Constrained and Un-constrained Testing Environment, Revisited [online] http://cuter.rl.ac.uk/ cuter-www/problems.html (accessed 14 July 2012
39. Griewank, A.O. (1981) 'Generalized descent for global optimization', Journal of Optimization Theory and Applications, Vol. 34, No. 1, pp.11-39.
40. Hartman, J.K. (1972) Some Experiments in Global Optimization [online] http://ia701505.us.archive.org/9/items/someexperimentsi00hart/ someexperimentsi00hart.pdf (accessed 15 August 2012).
41. Hedar, A-R. (n.d.) Global Optimization Test Problems [online] http://www-optima.amp.i.kyoto-u.ac.jp/member/student/hedar/Hedar files/TestGO.htm (accessed 17 August 2012
42. Hennart, J.P. (Ed.) (1982) 'Numerical analysis', Proc. 3rd AS Workshop, Lecture Notes in Mathematics, Vol. 90, Springer.
43. Himmelblau, D.M. (1972) Applied Nonlinear Programming, McGraw-Hill, New York.
44. Jennrich, R.I. and Sampson, P.F. (1968) 'Application of stepwise regression to non-linear estimation', Techometrics, Vol. 10, No. 1, pp.63-72 http://www.jstor.org/discover/10.2307/1266224?uid=3737864&uid=2129&uid= 2&uid=70&uid=4&sid=21101664491701.
45. Junior, A.D., Silva, R.S., Mundim, K.C. and Dardenne, L.E. (2004) 'Performance and parameterization of the algorithm simplified generalized simulated annealing', Genet. Mol. Biol., Vol. 27, No. 4, pp.616-622 [online] http://www.scielo.br/scielo.php?script=sci arttext&pid=S1415- 47572004000400024 &lng=en&nrm=iso;
46. ISSN 1415-4757 [online] http://dx.doi.org/10.1590/S1415- 47572004000400024.
47. Lavi, A. and Vogel, T.P. (Eds.) (1966) Recent Advances in Optimization Techniques, John Wliley & Sons, New York.
48. Lootsma, F.A. (Ed.) (1972) Numerical Methods for Non-Linear Optimization, Academic Press, London, New York.
49. Mishra, S.K. (2006a) Performance of Differential Evolution and Particle Swarm Methods on Some Relatively Harder Multi-modal Benchmark Functions [online] http://mpra.ub.uni-muenchen.de/449/(accessed 14 August 2012
50. Mishra, S.K. (2006b) Performance of the Barter, the Differential Evolution and the Simulated Annealing Methods of Global Optimization on Some New and Some Old Test Functions [online] http://www.ssrn.com/abstract=941630 (accessed 14 August 2012
51. Mishra, S.K. (2006c) Repulsive Particle Swarm Method on Some Difficult Test Problems of Global Optimization [online] http://mpra.ub.uni-muenchen.de/ 1742/(accessed 14 August 2012
52. Mishra, S.K. (2006d) Performance of Repulsive Particle Swarm Method in Global Optimization of Some Important Test Functions: A Fortran Program [online] http://www.ssrn.com/abstract=924339 (accessed 14 August 2012
53. Mishra, S.K. (2006e) Global Optimization by Particle Swarm Method: A Fortran Program, Munich Research Papers in Economics [online] http://mpra.ub.uni-muenchen.de/874/(accessed 14 August 2012
54. Mishra, S.K. (2006f) Global Optimization By Differential Evolution and Particle Swarm Methods: Evaluation on Some Benchmark Functions, Munich Research Papers in Economics [online] http://mpra.ub.uni-muenchen.de/1005/(accessed 14 August 2012
55. Mishra, S.K. (2006g) Some New Test Functions For Global Optimization and Performance of Repulsive Particle Swarm Method [online] http://mpra.ub.uni- muenchen.de/2718/(accessed 14 August 2012
56. Moore, R.E. (1988) Reliability in Computing, Academic Press, San Diego, CA, USA.
57. More, J.J., Garbow, B.S. and Hillstrom, K.E. (1981) 'Testing unconstrained optimization software', ACM Trans. on Mathematical Software, Vol. 7, No. 1, pp.17-41.
58. Muntenau, C. and Lazarescu, V. (1998) 'Global search using a new evolutionary framework: the adaptive reservoir genetic algorithm', Complexity International, Vol. 5 [online] http://www.complexity.org.au/ci/vol05/munteanu/ munteanu.html (accessed 14 August 2012
59. Neumaier, A. (2003) COCONUT Benchmark [online] http://www.mat.univie.ac. at/neum/glopt/coconut/benchmark.html (accessed 14 August 2012
60. Opacic, J. (1973) 'A heuristic method for finding most extrema of a nonlinear functional', IEEE Transactions on Systems, Man and Cybernetics, Vol. 3, No. 1, pp.102-107.
61. Pinter, J.D. (1996) Global Optimization in Action: Continuous and Lipschitz Optimization Algorithms, Implementations and Applications, Kluwer, Hingham, MA, USA.
62. Powell, M.J.D. (1962) 'An iterative method for finding stationary values of a function of several variables', Computer Journal, Vol. 5, No. 2, pp.147-151 [online] http://comjnl.oxfordjournals.org/content/5/2/147.full.pdf.
63. Powell, M.J.D. (1964) 'An efficient method for finding the minimum of a function for several variables without calculating derivatives', Computer Journal, Vol. 7, No. 2, pp.155-162.
64. Price, K.V., Storn, R.M. and Lampinen, J.A. (2005) Differential Evolution: A Practical Approach to Global Optimization, Springer-Verlag New York, Inc. Secaucus, NJ, USA.
65. Price, W.L. (1977) 'A controlled random search procedure for global optimisation', Computer Journal, Vol. 20, No. 4, pp.367-370 [online] http://comjnl.oxfordjournals.org/content/20/4/367.full.pdf.
66. Qing, A. (2006) 'Dynamic differential evolution strategy and applications in electromagnetic inverse scattering problems', IEEE Transactions on Geoscience and Remote Sensing, Vol. 44, No. 1, pp.116-125.
67. Ronkkonen, J. (2009) Continuous Multimodal Global Optimization With Differential Evolution-Based Methods, PhD thesis, Lappeenranta University of Technology.
68. Rahnamyan, S., Tizhoosh, H.R. and Salama, N.M.M. (2007a) 'A novel population initialization method for accelerating evolutionary algorithms', Computers and Mathematics with Applications, Vol. 53, No. 10, pp.1605-1614.
69. Rahnamyan, S., Tizhoosh, H.R. and Salama, N.M.M. (2007b) 'Opposition-based differential evolution (ODE) with variable jumping rate', IEEE Symposium Foundations Computation Intelligence, Honolulu, HI, pp.81-88.
70. Rao, S.S. (2009) Engineering Optimization: Theory and Practice, John Wiley & Sons, Hoboken, New Jersey, USA.
71. Rosenbrock, H.H. (1960) 'An automatic method for finding the greatest or least value of a function', Computer Journal, Vol. 3, No. 3, pp.175-184 [online] http://comjnl.oxfordjournals.org/content/3/3/175.full.pdf.
72. Salomon, R. (1996) 'Re-evaluating genetic algorithm performance under corodinate rotation of benchmark functions: a survey of some theoretical and practical aspects of genetic algorithms', BioSystems, Vol. 39, No. 3, pp.263-278.
73. Schaffer, J.D., Caruana, R.A., Eshelman, L.J. and Das, R. (1989) 'A study of control parameters affecting online performance of genetic algorithms for function optimization', Proc. 3rd International Conf. on Genetic Algorithms, George Mason Uni., pp.51-60.
74. Schumer, M.A. and Steiglitz, K. (1968) 'Adaptive step size random search', IEEE Transactions on Automatic Control, Vol. 13, No. 3, pp.270-276.
75. Schwefel, H.P. (1981) Numerical Optimization for Computer Models, John Wiley & Sons, New York, NY, USA.
76. Schwefel, H.P. (1995) Evolution and Optimum Seeking, John Wiley & Sons, New York, NY, USA.
77. Shanno, D.F. (1970) 'Conditioning of Quasi-Newton methods for function minimization', Mathematics of Computation, Vol. 24, No. 111, pp.647-656.
78. Silagadze, Z.K. (2007) 'Finding two-dimensional peaks', Physics of Particles and Nuclei Letters, Vol. 4, No. 1, pp.73-80.
79. Storn, R. and Price, K. (1996) Differential Evolution -A Simple and Efficient Adaptive Scheme for Global Optimization over Continuous Spaces, Technical Report No. TR-95-012, International Computer Science Institute, Berkeley, CA [online] http://www1.icsi.berkeley.edu/storn/TR-95-012.pdf.
80. Suganthan, P.N., Hansen, N., Liang, J.J., Deb, K., Chen, Y-P., Auger, A. and Tiwari, S. (2005) Problem Definitions and Evaluation Criteria for CEC 2005, Special Session on Real-Parameter Optimization, Nanyang Technological University (NTU), Singapore, Tech. Rep. [online] http://www.lri.fr/hansen/Tech-Report-May- 30-05.pdf.
81. Tang, K., Yao, X., Suganthan, P.N., MacNish, C., Chen, Y-P., Chen, C-M. and Yang, Z. (2008) Benchmark Functions for the CEC 2008 Special Session and Competition on Large Scale Global Optimization, Tech. Rep. [online] http://nical.ustc.edu.cn/cec08ss.php.
82. Tang, K., Li, X., Suganthan, P.N., Yang, Z. and Weise, T. (2010) Benchmark Functions for the CEC 2010 Special Session and Competition on Large-Scale Global Optimization, Tech. Rep. [online] http://sci2s.ugr.es/eamhco/ cec2010 functions.pdf.
83. Test Problems for Global Optimization [online] http://www2.imm.dtu.dk/ kajm/Test ex forms/test ex.html.
84. The Cross-Entropy Toolbox [online] http://www.maths.uq.edu.au/CEToolBox/.
85. Wayburn, T.L. and Seader, J.D. (1987) 'Homotopy continuation methods for computer-aided process design', Computers and Chemical Engineering, Vol. 11, No. 1, pp.7-25.
86. Whitley, D., Mathias, K., Rana, S. and Dzubera, J. (1996) 'Evaluating evolutionary algorithms', Artificial Intelligence, Vol. 85, Nos. 1-2, pp.245-276.
87. Winston, P.H. (1992) Artificial Intelligence, 3rd ed., Addison-Wesley, Boston, MA, USA.
88. Yang, X.S. (2010a) 'Test problems in optimization', Engineering Optimization: An Introduction with Metaheuristic Applications, John Wliey & Sons [online] http://arxiv.org/abs/1008.0549.
89. Yang, X.S. (2010b) 'Firefly algorithm, stochastic test functions and design optimisation', Intl. J. Bio-Inspired Computation, Vol. 2, No. 2, pp.78-84 [online] http://arxiv.org/abs/1008.0549.
90. Yao, X. and Liu, Y. (1996) 'Fast evolutionary programming', Proc. 5th Conf. on Evolutionary Programming.