A modified Covariance Matrix Adaptation Evolution Strategy with adaptive penalty function and restart for constrained optimization

Expert Systems with Applications

Volumn 41, Issue 16, 2014, Pages 7077-7094

  De Melo, Vinícius Veloso ^a   Iacca, Giovanni ^b  

^a FEDERAL UNIVERSITY OF SÃO PAULO   (Brazil)

^b INCAS3 ^*  (Netherlands)

Author keywords

Adaptive penalty function; Constrained optimization; Covariance Matrix Adaptation Evolution Strategy

Indexed keywords

CONSTRAINED OPTIMIZATION; EVOLUTIONARY ALGORITHMS;

ADAPTIVE PENALTY FUNCTIONS; CONSTRAINED OPTIMI-ZATION PROBLEMS; CONSTRAINT HANDLING; COVARIANCE MATRIX ADAPTATION EVOLUTION STRATEGIES; ENGINEERING PROBLEMS; MULTIPLE CONSTRAINT; OPTIMIZATION PROBLEMS; STATE-OF-THE-ART ALGORITHMS;

PROBLEM SOLVING;

EID: 84904311130     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2014.06.032     Document Type: Article

References (82)

1. Z. Michalewicz Genetic algorithms + data structures = evolution programs Vol. 3 1996 Springer-Verlag Heidelberg
2. C.A. Coello Coello Use of a self-adaptive penalty approach for engineering optimization problems Computers in Industry 41 2000 113 127 (Pubitemid 30560174)
3. C.A. Coello Coello, and E. Mezura-Montes Constraint-handling in genetic algorithms through the use of dominance-based tournament selection Advanced Engineering Informatics 16 2002 193 203
4. E. Mezura-Montes, and C.A. Coello Coello A simple multimembered evolution strategy to solve constrained optimization problems IEEE Transactions on Evolutionary Computation 9 2005 1 17 (Pubitemid 40337296)
5. Hu, X., Eberhart, R., & Shi, Y. Engineering optimization with particle swarm. In 2003 IEEE swarm intelligence symposium (SIS 2003) (pp. 53-57).
6. Aguirre, A., Muñoz Zavala, A., Villa Diharce, E., & Botello Rionda, S. (2007). COPSO: Constrained Optimization via PSO algorithm, Technical Report I-07-04, Center of Research in Mathematics (CIMAT), Guanajuato, México.
7. L.C. Cagnina, S.C. Esquivel, and C.A.C. Coello Solving engineering optimization problems with the simple constrained particle swarm optimizer Informatica 32 2008 319 326
8. M. Pant, R. Thangaraj, and A. Abraha Low discrepancy initialized particle swarm optimization for solving constrained optimization problems Fundamental Information 95 2009 511 531
9. L.d.S. Coelho Gaussian quantum-behaved particle swarm optimization approaches for constrained engineering design problems Expert Systems with Applications 37 2010 1676 1683
10. Q. He, and L. Wang An effective co-evolutionary particle swarm optimization for constrained engineering design problems Engineering Applications of Artificial Intelligence 20 2007 89 99 (Pubitemid 44692464)
11. X.-S. Yang, and S. Deb Engineering optimisation by cuckoo search International Journal of Mathematical Modelling and Numerical Optimisation 1 2010 330 343
12. I. Brajevic, M. Tuba, and M. Subotic Performance of the improved artificial bee colony algorithm on standard engineering constrained problems International Journal of Mathematics And Computers In Simulation 5 2011 135 143
13. E. Mezura-Montes, C.A. Coello Coello, E.I. Tun-Morales, S.D. Computación, and V. Tabasco Simple feasibility rules and differential evolution for constrained optimization 3rd mexican international conference on artificial intelligence (MICAI 2004) 2004 Springer-Verlag 707 716 (Pubitemid 38716836)
14. Mezura-Montes, E., Coello Coello, C. A., & Velázquez-Reyes, J. Increasing successful offspring and diversity in differential evolution for engineering design. In I. Parmee (Ed.), 7th International conference on adaptive computing in design and manufacture (pp. 131-139). Bristol: Springer, UK.**
15. Mezura-Montes, E., & Palomeque-Ortiz, A. G. Parameter control in differential evolution for constrained optimization. In 2009 IEEE congress on evolutionary computation (CEC 2009) (pp. 1375-1382). Piscataway, NJ, USA.
16. E. Mezura-Montes, and A.G. Palomeque-Ortiz Self-adaptive and deterministic parameter control in differential evolution for constrained optimization E. Mezura-Montes, Constraint-handling in evolutionary computation Studies in computational intelligence Vol. 198 2009 Springer Berlin 978-3-642-00618-0 95 120
17. Y. Wang, and Z. Cai Constrained evolutionary optimization by means of (μ + λ)-differential evolution and improved adaptive trade-off model Evolutionary Computation 19 2011 249 285
18. V.V. de Melo, and G.L.C. Carosio Evaluating differential evolution with penalty function to solve constrained engineering problems Expert Systems with Applications 39 2012 7860 7863
19. A.W. Mohamed, and H.Z. Sabry Constrained optimization based on modified differential evolution algorithm Information Science 194 2012 171 208
20. Mezura-Montes, E., & Lopez-Ramirez, B. C. Comparing bio-inspired algorithms in constrained optimization problems In 2007 IEEE congress on evolutionary computation (CEC 2007) (pp. 662-669).
21. H. Liu, Z. Cai, and Y. Wang Hybridizing particle swarm optimization with differential evolution for constrained numerical and engineering optimization Applied Soft Computing 10 2010 629 640
22. Q. He, and L. Wang A hybrid particle swarm optimization with a feasibility-based rule for constrained optimization Applied Mathematics and Computation 186 2007 1407 1422 (Pubitemid 46497348)
23. Sun, J. & Garibaldi, J. M. A novel memetic algorithm for constrained optimization. In 2010 IEEE congress on evolutionary computation (CEC 2010) (pp. 549-556). Barcelona, Spain.
24. Ullah, A. Sarker, R. Cornforth, D. & Lokan, C. An agent-based memetic algorithm (AMA) for solving constrained optimization problems. In 2007 IEEE congress on evolutionary computation (CEC 2007) (pp. 999-1006).
25. Pescador Rojas, M. & Coello Coello, C. A. (2012). A memetic algorithm with simplex crossover for solving constrained optimization problems. In World automation congress (WAC) (pp. 1-6).
26. N. Noman, and H. Iba Accelerating differential evolution using an adaptive local search IEEE Transactions on Evolutionary Computation 12 2008 107 125 (Pubitemid 351330335)
27. L. Clevenger, L. Ferguson, and W.E. Hart A filter-based evolutionary algorithm for constrained optimization Evolutionary Computation 13 2005 329 352 (Pubitemid 41335761)
28. N. Hansen, S.D. Müller, and P. Koumoutsakos Reducing the time complexity of the derandomized evolution strategy with covariance matrix adaptation (CMA-ES) Evolutionary Computation 11 2003 1 18 (Pubitemid 37044186)
29. Schwefel, H. P. (1965). Kybernetische Evolution als Strategie der experimentellen Forschung in der Strömungstechnik (Ph.D. thesis). Technical University of Berlin, Hermann Föttinger-Institute for Fluid Dynamics.
30. Rechenberg, I. (1971). Evolutionsstrategie - Optimierung technischer Systeme nach Prinzipien der biologischen Evolution (Ph.D. thesis). Technical University of Berlin.
31. N. Hansen, and A. Ostermeier Completely derandomized self-adaptation in evolution strategies Evolutionary Computation 9 2001 159 195
32. Hansen, N. & Ostermeier, A. (1996). Adapting arbitrary normal mutation distributions in evolution strategies: the covariance matrix adaptation, in: IEEE international conference on evolutionary computation (pp. 312-317).
33. Auger, A. & Hansen, N. A restart CMA evolution strategy with increasing population size. In 2005 IEEE congress on evolutionary computation (CEC 2005) (pp. 1769-1776). Canberra.
34. Ghosh, S., Roy, S., Islam, S., Das, S., & Suganthan, P. A differential covariance matrix adaptation evolutionary algorithm for global optimization. In 2011 IEEE symposium on differential evolution (SDE) (pp. 1-8).
35. D. Molina, M. Lozano, C. Garcia-Martinez, and F. Herrera Memetic algorithms for continuous optimization based on local search chains Evolutionary Computation 18 2010 27 63
36. Caraffini, F., Iacca, G., Neri, F., Picinali, L., & Mininno, E. A CMA-ES super-fit scheme for the re-sampled inheritance search. In 2013 IEEE congress on evolutionary computation (CEC 2013) (pp. 1123-1130).
37. C. Igel, T. Suttorp, and N. Hansen A computational efficient covariance matrix update and a (1+1)-CMA for evolution strategies 2006 genetic and evolutionary computation conference (GECCO 2006) 2006 ACM Press 453 460 (Pubitemid 44611358)
38. Hansen, N. Benchmarking a BI-population CMA-ES on the BBOB-2009 function testbed. In 2009 Genetic and evolutionary computation conference (GECCO 2009) (pp. 2389-2396).
39. Loshchilov, I. Schoenauer, M. & Sebag, M. Alternative restart strategies for CMA-ES. In Parallel problem solving from nature-PPSN (Vol. XII, pp. 296-305).
40. Loshchilov, I. Schoenauer, M. & Sebag, M. Intensive surrogate model exploitation in self-adaptive surrogate-assisted CMA-ES (saACM-ES). In 2013 genetic and evolutionary computation conference (GECCO 2013) (pp. 439-446).
41. N. Hansen, A.S.P. Niederberger, L. Guzzella, and P. Koumoutsakos A method for handling uncertainty in evolutionary optimization with an application to feedback control of combustion IEEE Transactions on Evolutionary Computation 13 2009 180 197
42. G. Collange, N. Delattre, N. Hansen, I. Quinquis, and M. Schoenauer Multidisciplinary optimisation in the design of future space launchers P. Breitkopf, R.F. Coelho, Multidisciplinary design optimization in computational mechanics 2010 Wiley 487 496
43. O. Kramer, A. Barthelmes, and G. Rudolph Surrogate constraint functions for CMA evolution strategies 32nd annual German conference on advances in artificial intelligence KI'09 2009 Springer-Verlag Berlin, Heidelberg 169 176
44. D.V. Arnold, and N. Hausen A (1+1)-CMA-ES for constrained optimisation 2012 genetic and evolutionary computation conference (GECCO 2012) 2012 ACM Press Philadelphia, USA 297 304 ISBN: 978-1-4503-1177-9.
45. H.-G. Beyer, and S. Finck On the design of constraint covariance matrix self-adaptation evolution strategies including a cardinality constraint IEEE Transactions on Evolutionary Computation 16 2012 578 596
46. E.G. Birgin, and J.M. Martínez Augmented lagrangian method with nonmonotone penalty parameters for constrained optimization Computational Optimization and Applications 51 2012 941 965
47. Liang, J. Runarsson, T. Mezura-Montes, E. Clerc, M. Suganthan, P. Coello, C. & Deb, K. (2006). Problem definitions and evaluation criteria for the CEC 2006 special session on constrained real-parameter optimization. Technical Report, Singapore.
48. L. Wang, and L.-p. Li An effective differential evolution with level comparison for constrained engineering design Structural and Multidisciplinary Optimization 41 2010 947 963
49. T. Takahama, and S. Sakai Constrained optimization by the ε constrained differential evolution with gradient-based mutation and feasible elites G.G. Yen, S.M. Lucas, G. Fogel, G. Kendall, R. Salomon, B.-T. Zhang, 2006 IEEE congress on evolutionary computation (CEC 2006) 2006 IEEE Press Vancouver, BC, Canada 1 8 (Pubitemid 47130472)
50. V. Huang, A. Qin, and P. Suganthan Self-adaptive differential evolution algorithm for constrained real-parameter optimization G.G. Yen, S.M. Lucas, G. Fogel, G. Kendall, R. Salomon, B.-T. Zhang, 2006 IEEE congress on evolutionary computation (CEC 2006) 2006 IEEE Press Vancouver, BC, Canada 17 24 (Pubitemid 47130474)
51. E. Mezura-Montes, J. Velazquez-Reyes, and C.C. Coello Modified differential evolution for constrained optimization 2006 IEEE congress on evolutionary computation (CEC 2006) 2006 IEEE Press Vancouver, BC, Canada 25 32 (Pubitemid 47130475)
52. M. Tasgetiren, and P. Suganthan A multi-populated differential evolution algorithm for solving constrained optimization problem G.G. Yen, S.M. Lucas, G. Fogel, G. Kendall, R. Salomon, B.-T. Zhang, 2006 IEEE congress on evolutionary computation (CEC 2006) 2006 IEEE Press Vancouver, BC, Canada 33 40 (Pubitemid 47130476)
53. S. Kukkonen, and J. Lampinen Constrained real-parameter optimization with generalized differential evolution G.G. Yen, S.M. Lucas, G. Fogel, G. Kendall, R. Salomon, B.-T. Zhang, 2006 IEEE congress on evolutionary computation (CEC 2006) 2006 IEEE Press Vancouver, BC, Canada 207 214 (Pubitemid 47130499)
54. J. Liang, and P. Suganthan Dynamic multi-swarm particle swarm optimizer with a novel constraint-handling mechanism G.G. Yen, S.M. Lucas, G. Fogel, G. Kendall, R. Salomon, B.-T. Zhang, 2006 IEEE congress on evolutionary computation (CEC 2006) 2006 IEEE Press Vancouver, BC, Canada 9 16 (Pubitemid 47130473)
55. A. Sinha, A. Srinivasan, and K. Deb A population-based parent centric procedure for constrained real-parameter optimization G.G. Yen, S.M. Lucas, G. Fogel, G. Kendall, R. Salomon, B.-T. Zhang, 2006 IEEE congress on evolutionary computation (CEC 2006) 2006 IEEE Press Vancouver, BC, Canada 239 245 (Pubitemid 47130503)
56. J. Brest, V. Zumer, and M. Maucec Self-adaptive differential evolution algorithm in constrained real-parameter optimization G.G. Yen, S.M. Lucas, G. Fogel, G. Kendall, R. Salomon, B.-T. Zhang, 2006 IEEE congress on evolutionary computation (CEC 2006) 2006 IEEE Press Vancouver, BC, Canada 215 222 (Pubitemid 47130500)
57. A.O. Kusakci, and M. Can An adaptive penalty based covariance matrix adaptation-evolution strategy Computers & Operations Research 40 2013 2398 2417
58. Ben Hamida, S. Schoenauer, M. Aschea: New results using adaptive segregational constraint handling. In 2002 IEEE evolutionary computation (CEC 2002) (Vol. 1, pp. 884-889). IEEE Press.
59. Kusakci, A. O. (2013). Constrained optimization with evolution strategies: Adaptive approaches (Ph.D. thesis). International University of Sarajevo.
60. V.V. de Melo, and G.L.C. Carosio Investigating multi-view differential evolution for solving constrained engineering design problems Expert Systems with Applications 40 2013 3370 3377
61. C.A.C. Coello, and E. Mezura-Montes Constraint-handling in genetic algorithms through the use of dominance-based tournament selection Advanced Engineering Informatics 16 2002 193 203
62. C.A. Coello Coello, and R.L. Becerra Efficient evolutionary optimization through the use of a cultural algorithm Engineering Optimization 36 2004 219 236
63. E. Zahara, and Y.-T. Kao Hybrid Nelder-Mead simplex search and particle swarm optimization for constrained engineering design problems Expert Systems with Applications 36 2009 3880 3886
64. R.L. Becerra, and C.A.C. Coello Cultured differential evolution for constrained optimization Computer Methods in Applied Mechanics and Engineering 195 2006 4303 4322 (Pubitemid 44287665)
65. E. Mezura-Montes, and C.A.C. Coello Useful infeasible solutions in engineering optimization with evolutionary algorithms A.F. Gelbukh, A. de Albornoz, H. Terashima-Marín, MICAI Lecture notes in computer science Vol. 3789 2005 Springer 652 662 (Pubitemid 43763570)
66. D. Karaboga, and B. Basturk Artificial bee colony (ABC) optimization algorithm for solving constrained optimization problems P. Melin, O. Castillo, L.T. Aguilar, J. Kacptrzyk, W. Pedrycz, Foundations of fuzzy logic and soft computing, 12th international fuzzy systems association, world congress, IFSA 2007 Lecture notes in artificial intelligence Vol. 4529 2007 Springer Cancun, Mexico 789 798 (Pubitemid 350270033)
67. R.V. Rao, V.J. Savsani, and D.P. Vakharia Teaching-learning-based optimization: A novel method for constrained mechanical design optimization problems Computer-Aided Design 43 2011 303 315
68. A. Sadollah, A. Bahreininejad, H. Eskandar, and M. Hamdi Mine blast algorithm: A new population based algorithm for solving constrained engineering optimization problems Applied Soft Computing 13 2013 2592 2612
69. M. Zhang, W. Luo, and X. Wang Differential evolution with dynamic stochastic selection for constrained optimization Information Sciences 178 2008 3043 3074
70. T. Ray, and K. Liew Society and civilization: an optimization algorithm based on the simulation of social behavior IEEE Transactions on Evolutionary Computation 7 2003 386 396
71. Y. Wang, Z. Cai, Y. Zhou, and Z. Fan Constrained optimization based on hybrid evolutionary algorithm and adaptive constraint-handling technique Structural and Multidisciplinary Optimization 37 2009 395 413
72. Mezura-Montes, E. Velazquez-Reyes, J. & Coello Coello, C. Modified differential evolution for constrained optimization. In 2006 IEEE congress on evolutionary computation (CEC 2006) (pp. 25-32).
73. L. dos Santos Coelho Gaussian quantum-behaved particle swarm optimization approaches for constrained engineering design problems Expert Systems with Applications 37 2010 1676 1683
74. I.C. Trelea The particle swarm optimization algorithm: convergence analysis and parameter selection Information Processing Letters 85 2003 317 325
75. K.E. Parsopoulos, and M.N. Vrahatis Unified particle swarm optimization for solving constrained engineering optimization problems Advances in natural computation, first international conference 2005, (ICNC 2005) Lecture notes in computer science Vol. 3612 2005 Springer Changsha, China 582 591 (Pubitemid 41449622)
76. F.-Z. Huang, L. Wang, and Q. He An effective co-evolutionary differential evolution for constrained optimization Applied Mathematics and Computation 186 2007 340 356 (Pubitemid 46435619)
77. G. Iacca, F. Neri, E. Mininno, Y.S. Ong, and M.H. Lim Ockham's Razor in memetic computing: three stage optimal memetic exploration Information Sciences 188 2012 17 43
78. F. Caraffini, F. Neri, G. Iacca, and A. Mol Parallel memetic structures Information Sciences 227 2013 60 82
79. Cagnina, L. C., Esquivel, S. C., & Coello, C. A. C. (2008). Solving engineering optimization problems with the simple constrained particle swarm optimizer. In B. Filipic, J. Silc (Eds.), Third international conference on bioinspired optimization methods and their applications (BIOMA 2008) (pp. 107-120). Jozef Stefan Institute, Ljubljana, Slovenia. ISBN 978-961-264-002-6.
80. A. Gandomi, X.-S. Yang, and A. Alavi Cuckoo search algorithm: A metaheuristic approach to solve structural optimization problems Engineering with Computers 2011 10.1007/s00366-011-0241-y
81. A.H. Kashan An efficient algorithm for constrained global optimization and application to mechanical engineering design: League championship algorithm (LCA) Computer-Aided Design 43 2011 1769 1792
82. H. Shen, Y. Zhu, B. Niu, and Q. Wu An improved group search optimizer for mechanical design optimization problems Progress in Natural Science 19 2009 91 97