Generalized decomposition and cross entropy methods for many-objective optimization

Information Sciences

Volumn 282, Issue , 2014, Pages 363-387

  Giagkiozis, I ^a   Purshouse, R C ^a   Fleming, P J ^a  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

Author keywords

Convex optimization; Cross entropy method; Decomposition method; Generalized decomposition; Many objective optimization

Indexed keywords

CONVEX OPTIMIZATION; MULTIOBJECTIVE OPTIMIZATION; OPTIMAL SYSTEMS; PARETO PRINCIPLE;

CROSS-ENTROPY METHOD; DECOMPOSITION METHODS; ESTIMATION OF DISTRIBUTION ALGORITHM (EDA); HIGH DIMENSIONAL SPACES; MANY-OBJECTIVE OPTIMIZATIONS; MULTI-OBJECTIVE OPTIMIZATION PROBLEM; PARETO OPTIMAL SOLUTIONS; PERFORMANCE OBJECTIVE;

ALGORITHMS;

EID: 84905158884     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2014.05.045     Document Type: Article

References (66)

1. P. Fleming, and R. Purshouse Evolutionary algorithms in control systems engineering: a survey Control Eng. Pract. 10 11 2002 1223 1241 (Pubitemid 36073055)
2. M. Tapia, C. Coello, Applications of multi-objective evolutionary algorithms in economics and finance: a survey, in: IEEE Congress on Evolutionary Computation, 2007, pp. 532-539.
3. N. Krasnogor, W. Hart, J. Smith, D. Pelta, Protein structure prediction with evolutionary algorithms, in: Proceedings of the Genetic and Evolutionary Computation Conference, vol. 2, 1999, pp. 1596-1601.
4. K. Miettinen Nonlinear Multiobjective Optimization vol. 12 1999 Springer
5. E. Zitzler, M. Laumanns, L. Thiele, et al., SPEA2: improving the strength Pareto evolutionary algorithm, in: EUROGEN, no. 103, 2001, pp. 1-21.
6. R. Purshouse, and P. Fleming Evolutionary many-objective optimisation: an exploratory analysis IEEE Congress on Evolutionary Computation vol. 3 2003 IEEE 2066 2073
7. D. Goldberg, and J. Holland Genetic algorithms and machine learning Mach. Learn. 3 2 1988 95 99
8. I. Giagkiozis, R.C. Purshouse, and P.J. Fleming An overview of population-based algorithms for multi-objective optimisation Int. J. Syst. Sci. 0 0 2013 1 28
9. C. Fonseca, P. Fleming, Genetic algorithms for multiobjective optimization: formulation, discussion and generalization, in: Conference on Genetic Algorithms, vol. 423, 1993, pp. 416-423.
10. Q. Zhang, and H. Li MOEA/D: a multiobjective evolutionary algorithm based on decomposition IEEE Trans. Evol. Comput. 11 6 2007 712 731 (Pubitemid 350187486)
11. F. Edgeworth, Mathematical Psychics: An Essay on the Application of Mathematics to the Moral Sciences, no. 10, CK Paul, 1881.
12. V. Pareto, Cours d'économie politique, Librairie Droz, 1896.
13. H. Ishibuchi, N. Tsukamoto, Y. Nojima, Evolutionary many-objective optimization: a short review, in: IEEE Congress on Evolutionary Computation, 2008, pp. 2419-2426.
14. R. Takahashi, R. Saldanha, W. Dias-Filho, and J. Ramírez A new constrained ellipsoidal algorithm for nonlinear optimization with equality constraints IEEE Trans. Magn. 39 3 2003 1289 1292
15. A. Jaszkiewicz On the performance of multiple-objective genetic local search on the 0/1 knapsack problem - a comparative experiment IEEE Trans. Evol. Comput. 6 4 2002 402 412 (Pubitemid 35032741)
16. E. Hughes Multiple single objective Pareto sampling Congress on Evolutionary Computation vol. 4 2003 IEEE 2678 2684
17. E. Hughes, MSOPS-II: a general-purpose many-objective optimiser, in: IEEE Congress on Evolutionary Computation, 2007, pp. 3944-3951.
18. I. Giagkiozis, R.C. Purshouse, and P.J. Fleming Generalized decomposition Evolutionary Multi-Criterion Optimization Lecture Notes in Computer Science vol. 7811 2013 Springer Berlin, Heidelberg 428 442
19. S. Jiang, Z. Cai, J. Zhang, Y.-S. Ong, Multiobjective optimization by decomposition with Pareto-adaptive weight vectors, in: International Conference on Natural Computation, vol. 3, 2011, pp. 1260-1264.
20. S. Jiang, J. Zhang, and Y. Ong Asymmetric Pareto-adaptive scheme for multiobjective optimization Advances in Artificial Intelligence Lecture Notes in Computer Science vol. 7106 2011 Springer Berlin, Heidelberg 351 360
21. E. Zitzler, and L. Thiele Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach IEEE Trans. Evol. Comput. 3 4 1999 257 271 (Pubitemid 30544879)
22. L. While, P. Hingston, L. Barone, and S. Huband A faster algorithm for calculating hypervolume IEEE Trans. Evol. Comput. 10 1 2006 29 38 (Pubitemid 43174983)
23. C. Fonseca, L. Paquete, M. Lopez-Ibanez, An improved dimension-sweep algorithm for the hypervolume indicator, in: IEEE Congress on Evolutionary Computation, 2006, pp. 1157-1163. (Pubitemid 47130629)
24. F. Gu, H. Liu, and K. Tan A multiobjective evolutionary algorithm using dynamic weight method Int. J. Innov. Comput. Inform. Control 8 5B 2012 3677 3688
25. I. Giagkiozis, R. Purshouse, P. Fleming, Towards understanding the cost of adaptation in decomposition-based optimization algorithms, in: IEEE International Conference on Systems, Man and Cybernetics, 2013, pp. 615-620.
26. S. Huband, P. Hingston, L. Barone, and L. While A review of multiobjective test problems and a scalable test problem toolkit IEEE Trans. Evol. Comput. 10 5 2006 477 506 (Pubitemid 44560739)
27. K. Deb, L. Thiele, M. Laumanns, E. Zitzler, Scalable multi-objective optimization test problems, in: Congress on Evolutionary Computation, vol. 1, 2002, pp. 825-830.
28. E. Zitzler, K. Deb, and L. Thiele Comparison of multiobjective evolutionary algorithms: empirical results Evol. Comput. 8 2 2000 173 195
29. H. Mühlenbein, and G. Paass From recombination of genes to the estimation of distributions I. Binary parameters Parall. Probl. Solving Nat. 1996 178 187 (Pubitemid 126128306)
30. J. He, and X. Yao Drift analysis and average time complexity of evolutionary algorithms Artif. Intell. 127 1 2001 57 85 (Pubitemid 32264935)
31. T. Chen, K. Tang, G. Chen, and X. Yao Analysis of computational time of simple estimation of distribution algorithms IEEE Trans. Evol. Comput. 14 1 2010 1 22
32. M. Hauschild, M. Pelikan, A Survey of Estimation of Distribution Algorithms, Tech. Rep., University of Missouri - St. Louis, 2011.
33. M. Pelikan Bayesian optimization algorithm Hierarchical Bayesian Optim. Algor. 2005 31 48
34. L. Emmendorfer, and A. Pozo Effective linkage learning using low-order statistics and clustering IEEE Trans. Evol. Comput. 13 6 2009 1233 1246
35. C. Echegoyen, Q. Zhang, A. Mendiburu, R. Santana, and J. Lozano On the limits of effectiveness in estimation of distribution algorithms IEEE Congress on Evolutionary Computation 2011 IEEE 1573 1580
36. R. Rubinstein The cross-entropy method for combinatorial and continuous optimization Methodol. Comput. Appl. Probabi. 1 2 1999 127 190
37. S.B. Damelin, and P.J. Grabner Energy functionals, numerical integration and asymptotic equidistribution on the sphere J. Complex. 19 3 2003 231 246 (Pubitemid 36645453)
38. K. Miettinen, and M. Mäkelä On scalarizing functions in multiobjective optimization OR Spectrum 24 2 2002 193 213
39. I. Giagkiozis, P. Fleming, Methods for Many-Objective Optimization: An Analysis, Research Report No. 1030, November 2012.
40. M. Grant, S. Boyd, and Y. Ye Disciplined Convex Programming Nonconvex Optimization and its Applications vol. 84 2006 Springer 155 210
41. S. Boyd, and L. Vandenberghe Convex Optimization 2004 Cambridge University Press
42. M. Grant, S. Boyd, CVX: Matlab Software for Disciplined Convex Programming. < http://cvxr.com/cvx/ >.
43. E. Saff, and A. Kuijlaars Distributing many points on a sphere Math. Intell. 19 1 1997 5 11 (Pubitemid 127349280)
44. D. Hardin, and E. Saff Discretizing manifolds via minimum energy points Notices AMS 51 10 2004 1186 1194 (Pubitemid 41647514)
45. H. Li, and Q. Zhang Multiobjective optimization problems with complicated Pareto sets, MOEA/D and NSGA-II IEEE Trans. Evol. Comput. 13 2 2009 284 302
46. H. Thompson, A. Chipperfield, P. Fleming, and C. Legge Distributed aero-engine control systems architecture selection using multi-objective optimisation Control Eng. Pract. 7 5 1999 655 664
47. R. Tavakkoli-Moghaddam, A. Rahimi-Vahed, and A. Mirzaei A hybrid multi-objective immune algorithm for a flow shop scheduling problem with bi-objectives: weighted mean completion time and weighted mean tardiness Inform. Sci. 177 22 2007 5072 5090 (Pubitemid 47331458)
48. G. Zhang, X. Shao, P. Li, and L. Gao An effective hybrid particle swarm optimization algorithm for multi-objective flexible job-shop scheduling problem Comput. Ind. Eng. 56 4 2009 1309 1318
49. A. Katanforoush, and M. Shahshahani Distributing points on the sphere, I Exp. Math. 12 2 2003 199 210
50. P. Leopardi, Distributing Points on the Sphere: Partitions, Separation, Quadrature and Energy, Ph.D. Thesis, University of New South Wales, 2007.
51. D. Wolpert Information theory - the bridge connecting bounded rational game theory and statistical physics Complex Eng. Syst. 2006 262 290
52. R. Rubinstein A stochastic minimum cross-entropy method for combinatorial optimization and rare-event estimation Methodol. Comput. Appl. Probabi. 7 1 2005 5 50 (Pubitemid 40465006)
53. Z. Botev, D. Kroese, and T. Taimre Generalized cross-entropy methods with applications to rare-event simulation and optimization Simulation 83 11 2007 785
54. P. De Boer, D. Kroese, S. Mannor, and R. Rubinstein A tutorial on the cross-entropy method Ann. Oper. Res. 134 1 2005 19 67 (Pubitemid 40550039)
55. C.N. Morris Natural exponential families with quadratic variance functions Ann. Stat. 10 1982 65 80
56. Q. Zhang, A. Zhou, and Y. Jin RM-MEDA: a regularity model-based multiobjective estimation of distribution algorithm IEEE Trans. Evol. Comput. 12 1 2008 41 63 (Pubitemid 351330331)
57. I. Das, J. Dennis, Normal-Boundary Intersection: An Alternate Method for Generating Pareto Optimal Points in Multicriteria Optimization Problems, Tech. Rep., DTIC Document, 1996.
58. K. Deb, A. Sinha, and S. Kukkonen Multi-objective test problems, linkages, and evolutionary methodologies Conference on Genetic and Evolutionary Computation 2006 ACM 1141 1148 (Pubitemid 44611445)
59. S. Kukkonen, and J. Lampinen GDE3: the third evolution step of generalized differential evolution IEEE Congress on Evolutionary Computation vol. 1 2005 IEEE 443 450 (Pubitemid 41495887)
60. P. Bosman, and D. Thierens The naive MIDEA: a baseline multi-objective EA Evolutionary Multi-Criterion Optimization 2005 Springer 428 442 (Pubitemid 41251781)
61. D. Wolpert, and W. Macready No free lunch theorems for optimization IEEE Trans. Evol. Comput. 1 1 1997 67 82 (Pubitemid 127771019)
62. D. Van Veldhuizen, Multiobjective evolutionary algorithms: classifications, analyses, and new innovations, in: Evolutionary Computation, 1999.
63. R. Purshouse, and P. Fleming On the evolutionary optimization of many conflicting objectives IEEE Trans. Evol. Comput. 11 6 2007 770 784 (Pubitemid 350187490)
64. D. Hadka, and P. Reed Diagnostic assessment of search controls and failure modes in many - objective evolutionary optimization Evol. Comput. 20 3 2012 423 452
65. R. Rockafellar Convex Analysis vol. 28 1970 Princeton University Press
66. J. Mattingley, and S. Boyd CVXGEN: a code generator for embedded convex optimization Optimiz. Eng. 2012 1 27