Adaptive operator selection with bandits for a multiobjective evolutionary algorithm based on decomposition

IEEE Transactions on Evolutionary Computation

Volumn 18, Issue 1, 2014, Pages 114-130

  Li, Ke ^a   Fialho, Alvaro ^b,c   Kwong, Sam ^a   Zhang, Qingfu ^a,d  

^a CITY UNIVERSITY OF HONG KONG   (Hong Kong)

^b Nokia Technology Institute (INdT)   (Brazil)

^c GE GLOBAL RESEARCH   (United States)

^d UNIVERSITY OF ESSEX   (United Kingdom)

Author keywords

Adaptive operator selection (AOS); decomposition; multiarmed bandit; multiobjective evolutionary algorithm based on decomposition (MOEA D); multiobjective optimization

Indexed keywords

ADAPTIVE OPERATOR SELECTIONS; MULTI ARMED BANDIT; MULTI OBJECTIVE EVOLUTIONARY ALGORITHMS; MULTI-OBJECTIVE OPTIMIZATION PROBLEM; MULTIOBJECTIVE EVOLUTIONARY COMPUTATION; OPERATOR SELECTIONS; SCALAR OPTIMIZATION; SELECTION PROBABILITIES;

DECOMPOSITION; EVOLUTIONARY ALGORITHMS; HEALTH;

MULTIOBJECTIVE OPTIMIZATION;

EID: 84893865972     PISSN: 1089778X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TEVC.2013.2239648     Document Type: Article

References (54)

1. K. Miettinen, Nonlinear Multiobjective Optimization, vol. 12. Dordrecht, The Netherlands: Kluwer Academic, 1999.
2. J. D. Schaffer, "Multiple objective optimization with vector evaluated genetic algorithms," in Proc. 1st Int. Conf. Genet. Algorithms, 1985, pp. 93-100.
3. K. Deb, A. Pratap, S. Agarwal, and T. Meyarivan, "A fast and elitist multiobjective genetic algorithm: NSGA-II," IEEE Trans. Evol. Comput., vol. 6, no. 2, pp. 182-197, Apr. 2002. (Pubitemid 34555372)
4. E. Zitzler, M. Laumanns, and L. Thiele, "SPEA2: Improving the strength Pareto evolutionary algorithm for multiobjective optimization," in Proc. Evol. Methods Des. Optimization Control Appl. Ind. Problems, 2002, pp. 95-100.
5. T. Chan, K. Man, K. Tang, and S. Kwong, "A jumping gene paradigm for evolutionary multiobjective optimization," IEEE Trans. Evol. Comput., vol. 12, no. 2, pp. 143-159, Apr. 2008. (Pubitemid 351546691)
6. Q. Zhang and H. Li, "MOEA/D: A multiobjective evolutionary algorithm based on decomposition," IEEE Trans. Evol. Comput., vol. 11, no. 6, pp. 712-731, Dec. 2007. (Pubitemid 350187486)
7. K. Li, S. Kwong, R. Wang, K.-S. Tang, and K.-F. Man, "Learning paradigm based on jumping genes: A general framework for enhancing exploration in evolutionary multiobjective optimization," Inform. Sci., vol. 226, pp. 1-22, Mar. 2013.
8. K. Li, S. Kwong, J. Cao, M. Li, J. Zheng, and R. Shen, "Achieving balance between proximity and diversity in multiobjective evolutionary algorithm," Inform. Sci., vol. 182, no. 1, pp. 220-242, 2012.
9. K. Deb, Multi-Objective Optimization Using Evolutionary Algorithms. New York: Wiley, 2001.
10. C. A. Coello Coello, G. B. Lamont, and D. A. V. Veldhuizen, Evolutionary Algorithms for Solving Multi-Objective Problems (Genetic and Evolutionary Computation), 2nd ed. New York: Springer, 2007.
11. F. G. Lobo, C. F. Lima, and Z. Michalewicz, Parameter Setting in Evolutionary Algorithms (Studies in Computational Intelligence), F. Lobo, C. Lima, and Z. Michalewicz, Eds. Berlin/Heidelberg, Germany: Springer, 2007.
12. P. Auer, N. Cesa-Bianchi, and P. Fischer, "Finite-time analysis of the multiarmed bandit problem," Mach. Learning, vol. 47, nos. 2-3, pp. 235-256, May 2002. (Pubitemid 34126111)
13. L. Da Costa, A. Fialho, M. Schoenauer, and M. Sebag, "Adaptive operator selection with dynamic multiarmed bandits," in Proc. Annu. Conf. Genet. Evol. Comput., Jul. 2008, pp. 913-920.
14. A. Fialho, L. Da Costa, M. Schoenauer, and M. Sebag, "Analyzing bandit-based adaptive operator selection mechanisms," Ann. Math. Artif. Intell., vol. 60, nos. 1-2, pp. 25-64, Oct. 2010.
15. A. Fialho, L. Da Costa, M. Schoenauer, and M. Sebag, "Dynamic multiarmed bandits and extreme value-based rewards for adaptive operator selection in evolutionary algorithms," in Proc. 3rd Int. Conf. Learning Intell. Optimization, LNCS 5851. 2009, pp. 176-190.
16. A. Fialho, M. Schoenauer, and M. Sebag, "Toward comparison-based adaptive operator selection," in Proc. Annu. Conf. Genet. Evol. Comput., Jul. 2010, pp. 767-774.
17. A. K. Qin, V. L. Huang, and P. N. Suganthan, "Differential evolution algorithm with strategy adaptation for global numerical optimization," IEEE Trans. Evol. Comput., vol. 13, no. 2, pp. 398-417, Apr. 2009.
18. J. Zhang and A. C. Sanderson, "JADE: Adaptive differential evolution with optional external archive," IEEE Trans. Evol. Comput., vol. 13, no. 5, pp. 945-958, Oct. 2009.
19. J. Brest, S. Greiner, B. Boskovic, M. Mernik, and V. Zumer, "Selfadapting control parameters in differential evolution: A comparative study on numerical benchmark problems," IEEE Trans. Evol. Comput., vol. 10, no. 6, pp. 646-657, Dec. 2006. (Pubitemid 46445554)
20. J. Zhang and A. C. Sanderson, "Self-adaptive multiobjective differential evolution with direction information provided by archived inferior solutions," in Proc. IEEE Congr. Evol. Comput., Jul. 2008, pp. 2806-2815.
21. V. L. Huang, A. K. Qin, P. N. Suganthan, and M. F. Tasgetiren, "Multiobjective optimization based on self-adaptive differential evolution algorithm," in Proc. IEEE Congr. Evol. Comput., May. 2007, pp. 3601-3608.
22. V. L. Huang, S. Z. Zhao, R. Mallipeddi, and P. N. Suganthan, "Multiobjective optimization using self-adaptive differential evolution algorithm," in Proc. IEEE Congr. Evol. Comput., Sep. 2009, pp. 190-194.
23. K. Li, A. Fialho, and S. Kwong, "Multiobjective differential evolution with adaptive control of parameters and operators," in Proc. 5th Int. Conf. Learning Intell. Optimization (LION), LNCS. 2011, pp. 473-487.
24. K. Li, S. Kwong, R. Wang, J. Cao, and I. J. Rudas, "Multiobjective differential evolution with self-navigation," in Proc. IEEE Int. Conf. Syst. Man Cybern., Oct. 2012, pp. 508-513.
25. R. Mallipeddi, P. N. Suganthan, Q. Pan, and M. F. Tasgetiren, "Differential evolution algorithm with ensemble of parameters and mutation strategies," Appl. Soft Comput., vol. 11, no. 2, pp. 1679-1696, 2011.
26. Y. Wang, Z. Cai, and Q. Zhang, "Differential evolution with composite trial vector generation strategies and control parameters," IEEE Trans. Evol. Comput., vol. 15, no. 1, pp. 55-66, Feb. 2011.
27. Q. Zhang, W. Liu, and H. Li, "The performance of a new version of MOEA/D on CEC09 unconstrained MOP test instances," in Proc. IEEE Congr. Evol. Comput., May 2009, pp. 203-208.
28. A. Eiben, Z. Michalewicz, M. Schoenauer, and J. Smith, "Parameter control in evolutionary algorithms," in Parameter Setting in Evolutionary Algorithms (Studies in Computational Intelligence, vol. 54), F. Lobo, C. Lima, and Z. Michalewicz, Eds. Berlin/Heidelberg, Germany: Springer, 2007, pp. 19-46.
29. L. Davis, "Adapting operator probabilities in genetic algorithms," in Proc. ICGA, 1989, pp. 61-69.
30. W. Gong, A. Fialho, and Z. Cai, "Adaptive strategy selection in differential evolution," in Proc. Annu. Conf. Genet. Evol. Comput., Jul. 2010, pp. 409-416.
31. J. Whitacre, T. Pham, and R. Sarker, "Use of statistical outlier detection method in adaptive evolutionary algorithms," in Proc. Annu. Conf. Genet. Evol. Comput., 2006, pp. 1345-1352. (Pubitemid 44612720)
32. A. Fialho, R. Ros, M. Schoenauer, and M. Sebag, "Comparisonbased adaptive strategy selection in differential evolution," in Proc. 11th Int. Conf. Parallel Problem Solving From Nature, 2010, pp. 194-203.
33. J. Maturana, F. Lardeux, and F. Saubion, "Autonomous operator management for evolutionary algorithms," J. Heuristics, vol. 16, no. 6, pp. 881-909, 2010.
34. D. E. Goldberg, "Probability matching, the magnitude of reinforcement, and classifier system bidding," Mach. Learning, vol. 5, no. 4, pp. 407-425, Oct. 1990.
35. D. Thierens, "An adaptive pursuit strategy for allocating operator probabilities," in Proc. Annu. Conf. Genet. Evol. Comput., 2005, pp. 1539-1546. (Pubitemid 43226475)
36. A. Fialho, "Adaptive operator selection for optimization," Ph.D. dissertation, Comput. Sci. Dept., Univ. Paris-Sud XI, Orsay, France, Dec. 2010.
37. J. Knowles and D. Corne, "Approximating the nondominated front using the Pareto archived evolution strategy," Evol. Comput., vol. 8, no. 2, pp. 149-172, Jun. 2000.
38. Y. Mei, K. Tang, and X. Yao, "Decomposition-based memetic algorithm for multiobjective capacitated arc routing problem," IEEE Trans. Evol. Comput., vol. 15, no. 2, pp. 151-165, Apr. 2011.
39. H. Ishibuchi, Y. Sakane, N. Tsukamoto, and Y. Nojima, "Adaptation of scalarizing functions in MOEA/D: An adaptive scalarizing functionbased multiobjective evolutionary algorithm," in Proc. 5th Int. Conf. Evol. Multi-Criterion Optimization, 2009, pp. 438-452.
40. V. A. Shim, K. C. Tan, and C. Y. Cheong, "A hybrid estimation of distribution algorithm with decomposition for solving the multiobjective multiple traveling salesman problem," IEEE Trans. Syst., Man, Cybern., C Appl. Rev., vol. 42, no. 5, pp. 682-691, Sep. 2012.
41. S. Martinez and C. Coello, "A direct local search mechanism for decomposition-based multiobjective evolutionary algorithms," in Proc. IEEE CEC, Jun. 2012, pp. 1-8.
42. K. Sindhya, K. Miettinen, and K. Deb, "A hybrid framework for evolutionary multiobjective optimization," IEEE Trans. Evol. Comput., to be published.
43. R. Storn and K. Price, "Differential evolution: A simple and efficient heuristic for global optimization over continuous spaces," J. Global Optimization, vol. 11, no. 4, pp. 341-359, Dec. 1997. (Pubitemid 127502202)
44. K. Deb and M. Goyal, "A combined genetic adaptive search (geneas) for engineering design," Comput. Sci. Informatics, vol. 26, no. 4, pp. 30-45, 1996.
45. H. Li and Q. Zhang, "Multiobjective optimization problems with complicated pareto sets, MOEA/D and NSGA-II," IEEE Trans. Evol. Comput., vol. 12, no. 2, pp. 284-302, Apr. 2009.
46. S. Zhao, P. N. Suganthan, and Q. Zhang, "Decomposition based multiobjective evolutionary algorithm with an ensemble of neighborhood sizes," IEEE Trans. Evol. Comput., vol. 16, no. 3, pp. 442-446, Jun. 2012.
47. Q. Zhang, A. Zhou, S. Zhao, P. N. Suganthan, W. Liu, and S. Tiwari, "Multiobjective optimization test instances for the CEC 2009 special session and competition," Univ. Essex and Nanyang Technological University, Essex, U.K./Singapore, Tech. Rep. CES-487, 2008.
48. S. Huband, P. Hingston, L. Barone, and L. While, "A review of multiobjective test problems and a scalable test problem toolkit," IEEE Trans. Evol. Comput., vol. 10, no. 5, pp. 477-506, Oct. 2006. (Pubitemid 44560739)
49. E. Zitzler, L. Thiele, M. Laumanns, C. Fonseca, and V. da Fonseca, "Performance assessment of multiobjective optimizers: An analysis and review," IEEE Trans. Evol. Comput., vol. 7, no. 2, pp. 117-132, Apr. 2003.
50. O. Scḧutze, X. Esquivel, A. Lara, and C. A. Coello Coello, "Using the averaged hausdorff distance as a performance measure in evolutionary multiobjective optimization," IEEE Trans. Evol. Comput., vol. 16, no. 4, pp. 504-522, Aug. 2012.
51. P. Bosman and D. Thierens, "The balance between proximity and diversity in multiobjective evolutionary algorithms," IEEE Trans. Evol. Comput., vol. 7, no. 2, pp. 174-188, Apr. 2003.
52. E. Zitzler and L. Thiele, "Multiobjective evolutionary algorithms: A comparative case study and the strength pareto approach," IEEE Trans. Evol. Comput., vol. 3, no. 4, pp. 257-271, Nov. 1999. (Pubitemid 30544879)
53. T. Wagner, N. Beume, and B. Naujoks, "Pareto-, aggregation-, and indicator-based methods in many-objective optimization," in Proc. 4th Int. Conf. Evol. Multi-Criterion Optimization, 2007, pp. 742-756. (Pubitemid 350270923)
54. V. L. Huang, A. K. Qin, K. Deb, E. Zitzler, P. N. Suganthan, J. J. Liang, M. Preuss, and S. Huband, "Problem definitions for performance assessment of multiobjective optimization algorithms," Nanyang Technol. Univ., Singapore, Tech. Rep., 2007.