Expensive multiobjective optimization by MOEA/D with gaussian process model

IEEE Transactions on Evolutionary Computation

Volumn 14, Issue 3, 2010, Pages 456-474

  Zhang, Qingfu ^a   Liu, Wudong ^a   Tsang, Edward ^a   Virginas, Botond ^b  

^a UNIVERSITY OF ESSEX   (United Kingdom)

^b MARTLESHAM HEATH   (United Kingdom)

Author keywords

Evolutionary algorithm; Expensive optimization; Gaussian stochastic processes; Multiobjective optimization; Pareto optimality

Indexed keywords

EXPECTED IMPROVEMENTS; EXPERIMENTAL STUDIES; GAUSSIAN PROCESS MODELS; GAUSSIAN STOCHASTIC PROCESS; GAUSSIAN STOCHASTIC PROCESSES; METRIC VALUES; MULTI-OBJECTIVE OPTIMIZATION PROBLEM; PARETO-OPTIMALITY; PREDICTION QUALITY; PREDICTIVE MODELS; SINGLE OBJECTIVE OPTIMIZATION; SUB-PROBLEMS; TEST POINTS;

EVOLUTIONARY ALGORITHMS; FUNCTION EVALUATION; RANDOM PROCESSES; STOCHASTIC SYSTEMS;

MULTIOBJECTIVE OPTIMIZATION;

EID: 77953083432     PISSN: 1089778X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TEVC.2009.2033671     Document Type: Article

References (54)

1. M. L. Stein, Interpolation of Spatial Data: Some Theory for Kriging. New York: Springer-Verlag, 1999.
2. J. Sacks, W. J. Welch, T. J. Mitchell, and H. P. Wynn, " Design and analysis of computer experiments (with discussion), " Statist. Sci., vol. 4, no. 4, pp. 409-423, Nov. 1989.
3. D. R. Jones, " A taxonomy of global optimization methods based on response surfaces, " J. Global Optim., vol. 21, no. 4, pp. 345-383, Dec. 2001.
4. D. Huang, T. T. Allen, W. I. Notz, and N. Zeng, " Global optimization of stochastic black-box systems via sequential kriging meta-models, " J. Global Optim., vol. 34, no. 3, pp. 441-466, Mar. 2006.
5. K. Grave, J. Ramon, and L. Raedt, " Active learning for high throughput screening, " in Proc. 11th Int. Conf. Discov. Sci., Berlin, Heidelberg, Germany, 2008, pp. 185-196.
6. J. Mockus, V. Tiesis, and A. Zilinskas, " The application of Bayesian methods for seeking the extremum, " in Toward Global Optimization, vol. 2, L. C. W. Dixon and G. P. Szego, Eds. Amsterdam, The Netherlands: Elsevier, 1978, pp. 117-129.
7. B. E. Stuckman, " A global search method for optimizing nonlinear systems, " IEEE Trans. Syst. Man Cybern., vol. 18, no. 6, pp. 965-977, Nov.-Dec. 1988.
8. D. R. Jones, M. Schonlau, and W. J. Welch, " Efficient global optimization of expensive black-box functions, " J. Global Optim., vol. 13, no. 4, pp. 455-492, Dec. 1998.
9. G. E. P. Box and N. R. Draper, Empirical Model Building and Response Surfaces. New York: Wiley, 1987.
10. T. A. Donnelly, " Response-surface experimental design, " IEEE Potentials, vol. 11, no. 1, pp. 19-21, Feb. 1992.
11. Y. Jin, M. Olhofer, and B. Sendhoff, " A framework for evolutionary optimization with approximate fitness functions, " IEEE Trans. Evol. Comput., vol. 6, no. 5, pp. 481-494, Oct. 2002.
12. H. Ulmer, F. Streichert, and A. Zell, " Evolution strategies assisted by Gaussian processes with improved preselection criterion, " in Proc. IEEE Congr. Evol. Comput., vol. 1. Canberra, Australia, Dec. 2003, pp. 692-699.
13. R. Regis and C. Shoemaker, " Local function approximation in evolutionary algorithms for the optimization of costly functions, " IEEE Trans. Evol. Comput., vol. 8, no. 5, pp. 490-505, Oct. 2004.
14. D. Buche, N. N. Schraudolph, and P. Koumoutsakos, " Accelerating evolutionary algorithms with Gaussian process fitness function models, " IEEE Trans. Syst. Man Cybern. C, vol. 35, no. 2, pp. 184-194, May 2005.
15. Y.-S. Ong, P. B. Nair, and K. Y. Lum, " Max-min surrogate-assisted evolutionary algorithm for robust design, " IEEE Trans. Evol. Comput., vol. 10, no. 4, pp. 392-404, Aug. 2006.
16. Z. Zhou, Y.-S. Ong, P. B. Nair, A. J. Keane, and K. Y. Lum, " Combining global and local surrogate models to accelerate evolutionary optimization, " IEEE Trans. Syst. Man Cybern. C, vol. 37, no. 1, pp. 66-76, Jan. 2007.
17. I. Paenke, J. Branke, and Y. Jin, " Efficient search for robust solutions by means of evolutionary algorithms and fitness approximation, " IEEE Trans. Evol. Comput., vol. 10, no. 4, pp. 405-420, Aug. 2006.
18. Y. Jin, " A comprehensive survey of fitness approximation in evolutionary computation, " Soft Comput. Fusion Found. Method. Appl., vol. 9, no. 1, pp. 3-12, Jan. 2005.
19. B. S. Yang, Y. S. Yeun, and W. S. Ruy, " Managing approximation models in multiobjective optimization, " Struct. Multidis. Optim., vol. 24, no. 2, pp. 141-156, Sep. 2002.
20. H.-S. Chung and J. J. Alonso, " Multiobjective optimization using approximation model-based genetic algorithms, " in Proc. 10th Am. Instit. Aeronaut. Astronaut./Int. Soc. Struct. Multidis. Optim. Symp. Multidisciplinary Anal. Optim., New York, Sep. 2004.
21. S. Jeong and S. Obayashi, " Efficient global optimization (EGO) for multiobjective problem and data mining, " in Proc. IEEE Congr. Evol. Comput., vol. 3. Edinburgh, U. K., Sep. 2005, pp. 2138-2145.
22. A. J. Keane, " Statistical improvement criteria for use in multiobjective design optimization, " Am. Instit. Aeronaut. Astronaut. J., vol. 44, no. 4, pp. 879-891, Apr. 2006.
23. M. K. Karakasis and K. C. Giannakoglou, " On the use of metamodel-assisted, multiobjective evolutionary algorithms, " Eng. Optim., vol. 38, no. 8, pp. 941-957, Dec. 2006.
24. M. Emmerich, K. Giannakoglou, and B. Naujoks, " Single and multi-objective evolutionary optimization assisted by Gaussian random field metamodels, " IEEE Trans. Evol. Comput., vol. 10, no. 4, pp. 421-439, Aug. 2006.
25. J. Knowles, " ParEGO: A hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems, " IEEE Trans. Evol. Comput., vol. 10, no. 1, pp. 50-66, Feb. 2006.
26. W. Ponweiser, T. Wagner, D. Biermann, and M. Vincze, " Multiob-jective optimization on a limited budget of evaluations using model-assisted S-Metric selection, " in Proc. 10th Parallel Problem Solving Nat., Dortmund, Germany, Sep. 2008, pp. 784-794.
27. K. Deb, A. Pratap, S. Agarwal, and T. Meyarivan, " A fast and elitist multiobjective genetic algorithm: NSGA-II, " IEEE Trans. Evol. Comput., vol. 6, no. 2, pp. 182-197, Apr. 2002.
28. Q. Zhang and H. Li, " MOEA/D: A multiobjective evolutionary algorithm based on decomposition, " IEEE Trans. Evol. Comput., vol. 11, no. 6, pp. 712-731, Dec. 2007. (Pubitemid 350187486)
29. H. Ishibuchi and T. Murata, " A multiobjective genetic local search algorithm and its application to flowshop scheduling, " IEEE Trans. Syst. Man Cybern. C, vol. 28, no. 3, pp. 392-403, Aug. 1998.
30. H. Ishibuchi, T. Yoshida, and T. Murata, " Balance between genetic search and local search in memetic algorithms for multiobjective permutation flowshop scheduling, " IEEE Trans. Evol. Comput., vol. 7, no. 2, pp. 204-223, Apr. 2003.
31. A. Jaszkiewicz, " On the performance of multiple-objective genetic local search on the 0/1 knapsack problem: A comparative experiment, " IEEE Trans. Evol. Comput., vol. 6, no. 4, pp. 402-412, Aug. 2002.
32. E. Hughes, " Multiple single objective Pareto sampling, " in Proc. IEEE Congr. Evol. Comput., vol. 4. Canberra, Australia, Dec. 2003, pp. 2678-2684.
33. H. Li and Q. Zhang, " Multiobjective optimization problems with complicated Pareto sets, MOEA/D and NSGA-II, " IEEE Trans. Evol. Comput., vol. 12, no. 2, pp. 284-302, Apr. 2009.
34. P. C. Chang, S. H. Chen, Q. Zhang, and J. L. Lin, " MOEA/D for flowshop scheduling problems, " in Proc. IEEE Congr. Evol. Comput., Hong Kong, Jun. 2008, pp. 1433-1438.
35. W. Peng, Q. Zhang, and H. Li, " Comparison between MOEA/D and NSGA-II on the multiobjective travelling salesman problem, " in Mul-tiobjective Memetic Algorithms (Studies in Computational Intelligence Series), vol. 171, C.-K. Goh, Y.-S. Ong, and K. C. Tan, Eds. Berlin, Germany: Springer-Verlag, 2009, pp. 309-324.
36. H. Ishibuchi, Y. Sakane, N. Tsukamoto, and Y. Nojima, " Adaptation of scalarizing functions in MOEA/D: An adaptive scalarizing function-based multiobjective evolutionary algorithm, " in Proc. 5th Int. Conf. Devoted Evol. Multicriterion Optim., Nantes, France, Apr. 2009, pp. 438-452.
37. K. Miettinen, " A posteriori methods: Part 2, " in Nonlinear Multiobjective Optimization, Norwell, MA: Kluwer, 1999, pp. 77-95.
38. A. Pascoletti and P. Serafini, " Scalarizing vector optimization problems, " J. Opt. Theory Appl., vol. 42, no. 4, pp. 499-524, Apr. 1984.
39. M. Ehrgott, " Scalarization techniques, " in Multicriteria Optimization. New York: Springer-Verlag, 2005, pp. 97-121.
40. G. Eichfelder, Adaptive Scalarization Methods in Multiobjective Optimization, Berlin, Germany: Springer, 2008.
41. C. E. Rasmussen and C. K. I. Williams, Gaussian Processes for Machine Learning, Cambridge, MA: MIT Press, 2005.
42. K. V. Price, R. M. Storn, and J. A. Lampinen, " Differential evolution algorithms, " in Differential Evolution: A Practical Approach to Global Optimization, New York: Springer-Verlag, 2005, pp. 37-47.
43. S. Seo, M. Wallat, T. Graepel, and K. Obermayer, " Gaussian process regression: Active data selection and test point rejection, " in Proc. IEEE-Int. Neural Netw. Soc.-Eur. Neural Netw. Soc. Int. Joint Conf. Neural Netw., vol. 3. Jul. 2000, pp. 241-246.
44. N. Lawrence, M. Seeger, and R. Herbrich, " Fast sparse Gaussian process methods: The informative vector machine, " in Proc. Adv. Neural Inf. Process. Syst., vol. 15. British Columbia, Canada, Dec. 2002, pp. 609-616.
45. L. Bottou and V. Vapnik, " Local learning algorithms, " Neural Comput., vol. 4, no. 6, pp. 888-900, Nov. 1992.
46. A. Choudhury, P. B. Nair, and A. J. Keane, " A data parallel approach for large-scale gaussian process modeling, " in Proc. 2nd Soc. Ind. Appl. Math. Int. Conf. Data Mining, Arlington, VA, Apr. 2002, pp. 95-111.
47. A. Schwaighofer and V. Tresp, " Transductive and inductive methods for approximate Gaussian process regression, " in Proc. Adv. Neural Inf. Process. Syst., vol. 15. British Columbia, Canada, Dec. 2002, pp. 977-984.
48. J. C. Bezdek, Pattern Recognition with Fuzzy Objective Function Algorithms, Norwell, MA: Kluwer, 1981.
49. C. E. Clark, " The greatest of a finite set of random variables, " Oper. Res., vol. 9, no. 2, pp. 45-162, Mar.-Apr. 1961.
50. K. Deb, " Multiobjective genetic algorithms: Problem difficulties and construction of test problems, " Evol. Comput., vol. 7, no. 3, pp. 205-230, Feb. 1999.
51. K. Deb, L. Thiele, M. Laumanns, and E. Zitzler, " Scalable multiobjective optimization test problems, " in Proc. IEEE Congr. Evol. Comput., vol. 1. Honolulu, HI, May 2002, pp. 825-830.
52. D. A. van Veldhuizen and G. B. Lamont, " Multiobjective evolutionary algorithm test suites, " in Proc. Assoc. Comput. Mach. Symp. Appl. Comput., San Antonio, TX, Feb. 1999, pp. 351-357.
53. M. D. McKay, R. J. Beckman, and W. J. Conover, " A comparison of three methods for selecting values of input variables in the analysis of output from a computer code, " Technometrics, vol. 42, no. 1, pp. 55-61, Feb. 2000.
54. E. Zitzler, L. Thiele, M. Laumanns, C. M. Fonseca, and V. G. da Fonseca, " Performance assessment of multiobjective optimizers: An analysis and review, " IEEE Trans. Evol. Comput., vol. 7, no. 2, pp. 117-132, Apr. 2003.