SO-MI: A surrogate model algorithm for computationally expensive nonlinear mixed-integer black-box global optimization problems

Computers and Operations Research

Volumn 40, Issue 5, 2013, Pages 1383-1400

  Müller, Juliane ^a,b   Shoemaker, Christine A ^b   Piché, Robert ^a  

^a TAMPERE UNIVERSITY OF TECHNOLOGY   (Finland)

^b Cornell University   (United States)

Author keywords

Black box; Derivative free; Global optimization; Mixed integer optimization; Multimodal; Nonlinear; Radial basis functions; Surrogate model

Indexed keywords

BLACK BOXES; DERIVATIVE-FREE; MIXED INTEGER OPTIMIZATION; MULTI-MODAL; NONLINEAR; RADIAL BASIS FUNCTIONS; SURROGATE MODEL;

COMPUTER SIMULATION; CONSTRAINED OPTIMIZATION; FUNCTION EVALUATION; GENETIC ALGORITHMS; GLOBAL OPTIMIZATION; IMAGE SEGMENTATION; INTEGER PROGRAMMING; LINEAR PROGRAMMING; RADIAL BASIS FUNCTION NETWORKS; STRUCTURAL OPTIMIZATION;

ITERATIVE METHODS;

EID: 84875223245     PISSN: 03050548     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cor.2012.08.022     Document Type: Article

References (71)

1. L. Costa, and P. Oliveira Evolutionary algorithms approach to the solution of mixed integer non-linear programming problems Computers and Chemical Engineering 25 2001 257 266
2. V. Gantovnik, Z. Gürdal, L. Watson, and C. Anderson-Cook A genetic algorithm for mixed integer nonlinear programming problems using separate constraint approximations AIAA Journal 43 2005 1844 1849
3. R. Haupt Antenna design with a mixed integer genetic algorithm IEEE Transactions on Antennas and Propagation 55 2007 577 582
4. Schlüter M, Gerdts M, Rückmann J-J. MIDACO: new global optimization software for MINLPs, 2010. 〈 http://www.midaco-solver.com/ about.html 〉.
5. J. Viswanathan, and I. Grossmann A combined penalty function and outer-approximation method for MINLP optimization Computers and Chemical Engineering 14 1990 769 782
6. P. Bonami, L. Biegler, A. Conn, G. Cornuéjols, I. Grossmann, and C. Laird An algorithmic framework for convex mixed integer nonlinear programs Discrete Optimization 5 2008 186 204
7. I. Nowak Relaxation and decomposition methods for mixed integer nonlinear programming 2005 Birkhäuser
8. I. Nowak, and S. Vigerske LaGO - a (heuristic) branch and cut algorithm for nonconvex MINLPs Central European Journal of Operations Research 16 2008 127 138
9. E. Smith, and C. Pantelides A symbolic reformulation/spatial branch-and-bound algorithm for the global optimization of nonconvex MINLPs Computers and Chemical Engineering 23 1999 457 478
10. J. Holland Adaptation in natural and artificial systems 1975 University of Michigan Press Ann Arbor
11. M. Abramson, C. Audet, J. Chrissis, and J. Walston Mesh adaptive direct search algorithms for mixed variable optimization Optimization Letters 3 2009 35 47
12. Abramson M, Audet C, Couture G, Dennis Jr J, Le Digabel S. The NOMAD project. Software available at: 〈 http://www.gerad.ca/nomad 〉, 2011.
13. M. Abramson, C. Audet, and J. Dennis Jr Filter pattern search algorithms for mixed variable constrained optimization problems SIAM Journal on Optimization 11 2004 573 594
14. M. Abramson, and C. Audet Convergence of mesh adaptive direct search to second-order stationary points SIAM Journal on Optimization 17 2006 606 619
15. P. Hansen, and N. Mladenović Variable neighborhood search principles and applications. European Journal of Operational Research 130 2001 449 467
16. N. Mladenović, and P. Hansen Variable neighborhood search Computers and Operations Research 24 1997 1097 1100
17. C. Audet, V. Béchard, and S. Le Digabel Nonsmooth optimization through mesh adaptive direct search and variable neighborhood search Journal of Global Optimization 41 2008 299 318
18. C. Audet, and J. Dennis Jr Pattern search algorithms for mixed variable programming SIAM Journal on Optimization 11 2000 573 594
19. Liuzzi G, Lucidi S, Rinaldi F. Derivative-free methods for bound constrained mixed-integer optimization, Computational Optimization and Applications, 2011, doi:10.1007/s10589-011-9405-3.
20. A. Booker, J. Dennis Jr, P. Frank, D. Serafini, V. Torczon, and M. Trosset A rigorous framework for optimization of expensive functions by surrogates Structural Multidisciplinary Optimization 17 1999 1 13
21. A. Forrester, A. Sóbester, and A. Keane Engineering design via surrogate modelling - a practical guide 2008 Wiley
22. H. Gutmann A radial basis function method for global optimization Journal of Global Optimization 19 2001 201 227
23. D. Jones A taxonomy of global optimization methods based on response surfaces Journal of Global Optimization 21 2001 345 383
24. D. Jones, M. Schonlau, and W. Welch Efficient global optimization of expensive black-box functions Journal of Global Optimization 13 1998 455 492
25. J. Müller, and R. Piché Mixture surrogate models based on Dempster-Shafer theory for global optimization problems Journal of Global Optimization 51 2011 79 104
26. R. Regis Stochastic radial basis function algorithms for large-scale optimization involving expensive black-box objective and constraint functions Computers and Operations Research 38 2011 837 853
27. R. Regis, and C. Shoemaker A stochastic radial basis function method for the global optimization of expensive functions INFORMS Journal on Computing 19 2007 497 509
28. S. Wild, R. Regis, and C. Shoemaker ORBIT optimization by radial basis function interpolation in trust-regions. SIAM Journal on Scientific Computing 30 2007 3197 3219
29. B. Glaz, P. Friedmann, and L. Liu Surrogate based optimization of helicopter rotor blades for vibration reduction in forward flight Structural and Multidisciplinary Optimization 35 2008 341 363
30. J. Jouhaud, P. Sagaut, M. Montagnac, and J. Laurenceau A surrogate-model based multidisciplinary shape optimization method with application to a 2D subsonic airfoil Computers and Fluids 36 2007 520 529
31. X. Lam, Y. Kim, A. Hoang, and C. Park Coupled aerostructural design optimization using the kriging model and integrated multiobjective optimization algorithm Journal of Optimization Theory and Applications 142 2009 533 556
32. C. Li, F. Wang, Y. Chang, and Y. Liu A modified global optimization method based on surrogate model and its application in packing profile optimization of injection molding process The International Journal of Advanced Manufacturing Technology 48 2010 505 511
33. E. Davis, and M. Ierapetritou Kriging based method for the solution of mixed-integer nonlinear programs containing black-box functions Journal of Global Optimization 43 2009 191 205
34. Hemker T. Derivative free surrogate optimization for mixed-integer nonlinear black box problems in engineering, PhD thesis, TU Darmstadt; 2008.
35. K. Holmström, N. Quttineh, and M. Edvall An adaptive radial basis algorithm (ARBF) for expensive black-box mixed-integer constrained global optimization Journal of Global Optimization 41 2008 447 464
36. Rashid K, Ambani S, Cetinkaya E. An adaptive multiquadric radial basis function method for expensive black-box mixed-integer nonlinear constrained optimization. Engineering Optimization doi:10.1080/0305215X.2012.665450, 2012.
37. J. Friedman Multivariate adaptive regression splines The Annals of Statistics 19 1991 1 141
38. R. Myers, and D. Montgomery Response surface methodology, process and product optimization using designed experiments 1995 Wiley-Interscience Publication
39. Currin C, Mitchell T, Morris M, Ylvisaker D. A Bayesian approach to the design and analysis of computer experiments, Technical Report, Oak Ridge National Laboratory, Oak Ridge, TN; 1988.
40. J. Duchon Constructive theory of functions of several variables 1977 Springer-Verlag Berlin
41. R. Regis, and C. Shoemaker Constrained global optimization of expensive black-box functions using radial basis functions Journal of Global Optimization 31 2005 153 171
42. R. Regis, and C. Shoemaker Improved strategies for radial basis function methods for global optimization Journal of Global Optimization 37 2007 113 135
43. Powell M. The theory of radial basis function approximation in 1990, advances in numerical analysis, vol. 2: wavelets, subdivision algorithms and radial basis functions. Oxford University Press, Oxford; 1992, p. 105-210.
44. A. Neumeier Complete search in constrained global optimization Acta Numerica 13 2004 271 369
45. Kuipers E. 〈 http://www.mathworks.com/matlabcentral/fileexchange/95 〉, Last accessed May 31, 2011. (2000).
46. F. Herrera, M. Lozano, and J. Verdegay Tackling real-coded genetic algorithms operators and tools for behavioural analysis. Artificial Intelligence Review 12 1998 265 319
47. M. Srinivas, and L. Patnaik Adaptive probabilities of crossover and mutation in genetic algorithms IEEE Transactions on Systems, Man and Cybernetics 24 1994 565 667
48. J. Zhang, H. Chung, and W. Lo Clustering-based adaptive crossover and mutation probabilities for genetic algorithms IEEE Transactions on Evolutionary Computation 11 2007 326 335
49. S. Koziel, and Z. Michalewicz Evolutionary algorithms, homomorphous mappings, and constrained parameter optimization Evolutionary Computation 7 1999 19 44
50. M. Bussieck, A. Stolbjerg Drud, and A. Meeraus MINLPLib - a collection of test models for mixed-integer nonlinear programming INFORMS Journal on Computing 15 2003 114 119
51. C. Adjiman, I. Androulakis, and C. Floudas Global optimization of mixed-integer nonlinear problems AIChE Journal 46 2000 1769 1797
52. O. Berman, and N. Ashrafi Optimization models for reliability of modular software systems IEEE Transactions on Software Engineering 19 1993 1119 1123
53. C. Floudas, O. Pardalos, C. Adjiman, W. Esposito, Z. Gumus, and S. Harding Handbook of test problems in local and global optimization 1999 Kluwer Academic Publishers Dordrecht
54. X. Yuan, S. Zhang, L. Piboleau, and S. Domenech Une méthode d'optimisation non linéaire en variables mixtes pour la conception de procédés R.A.I.R.O. Operation Research 22 1988 331 346
55. T. Dede, S. Bekiroǧlu, and Y. Ayvaz Weight minimization of trusses with genetic algorithm Applied Soft Computing 11 2011 2565 2575
56. H. Jensen, and J. Sepulveda Structural optimization of uncertain dynamical systems considering mixed-design variables Probabilistic Engineering Mechanics 26 2011 269 280
57. S. Rajan, and D. Nguyen Design optimization of discrete structural systems using MPI-enabled genetic algorithm Structural and Multidisciplinary Optimization 27 2004 1 9
58. K. Schittkowski, C. Zillober, and R. Zotemantel Numerical comparison of nonlinear programming algorithms for structural optimization Structural Optimization 7 1994 1 19
59. R. Stocki, K. Kolanek, S. Jendo, and M. Kleiber Study on discrete optimization techniques in reliability-based optimization of truss structures Computers and Structures 79 2001 2235 2247
60. W. Kuo, V. Prasad, F. Tillman, and C.-L. Hwang Optimal reliability design fundamentals and applications. 2001 Cambridge University Press
61. K. Gopal, K. Aggarwal, and J. Gupta A method for solving reliability optimization problem IEEE Transactions on Reliability R-29 1980 36 38
62. F. Tillman, C. Hwang, and W. Kuo Determining component reliability and redundancy for optimum system reliability IEEE Transactions on Reliability R-26 1977 162 165
63. W. Kuo, H. Lin, Z. Xu, and W. Zhang Reliability optimization with Lagrange multiplier and branch-and-bound technique IEEE Transactions on Reliability R-36 1987 624 630
64. D. Coit, and A. Smith Reliability optimization of series-parallel systems using a genetic algorithm IEEE Transactions on Reliability 45 1996 254 266
65. Hsieh Y, Chen T, Bricker D. Genetic Algorithms for reliability design problems, Technical Report, Department of Industrial Engineering, University of Iowa; 1997.
66. T.-C. Chen IAs based approach for reliability redundancy allocation problems Applied Mathematics and Computation 182 2006 1556 1567
67. A. Dhingra Optimal apportionment of reliability and redundancy in series systems under multiple objectives IEEE Transactions on Reliability 41 1992 576 582
68. M. Hikita, Y. Nakagawa, K. Nakashima, and H. Narihisa Reliability optimization of systems by a surrogate-constraints algorithm IEEE Transactions on Reliability R-41 1992 473 480
69. T. Yokota, M. Gen, and Y.-X. Li Genetic algorithm for nonlinear mixed-integer programming problems and its application Computers and Industrial Engineering 30 1996 905 917
70. C. Floudas Nonlinear and mixed-integer optimization fundamentals and applications 1995 Oxford University Press Oxford
71. Törn A, Zilinskas A. Global optimization. Lecture notes in computer science, vol. 350. Berlin: Springer-Verlag; 1989.