Stochastic radial basis function algorithms for large-scale optimization involving expensive black-box objective and constraint functions

Computers and Operations Research

Volumn 38, Issue 5, 2011, Pages 837-853

  Regis, Rommel G ^a  

^a SAINT JOSEPH S UNIVERSITY   (United States)

Author keywords

Constrained optimization; Derivative free optimization; Expensive function; Large scale optimization; Radial basis function; Stochastic algorithm; Surrogate model

Indexed keywords

DERIVATIVE-FREE OPTIMIZATION; EXPENSIVE FUNCTION; LARGE-SCALE OPTIMIZATION; RADIAL BASIS FUNCTIONS; STOCHASTIC ALGORITHMS; SURROGATE MODEL;

ALGORITHMS; ATTITUDE CONTROL; AUTOMOTIVE INDUSTRY; FUEL ADDITIVES; FUNCTION EVALUATION; QUADRATIC PROGRAMMING; RADIAL BASIS FUNCTION NETWORKS; STOCHASTIC MODELS; STOCHASTIC SYSTEMS;

CONSTRAINED OPTIMIZATION;

EID: 78149285658     PISSN: 03050548     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cor.2010.09.013     Document Type: Article

References (59)

1. R.G. Regis, and C.A. Shoemaker A stochastic radial basis function method for the global optimization of expensive functions INFORMS Journal on Computing 19 4 2007 497 509
2. Jones DR. Large-scale multi-disciplinary mass optimization in the auto industry. Presented at the modeling and optimization: theory and applications (MOPTA) 2008 conference, Ontario, Canada, 2008.
3. M.A. Abramson, and C. Audet Convergence of mesh adaptive direct search to second-order stationary points SIAM Journal on Optimization 17 2 2006 606 619
4. C. Audet, and J.E. Dennis Jr. Mesh adaptive direct search algorithms for constrained optimization SIAM Journal on Optimization 17 2 2006 188 217
5. M.J.D. Powell A direct search optimization methods that models the objective and constraint functions by linear interpolation S. Gomez, J.-P. Hennart, Advances in optimization and numerical analysis 1994 Kluwer Dordrecht 51 67
6. Z. Ugray, L. Lasdon, J. Plummer, F. Glover, J. Kelley, and R. Marti Scatter search and local NLP solvers: a multistart framework for global optimization INFORMS Journal on Computing 19 3 2007 328 340
7. L. Lasdon, A. Duarte, F. Glover, M. Laguna, and R. Marti Adaptive memory programming for constrained global optimization Computers & Operations Research 37 8 2010 1500 1509
8. T.G. Kolda, R.M. Lewis, and V. Torczon Optimization by direct search: new perspectives on some classical and modern methods SIAM Review 45 3 2003 385 482
9. A.R. Conn, K. Scheinberg, and L.N. Vicente Introduction to derivative-free optimization 2009 SIAM Philadelphia, PA
10. V. Torczon On the convergence of pattern search algorithms SIAM Journal on Optimization 7 1997 1 25
11. A.R. Conn, K. Scheinberg, and Ph.L. Toint Recent progress in unconstrained nonlinear optimization without derivatives Mathematical Programming 79 3 1997 397 414
12. M.J.D. Powell UOBYQA: unconstrained optimization by quadratic approximation Mathematical Programming 92 2002 555 582
13. M.J.D. Powell The NEWUOA software for unconstrained optimization without derivatives G. Di Pillo, M. Roma, Large-scale nonlinear optimization 2006 Springer US 255 297
14. S. Wild, R.G. Regis, and C.A. Shoemaker ORBIT: optimization by radial basis function interpolation in trust-regions SIAM Journal on Scientific Computing 30 6 2008 3197 3219
15. R. Storn, and K. Price Differential evolutiona simple and efficient heuristic for global optimization over continuous spaces Journal of Global Optimization 11 4 1997 341 359
16. H. Sarimveis, and A. Nikolakopoulos A line up evolutionary algorithm for solving nonlinear constrained optimization problems Computers & Operations Research 32 6 2005 1499 1514
17. F. Glover A template for scatter search and path relinking J.-K. Hao, E. Lutton, E. Ronald, M. Schoenauer, D. Snyers, Artificial evolution. Lecture notes in computer science vol. 1363 1998 Springer Verlag Berlin, Germany 13 54
18. M. Laguna, and R. Marti Scatter search: methodology and implementations in C 2003 Kluwer Boston, MA
19. M. Rodriguez-Fernandez, J.A. Egea, and J.R. Banga Novel metaheuristic for parameter estimation in nonlinear dynamic biological systems BMC Bioinformatics 7 2006 483
20. J.A. Egea, M. Rodriguez-Fernandez, J.R. Banga, and R. Marti Scatter search for chemical and bioprocess optimization Journal of Global Optimization 37 3 2007 481 503
21. R.H. Myers, and D.C. Montgomery Response surface methodology: process and product optimization using designed experiments 1995 Wiley New York
22. M.D. Buhmann Radial basis functions 2003 Cambridge University Press Cambridge, UK
23. M.J.D. Powell The theory of radial basis function approximation in 1990 W. Light, Advances in numerical analysis, volume 2: wavelets subdivision algorithms and radial basis functions 1992 Oxford University Press Oxford, UK 105 210
24. J. Sacks, W.J. Welch, T.J. Mitchell, and H.P. Wynn Design and analysis of computer experiments Statistical Science 4 1989 409 435
25. N. Cressie Statistics for spatial data 1993 Wiley New York
26. A.A. Giunta, V. Balabanov, D. Haim, B. Grossman, W.H. Mason, and L.T. Watson Aircraft multidisciplinary design optimisation using design of experiments theory and response surface modelling Aeronautical Journal 101 1008 1997 347 356
27. T.W. Simpson, T.M. Mauery, J.J. Korte, and F. Mistree Kriging metamodels for global approximation in simulation-based multidisciplinary design optimization AIAA Journal 39 12 2001 2233 2241
28. D.R. Jones, M. Schonlau, and W.J. Welch Efficient global optimization of expensive black-box functions Journal of Global Optimization 13 4 1998 455 492
29. D.M. Aleman, H.E. Romeijn, and J.F. Dempsey A response surface approach to beam orientation optimization in intensity modulated radiation therapy treatment planning INFORMS Journal on Computing 21 2009 62 76
30. J. Villemonteix, E. Vazquez, and E. Walter An informational approach to the global optimization of expensive-to-evaluate functions Journal of Global Optimization 44 4 2009 509 534
31. H.-M. Gutmann A radial basis function method for global optimization Journal of Global Optimization 19 3 2001 201 227
32. M. Bjrkman, and K. Holmstrm Global optimization of costly nonconvex functions using radial basis functions Optimization and Engineering 1 2000 373 397
33. R.G. Regis, and C.A. Shoemaker Improved strategies for radial basis function methods for global optimization Journal of Global Optimization 37 1 2007 113 135
34. A.J. Booker, J.E. Dennis, P.D. Frank, D.B. Serafini, V. Torczon, and M.W. Trosset A rigorous framework for optimization of expensive functions by surrogates Structural Optimization 17 1 1999 1 13
35. A.L. Marsden, M. Wang, J.E. Dennis Jr., and P. Moin Optimal aeroacoustic shape design using the surrogate management framework Optimization and Engineering 5 2 2004 235 262
36. J.A. Egea, E. Vazquez, J.R. Banga, and R. Marti Improved scatter search for the global optimization of computationally expensive dynamic models Journal of Global Optimization 43 23 2009 175 190
37. R.G. Regis, and C.A. Shoemaker Constrained global optimization using radial basis functions Journal of Global Optimization 31 2005 153 171
38. K. Holmstrm, N.-H. Quttineh, and M.M. Edvall An adaptive radial basis algorithm (ARBF) for expensive black-box mixed-integer constrained global optimization Optimization and Engineering 9 4 2008 311 339
39. Shi L, Rasheed K. ASAGA: an adaptive surrogate-assisted genetic algorithm. In: Proceedings of the genetic and evolutionary computation conference (GECCO 2008), 2008. p. 104956.
40. Abramson MA. 2007. NOMADm version 4.6 User's Guide. Unpublished manuscript.
41. J.P.C. Kleijnen, W. van Beers, and I. van Nieuwenhuyse Constrained optimization in expensive simulation: novel approach European Journal of Operational Research 202 1 2010 164 174
42. R.G. Regis, and C.A. Shoemaker Local function approximation in evolutionary algorithms for costly black box optimization IEEE Transactions on Evolutionary Computation 8 5 2004 490 505
43. Lophaven SN, Nielsen HB, Søndergaard J. DACE: a Matlab Kriging Toolbox, Version 2.0. Technical Report IMM-TR-2002-12, Informatics and Mathematical Modelling, Technical University of Denmark, Lyngby, Denmark; 2002
44. Forrester A, Jones DR. Enhancements to the expected improvement criterion. Presented at the 20th international symposium on mathematical programming (ISMP), Chicago, IL, 2009.
45. Quttineh N, Holmstrm K. Implementation of a one-stage EGO algorithm. Presented at the 20th international symposium on mathematical programming (ISMP), Chicago, IL, 2009.
46. Regis RG. Radial basis function algorithms for large-scale nonlinearly constrained black-box optimization. Presented at the 20th international symposium on mathematical programming (ISMP), Chicago, IL, 2009.
47. J.R. Koehler, and A.B. Owen Computer experiments S. Ghosh, C.R. Rao, Handbook of statistics, 13: design and analysis of computer experiments 1996 North-Holland Amsterdam, The Netherlands 261 308
48. B.A. Tolson, and C.A. Shoemaker Dynamically dimensioned search algorithm for computationally efficient watershed model calibration Water Resources Research 43 2007 W01413 10.1029/2005WR004723
49. The Mathworks, Inc. 2009. Matlab Genetic Algorithm and Direct Search Toolbox: User's Guide, Version 2. Natick, MA.
50. The Mathworks, Inc. 2009. Matlab Optimization Toolbox: User's Guide, Version 4. Natick, MA.
51. C.A. Coello Coello, and E.M. Montes Constraint-handling in genetic algorithms through the use of dominance-based tournament selection Advanced Engineering Informatics 16 2002 193 203
52. Hedar A. Studies on metaheuristics for continuous global optimization problems. PhD thesis, Kyoto University, Kyoto, Japan; 2004.
53. C.S. Beightler, and D.T. Phillips Applied geometric programming 1976 Wiley New York
54. C.A. Floudas, and P.M. Pardalos A collection of test problems for constrained global optimization algorithms 1990 Springer-Verlag Berlin
55. Z. Michalewicz, and D.B. Fogel How to solve it: modern heuristics 2000 Springer-Verlag Berlin
56. Egea JA. New heuristics for global optimization of complex bioprocesses. PhD thesis, Universidade de Vigo, Spain; 2008.
57. R. Hesse A heuristic search procedure for estimating a global solution of nonconvex programming problems Operational Research 21 1973 1267 1280
58. K.Q. Ye, W. Li, and A. Sudjianto Algorithmic construction of optimal symmetric latin hypercube designs Journal of Statistical Planning and Inference 90 2000 145 159
59. K. Rasheed, X. Ni, and S. Vattam Comparison of methods for developing dynamic reduced models for design optimization The Soft Computing Journal 9 1 2005 29 37