Pattern search ranking and selection algorithms for mixed variable simulation-based optimization

European Journal of Operational Research

Volumn 198, Issue 3, 2009, Pages 878-890

  Sriver, Todd A ^a   Chrissis, James W ^b   Abramson, Mark A ^c  

^a Ramstein Air Base   (United States)

^b AIR FORCE INSTITUTE OF TECHNOLOGY   (United States)

^c BOEING COMPANY   (United States)

Author keywords

Mixed variable programming; Nonlinear programming; Pattern search algorithms; Ranking and selection; Simulation

Indexed keywords

ASYMPTOTIC CONVERGENCES; FUNCTION VALUES; GENERALIZED PATTERN SEARCHES; MIXED VARIABLE PROGRAMMING; MIXED VARIABLES; OBJECTIVE FUNCTIONS; PATTERN SEARCH ALGORITHMS; PATTERN SEARCHES; RANDOM NOISE; RANKING AND SELECTION; SIMULATION; SIMULATION-BASED OPTIMIZATIONS; STATISTICAL POWER; TEST PROBLEMS;

COMPUTER SOFTWARE SELECTION AND EVALUATION; DYNAMIC PROGRAMMING; LEARNING ALGORITHMS; NONLINEAR PROGRAMMING; OPTIMIZATION;

CONVERGENCE OF NUMERICAL METHODS;

EID: 64449087894     PISSN: 03772217     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ejor.2008.10.020     Document Type: Article

References (48)

1. M.A. Abramson, Pattern search algorithms for mixed variable general constrained optimization problems, Ph.D. Thesis, Rice University, Department of Computational and Applied Mathematics, 2002.
2. Abramson M.A. Second-order behavior of pattern search. SIAM Journal of Optimization 16 2 (2005) 515-530
3. Abramson M.A., Audet C., Chrissis J.W., and Walston J. Mesh adaptive direct search algorithms for mixed variable optimization. Optimization Letters 3 1 (2009) 35-47
4. Abramson M.A., Audet C., and Dennis Jr. J.E. Filter pattern search algorithms for mixed variable constrained optimization. Pacific Journal of Optimization 3 3 (2007) 477-500
5. Abramson M.A., Brezhneva O.A., Dennis Jr. J.E., and Pingel R.L. Pattern search in the presence of degeneracy. Optimization Methods and Software 23 3 (2007) 297-319
6. Ahmed M.A., and Alkhamis T.M. Simulation-based optimization using simulated annealing with ranking and selection. Computers and Operations Research 29 (2002) 387-402
7. Anderson E.J., and Ferris M.C. A direct search algorithm for optimization with noisy function evaluations. SIAM Journal of Optimization 11 3 (2001) 837-857
8. Andradóttir S. Simulation optimization (Chapter 9). In: Banks J. (Ed). Handbook of Simulation (1998), John Wiley & Sons, New York 307-333
9. Andradóttir S. Accelerating the convergence of random search methods for discrete stochastic optimization. ACM Transactions on Model. Comput. Sim. 9 4 (1999) 349-380
10. Audet C., and Dennis Jr. J.E. Pattern search algorithms for mixed variable programming. SIAM Journal of Optimization 11 3 (2000) 573-594
11. Audet C., and Dennis Jr. J.E. Analysis of generalized pattern searches. SIAM Journal of Optimization 13 3 (2003) 889-903
12. Audet C., and Dennis Jr. J.E. A pattern search filter method for nonlinear programming without derivatives. SIAM Journal of Optimization 14 4 (2003) 980-1010
13. Audet C., and Dennis Jr. J.E. Mesh adaptive direct search algorithms for constrained optimization. SIAM Journal of Optimization 17 2 (2006) 188-217
14. Bechhofer R.E. A single-sample multiple decision procedure for ranking means of normal populations with known variances. Annals of Mathematical Statistics 25 (1954) 16-39
15. Bechhofer R.E., Santner T.J., and Goldsman D.M. Design and Analysis of Experiments for Statistical, Selection, Screening and Multiple Comparisons (1995), John Wiley & Sons, New York
16. Boesel J., Nelson B.L., and Kim S.H. Using ranking and selection to "clean up" after simulation optimization. Operation Research 51 5 (2003) 814-825
17. A.J. Booker, J.E. Dennis Jr., P.D. Frank, D.W. Moore, D.B. Serafini, Managing surrogate objectives to optimize a helicopter rotor design - further experiments, Technical Report 98-4717, AIAA, St. Louis, September 1999.
18. Booker A.J., Dennis Jr. J.E., Frank P.D., Serafini D.B., and Torczon V. Optimization using surrogate objectives on a helicopter test example. In: Borggaard J., Burns J., Cliff E., and Schreck S. (Eds). Optimal Design and Control Progress in Systems and Control Theory (1998), Massachusetts, Birkhäuser, Cambridge 49-58
19. Booker A.J., Dennis Jr. J.E., Frank P.D., Serafini D.B., Torczon V., and Trosset M.W. A rigorous framework for optimization of expensive functions by surrogates. Structural Optimization 17 1 (1999) 1-13
20. Davis C. Theory of positive linear dependence. American Journal of Mathematics 76 4 (1954) 733-746
21. Dolan E.D., Lewis R.M., and Torczon V. On the local convergence of pattern search. SIAM Journal of Optimization 14 2 (2003) 567-583
22. Dudewicz E.J., and Dalal S.R. Allocation of observations in ranking and selection. Indian Journal of Statistics 37B 1 (1975) 28-78
23. Elster C., and Neumaier A. A grid algorithm for bound constrained optimization of noisy functions. IMA Journal of Numerical Analysis 15 (1995) 585-608
24. Fu M.C. Optimization for simulation: Theory vs. practice. INFORMS Journal on Computing 14 3 (2002) 192-215
25. Hock W., and Schittkowski K. Test Examples for Nonlinear Programming Codes. Lecture Notes in Economics and Mathematical Systems vol. 187 (1981), Springer-Verlag, Berlin
26. Kokkolaras M., Audet C., and Dennis Jr. J.E. Mixed variable optimization of the number and composition of heat intercepts in a thermal insulation system. Optimization and Engineering 2 1 (2001) 5-29
27. R.M. Lewis, V. Torczon, Rank ordering and positive bases in pattern search algorithms, Technical Report ICASE 96-71, NASA Langley Research Center, 1996.
28. Lewis R.M., and Torczon V. Pattern search algorithms for bound constrained minimization. SIAM Journal of Optimization 9 4 (1999) 1082-1099
29. Lewis R.M., and Torczon V. Pattern search methods for linearly constrained minimization. SIAM Journal of Optimization 10 3 (2000) 917-941
30. Lewis R.M., and Torczon V. A globally convergent augmented Lagrangian pattern search algorithm for optimization with general constraints and simple bounds. SIAM Journal of Optimization 12 4 (2002) 1075-1089
31. Ljung L., Pflug G., and Walk H. Stochastic Approximation and Optimization of Random Systems (1992), Birkhäuser Verlag, Berlin
32. Lucidi S., and Piccialli V. A derivative-based algorithm for a particular class of mixed variable optimization problems. Optimization Methods and Software 19 3-4 (2004) 371-387
33. Lucidi S., Piccialli V., and Sciandrone M. An algorithm model for mixed variable programming. SIAM Journal of Optimization 15 4 (2005) 1057-1084
34. Marsden A.L., Wang M., Dennis Jr. J.E., and Moin P. Optimal aeroacoustic shape design using the surrogate management framework. Optimization and Engineering 5 2 (2004) 235-262
35. Nelson B.L., Swann J., Goldsman D., and Song W. Simple procedures for selecting the best simulated system when the number of alternatives is large. Operation Research 49 6 (2004) 950-963
36. S. Ólafsson, Iterative ranking-and-selection for large-scale optimization, in: P.A. Farrington, H.B. Nembhard, D.T. Sturrock, G.W. Evans, (Eds.), Proceedings of the 1999 Winter Simposium Conference, 1999, pp. 479-485.
37. Ouali M.S., Aoudjit H., and Audet C. Optimisation des stratégies de maintenance. Journal Européen des Systèmes Automatisés 37 5 (2003) 587-605
38. Pichitlamken J., and Nelson B.L. A combined procedure for optimization via simulation. ACM Transactions on Modeling Computer Simulation 13 2 (2003) 155-179
39. Rinott Y. On two-stage selection procedures and related probability-inequalities. Communications in Statistics A7 8 (1978) 799-811
40. Robbins H., and Monro S. A stochastic approximation method. Annals of Mathematical Statistics 22 (1951) 400-407
41. Schittkowski K. More Test Examples for Nonlinear Programming Codes. Lecture Notes in Economics and Mathematical Systems vol. 282 (1987), Springer, Verlag, Berlin
42. Spall J.C. An overview of the simultaneous perturbation method for efficient optimization. Johns Hopkins APL Technical Digest 19 4 (1998) 482-492
43. Spall J.C. Introduction to Stochastic Search and Optimization: Estimation, Simulation, and Control (2003), John Wiley & Sons, Hoboken, New Jersey
44. T.A. Sriver, Pattern Search ranking and selection algorithms for mixed variable stochastic systems, Ph.D. Thesis, Air Force Institute of Technology, Graduate School of Engineering and Management, Wright-Patterson AFB, Ohio, 2004.
45. T.A. Sriver, J.W. Chrissis, Combined pattern search and ranking and selection for simulation optimization, in: R.G. Ingalls, M.D. Rossetti, J.S. Smith, B.A. Peters, (Eds.), Proceedings of the 2004 Winter Simposium Conference, 2004.
46. Swisher J.R., Jacobson S.H., and Yücesan E. Discrete-event simulation optimization using ranking, selection, and multiple comparison procedures: A survey. ACM Transactions on Modeling and Computer Simulation 13 2 (2003) 134-154
47. Torczon V. On the convergence of pattern search algorithms. SIAM Journal of Optimization 7 1 (1997) 1-25
48. M.W. Trosset, On the use of direct search methods for stochastic optimization, Technical Report TR00-20, Department of Computational and Applied Mathematics, Rice University, Houston Texas, June 2000.