Simulation optimization: a review on theory and applications

Zidonghua Xuebao/Acta Automatica Sinica

Volumn 39, Issue 11, 2013, Pages 1957-1968

  Wang, Long Fei ^a   Shi, Le Yuan ^a  

^a PEKING UNIVERSITY   (China)

Author keywords

Gradient based methods; Nested partitions method; Optimal computing budget allocation (OCBA); Ranking and selection; Simulation optimization

Indexed keywords

GRADIENT-BASED METHOD; NESTED PARTITIONS; OPTIMAL COMPUTING BUDGET ALLOCATION; RANKING AND SELECTION; SIMULATION OPTIMIZATION;

BUDGET CONTROL;

OPTIMIZATION;

EID: 84889028161     PISSN: 02544156     EISSN: None     Source Type: Journal    
DOI: 10.3724/SP.J.1004.2013.01957     Document Type: Review

References (192)

1. Tekin E, Sabuncuoglu I. Simulation optimization: a comprehensive review on theory and applications. IIE Transactions, 2004, 36(11): 1067-1081
2. Meketon M S. Optimization in simulation: a survey of recent results. In: Proceedings of the 1987 Winter Simulation Conference. Piscataway, NJ: IEEE, 1987. 58-67
3. Jacobson S H, Schruben L W. Techniques for simulation response optimization. Operations Research Letters, 1989, 8(1): 1-9
4. Azadivar F. A tutorial on simulation optimization. In: Proceedings of the 1992 Winter Simulation Conference. Piscataway, NJ: IEEE, 1992. 198-204
5. Fu M C. Optimization via simulation: a review. Annals of Operations Research, 1994, 53(1): 199-247
6. Carson Y, Maria A. Simulation optimization: methods and applications. In: Proceedings of the 1997 Winter Simulation Conference. Atlanta, Georgia: IEEE, 1997. 118-126
7. Andradóttir S. A review of simulation optimization techniques. In: Proceedings of the 1998 Winter Simulation Conference. Piscataway, NJ: IEEE, 1998. 151-158
8. Bowden R O, Hall J D. Simulation optimization research and development. In: Proceedings of the 1998 Winter Simulation Conference. Washington, DC: IEEE, 1998. 1693-1698
9. Azadivar F. Simulation optimization methodologies. In: Proceedings of the 1999 Winter Simulation Conference. Phoenix, AZ: IEEE, 1999. 93-100
10. Swisher J R, Hyden P D, Jacobson S H, Schruben L W. A survey of simulation optimization techniques and procedures. In: Proceedings of the 2000 Winter Simulation Conference. Orlando, FL: IEEE, 2000. 119-128
11. Law A M, McComas M G. Simulation-based optimization. In: Proceedings of the 2000 Winter Simulation Conference. San Diego, CA, USA: IEEE, 2000. 46-49
12. Fu M C. Simulation optimization. In: Proceedings of the 2001 Winter Simulation Conference. Arlington, VA, USA: IEEE, 2001. 53-61
13. Fu M C. Optimization for simulation: theory vs. practice. INFORMS Journal on Computing, 2002, 14(3): 192-215
14. Ólafsson S, Kim J. Simulation optimization. In: Proceedings of the 2002 Winter Simulation Conference. Piscataway, NJ: IEEE, 2002. 79-84
15. Law A M, McComas M G. Simulation optimization: simulation-based optimization. In: Proceedings of the 2002 Winter Simulation Conference. San Diego, CA, USA: IEEE, 2002. 41-44
16. April J, Glover F, Kelly J P, Laguna M. Practical introduction to simulation optimization. In: Proceedings of the 2003 Winter Simulation Conference. New Orleans, LA, USA: IEEE, 2003. 71-78
17. Fu M C, Glover F W, April J. Simulation optimization: a review, new developments, and applications. In: Proceedings of the 2005 Winter Simulation Conference. Orlando, FL: IEEE, 2005. 83-95
18. Fu M C, Chen C H, Shi L. Some topics for simulation optimization. In: Proceedings of the 2008 Winter Simulation Conference. Austin, TX: IEEE, 2008. 27-38
19. Ho Y C, Eyler M A, Chien T T. A gradient technique for general buffer storage design in a production line. International Journal of Production Research, 1979, 17(6): 557-580
20. Ho Y C, Cao X R. Perturbation Analysis of Discrete Event Dynamic Systems. Norwell, MA, USA: Kluwer Academic Pub, 1991
21. Heidelberger P. Limitations of Infinitesimal Perturbation Analysis. International Business Machine Research Report RC 11891, IBM Watson Research Labs, Yorktown Heights, NY, 1986
22. Glasserman P. Structural conditions for perturbation analysis derivative estimation: finite-time performance indices. Operations Research, 1991, 39(5): 724-738
23. L'Ecuyer P, Perron G. On the convergence rates of IPA and FDC derivative estimators. Operations Research, 1994, 42(4): 643-656
24. Dai L L. Perturbation analysis via coupling. IEEE Transactions on Automatic Control, 2000, 45(4): 614-628
25. Ho Y C, Suri R, Cao X R, Diehl G W, Dille J W, Zazanis M. Optimization of large multiclass (non-product-form) queueing networks using perturbation analysis. Large Scale Systems, 1984, 7: 165-180
26. Ho Y C. On the perturbation analysis of discrete-event dynamic systems. Journal of Optimization Theory and Applications, 1985, 46(4): 535-545
27. Ho Y C, Hu J Q. An infinitesimal perturbation analysis algorithm for a multiclass G/G/1 queue. Operations Research Letters, 1990, 9(1): 35-44
28. Chong E K P, Ramadge P J. Optimization of queues using an infinitesimal perturbation analysis-based stochastic algorithm with general update times. SIAM Journal on Control and Optimization, 1993, 31(3): 698-732
29. Fu M C, Hu J Q. Smoothed perturbation analysis derivative estimation for Markov chains. Operations Research Letters, 1994, 15(5): 241-251
30. Fu M C. Sample path derivatives for (s, S) inventory systems. Operations Research, 1994, 42(2): 351-364
31. Bashyam S, Fu M C. Application of perturbation analysis to a class of periodic review (s, S) inventory systems. Naval Research Logistics (NRL), 1994, 41(1): 47-80
32. Bashyam S, Fu M C. Optimization of (s, S) inventory systems with random lead times and a service level constraint. Management Science, 1998, 44(12-Part-2): S243-S256
33. Donohue K L, Spearman M L. Improving the design of stochastic production lines: an approach using perturbation analysis. International Journal of Production Research, 1993, 31(12): 2789-2806
34. Yan H, Yin G, Lou S X C. Using stochastic optimization to determine threshold values for the control of unreliable manufacturing systems. Journal of Optimization Theory and Applications, 1994, 83(3): 511-539
35. Liberopoulos G, Caramanis M. Infinitesimal perturbation analysis for second derivative estimation and design of manufacturing flow controllers. Journal of Optimization Theory and Applications, 1994, 81(2): 297-327
36. Cheng D W. On the design of a tandem queue with blocking: modeling, analysis, and gradient estimation. Naval Research Logistics (NRL), 1994, 41(6): 759-770
37. Heidergott B. Sensitivity analysis of a manufacturing work-station using perturbation analysis techniques. International Journal of Production Research, 1995, 33(3): 611-622
38. Brooks C A, Varaiya P. Using augmented infinitesimal perturbation analysis for capacity planning in intree ATM networks. Discrete Event Dynamic Systems, 1997, 7(4): 377-390
39. Heidergott B. Optimisation of a single-component maintenance system: a smoothed perturbation analysis approach. European Journal of Operational Research, 1999, 119(1): 181-190
40. Schruben L W, Cogliano V J. Simulation sensitivity analysis: a frequency domain approach. In: Proceedings of the 1981 Winter Simulation Conference. Piscataway, NJ: IEEE, 1981. 455-459
41. Jacobson S H, Morrice D, Schruben L W. The global simulation clock as the frequency domain experiment index. In: Proceedings of the 1988 Winter Simulation Conference, San Diego, CA, USA: IEEE, 1988. 558-563
42. Jacobson S H, Buss A H, Schruben L W. Driving frequency selection for frequency domain simulation experiments. Operations Research, 1991, 39(6): 917-924
43. Hazra M M, Morrice D J, Park S K. A simulation clock-based solution to the frequency domain experiment indexing problem. IIE Transactions, 1997, 29(9): 769-782
44. Glynn P W. Likelihood ratio gradient estimation: an overview. In: Proceedings of the 1987 Winter Simulation Conference. Piscataway, NJ: IEEE, 1987. 366-375
45. Glynn P W. Likelihood ratio gradient estimation for stochastic systems. Communications of the ACM, 1990, 33(10): 75-84
46. Rubinstein R Y. Sensitivity analysis and performance extrapolation for computer simulation models. Operations Research, 1989, 37(1): 72-81
47. Rubinstein R Y. Optimization of computer simulation models with rare events. European Journal of Operational Research, 1997, 99(1): 89-112
48. Rubinstein R Y, Shapiro A. Discrete Event Systems: Sensitivity Analysis and Stochastic Optimization by the Score Function Method. New York: Wiley, 1993
49. Nakayama M K, Goyal A, Glynn P W. Likelihood ratio sensitivity analysis for Markovian models of highly dependable systems. Operations Research, 1994, 42(1): 137-157
50. Nakayama M K, Shahabuddin P. Likelihood ratio derivative estimation for finite-time performance measures in generalized semi-Markov processes. Management Science, 1998, 44(10): 1426-1441
51. Andradóttir, S. Optimization of the transient and steady-state behavior of discrete event systems. Management Science, 1996, 42(5): 717-737
52. Fu M C, Hu J Q, Nagi R. Comparison of gradient estimation techniques for queues with non-identical servers. Computers and Operations Research, 1995, 22(7): 715-729
53. Fu M C, Hu J Q. Efficient design and sensitivity analysis of control charts using Monte Carlo simulation. Management Science, 1999, 45(3): 395-413
54. Fu M C. 2006. Gradient estimation. Handbooks in Operations Research and Management Science: Simulation, Chapter 19 (Henderson S G, Nelson B L (editor)). Amsterdam: Elsevier. 575-616
55. Fu M C. What you should know about simulation and derivatives. Naval Research Logistics (NRL), 2008, 55(8): 723-736
56. Robbins H, Monro S. A stochastic approximation method. The Annals of Mathematical Statistics, 1951, 22(3): 400-407
57. Kiefer J, Wolfowitz J. Stochastic estimation of the maximum of a regression function. The Annals of Mathematical Statistics, 1952, 23(3): 462-466
58. Glynn P W. Stochastic approximation for Monte Carlo optimization. In: Proceedings of the 1986 Winter Simulation Conference. Piscataway, NJ: IEEE, 1986. 356-365
59. Kouritzin M A. On the convergence of linear stochastic approximation procedures. IEEE Transactions on Information Theory, 1996, 42(4): 1305-1309
60. Kulkarni S R, Horn C S. An alternative proof for convergence of stochastic approximation algorithms. IEEE Transactions on Automatic Control, 1996, 41(3): 419-424
61. L'Ecuyer P, Yin G. Budget-dependent convergence rate of stochastic approximation. SIAM Journal on Optimization, 1998, 8(1): 217-247
62. Andradóttir S. A stochastic approximation algorithm with varying bounds. Operations Research, 1995, 43(6): 1037-1048
63. Kleinman N L, Spall J C, Naiman D Q. Simulation-based optimization with stochastic approximation using common random numbers. Management Science, 1999, 45(11): 1570-1578
64. Fu M C, Ho Y C. Using perturbation analysis for gradient estimation, averaging and updating in a stochastic approximation algorithm. In: Proceedings of the 1988 Winter Simulation Conference. San Diego, CA, USA, 1988. 509-517
65. Fu M C. Convergence of a stochastic approximation algorithm for the GI/G/1 queue using infinitesimal perturbation analysis. Journal of Optimization Theory and Applications, 1990, 65(1): 149-160
66. L'Ecuyer P, Glynn P W. Stochastic optimization by simulation: convergence proofs for the GI/G/1 queue in steady-state. Management Science, 1994, 40(11): 1562-1578
67. Hill S D, Fu M C. Optimizing discrete event systems with the simultaneous perturbation stochastic approximation algorithm. In: Proceedings of the 33rd IEEE Conference on Decision and Control. Lake Buena Vista, FL: IEEE, 1994. 2631-2632
68. Fu M C, Hill S D. Optimization of discrete event systems via simultaneous perturbation stochastic approximation. IIE Transactions, 1997, 29(3): 233-243
69. Fu M, Hu J Q. Conditional Monte Carlo: Gradient Estimation and Optimization Applications. Boston: Kluwer Academic Publishers, 1997
70. Chong E K P, Ramadge P J. Optimal load sharing in soft real-time systems using likelihood ratios. Journal of Optimization Theory and Applications, 1994, 82(1): 23-48
71. Andradöttir S. A scaled stochastic approximation algorithm. Management Science, 1996, 42(4): 475-498
72. Tang Q Y, Chen H F, Han Z J. Convergence rates of Perturbation-Analysis-Robbins-Monro-Single-Run algorithms for single server queues. IEEE Transactions on Automatic Control, 1997, 42(10): 1442-1447
73. Tang Q Y, L'Ecuyer P, Chen H F. Asymptotic efficiency of perturbation-analysis-based stochastic approximation with averaging. SIAM Journal on Control and Optimization, 1999, 37(6): 1822-1847
74. Tang Q Y, Chen H F. Central limit theorems for stochastic optimization algorithms using infinitesimal perturbation analysis. Discrete Event Dynamic Systems, 2000, 10(1-2): 5-32
75. Hasan C N, Spearman M L. Optimal material release times in stochastic production environments. International Journal of Production Research, 1999, 37(6): 1201-1216
76. Andradóttir S. A new algorithm for stochastic optimization. In: Proceedings of the 1990 Winter Simulation Conference. New Orleans, LA: IEEE, 1986. 364-366
77. Andradóttir S. A projected stochastic approximation algorithm. In: Proceedings of the 1991 Winter Simulation Conference. Phoenix, AZ: IEEE, 1991. 954-957
78. Yakowitz S. A globally convergent stochastic approximation. SIAM Journal on Control and Optimization, 1993, 31(1): 30-40
79. Kushner H J, Yin G. Stochastic Approximation and Recursive Algorithms and Applications (2nd edition). New York: Springer-Verlag, 2003
80. Gurkan G, Yonca-Ozge A, Robinson T M. Sample-path optimization in simulation. In: Proceedings of the 1994 Winter Simulation Conference. Lake Buena Vista, FL, USA: IEEE, 1994. 247-254
81. Homem-de-Mello T, Shapiro A, Spearman M L. Finding optimal material release times using simulation-based optimization. Management Science, 1999, 45(1): 86-102
82. Kleywegt A J, Shapiro A, Homem-de-Mello T. The sample average approximation method for stochastic discrete optimization. SIAM Journal on Optimization, 2002, 12(2): 479-502
83. Chen H F, Schmeiser B W. Retrospective approximation algorithms for stochastic root finding. In: Proceedings of the 1994 Winter Simulation Conference. Lake Buena Vista, FL, USA: IEEE, 1994. 255-261
84. Shapiro A. Simulation based optimization. In: Proceedings of the 1996 Winter Simulation Conference. Washington, DC: IEEE, 1996. 332-336
85. Box G E P, Wilson K B. On the experimental attainment of optimum conditions. Journal of the Royal Statistical Society. Series B (Methodological), 1951, 13(1): 1-45
86. Box G E P. The exploration and exploitation of response surfaces: some general considerations and examples. Biometrics, 1954, 10(1): 16-60
87. Biles W E. A gradient-regression search procedure for simulation experimentation. In: Proceedings of the 1974 Winter Simulation Conference. Piscataway, NJ: IEEE, 1974. 491-497
88. Smith D E. Automatic optimum-seeking program for digital simulation. Simulation, 1976, 27(1): 27-31
89. Daughety A F, Turnquist M A. Simulation optimization using response surfaces based on spline approximations. In: Proceedings of the 1978 Winter Simulation Conference. Piscataway, NJ: IEEE, 1978. 183-193
90. Wilson J R. Future directions in response surface methodology for simulation. In: Proceedings of the 1987 Winter Simulation Conference. Piscataway, NJ: IEEE, 1987. 378-381
91. Myers R H, Khuri A I, Carter W H Jr. Response surface methodology: 1966-1988. Technometrics, 1989, 31(2): 137-157
92. Safizadeh M H, Signorile R. Optimization of simulation via quasi-Newton methods. ORSA Journal on Computing, 1994, 6(4): 398-408
93. Joshi S, Sherali H D, Tew J D. An enhanced response surface methodology (RSM) algorithm using gradient deflection and second-order search strategies. Computers and Operations Research, 1998, 25(7-8): 531-541
94. Kleijnen J P C. 1998. Experimental design for sensitivity analysis, optimization, and validation of simulation models. Handbook of Simulation, Chapter 6 (Banks J (editor)). New York: Wiley. 173-223
95. Kleijnen J P C. Simulation and optimization in production planning: a case study. Decision Support Systems, 1993, 9(3): 269-280
96. Kleijnen J P C. Sensitivity analysis and optimization of system dynamics models: regression analysis and statistical design of experiments. System Dynamics Review, 1995, 11(4): 275-288
97. Shang J S, Tadikamalla P R. Output maximization of a CIM system: simulation and statistical approach. International Journal of Production Research, 1993, 31(1): 19-41
98. Barton R R, Meckesheimer M. 2006. Metamodelbased simulation optimization. Handbooks in Operations Research and Management Science: Simulation, Chapter 18 (Henderson S G, Nelson B L (editor)). Amsterdam: Elsevier. 535-574
99. Kleijnen J P C. Design and Analysis of Simulation Experiments. New York: Springer, 2007
100. Dudewicz E J, Dalal S R. Allocation of observations in ranking and selection with unequal variances. Sankhyā: The Indian Journal of Statistics, Series B, 1975, 37(1): 28-78
101. Rinott Y. On two-stage selection procedures and related probability-inequalities. Communications in Statistics-Theory and Methods, 1978, 7(8): 799-811
102. Gupta S S, Sobel M. On a statistic which arises in selection and ranking problems. The Annals of Mathematical Statistics, 1957, 28(4): 957-967
103. Gupta S S. On some multiple decision (selection and ranking) rules. Technometrics, 1965, 7(2): 225-245
104. Sullivan D W, Wilson J R. Restricted subset selection procedures for simulation. Operations Research, 1989, 37(1): 52-71
105. Nelson B L, Swann J, Goldsman D, Song W. Simple procedures for selecting the best simulated system when the number of alternatives is large. Operations Research, 2001, 49(6): 950-963
106. Boesel J, Nelson B L, Kim S H. Using ranking and selection to "clean up" after simulation optimization. Operations Research, 2003, 51(5): 814-825
107. Kim S H, Nelson B L. 2006. Selecting the best system. Handbooks in Operations Research and Management Science: Simulation, Chapter 17 (Henderson S G, Nelson B L (editor)). Amsterdam: Elsevier. 501-534
108. Hsu J C. Constrained simultaneous confidence intervals for multiple comparisons with the best. The Annals of Statistics, 1984, 12(3): 1136-1144
109. Hsu J C. Sample size computation for designing multiple comparison experiments. Computational Statistics and Data Analysis, 1988, 7(1): 79-91
110. Dunnett C W. A multiple comparison procedure for comparing several treatments with a control. Journal of the American Statistical Association, 1955, 50(272): 1096-1121
111. Bofinger E, Lewis G J. Two-stage procedures for multiple comparisons with a control. American Journal of Mathematical and Management Sciences, 1992, 12: 253-275
112. Damerdji H, Nakayama M K. Two-stage multiple-comparison procedures for steady-state simulations. ACM Transactions on Modeling and Computer Simulation (TOMACS), 1999, 9(1): 1-30
113. Yang W N, Nelson B L. Optimization using common random numbers, control variates and multiple comparisons with the best. In: Proceedings of the 1989 Winter Simulation Conference. Washington, DC, USA: IEEE, 1989. 444-449
114. Yang W N, Nelson B L. Using common random numbers and control variates in multiple-comparison procedures. Operations Research, 1991, 39(4): 583-591
115. Goldsman L, Nelson B L. Batch-size effects on simulation optimization using multiple comparisons with the best. In: Proceedings of the 1990 Winter Simulation Conference. New Orleans, LA, 1990. 288-293
116. Yuan M, Nelson B L. Multiple comparisons with the best for steady-state simulation. ACM Transactions on Modeling and Computer Simulation (TOMACS), 1993, 3(1): 66-79
117. Nakayama M K. Selecting the best system in steady-state simulations using batch means. In: Proceedings of the 1995 Winter Simulation Conference. Piscataway, NJ: IEEE, 1995. 362-366
118. Nakayama M K. Multiple-comparison procedures for steady-state simulations. The Annals of Statistics, 1997, 25(6): 2433-2450
119. Matejcik F J, Nelson B L. Simultaneous ranking, selection and multiple comparisons for simulation. In: Proceedings of the 1993 Winter Simulation Conference. Piscataway, NJ: IEEE, 1993: 386-392
120. Goldsman D, Nelson B L. Ranking, selection and multiple comparisons in computer simulation. In: Proceedings of the 1994 Winter Simulation Conference. Lake Buena Vista, FL, USA: IEEE, 1994: 192-199
121. Matejcik F J, Nelson B L. Two-stage multiple comparisons with the best for computer simulation. Operations Research, 1995, 43(4): 633-640
122. Ho Y C, Sreenivas R S, Vakili P. Ordinal optimization of DEDS. Discrete Event Dynamic Systems, 1992, 2(1): 61-88
123. Ho Y C, Deng M. The problem of large search space in stochastic optimization. In: Proceedings of the 33rd IEEE Conference on Decision and Control. Lake Buena Vista, FL: IEEE, 1994. 1470-1475
124. Lee L H, Lau T W E, Ho Y C. Explanation of goal softening in ordinal optimization. IEEE Transactions on Automatic Control, 1999, 44(1): 94-99
125. Ho Y C. Overview of ordinal optimization. In: Proceedings of the 33rd IEEE Conference on Decision and Control. Lake Buena Vista, FL: IEEE, 1994. 1975-1977
126. Dai L. Convergence properties of ordinal comparison in the simulation of discrete event dynamic systems. Journal of Optimization Theory and Applications, 1996, 91(2): 363-388
127. Xie X. Dynamics and convergence rate of ordinal comparison of stochastic discrete-event systems. IEEE Transactions on Automatic Control, 1997, 42(4): 586-590
128. Dai L, Chen C H. Rates of convergence of ordinal comparison for dependent discrete event dynamic systems. Journal of Optimization Theory and Applications, 1997, 94(1): 29-54
129. Deng M, Ho Y C, Hu J Q. Effect of correlated estimation errors in ordinal optimization. In: Proceedings of the 1992 Winter Simulation Conference. Piscataway, NJ: IEEE, 1992: 466-474
130. Lau T W E, Ho Y C. Universal alignment probabilities and subset selection for ordinal optimization. Journal of Optimization Theory and Applications, 1997, 93(3): 455-489
131. Chen C H. A lower bound for the correct subset-selection probability and its application to discrete-event system simulations. IEEE Transactions on Automatic Control, 1996, 41(8): 1227-1231
132. Deng M, Ho Y C. Iterative ordinal optimization and its applications. In: Proceedings of the 36th IEEE Conference on Decision and Control. San Diego, CA: IEEE, 1997. 3562-3567
133. Chen H C, Chen C H, Yücesan E. Computing efforts allocation for ordinal optimization and discrete event simulation. IEEE Transactions on Automatic Control, 2000, 45(5): 960-964
134. Chen C H, Lin J, Yücesan E, Chick S E. Simulation budget allocation for further enhancing the efficiency of ordinal optimization. Discrete Event Dynamic Systems, 2000, 10(3): 251-270
135. Shi L, Chen C H. A new algorithm for stochastic discrete resource allocation optimization. Discrete Event Dynamic Systems, 2000, 10(3): 271-294
136. Ho Y C, Zhao Q C, Jia Q S. Ordinal Optimization: Soft Optimization for Hard Problems. New York: Springer, 2007
137. Chen H C, Dai L Y, Chen C H, Yücesan E. New development of optimal computing budget allocation for discrete event simulation. In: Proceedings of the 1997 Winter Simulation Conference. Washington, DC: IEEE, 1997. 334-341
138. Chen H C, Chen C H, Lin J, Yücesan E. An asymptotic allocation for simultaneous simulation experiments. In: Proceedings of the 1999 Winter Simulation Conference. Phoenix, AZ: IEEE, 1997. 359-366
139. Chen C H, Yücesan E. An alternative simulation budget allocation scheme for efficient simulation. International Journal of Simulation and Process Modelling, 2005, 1(1): 49-57
140. Branke J, Chick S E, Schmidt C. Selecting a selection procedure. Management Science, 2007, 53(12): 1916-1932
141. Fu M C, Hu J Q, Chen C H, Xiong X. Optimal computing budget allocation under correlated sampling. In: Proceedings of the 2004 Winter Simulation Conference. Washington, DC, USA: IEEE, 2004. 595-603
142. Fu M C, Hu J Q, Chen C H, Xiong X. Simulation allocation for determining the best design in the presence of correlated sampling. INFORMS Journal on Computing, 2007, 19(1): 101-111
143. Glynn P, Juneja S. A large deviations perspective on ordinal optimization. In: Proceedings of the 2004 Winter Simulation Conference. Washington, DC, USA: IEEE, 2004. 577-585
144. Chick S E, Wu Y Z. Selection procedures with frequentist expected opportunity cost bounds. Operations Research, 2005, 53(5): 867-878
145. He D H, Chick S E, Chen C H. Opportunity cost and OCBA selection procedures in ordinal optimization for a fixed number of alternative systems. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews, 2007, 37(5): 951-961
146. Trailovic L, Pao L Y. Computing budget allocation for efficient ranking and selection of variances with application to target tracking algorithms. IEEE Transactions on Automatic Control, 2004, 49(1): 58-67
147. Chen C H, He D, Fu M, Lee L H. Efficient simulation budget allocation for selecting an optimal subset. INFORMS Journal on Computing, 2008, 20(4): 579-595
148. Bartz-Beielstein T, Friese M, Zaefferer M, Naujoks B, Flasch O, Konen W, Koch P. Noisy optimization with sequential parameter optimization and optimal computational budget allocation. In: Proceedings of the 13th Annual Conference Companion on Genetic and Evolutionary Computation. New York, USA: ACM, 2011. 119-120
149. Chen C H, Lee L H. Stochastic Simulation Optimization: An Optimal Computing Budget Allocation. Singapore: World Scientific Publishing Company, 2011
150. Kirkpatrick S, Gelatt C D Jr, Vecchi M P. Optimization by simulated annealing. Science, 1983, 220(4598): 671-680
151. Alkhamis T M, Ahmed M A, Tuan V K. Simulated annealing for discrete optimization with estimation. European Journal of Operational Research, 1999, 116(3): 530-544
152. Alrefaei M H, Andradóttir S. A simulated annealing algorithm with constant temperature for discrete stochastic optimization. Management Science, 1999, 45(5): 748-764
153. Rosen S L, Harmonosky C M. An improved simulated annealing simulation optimization method for discrete parameter stochastic systems. Computers and Operations Research, 2005, 32(2): 343-358
154. Glover F. Tabu search-part I. INFORSA Journal on Computing, 1989, 1(3): 190-206
155. Glover F. Tabu search-part II. INFORSA Journal on Computing, 1990, 2(1): 4-32
156. Hu N F. Tabu search method with random moves for globally optimal design. International Journal for Numerical Methods in Engineering, 1992, 35(5): 1055-1070
157. Lopez-Garcia L, Posada-Bolivar A. A simulator that uses Tabu search to approach the optimal solution to stochastic inventory models. Computers and Industrial Engineering, 1999, 37(1): 215-218
158. Lutz C M, Roscoe Davis K, Sun M. Determining buffer location and size in production lines using Tabu search. European Journal of Operational Research, 1998, 106(2): 301-316
159. Martin A D, Chang T M, Yih Y, Kincaid R K. Using Tabu search to determine the number of kanbans and lotsizes in a generic kanban system. Annals of Operations Research, 1998, 78: 201-217
160. Dengiz B, Alabas C. Simulation optimization using Tabu search. In: Proceedings of the 2000 Winter Simulation Conference. Orlando, FL: IEEE, 2000. 805-810
161. Yang T, Kuo Y, Chang I. Tabu-search simulation optimization approach for flow-shop scheduling with multiple processors-a case study. International Journal of Production Research, 2004, 42(19): 4015-4030
162. Ryan J L, Bailey T G, Moore J T, Carltonet W B. Reactive tabu search in unmanned aerial reconnaissance simulations. In: Proceedings of the 1998 Winter Simulation Conference. Washington, DC: IEEE, 1998. 873-880
163. Goldberg D E. Genetic Algorithms in Search, Optimization, and Machine Learning. Boston: Addison-Wesley, 1989
164. Azadivar F, Tompkins G. Simulation optimization with qualitative variables and structural model changes: a genetic algorithm approach. European Journal of Operational Research, 1999, 113(1): 169-182
165. Azadivar F, Wang J. Facility layout optimization using simulation and genetic algorithms. International Journal of Production Research, 2000, 38(17): 4369-4383
166. Wang L. A hybrid genetic algorithm-neural network strategy for simulation optimization. Applied Mathematics and Computation, 2005, 170(2): 1329-1343
167. Pasandideh S H R, Niaki S T A. Multi-response simulation optimization using genetic algorithm within desirability function framework. Applied Mathematics and Computation, 2006, 175(1): 366-382
168. Daniel J, Rajendran C. A simulation-based genetic algorithm for inventory optimization in a serial supply chain. International Transactions in Operational Research, 2005, 12(1): 101-127
169. Glover F. Heuristics for integer programming using surrogate constraints. Decision Sciences, 1977, 8(1): 156-166
170. Glover F. A template for scatter search and path relinking. In: Proceedings of the 1998 Selected Papers from the Third European Conference on Artificial Evolution. Berlin Heidelberg: Springer, 1998. 3-54
171. Glover F, Laguna M, Martí R. Fundamentals of scatter search and path relinking. Control and Cybernetics, 2000, 39(3): 653-684
172. Laguna M, Marti R, Martí R C. Scatter Search: Methodology and Implementation in C. New York: Springer, 2003
173. Shi L, Ólafsson S. Nested Partitions Method, Theory and Applications. New York: Springer, 2009
174. Shi L, Ólafsson S, Sun N. New parallel randomized algorithms for the traveling salesman problem. Computers and Operations Research, 1999, 26(4): 371-394
175. Shi L, Ólafsson S. Nested partitions method for global optimization. Operations Research, 2000, 48(3): 390-407
176. Shi L Y, Ólafsson S. Convergence rate of the nested partitions method for stochastic optimization. Methodology and Computing in Applied Probability, 2000, 2(1): 37-58
177. Shi L Y, Ólafsson S. Nested partitions method for stochastic optimization. Methodology and Computing in Applied Probability, 2000, 2(3): 271-291
178. Shi L Y, Chen C H. A new algorithm for stochastic discrete resource allocation optimization. Discrete Event Dynamic Systems, 2000, 10(3): 271-294
179. Shi L Y, Ólafsson S, Chen Q. An optimization framework for product design. Management Science, 2001, 47(12): 1681-1692
180. Shi L Y, Meyer R R, Bozbay M, Andrew J. A nested partitions framework for solving large-scale multicommodity facility location problems. Journal of Systems Science and Systems Engineering, 2004, 13(2): 158-179
181. D'Souza W D, Zhang H H, Nazareth D P, Shi L Y, Meyer R R. A nested partitions framework for beam angle optimization in intensity-modulated radiation therapy. Physics in Medicine and Biology, 2008, 53(12): 3293-3307
182. Yau H, Shi L Y. Nested partitions for the large-scale extended job shop scheduling problem. Annals of Operations Research, 2009, 168(1): 23-39
183. Wu W, Wei J H, Guan X H, Shi L Y. A hybrid nested partitions algorithm for scheduling flexible resource in flow shop problem. International Journal of Production Research, 2012, 50(10): 2555-2569
184. Ólafsson S. 2006. Metaheuristics. Handbooks in Operations Research and Management Science: Simulation, Chapter 21 (Henderson S G, Nelson B L (editor)). Amsterdam: Elsevier, 2006. 633-654
185. Nelder J A, Mead R. A simplex method for function minimization. The Computer Journal, 1965, 7(4): 308-313
186. Azadivar F, Lee Y H. Optimization of discrete variable stochastic systems by computer simulation. Mathematics and Computers in Simulation, 1988, 30(4): 331-345
187. Barton R R, Ivey J S. Nelder-Mead simplex modifications for simulation optimization. Management Science, 1996, 42(7): 954-973
188. Hooke R, Jeeves T A. A direct search solution of numerical and statistical problems. Journal of the ACM (JACM), 1961, 8(2): 212-229
189. Chen M C, Tsai D M. Simulation optimization through direct search for multi-objective manufacturing systems. Production Planning and Control, 1996, 7(6): 554-565
190. Ho Y C, Shi L, Dai L, Gong W B. Optimizing discrete event dynamic systems via the gradient surface method. Discrete Event Dynamic Systems, 1992, 2(2): 99-120
191. Dorigo M, Stüzle T. Ant Colony Optimization. Cambridge, MA: MIT Press, 2004
192. Pasupathy R, Henderson S G. A testbed of simulation-optimization problems. In: Proceedings of the 2006 Winter Simulation Conference. Monterey, CA: IEEE, 2006. 255-263