Stochastic simulation optimization: An optimal computing budget allocation

Stochastic Simulation Optimization: An Optimal Computing Budget Allocation

Volumn 1, Issue , 2010, Pages 1-227

  Chen, Chun Hung ^a,b   Lee, Loo Hay ^c  

^a GEORGE MASON UNIVERSITY   (United States)

^b NATIONAL TAIWAN UNIVERSITY   (Taiwan)

^c NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85080610007     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1142/7437     Document Type: Book

References (103)

1. Banks, J., Carson II, J. S., Nelson, B. L. and Nicol, D. M. [2004] Discrete-Event System Simulation, 4th edn. (Prentice Hall).
2. Banks, J., Carson II, J. S., Nelson, B. L. and Nicol, D. M. [2010] Discrete Event- System Simulation, 5th edn. (Prentice Hall).
3. Barton, R. R. and Meckesheimer, M. [2006] "Metamodel-based simulation optimization," in Handbooks in Operations Research and Management Science: Simulation, eds. Henderson, S. G. and Nelson, B. L. (Elsevier) Chapter 18, pp. 535-574.
4. Bechhofer, R. E., Santner, T. J. and Goldsman, D. M. [1995] Design and Analysis of Experiments for Statistical Selection, Screening, and Multiple Comparisons (John Wiley & Sons).
5. Berger, P. D. and Maurer, R. E. [2002] Experimental Design with Applications in Management, Engineering, and the Sciences (Duxbury).
6. Bernardo, J. M. and Smith, A. F. M. [1994] Bayesian Theory (Wiley, New York).
7. Blanchet, J., Liu, J. and Zwart, B. [2007] "Large deviations perspective on ordinal optimization of heavy-tailed systems," Proc. 2007 Winter Simulation Conf., pp. 489-494.
8. Branke, J., Chick, S. E. and Schmidt, C. [2007] "Selecting a selection procedure," Manag. Sci. 53, 1916-1932.
9. Brantley, M. W., Lee, L. H., Chen, C. H. and Chen, A. [2008] "Optimal sampling in design of experiment for simulation-based stochastic optimization," Proc. 2008 IEEE Conf. on Automation Science and Engineering, Washington, DC, pp. 388-393.
10. Bratley, P., Fox, B. L. and Schrage, L. E. [1987] A Guide to Simulation, 2nd ed. (Springer-Verlag).
11. Butler, J., Morrice, D. J. and Mullarkey, P.W. [2001] "A multiple attribute utility theory approach to ranking and selection," Manag. Sci. 47(6), 800-816.
12. Chen, C. H. [1995] "An effective approach to smartly allocate computing budget for discrete event simulation," Proc. of the 34th IEEE Conf. on Decision and Control, pp. 2598-2605.
13. Chen, C. H. [1996] "A lower bound for the correct subset-selection probability and its application to discrete event system simulations," IEEE Trans. Automat. Contr. 41, 1227-1231.
14. Chen, H. C., Chen, C. H., Dai, L. and Yücesan, E. [1997] "New development of optimal computing budget allocation for discrete event simulation," Proc. 1997 Winter Simulation Conf., pp. 334-341.
15. Chen, C. H., Chen, H. C., Yücesan, E. and Dai, L. [1998] "Computing budget allocation for simulation experiments with different system structures," Proc. 1998 Winter Simulation Conf., pp. 735-741.
16. Chen, C. H., Fu, M. and Shi, L. [2008] "Simulation and Optimization," in Tutorials in Operations Research (Informs, Hanover, MD), pp. 247-260.
17. Chen, C. H. and He, D. [2005] "Intelligent simulation for alternatives comparison and application to air traffic management," J. Syst. Sci. Syst. Eng. 14(1), 37-51.
18. Chen, C. H., He, D. and Fu, M. [2006] "Efficient dynamic simulation allocation in ordinal optimization," IEEE Trans. Automat. Contr. 51(12), 2005-2009.
19. Chen, C. H., He, D., Fu, M. and Lee, L. H. [2008] "Efficient simulation budget allocation for selecting an optimal subset," Info. J. Comput. 20(4), 579-595.
20. Chen, C. H., Kumar, V. and Luo, Y. C. [1999] "Motion planning of walking robots in environments with uncertainty," J. Robot. Syst. 16(10), 527-545.
21. Chen, C. H., Lin, J., Yücesan, E. and Chick, S. E. [2000] "Simulation budget allocation for further enhancing the efficiency of ordinal optimization," J. Discrete Event Dynam. Syst. Theor. Appl. 10, 251-270.
22. Chen, C. H., Wu, S. D. and Dai, L. [1999] "Ordinal comparison of heuristic algorithms using stochastic optimization," IEEE Trans. Robot. Automat. 15(1), 44-56.
23. Chen, C. H. and Yücesan, E. [2005] "An alternative simulation budget allocation scheme for efficient simulation," Int. J. Simulat. Process Model. 1(1/2), 49-57.
24. Chen, C. H., Yücesan, E., Dai, L. and Chen, H. C. [2010] "Efficient computation of optimal budget allocation for discrete event simulation experiment," IIE Trans. 42(1), 60-70.
25. Chen, E. J. and Kelton, W. D. [2003] "Inferences from indifference-zone selection procedures," Proc. 2003 Winter Simulation Conf., pp. 456-464.
26. Cheng, R. C. H. [1982] "Antithetic variate methods for simulation of processes with peaks and troughs," Eur. J. Oper. Res. 33, 229-237.
27. Cheng, R. C. H. [1984] "The use of antithetic variates in computer simulations," J. Oper. Res. Soc. 15, 227-236.
28. Chew, E. P., Lee, L. H., Teng, S. Y. and Koh, C. H. [2009] "Differentiated service inventory optimization using nested partitions and MOCBA," Comput. Oper. Res. 36(5), 1703-1710.
29. Chick, S. E. [1997] "Selecting the best system: A decision-theoretic approach," Proc. 1997 Winter Simulation Conf., pp. 326-333.
30. Chick, S. E. [2003] "Expected opportunity cost guarantees and indifference-zone selection procedures," Proc. 2003 Winter Simulation Conf., pp. 465-473.
31. Chick, S. E., Branke, J. and Schmidt, C. [2007] "New greedy myopic and existing asymptotic sequential selection procedures: Preliminary empirical results," Proc. 2007 Winter Simulation Conf., pp. 289-296.
32. Chick, S. and Inoue, K. [2001a] "New two-stage and sequential procedures for selecting the best simulated system," Oper. Res. 49, 1609-1624.
33. Chick, S. and Inoue, K. [2001b] "New procedures to select the best simulated system using common random numbers," Manag. Sci. 47, 1133-1149.
34. Chick, S. E. and Gans, N. [2006] "Simulation selection problems: Overview of an economic analysis," Proc. 2006 Winter Simulation Conf., pp. 279-286.
35. Dai, L. and Chen, C. H. [1997] "Rate of convergence for ordinal comparison of dependent simulations in discrete event dynamic systems," J. Optim. Theor. Appl. 94(1), 29-54.
36. Dai, L., Chen, C. H. and Birge, J. R. [2000] "Large convergence properties of two-stage stochastic programming," J. Optim. Theor. Appl. 106(3), 489-510.
37. DeGroot, M. H. [1970] Optimal Statistical Decisions (McGraw-Hill, New York).
38. Dudewicz, E. J. and Dalal, S. R. [1975] "Allocation of observations in ranking and selection with unequal variances," Sankhya B37, 28-78.
39. Frazier, P. and Powell, W. B. [2008] "The knowledge-gradient stopping rule for ranking and selection," Proc. 2008 Winter Simulation Conf., pp. 305-312.
40. Fu,M. [2002] "Optimization for simulation: Theory vs. practice," Info. J. Comput. 14(3), 192-215.
41. Fu, M. C. [2006] "Gradient estimation," in Handbooks in Operations Research and Management Science: Simulation, eds. Henderson, S. G. and Nelson, B. L. (Elsevier), Chapter 19, pp. 575-616.
42. Fu, M. C. [2007] "Are we there yet? the marriage between simulation & optimization," OR/MS Today, pp. 16-17.
43. Fu, M. C., Hu, J. Q., Chen, C. H. and Xiong, X. [2007] "Simulation allocation for determining the best design in the presence of correlated sampling," Info. J. Comput. 19(1), 101-111.
44. Fu, M. C., Hu, J. and Marcus, S. I. [2006] "Model-based randomized methods for global optimization," Proc. 17th Int. Symp. on Mathematical Theory of Networks and Systems, 355-363.
45. Fu, M, Chen, C. H. and Shi, L. [2008] "Some topics for simulation optimization," Proc. 2008 Winter Simulation Conf., Miami, FL, pp. 27-38.
46. Fu, M. C. and Hu, J. Q. [1997] Conditional Monte Carlo: Gradient Estimation and Optimization Applications (Kluwer Academic Publishers).
47. Fonseca, C. M. and Fleming, P. J. [1995] "An overview of evolutionary algorithms in multiobjective optimization," Evol. Comput. 3(1), 1-16.
48. Garvels, M. J. J., Kroese, D. P. and Van Ommeren, J.-K. C. W. [2002] "On the importance function in splitting simulation," Eur. Trans. Telecommunications 13(4), 363-371.
49. Glasserman, P. [1991] Gradient Estimation via Perturbation Analysis (Kluwer Academic, Boston, Massachusetts).
50. Glasserman, P., Heidelberger, P., Shahabuddin, P. and Zajic, T. [1999] "Multilevel splitting for estimating rare event probabilities," Oper. Res. 47(4), 585-600.
51. Glynn, P. W. [1994] "Efficiency improvement technique," Annals of Operations Research.
52. Glynn, P. and Juneja, S. [2004] "A large deviations perspective on ordinal optimization," Proc. 2004 Winter Simulation Conf., pp. 577-585.
53. Goldberg, D. E. [1989] Genetic Algorithms in Search, Optimization, and Machine Learning (Addison-Wesley).
54. Goldsman, D. and Nelson, B. L. [1998] "Statistical screening, selection, and multiple comparisons in computer simulation," Proc. Winter Simulation Conf., pp. 159-166.
55. Gupta, S. S. [1965] "On some multiple decision (selection and ranking) rules," Technometrics 7, 225-245.
56. Hanne, T. and Nickel, S. [2005] "A multiobjective evolutionary algorithm for scheduling and inspection planning in software development projects," Eur. J. Oper. Res. 167, 663-678.
57. He, D., Chick, S. E. and Chen, C. H. [2007] "The opportunity cost and OCBA selection procedures in ordinal optimization," IEEE Trans. on Systems, Man, and Cybernetics - Part C 37(5), 951-961.
58. He, D., Lee, L. H., Chen, C. H., Fu, M. and Wasserkrug, S. [2010] "Simulation optimization using the cross-entropy method with optimal computing budget allocation," ACM Trans. on Modeling and Computer Simulation 20(1), 1-22.
59. Heidelberger, P. [1993] "Fast simulation of rare events in queueing and reliability models," in Performance Evaluation of Computer and Communication Systems, eds. Donatiello, L. and Nelson, R. (Springer Verlag), pp. 165-202.
60. Ho, Y. C. and Cao, X. R. [1991] Perturbation Analysis and Discrete Event Dynamic Systems (Kluwer Academic).
61. Ho, Y. C., Cassandras, C. G., Chen, C. H. and Dai, L. [2000] "Ordinal optimization and simulation," J. Oper. Res. Soc. 51(4), 490-500.
62. Ho, Y. C., Sreenivas, R. S. and Vakili, P. [1992] "Ordinal optimization of DEDS," J. Discrete Event Dynam. Syst. 2(2), 61-88.
63. Ho, Y. C., Zhao, Q. C. and Jia, Q. S. [2007] Ordinal Optimization: Soft Optimization for Hard Problems (Springer).
64. Holland, J. H. [1975] Adaptation in Natural and Artificial Systems (The University of Michigan Press).
65. Homem-de-Mello, T., Shapiro, A. and Spearman, M. L. [1999] "Finding optimal material release times using simulation-based optimization," Manag. Sci. 45, 86-102.
66. Hsieh, B. W., Chen, C. H. and Chang, S. C. [2001] "Scheduling semiconductor wafer fabrication by using ordinal optimization-based simulation," IEEE Trans. on Robot. Automat. 17(5), 599-608.
67. Inoue, K. and Chick, S. E. [1998] "Comparison of Bayesian and Frequentist assessments of uncertainty for selecting the best system," Proc. 1998 Winter Simulation Conf., pp. 727-734.
68. Inoue, K., Chick, S. E. and Chen, C. H. [1999] "An empirical evaluation of several methods to select the best system," ACM Trans. on Model. Comput. Simulat. 9(4), 381-407.
69. Kim, S. H. and Nelson, B. L. [2003] "Selecting the best system: Theory and methods," Proc. 2003 Winter Simulation Conf., pp. 101-112.
70. Kim, S.-H. and Nelson, B. L. [2006] "Selecting the best system," in Handbooks in Operations Research and Management Science: Simulation, eds. Henderson, S. G. and Nelson, B. L. (Elsevier), Chapter 18.
71. Kim, S. H. and Nelson, B. L. [2007] "Recent advances in ranking and selection," Proc. 2007 Winter Simulation Conf., pp. 162-172.
72. Law, A. M. and Kelton, W. D. [2000] Simulation Modeling and Analysis, 3rd ed. (MacGraw-Hill).
73. Lee, L. H., Chew, E. P., Teng, S. Y. and Goldsman, D. [2004] "Optimal computing budget allocation for multi-objective simulation models," Proc. 2004 Winter Simulation Conf., pp. 586-594.
74. Lee, L. H., Chew, E. P. and Teng, S. Y. [2007] "Finding the Pareto set for multiobjective simulation models by minimization of expected opportunity cost," Proc. 2007 Winter Simulation Conf., pp. 513-521.
75. Lee, L. H., Chew, E. P., Teng, S. Y. and Chen, Y. K. [2008] "Multi-objective simulation-based evolutionary algorithm for an aircraft spare parts allocation problem", Eur. J. Oper. Res., 189(2), 476-491.
76. Lee, L. H., Chew, E. P., Teng, S. Y. and Goldsman, D. [2010] "Finding the Pareto set for multi-objective simulation models," IIE Tran., in press.
77. Lehman, E. L. [1996] "Same concepts of dependence," Ann. Math. Stat. 37(5), 1137-1153.
78. Kleijnen, J. P. C. [2008] Design and Analysis of Simulation Experiments (Springer, New York).
79. Koenig, L. W. and Law, A. M. [1985] "A procedure for selecting a subset of size m containing the l best of k independent normal populations," Communication in Statistics - Simulation and Communication 14, 719-734.
80. Kushner, H. J. and Yin, G. G. [2003] Stochastic Approximation Algorithms and Applications, 2nd ed. (Springer-Verlag).
81. L'Ecuyer, P. [1994] "Efficiency improvement and variance reduction," Proc. 26th Conf. on Winter Simulation, pp. 122-132.
82. L'Ecuyer, P., Demers, V. and Tuffin, B. [2006] "Splitting for rare-event simulation," Proc. 2006 Winter Simulation Conf., pp. 137-148.
83. Luo, Y. C., Guignard-Spielberg, M. and Chen, C. H. [2001] "A hybrid approach for integer programming combining genetic algorithms, linear programming and ordinal optimization," J. Intell. Manuf. 12(5-6), 509-519.
84. Matejcik, F. J. and Nelson, B. L. [1995] "Two-stage multiple comparisons with the best for computer simulation," Oper. Res. 43, 633-640.
85. Nelson, B. L. [1990] "Control-variates remedies," Oper. Res. 38.
86. Nelson, B. L., Swann, J., Goldsman, D. and Song, W. M. [2001] "Simple procedures for selecting the best simulated system when the number of alternatives is large," Oper. Res. 49, 950-963.
87. Pflug, G. C. [1996] Optimization of Stochastic Models (Kluwer Academic).
88. Pritsker, A. [1986] Introduction to simulation and SLAM II (John Wiley and Sons, New York).
89. Pujowidianto, N. A., Lee, L. H., Chen, C. H. and Yep, C. M. [2009] "Optimal computing budget allocation for constrained optimization," Proc. 2009 Winter Simulation Conf., Austin, TX.
90. Rinott, Y. [1978] "On two-stage selection procedures and related probability inequalities," Communications in Statistics 7, 799-811.
91. Rubinstein, R. Y. and Shapiro, A. [1993] Discrete Event Systems: Sensitivity Analysis and Stochastic Optimization by the Score Function Method (John Wiley & Sons).
92. Sanchez, S. M. [2005] "Work smarter, not harder: Guidelines for designing simulation experiments," Proc. 2005 Winter Simulation Conf., pp. 178-187.
93. Shortle, J. and Chen, C. H. [2008] "A preliminary study of optimal splitting for rare-event simulation," Proc. 2008 Winter Simulation Conf., Miami, FL, pp. 266-272.
94. Shi, L. and Chen, C. H. [2000] "A new algorithm for stochastic discrete resource allocation optimization," J. Discrete Event Dynam. Syst. Theor. Appl. 10, 271-294.
95. Shi, L. and Olafsson, S. [2000] "Nested partitions method for global optimization," Oper. Res. 48, 390-407.
96. Shi, L. and Olafsson, S. [2008] Nested Partitions Optimization: Methodology and Applications (Springer, New York).
97. Spall, J. C. [1992] "Multivariate stochastic approximation using simultaneous perturbation gradient approximation," IEEE Trans. on Automat. Contr. 37, 332-341.
98. Sullivan, D. W. and Wilson, J. R. [1989] "Restricted subset selection procedures for simulation," Oper. Res. 37, 52-71.
99. Swisher, J. R., Jacobson, S. H. and Yücesan, E. [2003] "Discrete-event simulation optimization using ranking, selection, and multiple comparison procedures: A survey," ACM Trans. Model. Comput. Simulat. 13(2), 134-154.
100. Trailovic, L. and Pao, L. Y. [2004] "Computing budget allocation for efficient ranking and selection of variances with application to target tracking algorithms," IEEE Trans. Automat. Contr. 49, 58-67.
101. Wan, H., Ankenman, B. and Nelson, B. L. [2003] "Controlled sequential bifurcation: a new factor-screening method for discrete-event simulation," Proc. 2003 Winter Simulation Conf., pp. 565-573.
102. Wilson, J. R. [1993] "Antithetic sampling with multivariate inputs," Am. J. Math. Manag. Sci. 3, 121-144.
103. Zhao, Q. C., Ho, Y. C. and Jia, Q. S. [2005] "Vector ordinal optimization," J. Optim. Theor. Appl. 125(2), 259-274.