Efficient simulation budget allocation for selecting an optimal subset

INFORMS Journal on Computing

Volumn 20, Issue 4, 2008, Pages 579-595

  Chen, Chun Hung ^a   He, Donghai ^a   Fu, Michael ^b   Lee, Loo Hay ^c  

^a Krasnow Institute for Advanced Study   (United States)

^b UNIVERSITY OF MARYLAND   (United States)

^c NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Computing budget allocation; Ranking nd; Selection; Simulation optimization

Indexed keywords

EID: 61349118110     PISSN: 10919856     EISSN: 15265528     Source Type: Journal    
DOI: 10.1287/ijoc.1080.0268     Document Type: Article

References (34)

1. Andradóttir, S., D. Goldsman, B. W. Schmeiser, L. W. Schruben, E. Yücesan. 2005. Analysis methodology: Are we done? Proc. 2005 Winter Simulation Conf., Association for Computing Machinery, New York, 790-796.
2. Baluja, S. 1994. Population-based incremental learning: A method for integrating genetic search based function optimization and competitive learning. Technical Report CMU-CS-94-163, School of Computer Science, Carnegie Mellon University, Pittsburgh.
3. Bechhofer, R. E., T. J, Santner, D. M. Goldsman. 1995. Design and Analysis of Experiments for Statistical Selection, Screening, and Multiple Comparisons. John Wiley & Sons, New York.
4. Branke, J., S. E. Chick, C. Schmidt. 2007. Selecting a selection procedure. Management Sci. 53 1916-1932.
5. Chambers, L. 1995. Practical Handbook of Genetic Algorithms. CRC Press, Boca Raton, FL.
6. Chen, C. H. 1996. A lower bound for the correct subset-selection probability and its application to discrete event system simulations. IEEE Trans. Automatic Control 41 1227-1231.
7. Chen, C. H., D. He, M. Fu. 2006. Efficient dynamic simulation allocation in ordinal optimization. IEEE Trans. Automatic Control 51 2005-2009.
8. Chen, C. H., J. Lin, E. Yücesan, S. E. Chick. 2000. Simulation budget allocation for further enhancing the efficiency of ordinal optimization. J. Discrete Event Dynam. Systems: Theory Appl. 10 251-270.
9. Chen, H. C, C. H. Chen, L. Dai, E. Yücesan. 1997. New development of optimal computing budget allocation for discrete event simulation. Proc. 1997 Winter Simulation Conf, Association for Computing Machinery, New York, 334-341.
10. Chick, S., K. Inoue. 2001a. New two-stage and sequential procedures for selecting the best simulated system. Oper. Res. 49 1609-1624.
11. Chick, S., K. Inoue. 2001b. New procedures to select the best simulated system using common random numbers. Management Sci. 47 1133-1149.
12. DeGroot, M. H. 1970. Optimal Statistical Decisions. McGraw-Hill, New York.
13. Dudewicz, E. J., S. R. Dalal. 1975. Allocation of observations in ranking and selection with unequal variances. Sankhya 37 28-78.
14. Fu, M. C, J. Hu, S. I. Marcus. 2006. Model-based randomized methods for global optimization. Proc. 17th Internat. Sympos. Math. Theory Networks Systems, Kyoto, Japan, 355-363.
15. Fu, M. C, J. Q. Hu, C. H. Chen, X. Xiong. 2007. Simulation allocation for determining the best design in the presence of correlated sampling. INFORMS J, Comput. 19 101-111.
16. Goldsman, D., B. L. Nelson. 1998. Comparing systems via simulation. J, Banks, ed. Handbook of Simulation: Principles, Methodology, Advances, Applications, and Practice. John Wiley & Sons, New York, 273-306.
17. Gupta, S. S. 1965. On some multiple decision (selection and ranking) rules. Technometrics 7 225-245.
18. He, D., S. E. Chick, C. H. Chen. 2007. Opportunity cost and OCBA selection procedures in ordinal optimization for a fixed number of alternative systems. IEEE Trans. Systems, Man, Cybernetics- Part C 37 951-961.
19. Holland, J. H. 1975. Adaptation in Natural and Artificial Systems. The University of Michigan Press, Ann Arbor.
20. Hu, J., M. C. Fu, S. I. Marcus. 2007a. A model reference adaptive search algorithm for global optimization. Oper. Res. 55 549-568.
21. Hu, J., M. C. Fu, S. I. Marcus. 2007b. A model reference adaptive search algorithm for stochastic optimization with applications to Markov decision processes. Proc. 46th IEEE Conf. Decision Control IEEE Press, Washington, D.C., 975-980.
22. Inoue, K., S. E. Chick. 1998. Comparison of Bayesian and frequentist assessments of uncertainty for selecting the best system. Proc. 1998 Winter Simulation Conf., Institute of Electrical and Electronic Engineers, Piscataway, NJ, 727-734.
23. Inoue, K., S. E. Chick, C. H. Chen. 1999. An empirical evaluation of several methods to select the best system. ACM Transitions Model. Comput. Simulation 9 381-407.
24. Kim, S.-H, B. L. Nelson. 2006. Selecting the best system. S. G. Henderson, B. L. Nelson, eds. Handbooks in Operations Research and Management Science: Simulation, Chapter 18. Elsevier, New York.
25. Koenig, L. W, A. M. Law. 1985. A procedure for selecting a subset of size m containing the l best of k independent normal populations. Comm. Statist.-Simulation Comm. 14 719-734.
26. Law, A. M., W. D. Kelton. 2000. Simulation Modeling Analysis. McGraw-Hill, New York.
27. Lee, L. H, E. P. Chew, S. Y. Teng, D. Goldsman. 2004. Optimal computing budget allocation for multi-objective simulation models. Proc. 2004 Winter Simulation Conf, Association for Computing Machinery, New York, 586-594.
28. Rinott, Y. 1978. On two-stage selection procedures and related probability inequalities. Comm. Statist. 7 799-811.
29. Rubinstein, R. Y, D. P. Kroese. 2004. The Cross-Entropy Method: A Unified Approach to Combinatorial Optimization, Monte-Carlo Simulation, and Machine Learning. Springer, New York.
30. Rudlof, S., M. Köppen. 1996. Stochastic hill climbing with learning by vectors of normal distributions. Proc. First Online Workshop on Soft Comput., Nagoya University, Nagoya, Japan, 60-70.
31. Sullivan, D. W, J. R. Wilson. 1989. Restricted subset selection procedures for simulation. Oper. Res. 37 52-71.
32. Swisher, J. R., S. H. Jacobson, E. Yücesan. 2003. Discrete-event simulation optimization using ranking, selection, and multiple comparison procedures: A survey. ACM Trans. Model. Comput. Simulation 13 134-154.
33. Trailovic, L., L. Y. Pao. 2004. Computing budget allocation for efficient ranking and selection of variances with application to target tracking algorithms. IEEE Trans. Automatic Control 49 58-67.
34. Walker, R. C. 1999. Introduction to Mathematical Programming. Prentice Hall, Upper Saddle River, NJ.