Output data analysis for simulations

Winter Simulation Conference Proceedings

Volumn 1, Issue , 2002, Pages 85-96

  Alexopoulos, Christos ^a   Kim, Seong Hee ^a  

^a Georgia Institute of Technology   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA REDUCTION; PARAMETER ESTIMATION; SET THEORY; TIME SERIES ANALYSIS;

BATCH MEANS METHOD;

COMPUTER SIMULATION;

EID: 0036928207     PISSN: 02750708     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (80)

1. Alexopoulos, C., and D. Goldsman. 2002. To batch or not to batch? Technical Report, School of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, Georgia.
2. Alexopoulos, C., D. Goldsman, and G. Tokol. 2001. Properties of batched quadratic-form variance parameter estimators for simulations. INFORMS Journal on Computing 13:149-156.
3. Alexopoulos, C., and A. F. Seila. 1998. Output data analysis. In Handbook of Simulation, ed. J. Banks, Chapter 7. New York: John Wiley & Sons.
4. Alexopoulos, C., A. F. Seila, and G. S. Fishman. 1997. Computational experience with the batch means method. In Proceedings of the 1997 Winter Simulation Conference, 194-201. Institute of Electrical and Electronics Engineers, Piscataway, New Jersey.
5. Bechhofer, R. E., T. J. Santner, and D. Goldsman. 1995. Design and analysis of experiments for statistical selection, screening and multiple comparisons. New York: John Wiley & Sons.
6. Billingsley, P. 1968. Convergence of probability measures. New York: John Wiley & Sons.
7. Boesel, J., B. L. Nelson, and S.-H. Kim. 2002. Using ranking and selection to "clean up" after simulation optimization. To appear in Operations Research.
8. Bratley, P., B. L. Fox, and L. E. Schrage. 1987. A guide to simulation, 2d Ed. New York: Springer-Verlag.
9. Chance, F., and L. W. Schruben. 1992. Establishing a truncation point in simulation output. Technical Report, School of Operations Research and Industrial Engineering, Cornell University, Ithaca, New York.
10. Charnes, J. M. 1989. Statistical analysis of multivariate discrete-event simulation output. Ph.D. Thesis, Department of Operations and Management Science, University of Minnesota, Minneapolis, Minnesota.
11. Charnes, J. M. 1990. Power comparisons for the multivariate batch-means method. In Proceedings of the 1990 Winter Simulation Conference, 281-287. Piscataway, New Jersey: IEEE.
12. Charnes, J. M. 1991. Multivariate simulation output analysis. In Proceedings of the 1991 Winter Simulation Conference, 187-193. Piscataway, New Jersey: IEEE.
13. Chen, H.-C., C.-H. Chen, L. Dai, and E. Yücesan. 1997. New development of optimal computing budget allocation for discrete event simulation, In Proceedings of the 1997 Winter Simulation Conference, 334-341. Piscataway, New Jersey: IEEE.
14. Chen, R. D., and A. F. Seila. 1987. Multivariate inference in stationary simulation using batch means. In Proceedings of the 1987 Winter Simulation Conference, 302-304. Piscataway, New Jersey: IEEE.
15. Chick, S. E. 1997. Selecting the best system: A decision-theoretic approach. In Proceedings of the 1997 Winter Simulation Conference, 326-333. Piscataway, New Jersey: IEEE.
16. Chick, S. E., and K. Inoue. 2001a. New procedures for identifying the best simulated system using common random numbers. Management Science 47:1133-1149.
17. Chick, S. E., and K. Inoue. 2001b. New two-stage and sequential procedures for selecting the best simulated system. Operations Research 49:732-743.
18. Chien, C.-H. 1989. Small sample theory for steady state confidence intervals. Technical Report No. 37, Department of Operations Research, Stanford University, Palo Alto, California.
19. Chien, C.-H., D. Goldsman, and B. Melamed. 1997. Large-sample results for batch means. Management Science 43:1288-1295.
20. Chow, Y. S., and H. Robbins. 1965. On the asymptotic theory of fixed-width sequential confidence intervals for the mean. Annals of Mathematical Statistics 36:457-462.
21. Conway, R. W. 1963. Some tactical problems in digital simulation. Management Science 10:47-61.
22. Crane, M. A., and D. L. Iglehart. 1974a. Simulating stable stochastic systems, I: General multiserver queues. Journal of the ACM 21:103-113.
23. Crane, M. A., and D. L. Iglehart. 1974b. Simulating stable stochastic systems, II: Markov chains. Journal of the ACM 21:114-123.
24. Crane, M. A., and D. L. Iglehart. 1975. Simulating stable stochastic systems III: Regenerative processes and discrete-event simulations. Operations Research 23:33-45.
25. Damerdji, H. 1994. Strong consistency of the variance estimator in steady-state simulation output analysis. Mathematics of Operations Research 19:494-512.
26. Damerdji, H. and M. K. Nakayama. 1999. Two-stage multiple-comparison procedures for steady-state simulation. ACM TOMACS 9:1-30.
27. Fishman, G. S. 1973. Statistical analysis for queueing simulations. Management Science 20:363-369.
28. Fishman, G. S. 1974. Estimation of multiserver queueing simulations. Operations Research 22:72-78.
29. Fishman, G. S. 1996. Monte Carlo: Concepts, algorithms, and applications. New York: Springer Verlag.
30. Fishman, G. S. 2001. Discrete-event simulation. New York: Springer Verlag.
31. Fishman, G. S., and L. S. Yarberry. 1997. An implementation of the batch means method. INFORMS Journal on Computing 9:296-310.
32. Gafarian, A.V., C. J. Ancker, and F. Morisaku. 1978. Evaluation of commonly used rules for detecting steady-state in computer simulation. Naval Research Logistics Quarterly 25:511-529.
33. Glynn, P. W., and D. L. Iglehart. 1990. Simulation analysis using standardized time series. Mathematics of Operations Research 15:1-16.
34. Goldsman, D., S.-H. Kim, W. S. Marshall, and B. L. Nelson. 2000. Ranking and selection for steady-state simulation. In Proceedings of the 2000 Winter Simulation Conference, 544-553, Piscataway, New Jersey: IEEE.
35. Goldsman, D., S.-H. Kim, W. Marshall, and B. L. Nelson. 2001. Ranking and selection procedures for steady-state simulation: Perspectives and procedures. INFORMS Journals on Computing 14:2-19.
36. Goldsman, D., M. Meketon, and L. W. Schruben. 1990. Properties of standardized time series weighted area variance estimators. Management Science 36:602-612.
37. Goldsman, D., and B.L. Nelson. 1998. Comparing systems via simulation. In Handbook of Simulation, ed. J. Banks, Chapter 8. New York: John Wiley & Sons.
38. Goldsman, D., and L. W. Schruben. 1984. Asymptotic properties of some confidence interval estimators for simulation output. Management Science 30:1217-1225.
39. Goldsman, D., and L. W. Schruben. 1990. New confidence interval estimators using standardized time series. Management Science 36:393-397.
40. Goldsman, D., L. W. Schruben, and J. J. Swain. 1994. Tests for transient means in simulated time series. Naval Research Logistics 41:171-187.
41. Gupta, S. S. 1965. On some multiple decision (selection and ranking) rules. Technometrics 7:225-245.
42. Gupta, S. S., and D.-Y. Huang. 1976. Subset selection procedures for the means and variances of normal populations: Unequal sample sizes case, Sankhyā B, 38:112-128.
43. Heidelberger, P., and P. A. W. Lewis. 1984. Quantile estimation in dependent sequences. Operations Research 32:185-209.
44. Iglehart, D. L. 1975. Simulating stable stochastic systems, V: Comparison of ratio estimators. Naval Research Logistics Quarterly 22:553-565.
45. Iglehart, D. L. 1976. Simulating stable stochastic systems, VI: Quantile estimation. Journal of the ACM 23:347-360.
46. Iglehart, D. L. 1978. The regenerative method for simulation analysis. In Current Trends in Programming Methodology, Vol. III, eds. K. M. Chandy, and K. M. Yeh, 52-71. Prentice-Hall, Englewood Cliffs, New Jersey.
47. Inoue, K., S. E. Chick, and C.-H. Chen. 1999. An empirical evaluation of several methods to select the best system. ACM TOMACS 9:381-407.
48. Kelton, W. D. 1989. Random initialization methods in simulation. IIE Transactions 21:355-367.
49. Kim, S-H., and B. L. Nelson. 2001. A fully sequential procedure for indifference-zone selection in simulation. ACM TOMACS 11:251-273.
50. Law, A. M., and J. S. Carson. 1979. A sequential procedure for determining the length of a steady-state simulation. Operations Research 27:1011-1025.
51. Law, A. M., and W. D. Kelton. 2000. Simulation modeling and analysis, 3d Ed. McGraw-Hill, New York.
52. Malkovich, J. F., and A. A. Afifi. 1973. On tests for multivariate normality. Journal of the American Statistical Association 68:176-179.
53. Mechanic, H., and W. McKay. 1966. Confidence intervals for averages of dependent data in simulations II. Technical Report ASDD 17-202, IBM Corporation, Yorktown Heights, New York.
54. Meketon, M. S., and B. W. Schmeiser. 1984. Overlapping batch means: Something for nothing? In Proceedings of the 1984 Winter Simulation Conference, 227-230. Piscataway, New Jersey: IEEE.
55. Moore, L. W. 1980. Quantile estimation in regenerative processes. Ph.D. Thesis, Curriculum in Operations Research and Systems Analysis, University of North Carolina, Chapel Hill, North Carolina.
56. Nakayama, M. K. 1995. Selecting the best system in steady-state simulations using batch means. In Proceedings of the 1995 Winter Simulation Conference, 362-366. Piscataway, New Jersey: IEEE.
57. Nelson, B. L., and F. J. Matejcik. 1995. Using common random numbers for indifference-zone selection and multiple comparisons in simulation. Management Science 41:1935-1945
58. Nelson, B. L., J. Swann, D. Goldsman, and W.-M. T. Song. 2001. Simple procedures for selecting the best system when the number of alternatives is large. Operations Research 49:950-963.
59. Ockerman, D. H. 1995. Initialization bias tests for stationary stochastic processes based upon standardized time series techniques. Ph.D. Thesis, School of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, Georgia.
60. Rinott, Y. 1978. On two-stage selection procedures and related probability-inequalities. Communications in Statistics - Theory and Methods A 7:799-811.
61. Sargent, R. G., K. Kang, and D. Goldsman. 1992. An investigation of finite-sample behavior of confidence interval estimators. Operations Research 40:898-913.
62. Schmeiser, B. W. 1982. Batch size effects in the analysis of simulation output. Operations Research 30:556-568.
63. Schriber, T. J., and R. W. Andrews. 1979. Interactive analysis of simulation output by the method of batch means. In Proceedings of the 1979 Winter Simulation Conference, 513-525. Piscataway, New Jersey: IEEE.
64. Schruben, L. W. 1982. Detecting initialization bias in simulation output. Operations Research 30:569-590.
65. Schruben, L. W. 1983. Confidence interval estimation using standardized time series. Operations Research 31:1090-1108.
66. Schruben, L. W., H. Singh, and L. Tierney. 1983. Optimal tests for initialization bias in simulation output. Operations Research 31:1167-1178.
67. Seila, A. F. 1982a. A batching approach to quantile estimation in regenerative simulations. Management Science 28:573-581.
68. Seila, A. F. 1982b. Percentile estimation in discrete event simulation. Simulation 39:193-200.
69. Song, W.-M. T., and B. W. Schmeiser. 1993. Optimal mean-squared-error batch sizes. Management Science 41:110-123.
70. Steiger, N. M., and J. R. Wilson. 2001. Convergence properties of the batch-means method for simulation output analysis. INFORMS Journal on Computing 13(4):277-293.
71. Steiger, N. M., and J. R. Wilson. 2002a. An improved batch means procedure for simulation output analysis. Technical Report, Department of Industrial Engineering, North Carolina State University, Raleigh, North Carolina.
72. Steiger, N. M., E. K. Lada, J. R. Wilson, C. Alexopoulos, D. Goldsman, F. Zouaoui. 2002b. ASAP2: An improved batch means procedure for simulation output analysis. In Proceedings of the 2002 Winter Simulation Conference, this volume. Piscataway, New Jersey: IEEE.
73. von Neumann, J. 1941a. Distribution of the ratio of the mean square successive difference and the variance. Annals of Mathematical Statistics 12:367-395.
74. von Neumann, J. 1941b. The mean square difference. Annals of Mathematical Statistics 12:153-162.
75. Welch, P. D. 1983. The statistical analysis of simulation results. In The Computer Performance Modeling Handbook, ed. S. Lavenberg, 268-328. New York: Academic Press.
76. Welch, P. D. 1987. On the relationship between batch means, overlapping batch means and spectral estimation, In Proceedings of the 1987 Winter Simulation Conference, 320-323. Piscataway, New Jersey: IEEE.
77. Wilcox, R. R. 1984. A table for Rinott's selection procedure. Journal of Quality Technology 16:97-100.
78. Wilson, J. R., and A. A. B. Pritsker. 1978a. A survey of research on the simulation startup problem. Simulation 31:55-58.
79. Wilson, J. R., and A. A. B. Pritsker. 1978b. Evaluation of startup policies in simulation experiments. Simulation 31:79-89.
80. Yarberry, L. S. 1993. Incorporating a dynamic batch size selection mechanism in a fixed-sample-size batch means procedure. Ph.D. dissertation, Department of Operations Research, University of North Carolina, Chapel Hill, North Carolina.