Fast Simulation of Rare Events in Queueing and Reliability Models

ACM Transactions on Modeling and Computer Simulation (TOMACS)

Volumn 5, Issue 1, 1995, Pages 43-85

  Heidelberger, Philip ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

importance sampling; queueing models; rare event; reliability models; variance reduction

Indexed keywords

EID: 84976842451     PISSN: 10493301     EISSN: 15581195     Source Type: Journal    
DOI: 10.1145/203091.203094     Document Type: Article

References (119)

1. AL-QAQ, W. A, DEVETSIKIOTIS, M, AND TOWNSEND, J. K. 1993. Importance sampling methodologies for simulation of communication systems with adaptive equalizers and time-varying channels. IEEE J. Selected Areas Commun 11, 317-327.
2. ANANTHARAM, V. 1988. How large delays build up in a GI/G/1 queue. Queueing Syst. 5, 345-368.
3. ANANTHARAM, V, HEIDELBERGER, P., AND TSOUCAS, P. 1990. Analysis of rare events in continuous time Markov chains via time reversal and fluid approximation. Rep. RC 16280, IBM, Yorktown Heights, New York.
4. ARSHAM, H., FUERVERGER, A., MCLEISH, D. L., KREIMER, J., AND RUBINSTEIN, R. Y. 1989. Sensitivity analysis and the “what if' problem in simulation analysis. Math. Comput. Model. 12, 193-219
5. ASMUSSEN, S. 1993. Busy period analysis, rare events and transient behaviour in fluid models. To appear in J. Appl. Math. Stochastic Anal.
6. ASMUSSEN, S. 1990. Exponential families and regression in the Monte Carlo study of queues and random walks. Ann. Statist. 18, 1851-1867.
7. ASMUSSEN, S. 1989. Risk theory in a Markovian environment. Scand. Actuarial J., 69-100
8. ASMUSSEN, S. 1987. Applied Probability and Queues. Wiley, New York
9. ASMUSSEN, S. 1985. Conjugate processes and the simulation of ruin problems. Stochastic Process Appl. 20, 213-229.
10. ASMUSSEN, S 1982. Conditioned limit theorems relating a random walk to its associate. Adv. Appl. Probab. 14, 143-170.
11. ASMUSSEN, S., AND RUBINSTEIN, R. Y. 1994. Complexity properties of steady-state rare events simulation in queueing models. Preprint.
12. ASMUSSEN, S., AND RUBINSTEIN, R. Y. 1992. The efficiency and heavy traffic properties of the score function method in sensitivity analysis of queueing models. Adv. Appl. Probab. 24, 172-201.
13. ASMUSSEN, S., RUBINSTEIN, R. Y., AND WANG, C. L. 1992. Efficient regenerative rare events simulation via the likelihood ratio method. Preprint.
14. BARLOW, R. E., AND PROSCHAN, F. 1981. Statistical Theory of Reliability and Life Testing. Holt, Reinhart and Winston, New York.
15. BREIMAN, L. 1968. Probability. Addison-Wesley, Reading, Mass.
16. BROWN, M. 1990. Error bounds for exponential approximations of geometric convolutions. A. Probab. 18, 1388-1402.
17. BUCKLEW, J. 1990. Large Deviation Techniques in Decision, Simulation and Estimation. Wiley, New York.
18. BUCKLEW, J. A., NEY, P., AND SADOWSKY, J. S. 1990. Monte Carlo simulation and large deviations theory for uniformly recurrent Markov chains. J. Appl. Probab. 27, 44-99.
19. CARRASCO, J. A. 1991a. Failure distance-based simulation of repairable fault-tolerant systems. In Proceedings of the 5th International Conference on Modeling Techniques and Tools for Computer Performance Evaluation, 337-351.
20. CARRASCO, J. A. 1991b. Efficient transient simulation of failure/repair Markovian models. In Proceedings of the 10th Symposium on Reliable and Distributed Computing. (Pisa, Italy) IEEE Computer Society Press, 152-161.
21. CHANG, C. S. 1994. Stability, queue length and delay of deterministic and stochastic queueing networks. IEEE Trans. Autom. Control 39, 913-931.
22. CHANG, C. S. 1992. Stability, queue length and delay, Part II: Stochastic queueing networks. In Proceedings of the IEEE CDC'92 Conference. (Tucson, Ariz.). IEEE Computer Society Press, 1005-1010.
23. CHANG, C. S., HEIDELBERGER, P., JUNEJA, S., AND SHAHABUDDIN, P. 1994. Effective bandwidth and fast simulation of ATM intree networks. Perform. Eval. 20, 45-65.
24. CHANG, C. S., HEIDELBERGER, P., JUNEJA, S., AND SHAHABUDDIN, P. 1993. The application of effective bandwidth to fast simulation of communication networks. Rep. RC 18877, IBM, Yorktown Heights, New York.
25. CHANG, C. S., HEIDELBERGER, P., AND SHAHABUDDIN, P. 1993. Fast simulation of packet loss rates in a shared buffer communications switch. Rep. RC 19250, IBM, Yorktown Heights, New York.
26. CHEN, H., AND MANDELBAUM, A. 1991. Discrete flow networks: bottleneck analysis and fluid approximations. Math. Oper. Res. 16, 408-446.
27. ÇINLAR, E. 1975. Introduction to Stochastic Processes. Prentice Hall, Englewood Cliffs, NJ.
28. COGBURN, R. 1975. A uniform theory for sums of Markov chain transition probabilities. Ann. Probab. 3, 191-214.
29. COTTRELL, M., FORT, J. C., AND MALGOUYRES, G. 1983. Large deviations and rare events in the study of stochastic algorithms. IEEE Trans. Autom. Control. AC-28, 907-920.
30. CRANE, M. A., AND IGLEHART, D. L. 1975. Simulating stable stochastic systems III: regenerative processes and discrete event simulation. Oper. Res. 23, 33-45.
31. CSISZÁR, I., COVER, T. M., AND CHOI, B.-S. 1987. Conditional limit theorems under Markov conditioning. IEEE Trans. Inf. Theor. 33, 788-801.
32. DEVETSIKIOTIS, M., AL-QAQ, W. A., FREEBERSYSER, J. A., AND TOWNSEND, J. K. 1993. Stochastic gradient techniques for the efficient simulation of high-speed networks using importance sampling. In Proceedings of IEEE Globecom '93. IEEE Computer Society Press, 751-756.
33. DEVETSIKIOTIS, M., AND TOWNSEND, K. R. 1993. Statistical optimization of dynamic importance sampling parameters for efficient simulation of communication networks. IEEE/ACM Transactions on Networking 1, 3, 293-305.
34. DEVETSIKIOTIS, M., AND TOWNSEND, J. K. 1992a. On the efficient simulation of large communication networks using importance sampling. In Proceedings of IEEE Globecom '92. IEEE Computer Society Press, 1455-1459.
35. DEVETSIKIOTIS, M. AND TOWNSEND, J. K. 1992b A dynamic importance sampling methodology for the efficient estimation of rare event probabilities in regenerative simulations of queueing systems. In Proceedings of the IEEE ICC '92 Conference. IEEE Computer Society Press, 1290-1297.
36. DE VECIANA, G., COURCOUBETIS, C., AND WALRAND, J. 1994. Decoupling bandwidths for networks: A decomposition approach to resource management for networks In IEEE Infocom Proceedings '94, 466-473
37. DUPUIS, P. AND ELLIS, R. S. 1993. The large deviation principle for a general class of queueing systems, I. Rep. LCDS 93-10, Division of Applied Mathematics, Brown University, Providence, R.I.
38. DUPUIS, P, ISHII, H., AND SONER, H. M. 1990. A viscosity solution approach to the asymptotic analysis of queueing systems. Ann. Probab. 18, 226-255
39. ELLIS, R. S. 1984. Large deviations for a general class of random vectors Ann. Probab. 12, 1-12
40. FELLER, W. 1971. An Introduction to Probability Theory and its Applications, vol. 2. J. Wiley, New York
41. FRATER, M. R. 1993. Fast simulation of buffer overflows in equally loaded networks. Australian Telecommun. Res 27, 1, 13-18
42. FRATER, M. R., AND ANDERSON, B. D. O. 1994. Fast simulation of buffer overflows in tandem networks of GI/GI/1 queues. Ann. Oper Res. 49, 207-220.
43. FRATER, M. R., AND ANDERSON, B. D. O. 1989. Fast estimation of the statistics of excessive backlogs in tandem networks of queues. Australian Telecommun Res. 23, 49-55.
44. FRATER, M. R., BITMEAD, R. R, KENNEDY, R. A, AND ANDERSON, B. D. O. 1989. Rare events and reverse time models. In Proceedings of the 28th Conference on Decision and Control. IEEE Press, 1180-1183.
45. FRATER, M R., LENON, T M., AND ANDERSON, B D. O. 1991. Optimally efficient estimation of the statistics of rare events in queueing networks. IEEE Trans Autom. Control 36, 1395-1405.
46. FRATER, M. R., WALRAND, J., AND ANDERSON, B. D. O. 1990. Optimally efficient simulation of buffer overflows in queues with deterministic service times via importance sampling Australian Telecommun. Res. 24, 1-8.
47. FRESNEDO, R. D. 1989 Quick simulation of rare events in networks In 1989 Winter Simulation Conference Proceedings IEEE Press, 514-523
48. GÄRTNER, J. 1977. On large deviations from invariant measure Theory Probab. Appl. 22, 24-39.
49. GEIST, R. M. AND SMOTHERMAN, M. K. 1989. Ultrahigh reliability estimates through simulation In Proceedings of the Annual Reliability and Maintainability Symposium. IEEE Press, 350-355.
50. GERTSBAKH, I. B. 1984. Asymptotic methods in reliability theory: A review. Adv. Appl Probab. 16, 147-175.
51. GIBBENS, R. J., AND HUNT, P. J. 1991. Effective bandwidths for the multi-type UAS channel. Queueing Syst. 9, 17-28.
52. GLASSERMAN, P. 1993 Stochastic monotonicity and conditional Monte Carlo for likelihood ratios. Adv. Appl Probab. 25, 103-115.
53. GLASSERMAN, P. AND KOU, S. G. 1993. Overflow probabilities in Jackson networks. In Proceedings of the 32nd Conference on Decision and Control. IEEE Press, 3178-3182.
54. GLASSERMAN, P. AND KOU, S. G. 1995. Analysis of an importance sampling estimator for tandem queues. Preprint.
55. GLYNN, P. W. 1992. Importance sampling for Markov chains: asymptotics for the variance. Tech. Rep., Department of Operations Research, Stanford University. To appear in Stochastic Models
56. GLYNN, P. W. 1989. A GSMP formalism for discrete event systems. In Proc. IEEE 77, 14-23.
57. GLYNN, P. W., AND HEIDELBERGER, P. 1992. Experiments with initial transient deletion for parallel, replicated steady-state simulations. Manage. Sci. 38, 400-418.
58. GLYNN, P. W., HEIDELBERGER, P., NICOLA, V. F., AND SHAHABUDDIN, P. 1993. Efficient estimation of the mean time between failures in non-regenerative dependability models. In 1993 Winter Simulation Conference Proceedings. IEEE Computer Society Press, 311-316.
59. GLYNN, P. W., AND IGLEHART, D. L. 1989. Importance sampling for stochastic simulations. Manage. Sci. 35, 1367-1392.
60. GLYNN, P. W., AND WHITT, W. 1992. The asymptotic efficiency of simulation estimators. Oper. Res. 40, 505-520.
61. GOYAL, A., CARTER, W. C., DE SOUZA E SILVA, E., LAVENBERG, S. S., AND TRIVEDI, K. S. 1986. The system availability estimator. In Proceedings of the Sixteenth International Symposium on Fault-Tolerant Computing. IEEE Computer Society Press, 84-89.
62. GOYAL, A., AND LAVENBERG, S. S. 1987. Modeling and analysis of computer system availability. IBM J. Res. Dev. 31, 6, 651-664.
63. GOYAL, A., HEIDELBERGER, P., AND SHAHABUDDIN, P. 1987. Measure specific dynamic importance sampling for availability simulations. In 1987 Winter Simulation Conference Proceedings. IEEE Computer Society Press, 351-357.
64. GOYAL, A., SHAHABUDDIN, P., HEIDELBERGER, P., NICOLA, V. F., AND GLYNN, P. W. 1992. A unified framework for simulating Markovian models of highly reliable systems. IEEE Trans. Comput. C-41, 36-51.
65. GUERIN, R., AHMADI, H., AND NAGHSHINEH, M. 1991. Equivalent capacity and its application to bandwidth allocation in high-speed networks. IEEE J. Select. Areas Commun 9, 968-981.
66. HALTON, J. H. 1970. A retrospective and prospective survey of the Monte Carlo method. SIAM Rev. 12, 1-60.
67. HAMMERSLEY, J. M., AND HANDSCOMB, D. C. 1964. Monte Carlo Methods. Methuen, London.
68. HEIDELBERGER, P. 1988. Discrete event simulations and parallel processing: statistical properties. SIAM J. Sci. Stat. Comput. 9, 1114-1132.
69. HEIDELBERGER, P., NICOLA, V. F., AND SHAHABUDDIN, P. 1992. Simultaneous and efficient simulation of highly dependable systems with different underlying distributions. In Proceedings of the 1992 Winter Simulation Conference. IEEE Computer Society Press, 458-465.
70. HEIDELBERGER, P., SHAHABUDDIN, P., AND NICOLA, V. F. 1994. Bounded relative error in estimating transient measures of highly dependable non-Markovian systems. ACM Trans. Model. Comput. Simul. 4, 2, 137-164.
71. HEIDELBERG, P. AND SIMHA, R. 1995. Fast simulation of a voice-data multiplexer. In Proceedings of the IEEE INFOCOM '95 Conference, 361-368.
72. HEIDELBERGER, P., AND TSOUCAS, P. 1991. Reverse time simulation of rare events. IBM Tech. Disclosures Bull. 34, 3, 163-165.
73. HUI, J. Y. 1988. Resource allocation for broadband networks. IEEE J. Selected Areas Commun. 6, 9, 1598-1608.
74. IGLEHART, D. L. 1972. Extreme values in the GI/G/1 queue. Ann. Math. Statist. 43, 627-635.
75. JENSEN, A. 1953. Markov chains as an aid in the study of Markov processes. Skand. Aktuarietidskr, 36, 87-91.
76. JUNEJA, S. 1993. Efficient Rare Event Simulation of Stochastic Systems. Ph.D. Thesis, Department of Operations Research, Stanford University, Palo Alto, California.
77. JUNEJA, S., AND SHAHABUDDIN, P. 1992. Fast simulation of Markovian reliability/availability models with general repair policies. In Proceedings of the 22nd International Symposium on Fault-Tolerant Computing. IEEE Computer Society Press, 150-159.
78. KALOS, M. H., AND WHITLOCK, P. A. 1986. Monte Carlo Methods, Vol. I: Basics. Wiley, New York.
79. KEILSON, J. 1979. Markov Chain Models-Rarity and Exponentiality. Springer Verlag, New York.
80. KELLY, F. P. 1991. Effective bandwidths at multi-class queues. Queueing Syst. 9, 5-16.
81. KELLY, F. P. 1979. Reversibility and Stochastic Networks. Wiley, New York.
82. KESIDIS, G., AND WALRAND, J. 1993. Quick simulation at ATM buffers with on-off multiclass Markov fluid sources. ACM Trans. Model. Comput. Simul. 3, 269-276.
83. KOVALENKO, I. N. 1994. Rare events in queueing systems-a survey. Queueing Syst. 16, 1-49.
84. LEHTONEN, T., AND NYRHINEN, H. 1992a. Simulating level-crossing probabilities by importance sampling. Adv. Appl Probab 24, 858-874.
85. LEHTONEN, T., AND NYRHINEN, H 1992b. On asymptotically efficient simulation of ruin probabilities in a Markovian environment Scand. Actuarial J 60-75
86. LEWIS, E. E. AND BOHM, F 1984 Monte Carlo simulation of Markov unreliability models. Nuclear Eng. Des. 77, 49-62.
87. LEWIS, P. A. W., AND SHEDLER, G. S. 1979. Simulation of nonhomogeneous Poisson processes by thinning. Naval Res. Logistics Q. 26, 403-413
88. NAKAYAMA, M. K. 1991. Simulation of Highly Reliable Markoman and Non-Markovian Systems Ph.D. Thesis, Department of Operations Research, Stanford University, Palo Alto, California.
89. NAKAYAMA, M K 1994 A characterization of the simple failure biasing method for simulations of highly reliable Markovian systems. ACM Trans. Model. Comput. Simul. 4, 1, 52-88.
90. NAKAYAMA, M. K. 1993 General conditions for bounded relative error in simulations of highly reliable Markovian systems. Rep. RC 18993. IBM, Yorktown Heights, New York.
91. NAKAYAMA, M. K. 1991. Asymptotics for likelihood ratio derivative estimators in simulations of highly reliable Markovian systems. Rep. RC 17357, IBM, Yorktown Heights, New York.
92. NAKAYAMA, M K., GOYAL., A., AND GLYNN, P. W. 1994. Likelihood ratio sensitivity analysis for Markovian models of highly dependable systems. Oper. Res. 42, 1, 137-157.
93. NICOL, D M., AND PALUMBO, D. L. 1995. Reliability analysis of complex models using SURE bounds. Tech. Rep. 93-14, ICASE NASA Langley Research Center. IEEE Trans. Reliab. 44, 1, 46-53.
94. NICOLA, V. F., HEIDELBERGER, P., AND SHAHABUDDIN, P. 1992. Umformization and exponential transformation: techniques for fast simulation of highly dependable non-Markovian systems. In Proceedings of the 22nd International Symposium on Fault-Tolerant Computing. IEEE Computer Society Press, 130-139.
95. NICOLA, V. F., NAKAYAMA, M K, HEIDELBERGER, P., AND GOYAL, A 1991 Fast simulation of highly dependable systems with general failure and repair processes. IEEE Trans. Comput. 42, 8, 1440-1452.
96. NICOLA, V. F., NAKAYAMA, M K, HEIDELBERGER, P., AND GOYAL, A 1990. Fast simulation of dependability models with general failure, repair and maintenance processes. In Proceedings of the 20th International Symposium on Fault-Tolerant Computing. IEEE Computer Society Press, 491-498.
97. NICOLA, V. F., SHAHABUDDIN, P, AND HEIDELBERGER, P. 1993 Techniques for fast simulation of highly dependable systems. In Proceedings of the 2nd International Workshop on Performability Modelling of Computer and Communication Systems.
98. NICOLA, V. F., SHAHABUDDIN, P., HEIDELBERGER, P., AND GLYNN, P. W. 1993. Fast simulation of steady-state availability in non-Markovian highly dependable systems. In Proceedings of the 23rd International Symposium on Fault-Tolerant Computing IEEE Computer Society Press, 38-47.
99. OBAL II, W. D., AND SANDERS, W. H. 1994. Importance sampling simulation in UltraSAN. Simulation 62, 2, 98-111.
100. PAREKH, S., AND WALRAND, J. 1989. A quick simulation method for excessive backlogs in networks of queues. IEEE Trans Autom. Control 34, 54-56.
101. RUBINSTEIN, R. Y 1991. How to optimize discrete-event systems from a single sample path by the score function method. Ann. Oper Res 27, 175-212
102. SADOWSKY, J. S. 1993. On the optimality and stability of exponential twisting in Monte Carlo estimation. IEEE Trans Inf. Theor. 39, 119-128.
103. SADOWSKY, J. S 1991. Large deviations and efficient simulation of excessive backlogs in a GI/G/m queue IEEE Trans. Autom. Control 36, 1383-1394.
104. SADOWSKY, J. S., AND BUCKLEW, J A. 1990. On large deviations theory and asymptotically efficient Monte Carlo estimation. IEEE Trans Inf. Theor 36, 579-588.
105. SHAHABUDDIN, P. 1994a. Importance sampling for the simulation of highly reliable Markovian systems. Manage. Sci. 40, 333-352
106. SHAHABUDDIN, P. 1994b. Fast transient simulation of Markovian models of highly dependable systems Perform. Eval. 20, 267-286.
107. SHAHABUDDIN, P. 1994c. Fast simulation of packet loss rates in communication networks with priorities. In 1994 Winter Simulation Conference Proceedings, IEEE Press, 274-281.
108. SHAHABUDDIN, P. 1990. Simulation and Analysis of Highly Reliable Systems. Ph.D. Thesis, Department of Operations Research, Stanford University, Palo Alto, California.
109. SHAHABUDDIN, P., AND NAKAYAMA, M. K. 1993. Estimation of reliability and its derivatives for large time horizons in Markovian systems. In 1993 Winter Simulation Conference Proceedings. IEEE Press, 422-429.
110. SHAHABUDDIN, P., NICOLA, V. F., HEIDELBERGER, P., GOYAL, A., AND GLYNN, P. W. 1988. Variance reduction in mean time to failure simulations. In 1988 Winter Simulation Conference Proceedings. IEEE Press, 491-499.
111. SHANTHIKUMAR, J. G. 1986. Uniformization and hybrid simulation/analytic models of renewal processes. Oper. Res. 34, 573-580.
112. SHWARTZ, A., AND WEISS, A. 1993. Induced rare events: analysis via time reversal and large deviations. Adv. Appl. Probab. 25, 667-689.
113. SIEGMUND, D. 1976. Importance sampling in the Monte Carlo study of sequential tests. Ann. Statistics 4, 673-684.
114. SMITH, W. L. 1955. Regenerative stochastic processes. Proc. Roy. Soc. Ser. A. 232: 6-31.
115. STRICKLAND, S. G. 1993. Optimal importance sampling for quick simulation of highly reliable Markovian systems. In 1993 Winter Simulation Conference Proceedings, IEEE Press, 437-444.
116. TSOUCAS, P. 1992. Rare events in series of queues. J. Appl. Probab. 29, 168-175.
117. WEISS, A. 1986. A new technique for analyzing large traffic systems. Adv. Appl. Probab. 18, 506-532.
118. WHITT, W. 1993. Tail probability with statistical multiplexing and effective bandwidths in multi-class queues. Telecommun. Syst. 2, 71-107.
119. WHITT, W. 1980. Continuity of generalized semi-Markov processes. Math. Oper. Res. 5, 494-501.