Chapter 11 Rare-Event Simulation Techniques: An Introduction and Recent Advances

Handbooks in Operations Research and Management Science

Volumn 13, Issue C, 2006, Pages 291-350

  Juneja, S ^a   Shahabuddin, P ^b  

^a TATA INSTITUTE OF FUNDAMENTAL RESEARCH   (India)

^b Och Spine at New York Presbyterian Hospitals   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 77950483923     PISSN: 09270507     EISSN: None     Source Type: Book Series    
DOI: 10.1016/S0927-0507(06)13011-X     Document Type: Review

References (111)

1. Ahamed, T.P.I., Borkar, V.S., Juneja, S. (2006). Adaptive importance sampling technique for Markov chains using stochastic approximation. Operations Research, in press
2. Anantharam, V., Heidelberger, P., Tsoucas, P. (1990). Analysis of rare events in continuous time Markov chains via time reversal and fluid approximation. Report RC 16280, IBM, Yorktown Heights, NY
3. Anderson T. An Introduction to Multivariate Statistical Analysis. 2nd edition (1984), Wiley, New York
4. Andradottir S., Heyman D.P., and Ott T. On the choice of alternative measures in importance sampling with Markov chains. Operations Research 43 3 (1995) 509-519
5. Asmussen S. Conjugate processes and the simulation of ruin problems. Stochastic Process and Applications 20 (1985) 213-229
6. Asmussen S. Risk theory in a Markovian environment. Scandinavian Actuarial Journal 1989 (1989) 69-100
7. Asmussen S. Ruin Probabilities (2000), World Scientific, London
8. Asmussen S. Applied Probability and Queues. 2nd edition (2003), Springer-Verlag, New York
9. Asmussen S., and Binswanger K. Simulation of ruin probabilities for subexponential claims. ASTIN Bulletin 27 2 (1997) 297-318
10. Asmussen, S., Kroese, D. (2004). Improved algorithms for rare-event simulation with heavy tails. Research report, Department of Mathematical Sciences, Aarhus University, Denmark
11. Asmussen S., and Rubinstein R.Y. Steady state rare-event simulation in queueing models and its complexity properties. In: Dshalalow J.H. (Ed). Advances in Queueing: Theory, Methods and Open Problems (1995), CRC Press, New York 429-462
12. Asmussen S., Binswanger K., and Hojgaard B. Rare-event simulation for heavy-tailed distributions. Bernoulli 6 2 (2000) 303-322
13. Asmussen S., Kroese D., and Rubinstein R. Heavy tails, importance sampling and cross entropy. Stochastic Models 21 1 (2005) 57-76
14. Avram F., Dai J., and Hasenbein J. Explicit solutions for variational problems in the quadrant. Queueing Systems 37 (2001) 261-291
15. Bahadur R., and Rao R.R. On deviations of the sample mean. The Annals of Mathematical Statistics 31 (1960) 1015-1027
16. Bassamboo A., Juneja S., and Zeevi A. Expected shortfall in credit porfolios with extremal dependence. In: Kuhl M.E., Steiger N.M., Armstrong F.B., and Joines J.A. (Eds). Proceedings of the 2005 Winter Simulation Conference (2005), IEEE Press, Piscataway, NJ 1850-1858
17. Bassamboo, A., Juneja, S., Zeevi, A. (2005b). On the efficiency loss of state-dependent importance sampling in the presence of heavy tails. Operations Research Letters, in press
18. Bassamboo, A., Juneja, S., Zeevi, A. (2005c). Portfolio credit risk with extremal dependence. Preprint
19. Beck B., Dabrowski A., and McDonald D. A unified approach to fast teller queues and ATM. Advances in Applied Probability 31 (1999) 758-787
20. Bertsekas D., and Tsitsiklis J. Neuro-Dynamic Programming (1996), Athena Scientific, Athena, MA
21. Blanchet, J., Glynn, P. (2005). Efficient simulation for the maximum of a random walk with heavy-tailed increments. Presentation at the 13th INFORMS Applied Probability Conference, July 6-8, 2005, Ottawa, Canada
22. Bolia N., Glasserman P., and Juneja S. Function-approximation-based importance sampling for pricing American options. In: Ingalls R.G., Rossetti M.D., Smith J.S., and Peters B.A. (Eds). Proceedings of the 2004 Winter Simulation Conference (2004), IEEE Press, Piscataway, NJ 604-611
23. Booth T. Exponential convergence for Monte Carlo particle transport. Transactions of the American Nuclear Society 50 (1985) 267-268
24. Boots N., and Shahabuddin P. Simulating GI / GI / 1 queues and insurance processes with subexponential distributions. In: Joines J.A., Barton R.R., Kang K., and Fishwick P.A. (Eds). Proceedings of the 2000 Winter Simulation Conference (2000), IEEE Press, Piscataway, NJ 656-665 Latest version: Research report, IEOR Department, Columbia University, New York
25. Boots N., and Shahabuddin P. Simulating ruin probabilities in insurance risk processes with sub-exponential claims. In: Peters B.A., Smith J.S., Medeiros D.J., and Rohrer M.W. (Eds). Proceedings of the 2001 Winter Simulation Conference (2001), IEEE Press, Piscataway, NJ 468-476
26. Borkar V. Q-learning for risk-sensitive control. Mathematics of Operations Research 27 (2002) 294-311
27. Borkar V.S., and Meyn S.P. Risk-sensitive optimal control for Markov decision processes with monotone cost. Mathematics of Operations Research 27 (2002) 192-209
28. Borkar V.S., Juneja S., and Kherani A.A. Performance analysis conditioned on rare events: An adaptive simulation scheme. Communications in Information 3 4 (2004) 259-278
29. Bucklew J.S. Large Deviations Techniques in Decision, Simulation and Estimation (1990), Wiley, New York
30. Chang C.S., Heidelberger P., Juneja S., and Shahabuddin P. Effective bandwidth and fast simulation of ATM in tree networks. Performance Evaluation 20 (1994) 45-65
31. Chistyakov V.P. A theorem on sums of independent positive random variables and its applications to branching random processes. Theory of Probabability and Applications 9 (1964) 640-648
32. Collamore J.F. Hitting probabilities and large deviations. The Annals of Probability 24 4 (1996) 2065-2078
33. Collamore J.F. Importance sampling techniques for the multidimensional ruin problem for general Markov additive sequences of random vectors. The Annals of Applied Probability 12 1 (2002) 382-421
34. De Boer, P. (2001). Analysis and efficient simulation of queueing models of telecommunication systems. PhD thesis, University of Twente
35. De Boer P., Nicola V., and Rubinstein R. Adaptive importance sampling simulation of queueing networks. In: Joines J.A., Barton R.R., Kang K., and Fishwick P.A. (Eds). Proceedings of the 2000 Winter Simulation Conference (2000), IEEE Press, Piscataway, NJ 646-655
36. De Boer P.T., Kroese D.P., Mannor S., and Rubinstein R. A tutorial on the cross-entropy method. Annals of Operations Research 134 1 (2005) 19-67
37. Dembo A., and Zeitouni O. Large Deviations Techniques and Applications (1998), Springer-Verlag, New York, NY
38. Desai P., and Glynn P. A Markov chain perspective on adaptive Monte Carlo algorithms. In: Peters B.A., Smith J.S., Medeiros D.J., and Rohrer M.W. (Eds). Proceedings of the 2001 Winter Simulation Conference (2001), IEEE Press, Piscataway, NJ 379-384
39. Dupuis, P., Wang, H. (2004). Importance sampling, large deviations, and differential games. Preprint
40. Embrechts P., Kluppelberg C., and Mikosch T. Modelling Extremal Events for Insurance and Finance (1997), Springer-Verlag, Berlin, Heidelberg
41. Fang K.T., Kotz S., and Ng K. Symmetric Multivariate and Related Distributions (1987), Chapman and Hall, London
42. Fishman G. Discrete-Event Simulation: Modeling, Programming, and Analysis (2001), Springer-Verlag, Berlin
43. Frater M. Fast simulation of buffer overflows in equally loaded networks. Australian Telecommun. Res. 27 1 (1993) 13-18
44. Frater M., Lennon T., and Anderson B. Optimally efficient estimation of the statistics of rare events in queueing networks. IEEE Transactions on Automatic Control 36 (1991) 1395-1405
45. Glasserman P. Monte Carlo Methods in Financial Engineering (2004), Springer-Verlag, New York
46. Glasserman P., and Kou S. Analysis of an importance sampling estimator for tandem queues. ACM TOMACS 5 (1995) 22-42
47. Glasserman P., and Li J. Importance sampling for portfolio credit risk. Management Science 50 11 (2005) 1643-1656
48. Glasserman P., and Wang Y. Counterexamples in importance sampling for large deviations probabilities. The Annals of Applied Probability 7 (1997) 731-746
49. Glasserman P., Heidelberger P., and Shahabuddin P. Asymptotically optimal importance sampling and stratification for pricing path-dependent options. Mathematical Finance 9 (1999) 117-152
50. Glasserman P., Heidelberger P., and Shahabuddin P. Variance reduction techniques for estimating value-at-risk. Management Science 46 (2000) 1349-1364
51. Glasserman P., Heidelberger P., and Shahabuddin P. Portfolio value-at-risk with heavy-tailed risk factors. Mathematical Finance 9 (2002) 117-152
52. Glasserman, P., Kang, W., Shahabuddin, P. (2005). Fast simulation of multifactor portfolio credit risk. Working paper, IEOR Department, Columbia University
53. Glynn P., and Iglehart D. Importance sampling for stochastic simulations. Management Science 35 (1989) 1367-1392
54. Glynn P., and Whitt W. The asymptotic efficiency of simulation estimators. Operations Research 40 (1992) 505-520
55. Goyal A., and Lavenberg S. Modeling and analysis of computer system availability. IBM Journal of Research and Development 31 6 (1987) 651-664
56. Goyal A., Shahabuddin P., Heidelberger P., Nicola V., and Glynn P. A unified framework for simulating Markovian models of highly reliable systems. IEEE Transactions on Computers C-41 (1992) 36-51
57. Grassberger P. Go with the winners: A general Monte Carlo strategy. Computer Physics Communications 147 1/2 (2002) 64-70
58. Grassberger P., and Nadler W. "Go with the winners" - Simulations. In: Hoffman K.H., and Schreiber M. (Eds). Computational Statistical Physics: From Billards to Monte Carlo (2000), Springer-Verlag, Heidelberg 169-190
59. Gupta, G., Finger, C., Bhatia, M. (1997). Credit metrics technical document. Technical report, J.P. Morgan and Co., New York
60. Heidelberger P. Fast simulation of rare events in queueing and reliability models. ACM TOMACS 5 1 (1995) 43-85
61. Heyde C., and Kou S. On the controversy over tailweight of distributions. Operations Research Letters 32 (2004) 399-408
62. Huang Z., and Shahabuddin P. Rare-event, heavy-tailed simulations using hazard function transformations with applications to value-at-risk. In: Chick S., Sanchez P.J., Ferrin D., and Morrice D. (Eds). Proceedings of the 2003 Winter Simulation Conference (2003), IEEE Press, Piscataway, NJ 276-284 Latest version: Working paper, IEOR Department, Columbia University
63. Huang Z., and Shahabuddin P. A unified approach for finite dimensional, rare-event Monte Carlo simulation. In: Ignalls R.G., Rossetti M.D., Smith J.S., and Peters B.A. (Eds). Proceedings of the 2004 Winter Simulation Conference (2004), IEEE Press, Piscataway, NJ 1616-1624
64. Ignatiouk-Robert I. Large deviations of Jackson networks. The Annals of Applied Probability 10 3 (2000) 962-1001
65. Ignatyuk I., Malyshev V., and Scherbakov V. Boundary effects in large deviations problems. Russian Mathematical Surveys 49 2 (1994) 41-99
66. Juneja S. Importance sampling and the cyclic approach. Operations Research 46 4 (2001) 900-912
67. Juneja S. Efficient rare-event simulation using importance sampling: An introduction. In: Misra J.C. (Ed). Computational Mathematics, Modelling and Algorithms (2003), Narosa Publishing House, New Delhi 357-396
68. Juneja S., and Nicola V. Efficient simulation of buffer overflow probabilities in Jackson networks with feedback. ACM TOMACS 15 4 (2005) 281-315
69. Juneja S., and Shahabuddin P. Efficient simulation of Markov chains with small transition probabilities. Management Science 47 4 (2001) 547-562
70. Juneja S., and Shahabuddin P. Simulating heavy-tailed processes using delayed hazard rate twisting. ACM TOMACS 12 (2002) 94-118
71. Juneja S., Shahabuddin P., and Chandra A. Simulating heavy-tailed processes using delayed hazard-rate twisting. In: Farrington P.A., Nembhard H.B., Sturrock D.T., and Evans G.W. (Eds). Proceedings of the 1999 Winter Simulation Conference (1999), IEEE Press, Piscataway, NJ 420-427
72. Juneja, S., Karandikar, R., Shahabuddin, P. (2005). Tail asymptotics and fast simulation of delay probabilities in stochastic PERT networks. ACM TOMACS, undergoing review
73. Kang W., and Shahabuddin P. Fast simulation for multifactor portfolio credit risk in the t-copula model. In: Kuhl M.E., Steiger N.M., Armstrong F.B., and Joines J.A. (Eds). Proceedings of the 2005 Winter Simulation Conference (2005), IEEE Press, Piscataway, NJ 1859-1868
74. Kollman C., Baggerly K., Cox D., and Picard R. Adaptive importance sampling on discrete Markov chains. The Annals of Applied Probability 9 (1999) 391-412
75. Kontoyiannis I., and Meyn S. Spectral theory and limit theorems for geometrically ergodic Markov processes. The Annals of Applied Probability 13 (2003) 304-362
76. Kotz S., Kozubowski T., and Podgorski K. The Laplace Distribution and Generalizations: A Revisit with Applications to Communications, Economics, Engineering, and Finance (2001), Birkhäuser, Boston
77. Kroese D., and Nicola V. Efficient estimation of overflow probabilities in queues with breakdowns. Performance Evaluation 36/37 (1999) 471-484
78. Kroese D., and Nicola V. Efficient simulation of a tandem Jackson network. ACM TOMACS 12 (2002) 119-141
79. Kroese D., and Rubinstein R. The transform likelihood ratio method for rare-event simulation with heavy tails. Queueing Systems 46 (2004) 317-351
80. Kushner H., and Yin G. Stochastic Approximation Algorithms and Applications (1997), Springer-Verlag, New York
81. L'Ecuyer P., and Champoux Y. Estimating small cell-loss ratios in atm switches via importance sampling. ACM TOMACS 11 1 (2001) 76-105
82. Lehtonen T., and Nyrhinen H. Simulating level-crossing probabilities by importance sampling. Advances in Applied Probability 24 (1992) 858-874
83. Lehtonen T., and Nyrhinen H. On asymptotically efficient simulation of ruin probabilities in a Markovian environment. Scandinavian Actuarial Journal 1992 (1992) 60-75
84. Luenberger D. Linear and Non-Linear Programming. 2nd edition (1984), Addison-Wesley, Reading, MA
85. Merino S., and Nyefeler M. Applying importance sampling for estimating coherent credit risk contributions. Quantitative Finance 4 (2004) 199-207
86. Merton R. On the pricing of corporate debt: The risk structure of interest rates. Journal of Finance 29 (1974) 449-470
87. Morokoff W. An importance sampling method for portfolios of credit risky assets. In: Ingalls R.G., Rossetti M.D., Smith J.S., and Peters B.A. (Eds). Proceedings of the 2004 Winter Simulation Conference (2004), IEEE Press, Piscataway, NJ 1668-1676
88. Nakayama M., Nicola V., and Shahabuddin P. Techniques for fast simulation of models of highly dependable systems. IEEE Transactions on Reliability 50 (2001) 246-264
89. d. The Annals of Probability 11 (1983) 158-167
90. Pakes A. On the tails of waiting time distribution. Journal of Applied Probability 12 (1975) 555-564
91. Parekh S., and Walrand J. A quick simulation method for excessive backlogs in networks of queues. IEEE Transactions on Automatic Control 34 1 (1989) 54-66
92. Randhawa R.S., and Juneja S. Combining importance sampling and temporal difference control variates to simulate Markov chains. ACM TOMACS 14 (2004) 1-30
93. Royden H.L. Real Analysis (1984), Prentice Hall, New York
94. Rubinstein R.Y. Optimization of computer simulation models with rare events. European Journal of Operations Research 99 (1997) 89-112
95. Rubinstein, R.Y. (1999). Rare-event simulation via cross-entropy and importance sampling. In: Second Workshop on Rare Event Simulation, RESIM'99, Enshede, The Netherlands, pp. 1-17
96. Rubinstein R.Y., and Kroese D.P. The Cross-Entropy Method: A Unified Approach to Combinatorial Optimization, Monte Carlo Simulation and Machine Learning (2004), Springer-Verlag, New York
97. Sadowsky J. Large deviations and efficient simulation of excessive backlogs in a GI / G / m queue. IEEE Transactions on Automatic Control 36 (1991) 1383-1394
98. Sadowsky J. On Monte Carlo estimation of large deviations probabilities. The Annals of Applied Probability 6 2 (1996) 399-422
99. Sadowsky J.S., and Bucklew J. On large deviation theory and asymptotically efficient Monte Carlo estimation. IEEE Transactions on Information Theory 36 3 (1990) 579-588
100. Sadowsky J.S., and Szpankowski W. The probability of large queue lengths and waiting times in a heterogeneous multiserver queue part I: Tight limits. Advances in Applied Probability 27 (1995) 532-566
101. Shahabuddin P. Importance sampling for the simulation of highly reliable Markovian systems. Management Science 40 (1994) 333-352
102. Shahabuddin, P. (2005). An approach to simulation of random walks with heavy-tailed increments. Technical report, Department of IEOR, Columbia University
103. Shahabuddin, P., Woo, B. (2004). Conditional importance sampling with applications to value-at-risk simulations. Working paper, IEOR Department, Columbia University
104. Shwartz A., and Weiss A. Large Deviations for Performance Analysis (1995), Chapman and Hall, New York
105. Siegmund D. Importance sampling in the Monte Carlo study of sequential tests. The Annals of Statistics 4 (1976) 673-684
106. Sigman K. A primer on heavy-tailed distributions. Queueing Systems 33 (1999) 261-275
107. Su Y., and Fu M. Importance sampling in derivatives security pricing. In: Joines J.A., Barton R.R., Jang K., and Fishwick P.A. (Eds). Proceedings of the 2000 Winter Simulation Conference (2000), IEEE Press, Piscataway, NJ 587-596
108. Su Y., and Fu M.C. Optimal importance sampling in securities pricing. Journal of Computational Finance 5 (2002) 27-50
109. Szechtman R., and Glynn P. Rare-event simulation for infinite server queues. In: Yucesan E., Chen H., Snowdon J.L., and Charnes J.M. (Eds). Proceedings of the 2002 Winter Simulation Conference (2002), IEEE Press, Piscataway, NJ 416-423
110. Tong Y. The Multivariate Normal Distribution (1990), Springer-Verlag, New York
111. Vázquez-Abad F., and Dufresne D. Accelerated simulation for pricing Asian options. In: Medeiros D.J., Watson E.F., Carson M.S., and Manivannan J.S. (Eds). Proceedings of the 1998 Winter Simulation Conference (1998), IEEE Press, Piscataway, NJ 1493-1500