Sensitivity analysis of stationary performance measures for Markov chains

Mathematical and Computer Modelling

Volumn 23, Issue 11-12, 1996, Pages 143-160

  Dai, L ^a  

^a WASHINGTON UNIVERSITY IN ST LOUIS   (United States)

Author keywords

Derivative estimation; Markov chain; Performance analysis; Poisson equation; Simulation

Indexed keywords

EID: 0030159511     PISSN: 08957177     EISSN: None     Source Type: Journal    
DOI: 10.1016/0895-7177(96)00069-6     Document Type: Article

References (25)

1. 1. L. Kleinrock, Queueing Systems, Volume 1, John Wiley & Sons, (1975).
2. 2. P. Glasserman, Gradient Estimation via Perturbation Analysis, Kluwer Academic Publishers, Boston, (1991).
3. 3. Y.C. Ho and X.R. Cao, Perturbation Analysis of Discrete Event Dynamic Systems, Kluwer Academic Publishers, Boston, (1991).
4. 4. C.G. Cassandras, Discrete Event Systems: Modeling and Performance Analysis, Irwin and Asken, Illinois, (1993).
5. 5. L. Dai and Y.C. Ho, Structural infinitesimal perturbation analysis (SIPA) for derivative estimation of discrete event dynamic systems, IEEE Trans. on Automatic Control 40 (8), 1154-1166 (1995).
6. 6. M. Zazanis and R. Suri, Convergence rates of finite-difference sensitivity estimates for stochastic systems, Operations Research 41 (4), 694-703 (1993).
7. 7. W.B. Gong and Y.C. Ho, Smoothed perturbation analysis of discrete event systems, IEEE Trans. Automatic Control 32 (11), 858-866 (1987).
8. 8. W.B. Gong and H. Schulzrinne, Application of smoothed perturbation analysis to probabilistic routing, Mathematics and Computers in Simulation 34, 467-485 (1992).
9. 9. P. Bremaud and W.B. Gong, Smoothed perturbation analysis and likelihood ratio formulas for adaptive routing, ACM Trans. on Modeling and Computer Simulation (April), 134-161 (1993).
10. 10. M.C. Fu and J.Q. Hu, Smoothed perturbation analysis derivative estimation for Markov chains, Operations Research Letters (to appear).
11. 11. P. Bremaud, Maximal coupling and rare perturbation sensitivity analysis, Queueing Systems 11, 307-333 (1992).
12. 12. J.L. Doob, Stochastic Processes, John Wiley & Sons, New York, (1953).
13. 13. T. Lindvall, Lectures on the Coupling Method, John Wiley & Sons, New York, (1992).
14. 14. S. Goldstein, Maximal coupling, Z. Wahrsch. Verw. Gebiete 46, 193-204 (1979).
15. st Annual Allerton Conf. on Commun., Control, and Computing, 958-967 (1993).
16. 16. B.L. Fox and P. Glasserman, Estimating derivatives via Poisson equations, Prob. in Inform. Engi. Scis. 5 (4), 415-428 (1991).
17. 17. L. Dai, Sensitivity analysis of Markov chains via finite-difference approximation with common random numbers, SIAM Journal on Applied Mathematics (1996) (to appear).
18. 18. V. Fabian, Stochastic approximation, In Optimizing Methods in Statistics, (Edited by J.S. Rustagi), Academic Press, New York, (1971).
19. 19. K.L. Chung, On a stochastic approximation method, Annals of Mathematical Statistics 25, 463-483 (1954).
20. 20. P.W. Glynn and W. Whitt, The asymptotic efficiency of simulation estimators, Operations Research 40 (3), 505-520 (1992).
21. 21. J.M. Hammersley and D.C. Handscomb, Monte Carlo Methods, Methuen, London, (1964).
22. 22. X.R. Cao, First order perturbation analysis of a simple multiclass finite source queue, Performance Evaluation 7, 31-41 (1987).
23. 23. G.S. Fishman, Principles of Discrete Event Simulation, John Wiley & Sons, New York, (1978).
24. 24. S. Asmussen, Applied Probability and Queues, John Wiley and Sons, (1987).
25. 25. S.P. Meyn and R.L. Tweedie, Markov Chains and Stochastic Stability, Springer-Verlag, (1993).