Perturbation analysis via coupling

IEEE Transactions on Automatic Control

Volumn 45, Issue 4, 2000, Pages 614-628

  Dai, Liyi ^a,b  

^a IEEE   (United States)

^b WASHINGTON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COUPLING METHOD; DISCRETE EVENT DYNAMIC SYSTEMS; GRADIENT INFORMATION; PERTURBATION ANALYSIS;

ESTIMATION; MARKOV PROCESSES; PERTURBATION TECHNIQUES; PROBABILITY; THEOREM PROVING;

CONTROL SYSTEMS;

EID: 0034172288     PISSN: 00189286     EISSN: None     Source Type: Journal    
DOI: 10.1109/9.847099     Document Type: Article

References (24)

1. P. Bremaud, "Maximal coupling and rare perturbation sensitivity analysis," Queueing Syst.: Theory Appl., vol. 11, pp. 307-333, 1993.
2. P. Bremaud and L. Massoulie, " Maximal coupling and rare perturbation analysis with a random horizon," Discrete Event Dynamic Syst.: Theory Appl., vol. 5, pp. 319-342, 1995.
3. S. Cambanis, G. Simons, and W. Stout, "Inequalities for Εκ(Χ,Υ) when the marginals are fixed," Zeitschrift für Wahrscheinlichkeitstheorie Verwandte Gebiete, vol. 36, pp. 285-294, 1976.
4. X. R. Cao and H. F. Chen, "Perturbation realization, potentials, and sensitivity analysis of Markov processes," IEEE Trans. Automat. Contr., vol. 42, pp. 1382-1393, 1997.
5. C. G. Cassandras, Discrete Event Systems: Modeling and Performance Analysis: Irwin and Asken, 1993.
6. L. Dai, "Sensitivity analysis of stationary performance measures for general Markov chains," Math. Computer Modelling, vol. 23, pp. 143-160, 1996. Special issue on discrete event dynamic systems.
7. _, "The use of coupling in sensitivity analysis," in Proc. 32nd Annual Allerton Conf. Communication, Control, Computing, Monticello, IL, 1994, pp. 728-737.
8. L. Dai and Y. C. Ho, "Structural infinitesimal perturbation analysis (SIPA) for derivative estimation of discrete event dynamic systems," IEEE Trans. Automatic Contr., vol. 40, pp. 1154-1166, 1995.
9. W. Doeblin, "Exposé de la theorie des chaînes simples constantes de Markov à un nombre fini d'états," Rev. Math. Union Interbalkanique, vol. 2, pp. 77-105, 1938.
10. J. L. Doob, Stochastic Processes. New York: Wiley, 1953.
11. M. C. Fu, "On maximal coupling perturbation analysis," in Proc. 2nd St. Petersburg Workshop Simulation, 1996, pp. 143-151.
12. M. C. Fu and J. Q. Hu, Conditional Monte Carlo: Gradient Estimation and Optimization Applications. New York: Kluwer, 1997.
13. M. C. Fu, J. Q. Hu, and L. Shi, "Likelihood ratio methods via conditional Monte Carlo and splitting," in Proc. 31st Annual Allerton Conf. Commun., Control, Computing, 1993, pp. 958-967.
14. P. Glasserman, Gradient Estimation via Perturbation Analysis. Boston, MA: Kluwer, 1991.
15. P. W. Glynn, "Likelihood ratio gradient estimation: An overview," in Proc. 1987 Winter Simulation Conf., 1987, pp. 366-374.
16. S. Goldstein, "Maximal coupling," Z. Wahrsch. Verw. Gebiete, vol. 46, pp. 193-204, 1979.
17. W. B. Gong and Y. C. Ho, "Smoothed perturbation analysis of discrete event dynamic systems," IEEE Trans. Automat. Contr., vol. 32, pp. 858-867, 1987.
18. Y. C. Ho and X. R. Cao, Perturbation Analysis of Discrete Event Dynamic Systems. Boston, MA: Kluwer, 1991.
19. M. Iosifescu, Finite Markov Processes and Their Appl.. New York: Wiley, 1980.
20. J. G. Kemeny and J. L. Snell, "Potentials for denumerable Markov chains," J. Math. Analysis Appl., vol. 3, pp. 196-260, 1960.
21. E. L. Lehmann, "Some concepts of dependence," Annals Math. Statistics, vol. 37, pp. 1137-1153, 1966.
22. T. Lindvall, Lectures on the Coupling Method. New York: Wiley, 1992.
23. R. Suri, "Implementation of sensitivity calculation on a Monte-Carlo experiment," J. Optimization Theory Appl., vol. 40, pp. 625-630, 1983.
24. H. Thorisson, "Coupling and shift-coupling random sequences," in Doeblin and Model Probability, H. Cohn, Ed. Providence, RI: American Mathematical Society, 1993.