Numerical methods for controlled stochastic delay systems

Systems and Control: Foundations and Applications

Volumn , Issue 9780817645342, 2008, Pages 1-18

  Kushner, Harold J ^a  

^a NONE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85045461261     PISSN: 23249749     EISSN: 23249757     Source Type: Book Series    
DOI: None     Document Type: Chapter

References (95)

1. E. Altman and H. J. Kushner. Heavy traffic analysis of AIMD models for congestion control. In S. Raghavan and G. Anandalingham, editors, Telecommunications Planning: Innovations in Pricing, Network Design and Management. Kluwer, Amsterdam, 2005. Selected papers from the 2004 INFORMS telecommunications conference.
2. C. T. H. Baker and E. Buckwar. Numerical analysis of explicit one-step methods for stochastic delay differential equations. London Mathematical Society Journal of Computation and Mathematics, 3:315–335, 2000.
3. H. T. Banks and J. A. Burns. Hereditary control problems: numerical methods based on averaging approximations. SIAM J. Control Optimiz., 16:296–332, 1975.
4. J. J. Batzel, F. Kappel, D. Schneditz, and H. T. Tran. Cardiovascular and Respiratory Systems. SIAM, Philadelphia, 2006.
5. H. Bauer and U. Reidel. Stochastic control problems with delay. Math. Methods in Operations Research, 62:411–427, 2005.
6. A. Bellen and M. Zennaro. Numerical Methods for Delay Differential Equations. Oxford Science Publications, Oxford, 2003.
7. P. Billingsley. Convergence of Probability Measures. Wiley, New York, 1968.
8. P. Billingsley. Convergence of Probability Measures; Second Edition. Wiley, New York, 1999.
9. C. T. H. Baker and E. Buckwar. Numerical analysis of explicit one-step methods for stochastic delay differential equations. London Mathematical Society Journal of Computation and Mathematics, 3:315–335, 2000.
10. L. Breiman. Probability Theory, volume 7 of Classics in Applied Mathematics, A reprint of the 1968 Addison-Wesley edition. SIAM, Philadelphia, 1992.
11. M.-S. Chang and R. K. Youree. The European option with hereditary price structure: Basic theory. Applied Math. and Computation, 102:279–296, 1999.
12. A. Chojnowska-Michalik and B. Goldys. Existence, uniqueness and invariant measures for stochastic semilinear equations on hilbert spaces. Probability Theory and Related Fields, 102:331–356, 1995.
13. P.-L. Chow, J. L. Menaldi, and M. Robin. Additive control of stochastic linear systems with finite horizons. SIAM J. Control Optimiz., 23:858–899, 1985.
14. K.-L. Chung. Markov Chains with Stationary Transition Probabilities. Springer- Verlag, Berlin and New York, 1960.
15. C. T. H. Baker and E. Buckwar. Numerical analysis of explicit one-step methods for stochastic delay differential equations. London Mathematical Society Journal of Computation and Mathematics, 3:315–335, 2000.
16. J. L. Doob. Stochastic Processes. Wiley, New York, 1953.
17. C. T. H. Baker and E. Buckwar. Numerical analysis of explicit one-step methods for stochastic delay differential equations. London Mathematical Society Journal of Computation and Mathematics, 3:315–335, 2000.
18. T. E. Duncan, B. Pasik-Duncan, and L. Stettner. On the ergodic and adaptive control of stochastic differential delay systems. J. of Optimization Theory and Applications, 81:509–531, 1994.
19. N. Dunford and J. T. Schwartz. Linear Operators, Part 1: General Theory. Wiley-Interscience, New York, 1966.
20. P. Dupuis and H. Ishii. On Lipschitz continuity of the solution mapping to the Skorokhod problem, with applications. Stochastics Stochastics Rep., 35:31–62, 1991.
21. P. Dupuis and H. Ishii. SDE’s with oblique reflection on nonsmooth domains. Ann. Probability, 21:554–580, 1993.
22. A. El-Safty, M. S. Salim, and M. El-Khatib. Existence, uniqueness and stability of the spline approximation for delay controlled dynamical systems. International J. of Computer Mathematics, 77:629–640, 2001.
23. S. N. Ethier and T. G. Kurtz. Markov Processes: Characterization and Convergence. Wiley, New York, 1986.
24. W. Feller. An Introduction to Probability Theory and its Applications, Volume 2. Wiley, New York, 1966.
25. S. Floyd and V. Jacobson. Random early detection gateways for congestion avoidance. IEEE-ACM Transactions on Networking, 1:397–413, 1993.
26. J. Gibson. Linear-quadratic optimal control of hereditary differential systems: Infinite dimensional Ricatti equations and numerical approximations. SIAM J. Control Optimiz., 21:95–139, 1983.
27. C. T. H. Baker and E. Buckwar. Numerical analysis of explicit one-step methods for stochastic delay differential equations. London Mathematical Society Journal of Computation and Mathematics, 3:315–335, 2000.
28. J. K. Hale and S. M. Verduyn Lunel. Stability and control of feedback systems with time delays. Int. J. of Systems Science, 24:497–504, 2003.
29. J. M. Harrison and R.J. Williams. Brownian models of open queueing networks with homogeneous customer populations. Stochastics, 22:77–115, 1987.
30. K. Helmes and R. H. Stockbridge. Linear programming approach to the optimal stopping of singular stochastic processes. Stochastics Stochastics Rep., 35:309– 335, 2007.
31. H. J.Kushner. Numerical approximations for nonlinear stochastic systems with delays. Stochastics Stochastics Rep., 77:211–240, 2005.
32. Y. Hu, S-E. A. Mahammed, and F. Yan. Discrete-time approximations of stochastic delay equations: The Milstein scheme. Ann. Appl. Prob., 32:265–314, 2004.
33. Elsanosi I, B. Øksendal, and A. Sulem. Some solvable stochastic control problems with delays. Stochastics Stochastics Rep., 71:69–90, 2000.
34. N. Ikeda and S. Watanabe. Stochastic Differential Equations and Diffusion Processes, First Ed. North-Holland, Amsterdam, 1981.
35. C. T. H. Baker and E. Buckwar. Numerical analysis of explicit one-step methods for stochastic delay differential equations. London Mathematical Society Journal of Computation and Mathematics, 3:315–335, 2000.
36. K. Ito and F. Kappel. Approximation of infinite delay and Volterra type equations. Numerical Mathematics, 54:415–444, 1989.
37. K. Ito and R. Teglas. Legendre-tau approximations for functional differential equations. SIAM J. on Control Optimiz., 24:737–759, 1986.
38. K. Ito and R. Teglas. Legendre-T au approximations for functional differential equations Part II: The linear quadratic optimal control problem. SIAM J. on Control Optimiz., 25:1379–1408, 1987.
39. A. F. Ivanov, Y. I. Kazmerchuk, and A. V. Swishchuk. Theory, stochastic stability and applications of stochastic delay differential equations: a survey of results. Differential Equations and Dynamical Systems, 11:55–115, 2003.
40. F. Kappel. Galerkin type approximations schemes for delay systems. Ann. Differential Equations, 1:57–82, 1985.
41. I. Karatzas. A class of singular stochastic control problems. Adv. in Appl. Probab., 15:225–254, 1983.
42. I. Karatzas and S. E. Shreve. Brownian Motion and Stochastic Calculus. Springer-Verlag, New York, 1988.
43. S. Karlin and H. M. Taylor. A First Course in Stochastic Processes, Second Edition. Academic Press, New York, 1975.
44. V. B. Kolmanovskii and A. Myshkis. Applied Theory of Functional Differential Equations. Kluwer Academic Publishers, Dordrecht, 1992.
45. V. B. Kolmanovskii and V. R. Nosov. Stability of Functional Differential Equations. Academic Press, New York, 1986.
46. C. T. H. Baker and E. Buckwar. Numerical analysis of explicit one-step methods for stochastic delay differential equations. London Mathematical Society Journal of Computation and Mathematics, 3:315–335, 2000.
47. U. Küchler and E. Platen. Strong discrete time approximation of stochastic differential equations with time delay. Mathematics and Computers in Simulation, 54:189–205, 2000.
48. U. Küchler and E. Platen. Weak discrete time approximation of stochastic differential equations with time delay. Mathematics and Computers in Simulation, 59:497–507, 2002.
49. T. G. Kurtz. Approximation of Population Processes, volume 36 of CBMS-NSF Regional Conf. Series in Appl. Math. SIAM, Philadelphia, 1981.
50. H. J. Kushner. Numerical approximations for stochastic systems with delays in the state and control. Stochastics Stochastics Rep., 78:343–376, 2006.
51. H. J. Kushner. On the stability of stochastic differential-difference equations. J. Diff. Eqns., 4:424–443, 1968.
52. H. J. Kushner. Stability and existence of diffusions with discontinuous or rapidly growing terms. J. Math. Anal. Appl., 11:156–168, 1972.
53. H. J. Kushner. Probability Methods for Approximations in Stochastic Control and for Elliptic Equations. Academic Press, New York, 1977.
54. H. J. Kushner. Optimality conditions for the average cost per unit time problem with a diffusion model. SIAM J. Control Optimiz., 16:330–346, 1978.
55. H. J. Kushner. Weak Convergence Methods and Singularly Perturbed Stochastic Control and Filtering Problems, volume 3 of Systems and Control. Birkhäuser, Boston, 1990.
56. C. T. H. Baker and E. Buckwar. Numerical analysis of explicit one-step methods for stochastic delay differential equations. London Mathematical Society Journal of Computation and Mathematics, 3:315–335, 2000.
57. H. J. Kushner and D. Barnea. On the control of linear functional-differential equations with quadratic cost. SIAM J. Control Optimiz., 8:257–272, 1970.
58. C. T. H. Baker and E. Buckwar. Numerical analysis of explicit one-step methods for stochastic delay differential equations. London Mathematical Society Journal of Computation and Mathematics, 3:315–335, 2000.
59. H. J. Kushner, D. Jarvis, and J. Yang. Controlled and optimally controlled multiplexing systems: A numerical exploration. Queueing Systems, 20:255–291, 1995.
60. H. J. Kushner and L. F. Martins. Numerical methods for stochastic singular control problems. SIAM J. Control Optimiz., 29:1443–1475, 1991.
61. H. J. Kushner and G. Yin. Stochastic Approximation Algorithms and Applications. Springer-Verlag, Berlin and New York, 1997. Second Edition, 2003.
62. B. Larssen and N. H. Risebro. When are HJB equations in stochastic control of delay systems finite dimensional. Stochastic Anal. and Appl., 21:643–671, 2003.
63. I. Lasiecka and A. Manitius. Differentiability and convergence rates of approximating semigroups for retarded functional-differential equations. SIAM. J. of Numerical Analysis, 25:883–907, 1988.
64. J. P. Lehoczky and S. E. Shreve. Absolutely continuous and singular stochastic control. Stochastics, 17:91–110, 1986.
65. C. T. H. Baker and E. Buckwar. Numerical analysis of explicit one-step methods for stochastic delay differential equations. London Mathematical Society Journal of Computation and Mathematics, 3:315–335, 2000.
66. A. Manitius and T. Tran. Numerical approximations for hereditary systems with input and output delays: Convergence results and convergence rates. SIAM J. Control Optimiz., 32:1332–1363, 1994.
67. C. T. H. Baker and E. Buckwar. Numerical analysis of explicit one-step methods for stochastic delay differential equations. London Mathematical Society Journal of Computation and Mathematics, 3:315–335, 2000.
68. C. T. H. Baker and E. Buckwar. Numerical analysis of explicit one-step methods for stochastic delay differential equations. London Mathematical Society Journal of Computation and Mathematics, 3:315–335, 2000.
69. X. Mao and S. Sabinis. Numerical solution of stochastic differential delay equations under local lipschitz conditions. J. of Computational and Applied Mathematics, 151:215–227, 2003.
70. J.-L. Menaldi and M. Taksar. Optimal correction problem for a multidimensional stochastic system. Automatica, 25:223–232, 1989.
71. C. T. H. Baker and E. Buckwar. Numerical analysis of explicit one-step methods for stochastic delay differential equations. London Mathematical Society Journal of Computation and Mathematics, 3:315–335, 2000.
72. L. Mirkin. On the approximation of distributed-delay control laws. Systems and Control Letters, 51:331–342, 2004.
73. S-E. A. Mohammed. Stochastic Functional Differential Equations. Pitman, Boston, 1984.
74. C. T. H. Baker and E. Buckwar. Numerical analysis of explicit one-step methods for stochastic delay differential equations. London Mathematical Society Journal of Computation and Mathematics, 3:315–335, 2000.
75. B. S. Mordukhovich and R. Trubnik. Stability of discrete approximations and necessary conditions for delay-differential inclusions. Annals of Oper. Research, 101:149–170, 2001.
76. J. Neveu. Mathematical Foundations of the Calculus of Probability. Holden-Day, San Francisco, 1965.
77. C. T. H. Baker and E. Buckwar. Numerical analysis of explicit one-step methods for stochastic delay differential equations. London Mathematical Society Journal of Computation and Mathematics, 3:315–335, 2000.
78. C. T. H. Baker and E. Buckwar. Numerical analysis of explicit one-step methods for stochastic delay differential equations. London Mathematical Society Journal of Computation and Mathematics, 3:315–335, 2000.
79. J. Nilsson, B. Bernhardsson, and B. Wittenmark. Stochastic analysis and control of real-time systems with random time delays. Automatica, 34:57–64, 1998.
80. C. T. H. Baker and E. Buckwar. Numerical analysis of explicit one-step methods for stochastic delay differential equations. London Mathematical Society Journal of Computation and Mathematics, 3:315–335, 2000.
81. C. V. Pao. Finite difference solutions of reaction diffusion equations with continuous time delays. Computers and Mathematics With Applications, 42:399–412, 2001.
82. W. B. Powell. Approximate Dynamic Programming. Wiley, New York, 2007.
83. G. Da Prato and J. Zabczyk. Ergodicity for Infinite Dimensional Systems. Cambridge University Press, Cambridge, UK, 1996.
84. M. I. Reiman and R. J. Williams. A boundary property of semimartingale reflecting Brownian motions. Prob. Theory Rel. Fields, 77:87–97, 1988.
85. D. Revuz. Markov Chains. North Holland, Amsterdam, 1984.
86. M. Scheutzow. Qualitative behavior of stochastic delay equations with a bounded memory. Stochastics, 12:41–80, 1984.
87. J. Si, A. G. Barto, W. B. Powell, and D. Wunch. Handbook of Learning and Approximate Dynamic Programming. IEEE Press, New York, 2004.
88. H. M. Soner and S. E. Shreve. Regularity of the value function for a two-dimensional singular stochastic control problem. SIAM J. Control Optimiz., 27:876–907, 1989.
89. R. Srikant. Control of communication networks. In T. Samed, editor, Perspectives in Control Engineering: Technologies, Applications, New Directions. IEEE Press, New York, 1999.
90. R. Srikant. The Mathematics of Internet Congestion Control. Birkhäuser, Boston, 2003.
91. C. T. H. Baker and E. Buckwar. Numerical analysis of explicit one-step methods for stochastic delay differential equations. London Mathematical Society Journal of Computation and Mathematics, 3:315–335, 2000.
92. C. T. H. Baker and E. Buckwar. Numerical analysis of explicit one-step methods for stochastic delay differential equations. London Mathematical Society Journal of Computation and Mathematics, 3:315–335, 2000.
93. C. T. H. Baker and E. Buckwar. Numerical analysis of explicit one-step methods for stochastic delay differential equations. London Mathematical Society Journal of Computation and Mathematics, 3:315–335, 2000.
94. R. B. Vinter and R. H. Kwong. The infinite time quadratic control problem for linear systems with state and control delays: An evolution equation approach. SIAM J. Control Optimiz., 19:139–153, 1981.
95. Z. Xiong. Superconvergence of the continuous Galerkin finite element method for delay differential equations with several terms. J. of Computational and Applied Mathematics, 198:160–166, 2007.