Accuracy of fluid approximations to controlled birth-and-death processes: Absorbing case

Mathematical Methods of Operations Research

Volumn 73, Issue 2, 2011, Pages 159-187

  Piunovskiy, Alexey ^a   Zhang, Yi ^a  

^a UNIVERSITY OF LIVERPOOL   (United Kingdom)

Author keywords

Birth and death process; Continuous time Markov chain; Dynamic programming; Fluid model; Optimal control; Queueing system

Indexed keywords

BIRTH AND DEATH PROCESS; CONTINUOUS-TIME MARKOV CHAIN; FLUID MODEL; OPTIMAL CONTROLS; QUEUEING SYSTEM;

CONTINUOUS TIME SYSTEMS; CONTROL; FLUIDS; MARKOV PROCESSES; OPTIMIZATION; PLASMA FLOW; QUEUEING NETWORKS;

DYNAMIC PROGRAMMING;

EID: 79953025305     PISSN: 14322994     EISSN: 14325217     Source Type: Journal    
DOI: 10.1007/s00186-010-0340-3     Document Type: Article

References (33)

1. Avrachenkov K, Ayesta U, Piunovskiy A (2005) Optimal Choice of Buffer Size of an Internet Router. In: Proceedings of IEEE CDC/ECC, Spain
2. Avrachenkov K, Piunovskiy A, Zhang Y (2011) Asymptotic Fluid Optimality and Efficiency of Tracking Policies for Bandwidth-Sharing Networks. J Appl Prob (accepted)
3. Ayesta U, Piunovskiy A, Zhang Y (2008) Fluid Model of An Internet Router Under the MIMD Control Scheme. In: Raghavan S, Golden B, Wasil E (eds) Telecommunications Modeling Policy and Technology. Springer-Verlag, New York, pp 239-251
4. A Bassamboo R Randhawa 2010 On the accuracy of fluid models for capacity sizing in queueing systems with impatient customers Oper Res 58 5 1398 1413 2560543 10.1287/opre.1100.0815
5. N Bäuerle 2000 Asymptotic Optimality of Tracking Policies in Stochastic Networks Ann Appl Prob 10 4 1065 1083 1057.90003 10.1214/aoap/ 1019487605 (Pubitemid 33246399)
6. N Bäuerle 2002 Optimal Control of Queueing Networks: an Approach via Fluid Models Adv Appl Prob 34 313 328 1027.90007 10.1239/aap/1025131220 (Pubitemid 34838800)
7. Bertsekas D, Shreve S (1978) Stochastic Optimal Control: the Discrete-Time Case. Academic Press, NY
8. H Chen 1995 Fluid Approximations and Stability of Multiclass Queueing Networks: Work-Conserving Disciplines Ann Appl Prob 5 3 637 665 0847.60073 10.1214/aoap/1177004699 (Pubitemid 126032822)
9. H Chen 1996 Rate of Convergence of the Fluid Approximation for Generalized Jackson Networks J Appl Prob 33 804 814 1002.60530 10.2307/3215360
10. H Chen A Mandelbaum 1991 Discrete Flow Networks: Bottleneck Analysis and Fluid Approximations Math Oper Res 16 2 408 446 1106809 0735.60095 10.1287/moor.16.2.408
11. Chen H, Mandelbaum A (1994) Hierachical Modeling of Stochastic Networks, Part I: Fluid Models. In: Yao D (ed) Stochastic Modeling and Analysis of Manufacturing Systems. Springer, New York, pp 47-105
12. D Clancy A Piunovskiy 2005 An Explicit Optimal Isolation Policy for a Determinisitc Epidemic Model Applied Mathematics and Computation 163 1109 1121 2199469 1061.92053 10.1016/j.amc.2004.06.028 (Pubitemid 40304784)
13. J Dai 1995 On Positive Harris Recurrence of Multiclass Queueing Networks: A Unified Approach via Fluid Limit Models Ann Appl Prob 5 49 77 0822.60083 10.1214/aoap/1177004828
14. Ethier S, Kurtz T (1986) Markov Processes: Chracterization and Convergence. Wiley, NY
15. S Foss A Kovalevskii 1999 A Stability Criterion via Fluid Limits and its Application to a Polling System Queueing Syst 32 131 168 1720552 0945.90013 10.1023/A:1019187004209
16. AS Gajrat A Hordijk 2005 On the Structure of the Optimal Server Control for Fluid Networks Math Meth Oper Res 62 55 75 2226968 1093.90074 10.1007/s00186-005-0441-6 (Pubitemid 41261143)
17. AS Gajrat A Hordijk V Malyshev F Spieksma 1997 Fluid Approximations of Markov Decision Chains Markov Process Related Fields 3 129 150 1446922 0913.93078
18. AS Gajrat A Hordijk A Ridder 2003 Large-Deviations Analysis of the Fluid Approximations for a Controllable Tandem Queue Ann Appl Prob 13 4 1423 1448 2023882 1038.60088 10.1214/aoap/1069786504 (Pubitemid 38033583)
19. X Guo O Hernández-Lerma T Prieto-Rumeau 2006 A Survey of Recent Results on Continuous-Time Markov Decision Processes Top 14 177 257 2286961 05178054 10.1007/BF02837562
20. M Kitaev 1986 Semi-Markov and Jump Markov Controlled Models: Average Cost Criterion Theory Probab Appl 30 2 272 288 792619 0586.90093 10.1137/1130036
21. Kitaev M, Rykov V (1995) Controlled Queueing Systems. CRC Press, Boca Raton
22. Mandelbaum A, Pats G (1995) State-dependent Queues: Approximations and Applications. In: Kelly F, Williams R (eds) Proceedings of the IMA. Stochastic networks, Springer, NY, pp 239-282
23. A Mandelbaum W Massey M Reiman 1998 Strong Approximations for Markovian Service Networks Queueing Syst 30 149 201 1663767 0911.90167 10.1023/A:1019112920622 (Pubitemid 128370856)
24. Pang G, Day M (2007) Fluid Limits of Optimally Controlled Queueing Networks. J Appl Math Stoch Anal. Article ID 68958. doi: 10.I155/2007/68958
25. A Piunovskiy 1998 A Controlled Jump Discounted Model with Constraints Theory Probab Appl 42 1 51 71 10.1137/S0040585X97975964
26. A Piunovskiy 2004 Multicriteria Impulsive Control of Jump Markov Processes Math Meth Oper Res 60 125 144 2124622 1066.93067 10.1007/s001860400355 (Pubitemid 40877427)
27. A Piunovskiy 2009 Controlled Jump Markov Processes with Local Transitions and Their Fluid Approximation WSEAS Trans on Systems and Control 4 8 399 412 2761567
28. A Piunovskiy 2009 Random Walk, Birth-and-Death Process and Their Fluid Approximations: 'Absorbing Case' Math Meth Oper Res 70 2 285 312 2558414 1183.49027 10.1007/s00186-008-0269-y
29. A Piunovskiy D Clancy 2008 An Explicit Optimal Intervention Policy for a Determinisitc Epidemic Model Optim Control Appl Meth 29 413 428 2478635 10.1002/oca.834
30. Piunovskiy A, Zhang Y (2011) On the Fluid Approximations of a class of General Inventory Level-Dependent EOQ and EPQ Models. Adv Oper Res (submitted)
31. Puterman M (1994) Markov Decision Processes: Discrete Stochastic Dynamic Programming. Wiley Series in Probability and Mathematical Statistics. Wiley, NY, USA
32. Verloop IM (2009) Scheduling in Stochastic Resource-sharing Systems. PhD thesis, Eindhoven University of Technology
33. Y Zhang A Piunovskiy U Ayesta K Avrachenkov 2010 Convergence of Trajectories and Optimal Buffer Sizing for MIMD Congestion Control Com Com 33 2 149 159 1198.91200