Myopic policies and MaxWeight policies for stochastic networks

Proceedings of the IEEE Conference on Decision and Control

Volumn , Issue , 2007, Pages 639-646

  Meyn, Sean ^a  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ASYMPTOTIC ANALYSIS; LYAPUNOV FUNCTIONS; MARKOV PROCESSES; MATHEMATICAL MODELS; PUBLIC POLICY; SCHEDULING; STREET TRAFFIC CONTROL;

BUFFER POPULATION; MAXWEIGHT POLICIES; STOCHASTIC NETWORKS; SURROGATE VALUE FUNCTIONS;

STOCHASTIC CONTROL SYSTEMS;

EID: 62749127952     PISSN: 07431546     EISSN: 25762370     Source Type: Conference Proceeding    
DOI: 10.1109/CDC.2007.4434508     Document Type: Conference Paper

References (20)

1. L. Tassiulas and A. Ephremides, "Stability properties of constrained queueing systems and scheduling policies for maximum throughput in multihop radio networks," IEEE Trans. Automat. Control, vol. 37, no. 12, pp. 1936-1948, 1992.
2. A. L. Stolyar, "Maxweight scheduling in a generalized switch: state space collapse and workload minimization in heavy traffic," Adv. Appl. Probab., vol. 14, no. 1, pp. 1-53, 2004.
3. A. Mandelbaum and A. L. Stolyar, "Scheduling flexible servers with convex delay costs: heavy-traffic optimality of the generalized enrule," Operations Res., vol. 52, no. 6, pp. 836-855, 2004.
4. J. G. Dai and W. Lin, "Asymptotic optimality of maximum pressure policies in stochastic processing networks," 2006, preprint, July 2006, www2.isye.gatech.edu/people/faculty/dai/publicactions.
5. H. Chen and D. D. Yao, Fundamentals of queueing networks: Performance, asymptotics, and optimization. New York: Springer-Verlag, 2001, stochastic Modelling and Applied Probability.
6. S. P. Meyn, "Sequencing and routing in multiclass queueing networks. Part I: Feedback regulation," SIAM J. Control Optim., vol. 40, no. 3, pp. 741-776, 2001.
7. V. Subramanian and D. Leith, "Draining time based scheduling algorithm," 2007, Submitted to IEEE Conf. Dec. and Control.
8. P. R. Kumar and T. I. Seidman, "Dynamic instabilities and stabilization methods in distributed real-time scheduling of manufacturing systems," IEEE Trans. Automat. Control, vol. AC-35, no. 3, pp. 289-298, March 1990.
9. A. N. Rybko and A. L. Stolyar, "On the ergodicity of random processes that describe the functioning of open queueing networks," Problemy Peredachi Informatsii, vol. 28, no. 3, pp. 3-26, 1992.
10. S. P. Meyn and R. L. Tweedie, Markov Chains and Stochastic Stability, 2nd ed. London: Springer-Verlag, 1993, online: http://black.csl.uiuc.edu/~meyn/pages/book.html.
11. S. P. Meyn, "Control techniques for complex networks," to appear, Cambridge University Press, Nov. 2007. decision.csl.uiuc.edu/~meyn/ pages/CTCN/CTCN.html.
12. N. Laws, "Dynamic routing in queueing networks," Ph.D. dissertation, Cambridge University, Cambridge, UK, 1990.
13. S. P. Meyn, "Sequencing and routing in multiclass queueing networks. Part II: Workload relaxations," SIAM J. Control Optim., vol. 42, no. 1, pp. 178-217, 2003.
14. F. Kelly and C. Laws, "Dynamic routing in open queueing networks: Brownian models, cut constraints and resource pooling," Queueing Syst. Theory Appl., vol. 13, pp. 47-86, 1993.
15. J. M. Harrison, Brownian motion and stochastic flow systems. Malabar, FL: Robert E. Krieger Publishing Co. Inc., 1990, reprint of the 1985 original.
16. S. P. Meyn, "Dynamic safety-stocks for asymptotic optimality in stochastic networks," Queueing Syst. Theory Appl., vol. 50, pp. 255-297, 2005.
17. _, "Workload models for stochastic networks: Value functions and performance evaluation," IEEE Trans. Automat. Control, vol. 50, no. 8, pp. 1106-1122, August 2005.
18. _, "Stability and asymptotic optimality of generalized MaxWeight policies," 2006, submitted for publication.
19. J. G. Dai and W Lin, "Maximum pressure policies in stochastic processing networks," Operations Res., vol. 53, no. 2, pp. 197-218, 2005.
20. S. P. Meyn, "The policy iteration algorithm for average reward Markov decision processes with general state space," IEEE Trans. Automat. Control, vol. 42, no. 12, pp. 1663-1680, 1997.