Adaptive Provisioning of Differentiated Services Networks Based on Reinforcement Learning

IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews

Volumn 33, Issue 4, 2003, Pages 492-501

  Hui, Timothy Chee Kin ^a   Tham, Chen Khong ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Active networks; Adaptive bandwidth provisioning; Differentiated services; Quality of service; Reinforcement learning

Indexed keywords

BANDWIDTH; LEARNING ALGORITHMS; LEARNING SYSTEMS; MATHEMATICAL MODELS; QUALITY OF SERVICE; TELECOMMUNICATION TRAFFIC;

DIFFERENTIATED SERVICES; REINFORCEMENT LEARNING;

TELECOMMUNICATION NETWORKS;

EID: 0242696084     PISSN: 10946977     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCC.2003.818472     Document Type: Article

References (29)

1. IETF Differentiated Services (DiffServ) Working Group. http://www.ietf.org/html.charters/diffserv-charter.html.
2. S. Blake et al., An Architecture for Differentiated Services. Dec. 1998.
3. V. Jacobsen et al., An Expedited Forwarding PHB, June 1999.
4. J. Heinanen et al., Assured Forwarding PHB Group, June 1999.
5. D. Goderis et al., Service level specification semantics, parameters and negotiation requirements, in IETF Internet Draft, June 2001.
6. K. Nichols, V. Jacobsen. and L. Zhang, An approach to service allocation in the internet, in IETF Internet Draft, Nov. 1997.
7. D. Clark and W. Fang, "Explicit allocation of best-effort packet delivery service," IEEE/ACM Trans. Networking, vol. 6, no. 4. pp. 362-373, 1998.
8. R. J. Williams, "Simple statistical gradient-following algorithms for connectionist reinforcement learning," Mach. Learn., vol. 8, no. 3, pp. 229-256, 1992.
9. ns-2 - The Network Simulator, S. McCanne and S. Floyd.Available http://www.isi.edu/nsnam/ns/ [Online]
10. A. Demars, S. Keshav, and S. Shenker, "Analysis and simulation of a fair queuing algorithm," in Proc. ACM SIGCOMM '89. Sept. 1989.
11. S. J. Golestani, "A self-clocked fair queuing scheme for broadband applications." in Proc. IEEE INFOCOM '94. June 1994.
12. 2Q: worst-case fair weighted fair queuing," in Proc. IEEE INFOCOM '96, 1996.
13. C.-C. Li et al., "Proportional delay differentiation service based on weighted fair queuing." in Proc. IEEE ICCCN 2000, Oct. 2000.
14. M.-F. Horng et al., "An adaptive approach to weighted fair queue with QoS enhanced on IP network," in Proc. IEEE TENCON 2001, Aug. 2001.
15. 2FQ: an integrated traffic scheduling and shaping scheme for DiffServ networks," in Proc. IEEE HPSR 2001, May 2001.
16. H. Wang, C. Shen, and K. G. Shin, "Adaptive-weighted packet scheduling for premium service," in Proc. IEEE ICC 2001, June 2001.
17. S. Floyd and V. Jacobson. "Random early detection gateways for congestion avoidance," IEEE/ACM Trans. Networking, vol. 1, no. 4, pp. 397-413, 1993.
18. R.-F. Liao and A. T. Campbell, "Dynamic core provisioning for quantitative differentiated service," in Proc. IEEE IWQoS 2001, June 2001.
19. A. Barto, R. Sutton, and C. Anderson, "Neuron-like elements that can solve difficult learning control problems," IEEE Trans. Syst., Man, Cybern., vol. SMC-13, pp. 835-846, 1983.
20. C. J. C. H. Watkins and P. Dayan, "Q-learning, "Mach. Learn., vol. 8, pp. 279-292, 1992.
21. A. Vasilakos, M. Saltouros, A. Atlasis, and W. Pedrycz, "Optimizing QoS routing in hierarchical ATM networks using computational intelligence techniques," IEEE Trans. Syst., Man. Cybern. C. Special Issue on Computational Intelligence in Telecommunications Networks and Internet Services, vol. 33. pp. 297-312, Aug. 2003.
22. A. Atlasis and A. Vasilakos, "LB-SELA: rate-based access protocol for ATM networks," Comput. Networks ISDN Syst., vol. 30. no. 1998. pp. 963-980, May 1998.
23. A. Atlasis, N. Loukas, and A. Vasilakos, "The use of learning algorithms in ATM networks CAC problem: a methodology," Comput. Networks ISDN Syst., vol. 34, no. 2000, pp. 341-353. Sept. 2000.
24. H. Tong and T. X. Brown, "Adaptive call admission control under quality of service constraints: a reinforcement learning solution, " IEEE J. Select. Areas Commun., vol. 18. pp. 209-221, Feb. 2000.
25. P. Marbach, O. Mihatsch, and J. N. Tsitsiklis, "Call admission control and routing in integrated services networks using neuro-dynamic programming," IEEE J. Select. Areas Commun., vol. 18, no. 2, pp. 197-208, Feb. 2000.
26. C.-K. Tham and Y. Liu, "Minimizing transmission costs through adaptive marking in differentiated services networks," in IEEE MMNS 2002, Oct. 2002.
27. G. A. Rummery, "Problem Solving With Reinforcement Learning," Ph.D. Thesis, Cambridge Univ., Cambridge, U.K., July 1995.
28. C. N. Chuah, L. Subramanian, R. H. Katz, and A. D. Joseph, "QoS provisioning using a clearing house architecture," in Proc. IEEE IWQoS 2000, June 2000.
29. L. A. DaSilva, "Pricing for QoS-enabled networks: A survey," IEEE Commun. Surv. Tutorials, vol. 3, no. 2, pp. 2-8, 2000.