Reinforcement learning for load management in diffserv-MPLS mobile networks

IEEE Vehicular Technology Conference

Volumn , Issue , 2009, Pages

  Vučević, Nemanja ^a   Pérez Romero, Jordi ^a   Salient, Oriol ^a   Agustí, Ramon ^a  

^a UNIVERSITAT POLITÈCNICA DE CATALUNYA   (Spain)

Author keywords

All IP; DiffServ; MPLS; QoS; Reinforcement learning

Indexed keywords

ALL-IP; AUTONOMOUS NETWORKS; COGNITIVE NETWORK; DIFFERENTIATED SERVICES; DIFFSERV; DISTRIBUTED REINFORCEMENT LEARNING; LOAD MANAGEMENT; MOBILE NETWORKS; MPLS; MULTI PROTOCOL LABEL SWITCHING; NEXT-GENERATION WIRELESS NETWORK; NOVEL SOLUTIONS; QOS; RESOURCE SCARCITY; RESOURCE USAGE; TRAFFIC ROUTING;

EDUCATION; INTELLIGENT AGENTS; INTERNET PROTOCOLS; REINFORCEMENT; REINFORCEMENT LEARNING; ROUTERS; WIRELESS NETWORKS;

QUALITY OF SERVICE;

EID: 70349684748     PISSN: 15502252     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/VETECS.2009.5073831     Document Type: Conference Paper

References (22)

1. Michael Howard, "Mobile Backhaul Moves to the Forefront", Info-netics Research, 2006.
2. 3GPP TR 22.978, All-IP Network (AIPN) feasibility study, Jun 2006
3. J. Mitola, Cognitive Radio. An Integrated Agent Architecture for Software Defined Radio, PhD thesis, Royal Inst. of Tech. (KTH), 2000.
4. P. Leaves, et al, "Dynamic spectrum allocation in composite reconfi-gurable wireless networks", IEEE Communications Magazine, vol. 42, issue 5, pp. 72-81, May 2004
5. I. F. Akyildiz, W.-Y. Lee, M. C. Vuran, S. Mohanty, "Next Generation/Dynamic Spectrum Access/Cognitive Radio Wireless Networks: A Survey", ELSEVIER Computer Networks, vol. 50, Sept. 2006.
6. R. W. Thomas, L. A. DaSilva, A. B. MacKenzie, "Cognitive networks", IEEE DySPAN 2005, Nov. 2005
7. M. Sagfors, V. Virkki, T. Kuningas, "Overload Control of Best-Effort Traffic in the UTRAN Transport Network", IEEE VTC '06, May 2006
8. R.W. Thomas, D.H. Friend, L.A. DaSilva, A.B. MacKenzie, "Cognitive networks: adaptation and learning to achieve end-to-end performance objectives", IEEE Communications Magazine, vol. 44, issue 12, pp. 51-57, Dec. 2006
9. S. Blake, D. Black, M. Carlson, E. Davies, Z. Wang, W. Weiss, An Architecture for Differentiated Services, IETF RFC 2475, December 1998
10. E. Rosen, A. Viswanathan, R. Callon., Multiprotocol Label Switching Architecture, IETF RFC 3031, Jan. 2001
11. V. Jacobson, K. Nichols, K. Poduri, An expedited forwarding PHB, IETF RFC 2598, Jun 1999
12. J. Heinanen, F. Baker, W. Weiss, J. Wroclawski, Assured forwarding PHB group, IETF RFC 2597, Jun 1999
13. Vilho Raisanen, Nokia Networks OY Finland, Implementing Service Quality in IP Networks, John Wiley & Sons, 2003
14. 3GPP TR 23.228, "3GPP System Architecture Evolution - Report on Technical Options and Conclusions", Nov. 2006
15. A. Premji, "Using MPLS Auto-bandwidth in MPLS Networks", Wireline and Wireless Carriers, Juniper Networks, Inc., 2005
16. R. S. Sutton, A.G. Barto, Reinforcement Learning: An Introduction, A Bradford Book, MIT Press, Cambridge, MA 1998
17. F. Heidari, S, Mannor, L.G. Mason, "Reinforcement Learning - based Load Shared Sequential Routing", IFIP Networking 2007, Springer LNCS vol. 4479, pp. 832-843, Nov. 2007
18. C. Scoglio, T. Anjali, J.C. de Oliveira, I.F. Akyildiz, G. Uhl, "TEAM: A traffic engineering automated manager for DiffServ-based MPLS networks", IEEE Communications Magazine, vol. 42, issue 10, pp. 134-145, Oct. 2004
19. R. Rahim-Amoud, L. Merghem-Boulahia, D. Gaiti, "Autonomous Agents for Self-managed MPLS DiffServ-TE Domain", Autonomic Networking, Springer LNCS, Volume 4195, Sept. 2006
20. T. Chee-Kin Hui, C.-H. Tham, "Adaptive Provisioning of Differentiated Services Networks Based on Reinforcement Learning", IEEE Transactions on Systems, Man and Cybernetics, vol. 33, pp. 492-501, Nov. 2003
21. N. Vucevic, J. Perez-Romero, O. Salient, R. Agusti, "Reinforcement Learning for Active Queue Management in Mobile All-IP Networks", IEEE PIMRC '07, Sept. 2007
22. A. Demers, S. Keshavt and S. Shenker, "Analysis and Simulation of a FairQueueing Algorithm", Proc. SIGCOMM '88, vol. 19, Sept. 1989