A reinforcement learning approach for admission control in mobile multimedia networks with predictive information

IEICE Transactions on Communications

Volumn E90-B, Issue 7, 2007, Pages 1663-1673

  Giménez Guzmán, José Manuel ^a   Martínez Bauset, Jorge ^a   Pla, Vicent ^a  

^a UNIVERSITAT POLITÈCNICA DE VALÈNCIA   (Spain)

Author keywords

Admission control; Cellular mobile multimedia networks; Optimization; Predictive information

Indexed keywords

ACCESS CONTROL; FORECASTING; OPTIMIZATION; STOCHASTIC SYSTEMS; TECHNOLOGICAL FORECASTING;

ADMISSION CONTROL POLICIES; CELLULAR MOBILE; CONVENTIONAL REINFORCEMENT LEARNING; CURSE OF DIMENSIONALITY; MOBILE MULTIMEDIA NETWORKS; PREDICTIVE INFORMATION; REINFORCEMENT LEARNING APPROACH; TECHNOLOGICAL INNOVATION;

REINFORCEMENT LEARNING;

EID: 54849409585     PISSN: 09168516     EISSN: 17451345     Source Type: Journal    
DOI: 10.1093/ietcom/e90-b.7.1663     Document Type: Article

References (16)

1. R. Ramjee, R. Nagarajan, and D. Towsley, "On optimal call admission control in cellular networks," Wireless Networks Journal (WINET), vol.3, no.1, pp.29-41, 1997.
2. N. Bartolini, "Handoff and optimal channel assignment in wireless networks," Mobile Networks and Applications (MONET), vol.6, no.6, pp.511-524, 2001.
3. N. Bartolini and I. Chlamtac, "Call admission control in wireless multimedia networks," Proc. IEEE PIMRC, vol.1, pp.285-289, 2002.
4. V. Pla and V. Casares-Giner, "Optimal admission control policies in multiservice cellular networks," Proc. International Network Optimization Conference (INOC), pp.466-471, Oct. 2003.
5. W.S. Soh and H.S. Kim, "Dynamic bandwidth reservation in cellular networks using road topology based mobility prediction," Proc. IEEE INFOCOM, vol.4, pp.2766-2777, 2004.
6. R. Zander and J.M. Karlsson, "Predictive and adaptive resource reservation (PARR) for cellular networks," International Journal of Wireless Information Networks, vol.11, no.3, pp.161-171, July 2004.
7. R. Sutton and A.G. Barto, Reinforcement Learning, The MIT Press, Cambdridge, Massachusetts, 1998.
8. J.M. Giménez-Guzmán, J. Mart́inez-Bauset, and V. Pla, "An after-states reinforcement learning approach to optimize admission control in mobile cellular networks," in Wireless Systems and Network Architectures in Next Generation Internet, ed. M. Cesana and L. Fratta, Lecture Notes in Computer Science (LNCS), vol.3883, pp.115-129, 2006.
9. A. Yener and C. Rose, "Genetic algorithms applied to cellular call admission: Local policies," IEEE Trans. Veh. Technol., vol.46, no.1, pp.72-79, 1997.
10. S. Choi and K.G. Shin, "Adaptive bandwidth reservation and admission control in QoS-sensitive cellular networks," IEEE Trans. Parallel Distrib. Syst., vol.13, no.9, pp.882-897, Sept. 2002.
11. S. Biswas and B. Sengupta, "Call admissibility for multirate traffic in wireless ATM networks," Proc. IEEE INFOCOM, pp.649-657, 1997.
12. J.S. Evans and D. Everitt, "Effective bandwidth-based admission control for multiservice CDMA cellular networks," IEEE Trans. Veh. Technol., vol.48, no.1, pp.36-46, Jan. 1999.
13. M.L. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming, John Wiley & Sons, 1994.
14. V. Pla, J.M. Giménez-Guzmán, J. Mart́inez, and V. Casares-Giner, "Optimal bandwidth reservation in multiservice mobile cellular networks with movement prediction," IEICE Trans. Commun., vol.E88-B, no.10, pp.4138-4141, Oct. 2005.
15. T.K. Das, A. Gosavi, S. Mahadevan, and N. Marchalleck, "Solving semi-Markov decision problems using average reward reinforcement learning," Manage. Sci., vol.45, no.4, pp.560-574, 1999.
16. S. Singh and D. Bertsekas, "Reinforcement learning for dynamic channel allocation in cellular telephone systems" Proc. Advances in Neural Information Processing Systems 9, pp.974-980, 1997.