A learning approach for prioritized handoff channel Allocation in mobile multimedia networks

IEEE Transactions on Wireless Communications

Volumn 5, Issue 7, 2006, Pages 1651-1660

  El Alfy, El Sayed ^a,b   Yao, Yu Dong ^a,c   Heffes, Harry ^a,c  

^a IEEE   (Saudi Arabia)

^b KING FAHD UNIVERSITY OF PETROLEUM AND MINERALS   (Saudi Arabia)

^c Stevens Institute of Technology   (United States)

Author keywords

Cellular multimedia networks; Channel allocation; Dynamic programming; Handoffs; Markov decision processes; Reinforcement learning

Indexed keywords

CELLULAR MULTIMEDIA NETWORKS; CHANNEL ALLOCATION; HANDOFFS; MARKOV DECISION PROCESSES; MOBILE MULTIMEDIA NETWORKS; REINFORCEMENT LEARNING;

ALGORITHMS; CELLULAR TELEPHONE SYSTEMS; CHANNEL CAPACITY; COMPUTER SIMULATION; DYNAMIC PROGRAMMING; MARKOV PROCESSES; MULTIMEDIA SYSTEMS; QUALITY OF SERVICE; TELECOMMUNICATION NETWORKS; TELECOMMUNICATION TRAFFIC;

MOBILE TELECOMMUNICATION SYSTEMS;

EID: 33748118441     PISSN: 15361276     EISSN: None     Source Type: Journal    
DOI: 10.1109/TWC.2006.1673076     Document Type: Article

References (24)

1. G. L. Stüber, Principles of Mobile Communication. Norwell, MA: Kluwer Academic Publishers, 1996.
2. S. Tekinay and B. Jabbari, "Handover and channel assignment in mobile cellular networks," IEEE Commun. Mag., vol. 29, no. 4, pp. 42-46, Apr. 1991.
3. R. Sutton and A. Barto, Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press, 1998.
4. D. P. Bertsekas and J. N. Tsitsiklis, Neurodynamic Programming. Belmont, MA: Athena Scientific, 1996.
5. S. P. Singh and D. P. Bertsekas, "Reinforcement learning for dynamic channel allocation in cellular telephone systems," in Advances in NIPS, pp. 974-980 (Cambridge, MA: MIT Press, 1997).
6. J. Nie and S. Haykin, "A Q-learning based dynamic channel assignment technique for mobile communication systems," IEEE Trans. Veh. Technol., vol. 48, no. 5, pp. 1676-1687, Sep. 1999.
7. S.-H. Oh and D.-W. Tcha, "Prioritized channel assignment in a cellular radio networks," IEEE Trans. Commun., vol. 40, no. 7, pp. 1259-1269, July 1997.
8. R. Guerin, "Queueing-blocking system with two arrival streams and guard channels," IEEE Trans. Commun., vol. 36, no. 2, pp. 153-163, Feb. 1988.
9. D. Hong and S. S. Rappaport, "Traffic model and performance analysis for cellular mobile radio telephone systems with prioritized and nonprioritized handoff procedures," IEEE Trans. Veh. Technol., vol. 35, pp. 77-92, July 1986.
10. S. Boumerdassi and A. Beylot, "Adaptive channel allocation for wireless PCN," Mobile Networks and Applications, vol. 4, no. 2, pp. 111-116, June 1999.
11. O. Yu and V. Leung, "Adaptive resource allocation for prioritized call admission over an ATM-based wireless PCN," IEEE J. Select. Areas Commun., vol. 15, no. 7, pp. 1208-1225, Sep. 1997.
12. D. T. R. Ramjee and R. Nagarajan, "On optimal call admission control in cellular networks," Wireless Networks, vol. 3, no. 1, pp. 29-41, Jan. 1997.
13. M. Saquib and B. Yates, "Optimal call admission to a mobile cellular network," in Proc. IEEE Veh. Technol. Conf., July 1995, pp. 190-194.
14. C. J. Ho and C. T. Lea, "Improving call admission policies in wireless networks," Wireless Networks, vol. 5, no. 4, pp. 257-265, July 1999.
15. M. L. Putterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming. New York: Wiley, 1994.
16. H. C. Tijms, Stochastic Models: An Algorithmic Approach. New York: Wiley, 1994.
17. D. P. Bertsekas, Dynamic Programming and Optimal Control. Belmont, MA: Athena Scientific, 1995.
18. J. S. Kaufman, "Blocking in a shared resource environment," IEEE Trans. Commun., vol. 29, no. 10, pp. 1474-1481, Oct. 1981.
19. R. B. Cooper, Introduction to Queueing Theory. New York: Elsevier Science Publishing Co. Inc., 1981.
20. K. W. Ross and D. H. Tsang, "Optimal circuit access policies in an ISDN environment: A Markov decision approach," IEEE Trans. Commun., vol. 37, no. 9, pp. 934-939, Sep. 1989.
21. S. Mahadevan, "Average reward reinforcement learning: Foundations, algorithms and empirical results," Machine Learning, vol. 22, no. 1, pp. 159-196, Mar. 1996.
22. R. Guerin, H. Ahmadi, and M. Naghshineh, "Equivalent capacity and its application to bandwidth allocation in high-speed networks," IEEE J. Select. Areas Commun., vol. 9, no. 7, pp. 968-981, Sep. 1991.
23. C. J. C. H. Watkins and P. Dayan, "Q-learning," Machine Learning, vol. 8, no. 3, pp. 279-292, May 1992.
24. R. S. Sutton, "Learning to predict by the method of temporal differences," Machine Learning, vol. 3, no. 1, pp. 9-44, Aug. 1988.