Comparing a class of dynamic model-based reinforcement learning schemes for handoff prioritization in mobile communication networks

Expert Systems with Applications

Volumn 38, Issue 7, 2011, Pages 8730-8737

  El Alfy, El Sayed M ^a   Yao, Yu Dong ^b  

^a KING FAHD UNIVERSITY OF PETROLEUM AND MINERALS   (Saudi Arabia)

^b Stevens Institute of Technology   (United States)

Author keywords

Cellular systems; Handoff prioritization; Mobile communication networks; Reinforcement learning; Resource management; Semi Markov decision process

Indexed keywords

CELLULAR SYSTEM; HANDOFF PRIORITIZATION; MOBILE COMMUNICATION NETWORKS; RESOURCE MANAGEMENT; SEMI-MARKOV DECISION PROCESS;

BLOCKING PROBABILITY; CELLULAR ARRAYS; CELLULAR TELEPHONE SYSTEMS; COMMUNICATION; DECISION MAKING; DYNAMIC MODELS; LEARNING ALGORITHMS; MARKOV PROCESSES; MOBILE TELECOMMUNICATION SYSTEMS; NATURAL RESOURCES MANAGEMENT; REINFORCEMENT LEARNING; RESOURCE ALLOCATION; TELECOMMUNICATION NETWORKS;

WIRELESS NETWORKS;

EID: 79952445859     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2011.01.082     Document Type: Article

References (40)

1. S. Boumerdassi, and A. Beylot Adaptive channel allocation for wireless PCN Mobile Networks and Applications 4 1999 111 116
2. C. Chang, T. Su, and Y. Chiang Analysis of a cutoff priority cellular radio system with finite queueing and reneging/dropping IEEE/ACM Transactions on Networking 2 2 1994 166 175
3. M.-H. Chiu, and M.A. Bassiouni Predictive schemes for handoff prioritization in cellular networks based on mobile positioning IEEE Journal on Selected Areas in Communications 18 3 2000 510 522
4. J. Diederich, and M. Zitterbart A simple and scalable handoff prioritization scheme Computer Communications 28 7 2005 773 789 (Pubitemid 40556783)
5. El-Alfy, E.-S. M. (2001). Intelligent system for channel allocation with prioritized handoff in mobile cellular multimedia networks. PhD dissertation, Stevens Institute of Technology.
6. E.-S.M. El-Alfy, Y.D. Yao, and H. Heffes A learning approach for prioritized handoff channel allocation in mobile multimedia networks IEEE Transactions on Wireless Communications 5 7 2006 1651 1660 (Pubitemid 44304175)
7. R. Guerin Queueing-blocking system with two arrival streams and guard channels IEEE Transactions on Communications 36 1988 153 163 (Pubitemid 18596630)
8. C.-J. Ho, and C.-T. Lea Improving call admission policies in wireless networks Wireless Networks 5 4 1999 257 265
9. D. Hong, and S.S. Rappaport Traffic model and performance analysis for cellular mobile radio telephone systems with prioritized and nonprioritized handoff procedures IEEE Transactions on Vehicular Technology 35 1986 77 92 (Pubitemid 17468707)
10. C.-J. Huang, Y.-T. Chuang, and D.-X. Yang Implementation of call admission control scheme in next generation mobile communication networks using particle swarm optimization and fuzzy logic systems Expert Systems with Applications 35 3 2008 1246 1251
11. C.-J. Huang, K.-W. Hu, I.-F. Chen, Y.-J. Chen, and H.-X. Chen An intelligent resource management scheme for heterogeneous WiFi and WiMAX multi-hop relay networks Expert Systems with Applications 37 2 2010 1134 1142
12. Hussain, S., Hamid, Z., Khattak, N. S. (2006). Mobility management challenges and issues in 4G heterogeneous networks. In ACM proceedings of the first international conference on integrated internet ad hoc and sensor networks.
13. I. Katzela, and M. Naghshineh Channel assignment schemes for cellular mobile telecommunication systems: A comprehensive survey IEEE Personal Communications 1996 10 31 (Pubitemid 126596601)
14. Kouvatsos, D., Li, Y. (2005). A novel hand off priority channel assignment scheme for a 4G cellular network: Performance modeling and analysis. In Third international working conference on performance modeling and evaluation of heterogeneous networks, West Yorkshire, UK.
15. B.G. Lee, D. Park, and H. Seo Wireless communications resource management 2008 Wiley-IEEE Press
16. T. Lin, C. Wang, and P.-C. Lin A neural-network-based context-aware handoff algorithm for multimedia computing ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP) 4 3 2008 17:1 17:23
17. L.-L. Lu, J.-L.C. Wu, and H.-H. Liu Mobility-aided adaptive resource reservation schemes in wireless multimedia networks Computers and Electrical Engineering 32 1-3 2006 102 117 (Pubitemid 43732357)
18. A.W. Moore, and C.G. Atkeson Prioritized sweeping: Reinforcement learning with less data and less real time Machine Learning 1993 13
19. J. Nie, and S. Haykin A Q-learning based dynamic channel assignment technique for mobile communication systems IEEE Transactions on Vehicular Technology 48 5 1999 1676 1687 (Pubitemid 30503784)
20. S. Oh, and D. Tcha Prioritized channel assignment in a cellular radio networks IEEE Transactions on Communications 40 1992 1259 1269
21. M.L. Putterman Markov decision processes: Discrete stochastic dynamic programming 1994 Wiley New York
22. R. Ramjee, D. Towsley, and R. Nagarajan On optimal call admission control in cellular networks Wireless Networks 3 1997 29 41 (Pubitemid 127506836)
23. M. Salamah, and H. Lababidi Dynamically adaptive channel reservation scheme for cellular networks Computer Networks 49 6 2005 787 796 (Pubitemid 41425944)
24. T. Salih, and K. Fidanboylu Modeling and analysis of queuing handoff calls in single and two-tier cellular networks Computer Communications 29 17 2006 3580 3590 (Pubitemid 44633434)
25. Saquib, M., Yates, B. (1995). Optimal call admission to a mobile cellular network. In IEEE vehicular technology conference (pp. 190-194).
26. Schwartz, A. (1993). A reinforcement learning method for maximizing undiscounted rewards. In International Conference on Machine Learning.
27. Singh, S. (1994). Reinforcement learning algorithms for average-payoff Markovian decision processes. In Proceedings of the 12th AAAI.
28. S.P. Singh, and D.P. Bertsekas Reinforcement learning for dynamic channel allocation in cellular telephone systems Advances in NIPS Vol. 9 1997 MIT Press 974 980
29. W.-S. Soh, and H.S. Kim A predictive bandwidth reservation scheme using mobile positioning and road topology information IEEE/ACM Transactions on Networking 14 5 2006 1078 1091 (Pubitemid 44615117)
30. Q. Song, and A. Jamalipour A quality of service negotiation-based vertical handoff decision scheme in heterogeneous wireless systems European Journal of Operational Research 191 3 2008 1059 1074
31. I. Stojmenović Handbook of wireless networks and mobile computing 2002 John Wiley & Sons, Inc.
32. G.L. Stuber Principles of mobile communication 2nd ed. 2001 Kluwer Academic Publishers
33. Su, W., Gerla, M. (1998). Bandwidth allocation strategies for wireless ATM networks using predictive reservation. In IEEE global telecommunications conference (GLOBECOM 1998).
34. R. Sutton, and A. Barto Reinforcement learning: An introduction 1998 MIT Press
35. S. Tekinay, and B. Jabbari Handover and channel assignment in mobile cellular networks IEEE Communications Magazine 29 1991 42 46 (Pubitemid 23563838)
36. Thrun, S. (1992). Efficient exploration in reinforcement learning. Technical report CMU-CS-92-102, CMU, School of Computer Science.
37. Watkins, C. J. C. H. (1989). Learning from delayed rewards. PhD thesis, Cambridge University, Cambridge, England.
38. Z. Ye, L.K. Law, S.V. Krishnamurthy, Z. Xu, S. Dhirakaosal, and S.K. Tripathi Predictive channel reservation for handoff prioritization in wireless cellular networks Computer Networks 51 3 2007 798 822 (Pubitemid 44792527)
39. F. Yu, V.W.S. Wong, and V.C.M. Leung Efficient QoS provisioning for adaptive multimedia in mobile communication networks by reinforcement learning Journal on Mobile Networks and Applications 11 1 2006 101 110 (Pubitemid 43005817)
40. Zheng, Z. (2008). Performance analysis of a QoS guaranteed dynamic channel reservation for handoff prioritization in cellular mobile networks. In Fourth international conference on wireless communications, networking and mobile computing (WiCOM '08).