A Q-learning-based dynamic channel assignment technique for mobile communication systems

IEEE Transactions on Vehicular Technology

Volumn 48, Issue 5, 1999, Pages 1676-1687

  Nie, Junhong ^a   Haykin, Simon ^a  

^a MCMASTER UNIVERSITY   (Canada)

Author keywords

Dynamic channel assignment; Dynamic programming; Neural networks; Q learning

Indexed keywords

COMMUNICATION CHANNELS (INFORMATION THEORY); COMPUTER SIMULATION; DYNAMIC PROGRAMMING; NEURAL NETWORKS; TELECOMMUNICATION TRAFFIC;

DYNAMIC CHANNEL ASSIGNMENT (DCA); Q LEARNING;

MOBILE RADIO SYSTEMS;

EID: 0033344799     PISSN: 00189545     EISSN: None     Source Type: Journal    
DOI: 10.1109/25.790549     Document Type: Article

References (22)

1. A. G. Barto, S. J. Bradtke, and S. P. Singh, "Learning to act using real-time dynamic programming," Artificial Intelligence, vol. 72, pp. 81-138, 1995.
2. R. Bellman, Dynamic Programming. Princeton, NJ: Princeton Univ. Press, 1957.
3. P. T. Chen, M. Palaniswami, and D. Everitt, "Neural network-based dynamic channel assignment for cellular mobile communication systems," IEEE Trans. Veh. Technol., vol. 43, pp. 279-288, 1994.
4. J. Chuang, "Performance issues and algorithms for dynamic channel assignments," IEEE J. Select. Areas Comm., vol. 11, pp. 955-963, 1993.
5. D. C. Cox and D. O. Reudink, "Dynamic channel assignment in two dimensional large mobile radio systems," Bell Syst. Tech. J., vol. 51, pp. 1611-1627, 1972.
6. E. Del Re, R. Fantacci, and L. Ronga, "A dynamic channel allocation technique based on Hopfield neural networks," IEEE Trans. Veh. Technol., vol. 45, pp. 26-32, 1996.
7. D. D. Dimitrijevic and J. Vucetic, "Design and performance analysis of the algorithms for channel allocation in cellular networks," IEEE Trans. Veh. Technol., vol. 42, pp. 526-534, 1993.
8. M. Duque-Anton, D. Kunz, and B. Ruber, "Channel assignment for cellular radio using simulated annealing," IEEE Trans. Veh. Technol., vol. 42, pp. 14-21, 1993.
9. R. L. Freeman, Telecommunication System Engineering, 3rd ed. New York: Wiley, 1996.
10. Y. Furuya and Y. Akaiva, "Channel segregation: A distributed adaptive channel allocation scheme for mobile communications systems," in DMR II, Stockholm, Sweden, 1987, pp. 311-315.
11. S. Haykin, Neural Networks: A Comprehensive Foundation. New York: Macmillan, 1994.
12. D. Kunz, "Channel assignment for cellular radio using neural networks," IEEE Trans. Veh. Technol., vol. 40, pp. 188-193, 1991.
13. W. C. Y. Lee, Mobile Cellular Telecommunications. New York: McGraw-Hill, 1995.
14. W. K. Lai and G. G. Coghill, "Channel assignment through evolutionary optimization," IEEE Trans. Veh. Technol., vol. 45, pp. 91-96, 1996.
15. V. H. Macdonald, "The cellular concept," Bell Syst. Tech. J., vol. 58, pp. 15-1, 1979.
16. R. W. Nettleton and G. R. Schloemer, "A high capacity assignment method for cellular mobile telephone systems," in Proc IEEE 39th Veh. Technol. Conf., 1989, pp. 359-367.
17. K. N. Sivarajan, R. J. McEliece, and J. W. Ketchum, "Dynamic channel assignment in cellular radio," in Proc. IEEE 40th Veh. Technol. Conf., 1990, pp. 631-637.
18. S. Tekinary and B. Jabbari, "Handover and channel assignment in mobile cellular networks," IEEE Commun. Mag., pp. 42-46, Nov. 1991.
19. C. J. C. H. Watkins, "Learning from delayed rewards," Ph.D. dissertation, Cambridge Univ., Cambridge, U.K., 1989.
20. C. J. C. H. Watkins and P. Dayan, "Q-learning," Machine Learning, vol. 8, pp. 279-292, 1992.
21. M. Zhang and T. S. Yum, "Comparisons of channel assignment strategies in cellular mobile systems," IEEE Trans. Veh. Technol., vol. 38, pp. 211-215, 1989.
22. -, "The nonuniform compact pattern allocation algorithm for cellular mobile systems," IEEE Trans. Veh. Technol., vol. 40, pp. 387-391, 1991.