Markov game for autonomic joint radio resource management in a multi-operator scenario

Journal of China Universities of Posts and Telecommunications

Volumn 14, Issue 3, 2007, Pages 48-55

  ZHANG, Yong jing ^a   LIN, Yue wei ^a  

^a BEIJING UNIVERSITY OF POSTS AND TELECOMMUNICATIONS   (China)

Author keywords

autonomic; JRRM; Markov game; multi operator; reinforcement learning (RL); TN929.5

Indexed keywords

CODES (SYMBOLS); MARKOV PROCESSES; REINFORCEMENT LEARNING; RESOURCE ALLOCATION;

JOINT RADIO RESOURCE MANAGEMENT; MULTIOPERATOR; Q LEARNING; RADIO ACCESS TECHNOLOGIES;

RADIO COMMUNICATION;

EID: 35648944691     PISSN: 10058885     EISSN: None     Source Type: Journal    
DOI: 10.1016/S1005-8885(07)60148-4     Document Type: Article

References (17)

1. Zhang Q., Wang Y.-h., VICTOR O., et al. Intelligent vertical handoffs between heterogeneous communication networks. The Journal of China Universities of Posts and Telecommunications 12 2 (2005) 20-25
2. End-to-End Reconfigurability - Phase 2 (E2R II). [2006-01-01], http://e2r2.motlabs.com/
3. Demestichas P, Dimitrakopoulos G, Luo J, et al. Radio resource management and network planning in a reconfigurability context. Proceedings of 13th 1ST Mobile and Wireless Summit, Jun 27-30, 2004, Lyon, France. 2004: 1035-1039
4. Agusti R, Salient O, Perez-Romero J, et al. A fuzzy-neural based approach for joint radio resource management in a beyond 3G framework. Proceedings of 1st International Conference on Quality of Service in Heterogeneous Wired/Wireless Networks, Oct 18-20, 2004, Dallas, TX, USA. Piscataway, NJ, USA: IEEE, 2004: 216-224
5. Luo J, Mohyeldin E, Dillinger M. et al. Performance analysis of joint radio resource management for reconfigurable terminals with multi-class circuit-switched services. Proceedings of Wireless World Research Forum 12th Meeting, Nov 4-5, 2004, Toronto, Canada: 2004: 135-146
6. Zhang Y, Zhang K, Ji Y. et al. Adaptive threshold joint load control in an end-to-end reconfigurable system. Proceedings of 15th 1ST Mobile and Wireless Summit, Jun 4-8, 2006, Mykonos, Greece: 2006
7. Samaan N., and Karmouch A. An Automated Policy-based management framework for differentiated communication Systems. IEEE Journal on Selected Areas in communications 23 12 (2005) 2236-2247
8. Kaelbling L., Littman M., Wang X., et al. Reinforcement Learning: a survey. Journal of Artificial Intelligence Research 4 4 (1996) 237-285
9. Nie J., and Haykin S. A Q-learning-based dynamic channel assignment technique for mobile communication Systems. IEEE Transactions on Vehicular Technology 48 5 (1999) 1676-1687
10. Claus C, Boutilier C. The dynamics of reinforcement learning in cooperative multiagent systems. Proceedings of the 15th National Conference on Artificial Intelligence, Jul 26-30, 1998, Madison WI, USA. 1998: 746-752
11. Littman M L. Markov games as a framework for multi-agent reinforcement learning. Proceedings of the 11th International Conference on Machine Learning, San Mateo, CA, USA. San Francisco, CA, USA: Morgan Kaufmann, 1994: 157-163
12. Hu J, Wellman M P. Multiagent reinforcement learning: theoretical framework and an algorithm. Proceedings of the 15th International Conference on Machine Learning, Jul 24-27, 1998, Madison, WI, USA. San Francisco, CA, USA: Morgan Kaufmann 1998: 242-250
13. Greenwald A, Hall K. Correlated-Q learning. Proceedings of the 20th International Conference on Machine Learning, Aug 21-24, 2003, Washington, DC, USA. Washington, DC, USA: AAAI Press, 2003: 242-249
14. 2R cognitive pilot channel concept. Proceedings of 15th 1ST Mobile and Wireless Summit, Jun 4-8, 2006, Mykonos, Greece: 2006
15. Watkins C., and Dayan P. Q-learning. Machine Learning 8 3 (1992) 279-292
16. Hagan M T, Demuth H B, Beale M H. Neural network design, Boston, MA, USA: PWS Press, 1996: 12.12-12.14
17. GAO D.-q. On structures of supervised linear basis function feedforward three-layered neural networks. Chinese Journal of Computers 21 1 (1998) 80-86 (in Chinese)