Q-learning-based multirate transmission control scheme for RRM in multimedia WCDMA systems

IEEE Transactions on Vehicular Technology

Volumn 53, Issue 1, 2004, Pages 38-48

  Chen, Yih Shen ^a   Chang, Chung Ju ^a   Ren, Fang Chin ^b  

^a NATIONAL CHIAO TUNG UNIVERSITY   (Taiwan)

^b INDUSTRIAL TECHNOLOGY RESEARCH INSTITUTE   (Taiwan)

Author keywords

Code division multiple access (CDMA) communication system; Multirate transmission; Q learning; Radio resource management

Indexed keywords

CODE DIVISION MULTIPLE ACCESS; COMPUTER SIMULATION; FEATURE EXTRACTION; LEARNING ALGORITHMS; MARKOV PROCESSES; MATHEMATICAL MODELS; MULTIMEDIA SYSTEMS; QUALITY OF SERVICE; RADIAL BASIS FUNCTION NETWORKS; RADIO INTERFERENCE; STATE SPACE METHODS; VECTORS;

MULTIRATE TRANSMISSION CONTROL; RADIO RESOURCE MANAGEMENT; REINFORCEMENT LEARNING ALGORITHM; WIDE BAND CODE DIVISION MULTIPLE ACCESS;

RADIO TRANSMISSION;

EID: 1242308397     PISSN: 00189545     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVT.2003.822330     Document Type: Article

References (21)

1. S. Choi and K. G. Shin, "An uplink CDMA system architecture with diverse QoS guarantees for heterogeneous traffic," IEEE/ACM Trans. Networking, vol. 7, pp. 616-628, Oct. 1999.
2. K. S. Gilhousen, I. M. Jacobs, R. Padovani, A. J. Viterbi, L. A. Weaver, and C. E. Wheatley, "On the capacity of a cellular CDMA system," IEEE Trans. Veh. Technol., vol. 40, pp. 303-312, May 1991.
3. W. Huang and V. K. Bhargava, "Performance evaluation of a DS-CDMA cellular system with voice and data services," in Proc. IEEE PIMRC'96, 1996, pp. 588-592.
4. A. Hämäläinen and K. Valkealahti, "Adaptive power increase estimation in WCDMA," in IEEE PIMRC'02, vol. 3, Sept. 2002, pp. 1407-1411.
5. J. B. Kim and M. L. Honig, "Resource allocation for multiple classes of DS-CDMA traffic," IEEE Trans. Veh. Technol., vol. 49, pp. 506-519, Mar. 2000.
6. S. M. Chin, C.-H. Cho, and D. K. Sung, "Interference-based channel assignment for DS-CDMA cellular systems," IEEE Trans. Veh. Technol., vol. 48, pp. 233-239, Jan. 1999.
7. N. Dimitriou and R. Tafazolli, "Quality of service for multimedia CDMA," IEEE Commun. Mag., vol. 38, pp. 88-94, July 2000.
8. V. Phan-Van and D. Luong, "Capacity enhancement with simple and robust soft-decision call admission control for WCDMA mobile cellular PCNs," in Proc. IEEE Vehicular Technology Conf. (VTC'01), vol. 3, Oct. f001, pp. 1349-1353.
9. D. Mitra, M. I. Reiman, and J. Wang, "Robust dynamic admission control for unified cell and call QoS in statistical multiplexers," IEEE J. Select. Areas. Commun., vol. 16, pp. 692-707, June 1998.
10. K. W. Ross, Multiservice Loss Models for Broadband Communication Networks. Berlin, Germany: Springer-Verlag, 1995.
11. J. Nie and S. Haykin, "A Q-learning-based dynamic channel assignment technique for mobile communication systems," IEEE Trans. Veh. Technol., vol. 48, pp. 1676-1687, Sept. 1999.
12. H. Tong and T. X. Brown, "Adaptive admission call admission control under quality of service constraints: A reinforcement learning solution," IEEE J. Select. Areas. Commun., vol. 18, pp. 209-221, Feb. 2000.
13. B. Makarevitch, "Application of reinforcement learning to admission control in CDMA network," in Proc. IEEE PIMRC'00, pp. 1353-1357.
14. P. Marbach, O. Mihatsch, and J. N. Tsisiklis, "Call admission control and routing in integrated services networks using neuro-dynamic programming," IEEE J. Select. Areas. Commun., vol. 18, pp. 197-208, Feb. 2000.
15. C. J. C. H. Watkins and P. Dayan, "Q-learning," Machine Learning, vol. 8, pp. 279-292, 1992.
16. S. Haykin, Neural Networks, 2nd ed. Englewood Cliffs, NJ: Prentice-Hall, 1999.
17. D. P. Bertsekas and J. N. Tsitsiklis, Neuro-Dynamic Programming. Belmont, MA: Athena Scientific, 1996.
18. 3rd Generation Partnership Project. (1999, Dec.) Physical Channes and Mapping and Transport Channels onto Physical Channels (FDD). 3GPP TS25.211 [Online] http://www.3gpp.org
19. 3rd Generation Partnership Project. (1999, Dec.) MAC Protocol Specification. 3GPP TS25.321 [Online] http://www.3gpp.org
20. 3rd Generation Partnership Project. (2001, Mar.) Physical Layer Procedures (FDD). 3GPP TS25.214 [Online] http://www.3gpp.org
21. R. Bellman, Dynamic Programming. Princeton, NJ: Princeton Univ. Press, 1957.