Efficient QoS provisioning for adaptive multimedia in mobile communication networks by reinforcement learning

Mobile Networks and Applications

Volumn 11, Issue 1 SPEC. ISS., 2006, Pages 101-110

  Fei, Yu ^a,b   Wong, Vincent W S ^a   Leung, Victor C M ^a,c,d,e,f  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^b UCB   (Canada)

^c UBC ^*  (Canada)

^d UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^e IEEE   (Canada)

^f ACM   (Canada)

Author keywords

Adaptive multimedia; Mobile communication networks; QoS; Reinforcement learning

Indexed keywords

ADAPTIVE MULTIMEDIA; MOBILE COMMUNICATION NETWORKS; REINFORCEMENT LEARNING;

COMPUTATIONAL COMPLEXITY; COMPUTER NETWORKS; LEARNING SYSTEMS; MATHEMATICAL MODELS; MULTIMEDIA SYSTEMS; STANDARDS; WIRELESS TELECOMMUNICATION SYSTEMS;

QUALITY OF SERVICE;

EID: 29344443256     PISSN: 1383469X     EISSN: None     Source Type: Journal    
DOI: 10.1007/s11036-005-4464-2     Document Type: Article

References (28)

1. E. Altaian, Constrained Markov Decision Process (Chapman and Hall, London, 1999).
2. N. Argiriou and L. Georgiadis, Channel sharing by rate-adaptive streaming applications, in: P roc. IEEE Infocom'02 (June 2002).
3. D.P. Bertsekas and J.N. Tsitsiklis, Neuro-Dynamic Programming (Athena Scientific, 1996).
4. F.J. Beutler and K.W. Ross, Optimal policies for controlled Markov chains with a constraint, J. Math. Anal. Appl. 112 (1985) 236-252.
5. F.J. Beutler and K.W. Ross, Time-average optimal constrained semi-Markov decision processes, Adv. Appl. Prob. 18 (1986) 341-359.
6. A. Bhattacharya and S.K. Das, LeZi-update: An information-theoretic framework for personal mobility tracking in PCS networks, Wireless Networks 8(2/3) (2002) 121-135.
7. J.A. Boyan and M.L. Littman, Packet routing in dynamically changing networks: A reinforcement learning approach, in: Advances in NIPS 6, J.D. Cowan et al. (eds.) (1994) pp. 671-678.
8. C. Chou and K.G. Shin, Analysis of combined adaptive bandwidth allocation and admission control in wireless networks, in: Proc. IEEE Infocom'02 (June 2002).
9. 3GPP, RRC protocol specification, 3G TS25.331 version 3.20.0 (Sept. 2004).
10. Z. Gabor, Z. Kalmar and C. Szepesvari, Multi-criteria reinforcement learning, in: Proc. Int'l Conf. Machine Learning, Madison, WI (July 1998).
11. D. Hong and S.S. Rappaport, Traffic model and performance analysis for cellular mobile radio telephone systems with prioritised and non-prioritised handoff procedures, IEEE Trans. Veh. Technol. VT-35 (1986) 77-92.
12. ISO/IEC 144962-2, Information Technology Coding of Audio-Visual Objects: Visual (Committee draft, Oct. 1997).
13. ITU-T H. 263, Video Coding for Low Bitrate Communication (Jan. 1998).
14. T. Kwon, J. Choi, Y. Choi and S.K. Das, Near optimal bandwidth adaptation algorithm for adaptive multimedia services in: Wireless/Mobile Networks, in: Proc. IEEE VTC'99-Fall, vol. 2, Amsterdam, The Netherland (Sept. 1999) pp. 874-878.
15. T. Kwon, Y. Choi, C. Bisdikian and M. Naghshineh, QoS provisioning in wireless/mobile multimedia networks using an adaptive framework, Wireless Networks 9 (2003) 51-59.
16. P. Marbach, O. Mihatsch and J.N. Tsitsiklis, Call admission control and routing in integrated services networks using neuro-dynamic programming, IEEE J. Select. Areas Commun. 18(2) (2000) 197-208.
17. J. Nie and S. Haykin, A Q-learning based dynamic channel assignment technique for mobile communication systems, IEEE Trans. Veh. Technol. 48(5) (1999) 1676-1687.
18. M.L. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming (Wiley, New York, 1994).
19. S.P. Singh and D.P. Bertsekas, Reinforcement learning for dynamic channel allocation in cellular telephone systems, in: Advances in NIPS Vol. 9, M. Mozer et al. (eds.) (1997) pp. 974-980.
20. A.K. Talukdar, B.R. Badrinath and A. Acharya, Rate adaptation schemes in networks with mobile hosts, in: Proc. ACM/IEEE MobiCom'98(Oct. 1998).
21. H. Tong and T.X. Brown, Adaptive call admission control under quality of service constraints: a reinforcement learning solution, IEEE J. Select. Areas Commun. 18(2) (2000) 209-221.
22. D. Taubman and A. Zakhor, A common framework for rate and distortion based scaling of highly scalable compressed video, IEEE Trans. Circuits Syst. Video Technol. 6(4) (1996) 329-354.
23. C.J.C.H. Watkins and P. Dayan, Q-learning, Machine Learning 8 (1992) 279-292.
24. D. Wu, Y.T. Hou and Y.Q. Zhang, Scalable video coding and transport over broadband wireless networks, Proc. IEEE 89(1) (2001) 6-20.
25. S. Wu et al., A dynamic call admission policy with precision QoS guarantee using stochastic control for mobile wireless networks, IEEE/ACM Trans. Networking 10(2) (2002) 257-271.
26. F. Yu, V.W.S. Wong and V.C.M. Leung, Reinforcement learning for call admission control and bandwidth adaptation in mobile multimedia networks, in: Proc. of ICICS-PCM'3, Singapore (Dec. 2003).
27. F. Yu, V.W.S. Wong and V.C.M. Leung, A new QoS provisioning method for adaptive multimedia in cellular wireless networks, in: Proc. IEEE Infocom'04, HongKong, China, (Apr. 2004).
28. G. V. Zaruba, I. Chlamtac and S.K. Das, A prioritized real-time wireless call degradation framework for optimal call mix selection, Mobile Networks and Applications 7 (2002) 143-151.