Efficient QoS provisioning for adaptive multimedia in mobile communication networks by reinforcement learning

Proceedings - First International Conference on Broadband Networks, BroadNets 2004

Volumn , Issue , 2004, Pages 579-588

  Yu, Fei ^a   Wong, Vincent W S ^a   Leung, Victor C M ^a  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE SYSTEMS; BANDWIDTH; COMPUTER NETWORKS; COMPUTER SIMULATION; MARKOV PROCESSES; MATHEMATICAL MODELS; MOBILE TELECOMMUNICATION SYSTEMS; PROBABILITY; PROBLEM SOLVING; QUALITY OF SERVICE; SET THEORY;

BANDWIDTH ADAPTATION (BA); CALL ADMISSION CONTROL (CAC); MOTION PICTURE EXPERTS GROUP (MPEG); UNIVERSAL MOBILE TELECOMMUNICATIONS SYSTEMS (UMTS);

MULTIMEDIA SYSTEMS;

EID: 19544368616     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (28)

1. D. Hong and S. S. Rappaport, "Traffic model and performance analysis for cellular mobile radio telephone systems with prioritised and non-prioritised handoff procedures," IEEE Trans. Veh. Technol., vol. VT-35, pp. 77-92, Aug. 1986.
2. S. Wu et al., "A dynamic call admission policy with precision QoS guarantee using stochastic control for mobile wireless networks," IEEE/ACM Trans. Networking, vol. 10, no. 2, pp. 257-271, Apr. 2002.
3. ISO/IEC 144962-2, "Information technology coding of audio-visual objects: visual," Committee draft, Oct. 1997.
4. ITU-T H. 263, "Video coding for low bitrate communication," Jan. 1998.
5. 3GPP, "RRC protocol specification," 3G TS25.331 version 3.12.0, Sept. 2002.
6. A. K. Talukdar, B. R. Badrinath, and A. Acharya, "Rate adaptation schemes in networks with mobile hosts," in Proc. ACM/IEEE MobiCom '98, Oct. 1998.
7. T. Kwon, J. Choi, Y. Choi, and S. K. Das, "Near optimal bandwidth adaptation algorithm for adaptive multimedia services in wireless/mobile networks," in Proc. IEEE VTC'99-Fall, vol. 2, Amsterdam, The Netherland, Sept. 1999, pp. 874-878.
8. G. V. Zaruba, I. Chlamtac and S. K. Das, "A prioritized real-time wireless call degradation framework for optimal call mix selection," Mobile Networks and Applications, vol. 7, pp. 143-151, 2002.
9. C. Chou and K. G. Shin, "Analysis of combined adaptive bandwidth allocation and admission control in wireless networks," in Proc. IEEE Infocom '02, June 2002.
10. T. Kwon, Y. Choi, C. Bisdikian and M. Naghshineh, "QoS provisioning in wireless/mobile multimedia networks using an adaptive framework," Wireless Networks, vol. 9, pp. 51-59, 2003.
11. C. J. C. H. Watkins and P. Dayan, "Q-learning," Machine Learning, vol. 8, pp. 279-292, 1992.
12. F. Yu, V.W.S. Wong and V.C.M. Leung, "Reinforcement learning for call admission control and bandwidth adaptation in mobile multimedia networks," to appear in Proc. of ICICS-PCM'3, Singapore, Dec. 2003.
13. J. A. Boyan and M. L. Littman, "Packet routing in dynamically changing networks: A reinforcement learning approach," in J. D. Cowan, et al. (Eds.), Advances in NIPS 6, pp. 671-678, 1994.
14. H. Tong and T. X. Brown, "Adaptive call admission control under quality of service constraints: a reinforcement learning solution," IEEE J. Select. Areas Commun., vol. 18, no. 2, pp.209-221, 2000.
15. P. Marbach, O. Mihatsch, and J. N. Tsitsiklis, "Call admission control and routing in integrated services networks using neuro-dynamic programming," IEEE J. Select. Areas Commun., vol. 18, no. 2, pp.197-208, 2000.
16. S. P. Singh and D. P. Bertsekas, "Reinforcement learning for dynamic channel allocation in cellular telephone systems," in M. Mozer et al. (Eds.) Advances in NIPS 9, pp. 974-980, 1997.
17. J. Nie and S. Haykin, "A Q-learning based dynamic channel assignment technique for mobile communication systems," IEEE Trans. Veh. Technol., vol. 48, no. 5, pp. 1676-1687, Sept. 1999.
18. A. Bhattacharya and S.K. Das, "LeZi-update: an information-theoretic framework for personal mobility tracking in PCS networks," Wireless Networks, vol. 8, no.2/3, pp121-135, Mar. 2002.
19. F. Yu, V.W.S. Wong and V.C.M. Leung, "A new QoS provisioning method for adaptive multimedia in cellular wireless networks," in Proc. IEEE Infocom'04, HongKong, China, Apr. 2004.
20. D. Taubman and A. Zakhor, "A common framework for rate and distortion based scaling of highly scalable compressed video," IEEE Trans. Circuits Syst. Video Technol., vol. 6, no. 4, pp. 329-354, Aug. 1996.
21. D. Wu, Y. T. Hou, and Y. Q. Zhang, "Scalable video coding and transport over broadband wireless networks," Proc. IEEE, vol. 89, no. 1, pp. 6-20, Jan. 2001.
22. M. L. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming. New York: Wiley, 1994.
23. E. Altman, Constrained Markov decision process, Chapman and Hall, London, 1999.
24. Z. Gabor, Z. Kalmar, and C. Szepesvari, "Multi-criteria reinforcement learning," In Proc. Int'l Conf. Machine Learning, Madison, WI, July 1998.
25. F. J. Beutler and K. W. Ross, "Optimal policies for controlled Markov chains with a constraint," J. Math. Anal. Appl, vol. 112, pp. 236-252. 1985.
26. F. J. Beutler and K. W. Ross, "Time-average optimal constrained semi-Markov decision processes," Adv. Appl. Prob., vol. 18, pp. 341-359. 1986.
27. N. Argiriou and L. Georgiadis, "Channel sharing by rate-adaptive streaming applications," in Proc. IEEE INFOCOM'02, June 2002.
28. D. P. Bertsekas and J. N. Tsitsiklis, Neuro-Dynamic Programming, Athena Scientific, 1996.