A new QoS provisioning method for adaptive multimedia in cellular wireless networks

Proceedings - IEEE INFOCOM

Volumn 3, Issue , 2004, Pages 2130-2141

  Yu, Fei ^a   Wong, Vincent W S ^a   Leung, Victor C M ^a  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

Adaptive multimedia; Cellular wireless networks; Mathematical programming optimization; QoS

Indexed keywords

ADAPTIVE MULTIMEDIA; ADMISSION CONTROL; CELLULAR WIRELESS NETWORKS; MATHEMATICAL PROGRAMMING/OPTIMIZATION;

ADAPTIVE ALGORITHMS; ADAPTIVE SYSTEMS; COMPUTER SIMULATION; CONSTRAINT THEORY; LEARNING SYSTEMS; MATHEMATICAL PROGRAMMING; MULTIMEDIA SYSTEMS; OPTIMIZATION; PROBABILITY; QUALITY OF SERVICE;

WIRELESS TELECOMMUNICATION SYSTEMS;

EID: 8344265266     PISSN: 0743166X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/INFCOM.2004.1354620     Document Type: Conference Paper

References (33)

1. D. Hong and S. S. Rappaport, "Traffic model and performance analysis for cellular mobile radio telephone systems with prioritized and non-prioritised handoff procedures," IEEE Trans. Veh. Technol., vol. VT-35, pp. 77-92, Aug. 1986.
2. S. Wu, K. Y. M. Wong, and B. Li, "A dynamic call admission policy with precision QoS guarantee using stochastic control for mobile wireless networks," IEEE/ACM Trans. Networking, vol. 10, no. 2, pp. 257-271, Apr. 2002.
3. ISO/IEC 144962-2, "Information technology coding of audio-visual objects: visual," Committee draft, Oct. 1997.
4. ITU-T H.263, "Video coding for low bit rate communications," 1998.
5. 3GPP, "RRC protocol specification," 3G TS25.331 version 3.12.0, Sept. 2002.
6. (6] Y. B. Lin, A. Noerpel, and D. Harasty, "The sub-rating channel assignment strategy for PCS hand-offs," IEEE Trans. Veh. Technol., vol. 45, no. 1, pp. 122-130, 1996.
7. C. Chou and K. G. Shin, "Analysis of combined adaptive bandwidth allocation and admission control in wireless networks," in Proc. IEEE INFOCOM'02, June 2002.
8. A. K. Talukdar, B. R. Badrinath, and A. Acharya, "Rate adaptive schemes in networks with mobile hosts," in Proc. ACM/IEEE MOBICOM'98,Oct. 1998.
9. T. Kwon, J. Choi, Y. Choi, and S. Das, "Near optimal bandwidth adaptation algorithm for adaptive multimedia services in wireless/mobile networks," in Proc. IEEE VTC'99-Fall, Sept. 1999.
10. Y. Xiao, P. Chen, and Y. Wang, "Optimal admission control for multi-class of wireless adaptive multimedia services," IEICE Trans. Commun., vol. E84-B, no. 4, pp. 795-804, April 2001.
11. Y. Xiao, C.L.P. Chen, and B. Wang, "Bandwidth degradation QoS provisioning for adaptive multimedia in wireless/mobile networks," Computer Commun., vol. 25, pp.1153-1161, 2002.
12. G. V. Zaruba, I. Chlamtac, and S. K. Das, "A prioritized real-time wireless call degradation framework for optimal call mix selection," Mobile Networks and Applications, vol. 7, pp. 143-151, April 2002.
13. T. S. Rappaport, Wireless communications: Principles and practice. Englewood Cliffs, NJ: Prentice Hall, 1996.
14. T. Kwon, Y. Choi, C. Bisdikian, and M. Naghshineh, "QoS provisioning in wireless/mobile multimedia networks using an adaptive framework," Wireless Networks, vol. 9, pp. 51-59, 2003.
15. S. Ganguly and B. Nath, "QoS provisioning for adaptive services with degradation in cellular network," in Proc. IEEE WCNC'03, New Orleans, Louisiana, March 2003.
16. H. Tong and T. X. Brown, "Adaptive call admission control under quality of service constraints: a reinforcement learning solution," IEEE J. Select. Areas Commun., vol. 18, no. 2, pp.209-221, 2000.
17. P. Marbach, O. Mihatsch, and J.N. Tsitsiklis, "Call admission control and routing in integrated services networks using neuro-dynamic programming," IEEE J. Select. Areas Commun., vol. 18, no. 2, pp.197-208, 2000.
18. S. P. Singh and D. P. Bertsekas, "Reinforcement learning for dynamic channel allocation in cellular telephone systems," in M. Mozer et al. (Eds.) Advances in NIPS 9, pp. 974-980, 1997.
19. J. Nie and S. Haykin, "A Q-learning based dynamic channel assignment technique for mobile communication systems," IEEE Trans. Veh. Technol., vol. 48, no. 5, pp. 1676-1687, Sept. 1999.
20. D. Wu, Y.T. Hou, and Y.-Q. Zhang, "Scalable video coding and transport over broadband wireless networks," Proc. of the IEEE, vol. 89, no. 1, pp. 6-20, Jan. 2001.
21. M. L. Puterman, Markov decision processes, Wiley Interscience, New York, USA, 1994.
22. C. J. C. H. Watkins and P. Dayan, "Q-leaming," Machine Learning, vol. 8, pp. 279-292, 1992.
23. S. Mahadevan, "Average reward reinforcement learning: Foundations, algorithms, and empirical results," Machine Leaning, vol. 22, pp. 159-196, 1996.
24. T. K. Das, A. Gosavi, S. Mahadevan and N. Marchalleck, "Solving semi-markov decision problems using average reward reinforcement learning," Management Science, vol. 45, no. 4, pp. 560-574, 1999.
25. A. Gosavi, An algorithm for solving semi-Markov decision problems using reinforcement learning: convergence analysis and numerical results, Ph.D. Dissertation, University of South Florida, 1999.
26. A. Gosavi, N. Bandla and T. K. Das, "A reinforcement learning approach to airline seat allocation for multiple fare classes with overbooking," IIE Transactions on Operations Engineering, vol. 34, pp. 729-742, 2002.
27. E. Altman, Constrained Markov decision process, Chapman and Hall, London, 1999.
28. Z. Gabor, Z. Kalmar, and C. Szepesvari, "Multi-criteria reinforcement learning," in Proc. Int'l Conf. Machine Learning, Madison, WI, Jul. 1998.
29. F. J. Beutler and K. W. Ross, "Optimal policies for controlled Markov chains with a constraint" J. Math. Anal. Appl., vol. 112, pp. 236-252. 1985.
30. F. J. Beutler and K. W. Ross, "Time-average optimal constrained semi-Markov decision processes," Adv. Appl. Prob., vol. 18, pp. 341-359. 1986.
31. D. P. Bertsekas and J. N. Tsitsiklis, Neuro-dynamic programming, Athena Scientific, Behnont, MA, 1996.
32. C. Darken, J. Chang, and J. Moody, "Learning rate schedules for faster stochastic gradient search," in Proc. IEEE Workshop on Neural Networks for Signal Processing, Sept. 1992.
33. J. Abounadi, D. Bertsekas and V. S. Borkar, "Learning algorithms for Markov decision processes with average cost," SIAM J. Contr. Optimization., vol. 40, no. 3, pp 681-198, 2001.