Online learning for QoE-based video streaming to mobile receivers

2012 IEEE Globecom Workshops, GC Wkshps 2012

Volumn , Issue , 2012, Pages 1319-1324

  Changuel, Nesrine ^a   Sayadi, Bessem ^a   Kieffer, Michel ^b,c  

^a LUCENT TECHNOLOGIES   (United States)

^b UNIV PARIS SUD   (France)

^c INSTITUT TELECOM   (France)

Author keywords

Cross layer optimization; learning; QoE estimation; stochastic control; video streaming

Indexed keywords

CONTROL MECHANISM; CONTROL PROBLEMS; CROSS LAYER OPTIMIZATION; LEARNING; MARKOV DECISION PROCESSES; MEDIUM ACCESS CONTROL LAYER; PERFORMANCE DEGRADATION; STOCHASTIC CONTROL;

MARKOV PROCESSES; MEDIUM ACCESS CONTROL; OPTIMIZATION; REINFORCEMENT LEARNING;

VIDEO STREAMING;

EID: 84875647342     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/GLOCOMW.2012.6477773     Document Type: Conference Paper

References (27)

1. N. Amram, B. Fu, G. Kunzmann, T. Melia, D. Munaretto, S. Randriamasy, B. Sayadi, J. Widmer, and M. Zorzi, "QoE-based transport optimization for video delivery over next generation cellular networks," in IEEE SCC, Kerkyra, 2011, pp. 19-24.
2. R. Sutton and A. Barto, Reinforcement Learning: An Introduction. MIT Press, 1998.
3. P. de Cuetos and K. Ross, "Optimal streaming of layered video: joint scheduling and error concealment," in ACM MM, Berkeley, 2003, pp. 2-8.
4. F. Fu and M. Van der Schaar, "Structural solutions to dynamic scheduling for multimedia transmission in unknown wireless environments," Multimedia Systems and Applications Papers in Computer and Information Science, vol. abs/1008.4406, 2010.
5. H. Chi-Yuan, A. Ortega, and M. Khansari, "Rate control for robust video transmission over burst-error wireless channels," IEEE JSAC, vol. 17, no. 5, pp. 756-773, 1999.
6. W. Kumwilaisak, Y. Hou, Q. Zhang, W. Zhu, C.-C. Kuo, and Y.-Q. Zhang, "A cross-layer quality-of-service mapping architecture for video delivery in wireless networks," IEEE JSAC, vol. 21, no. 10, pp. 1685-1698, December 2003.
7. N. Changuel, C. Mastronarde, M. van der Shaar, B. sayadi, and M. kieffer, "End-to-end stochastic scheduling of scalable video over time-varying channels," in ACM MM, Florence, 2010, pp. 731-734.
8. S. Thakolsri and W. Kellerer, "QoE-based rate adaptation scheme selection for resource-constrained wireless video transmission," in ACM MM, Florence, 2010, pp. 783-786.
9. G. Liebl, H. Jenkac, T. Stockhammer, and C. Buchner, "Radio link buffer management and scheduling for wireless video streaming," in PV Workshop, Irvine, 2004, pp. 255-277.
10. Z. Orlov and M. C. Necker, "Enhancement of video streaming QoS with active buffer management in wireless environments," in Proc EW, Paris, 2007.
11. S. Yerima and K. Al-Begain, "Dynamic buffer management for multimedia qos in beyond 3G wireless networks," IJCS, vol. 36, no. 4, pp. 378-387, November 2009.
12. H. Schulzrinne and S. Casner, RTP profile for audo and video conferences with minimal control, IETF, July 2003, rFC 3551.
13. S. Sesia, I. Toufik, and M. Baker, LTE, The UMTS Long Term Evolution: From theory to practice. Wiley, February 2009.
14. E. Altman and P. Nain, "Closed-loop control with delayed information," in ACM SIGMETRICS, New York, June 1992, pp. 193-204.
15. T. J. Walsh, A. Nouri, L. Li, and L. M. L., "Learning and planning in environments with delayed feedback," AAMAS, vol. 18, no. 1, pp. 83-105, August 2009.
16. N. Changuel, N. Mastronarde, M. van der Schaar, B. Sayadi, and M. Kieffer, "Adaptive scalable layer filtering process for video scheduling over wireless networks based on MAC buffer management," in IEEE ICASSP, Prague, 2011, pp. 2352-2355.
17. H. Fattah and C. Leung, "An overview of scheduling algorithms in wireless multimedia networks," IEEE Wireless Communications, vol. 9, no. 5, pp. 76-83, October 2002. (Pubitemid 35468366)
18. W. Ajib and D. Haccoun, "An overview of scheduling algorithms in MIMO-based fourth-generation wireless systems," IEEE Network, vol. 19, no. 5, pp. 43-48, September 2005. (Pubitemid 41520183)
19. D. Turaga and T. Chen, "Hierarchical modeling of variable bit rate video sources," in PV Workshop, Kyongju, 2001.
20. J. Cabrera, A. Ortega, and J. Ronda, "Stochastic rate-control of video coders for wireless channels," IEEE trans. on circuits and systems for video technology, vol. 12, no. 6, pp. 496-510, June 2002. (Pubitemid 34835368)
21. ITU-T, "Objective perceptual multimedia video quality measurement in the presence of a full reference," ITU-T Rec. J.247 (08/08), Tech. Rep. Rec. J.247, 2008.
22. G. J. Sullivan and T. Wiegand, "Rate-distortion optimization for video compression," IEEE Signal Processing Magazine, vol. 15, no. 6, pp. 74-90, November 1998.
23. G. Winkler, Image Analysis, Random Fields and Dynamic Monte Carlo Methods: A Mathematical Introduction, 2nd ed., S. Verlag, Ed. Springer, 2005, vol. 27 of Applications of Mathematics.
24. K. Singh, A. Ksentini, and B. Marienval, "Quality of experience measurement tool for svc video coding," in IEEE ICC, 2011, pp. 1-5.
25. Z. Wu and J. M. Boyce, "An error concealment scheme for entire frame losses based on H.264/AVC," in IEEE ISCS, Kos, 2006, pp. 1-4.
26. J. Vieron, M. Wien, and H. Schwarz, JSVM9 software, Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG, JVT-V203, January 2007.
27. "Radio link control (RLC) protocol specification (release 5)," 3GPP TS 25.322 V5.12.0, Tech. Rep., 2005.