Q-learning based control algorithm for HTTP adaptive streaming

2015 Visual Communications and Image Processing, VCIP 2015

Volumn , Issue , 2015, Pages

  Martin, Virginia ^a   Cabrera, Julian ^a   Garcia, Narciso ^a  

^a UNIVERSIDAD POLITÉCNICA DE MADRID   (Spain)

Author keywords

adaptation; HTTP Adaptive Streaming; policy; Quality of Experience; reinforcement learning; reward; state

Indexed keywords

ALGORITHMS; HTTP; IMAGE PROCESSING; PUBLIC POLICY; QUALITY CONTROL; QUALITY OF SERVICE; REINFORCEMENT LEARNING; VISUAL COMMUNICATION;

ADAPTATION; ADAPTIVE STREAMING; QUALITY OF EXPERIENCE (QOE); REWARD; STATE;

LEARNING ALGORITHMS;

EID: 84979066942     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/VCIP.2015.7457906     Document Type: Conference Paper

References (9)

1. Dynamic adaptive streaming over HTTP (DASH)-Part 1: Media presentation description and segment formats. http://standards.iso.org/ittf/PubliclyAvailableStandards/index.html
2. K. Miller, E. Quacchio, G. Gennari, and A. Wolisz, "Adaptation algorithm for Adaptive Streaming over HTTP," in Packet Video Workshop (PV), 2012 19th International. IEEE, 2012, pp. 173-178
3. C. Liu, I. Bouazizi, and M. Gabbouj, "Rate adaptation for adaptive http streaming," in ACM MMSys 2011, Special Session: Modern Media Transport, Dynamic Adaptive Streaming over HTTP (DASH, pp. 23-25
4. S. Garcia, J. Cabrera, and N. Garcia, "Quality-control algorithm for adaptive streaming services over wireless channels," Selected Topics in Signal Processing, IEEE Journal of, vol. 9, no. 1, pp. 50-59, Feb 2015
5. Maxim Claeys, Steven Latré and F. D. Turck, "Design of a Q-Learning-based client quality selection algorithm for HTTP adaptive video streaming," in Adaptive and Learning Agents Workshop, part of AAMAS2013 (ALA-2013), 2013, pp. 30-37
6. M. Claeys, S. Latré, J. Famaey, T. Wu, W. Van Leekwijck, and F. De Turck, "Design and optimisation of a (FA) Q-learning-based HTTP adaptive streaming client," Connection Science, vol. 26, pp. 25-43, 2014
7. C. J. C. H. Watkins, "Learning from Delayed Rewards," Ph.D. dissertation, King's College, Cambridge, UK, May 1989. [Online]. Available: http://www.cs.rhul.ac.uk/ chrisw/new thesis.pdf
8. A. G. Barto, Reinforcement learning: An introduction (Adaptive Computation and Machine Learning). MIT press, 1998
9. M. Tokic and G. Palm, "Value-difference based exploration: adaptive control between epsilon-greedy and softmax," in KI 2011: Advances in Artificial Intelligence. Springer, 2011, pp. 335-346