Adaptive Video Transmission Control System Based on Reinforcement Learning Approach over Heterogeneous Networks

IEEE Transactions on Automation Science and Engineering

Volumn 12, Issue 3, 2015, Pages 1104-1113

  Cheng, Bo ^a   Yang, Jialin ^a   Wang, Shangguang ^a   Chen, Junliang ^a  

^a BEIJING UNIVERSITY OF POSTS AND TELECOMMUNICATIONS   (China)

Author keywords

Adaptive; heterogeneous networks; neural networks; reinforcement learning; video transmission control

Indexed keywords

CONTROL SYSTEMS; HETEROGENEOUS NETWORKS; IMAGE CODING; IMAGE COMMUNICATION SYSTEMS; NEURAL NETWORKS; REINFORCEMENT LEARNING;

ADAPTIVE; ADAPTIVE METHODS; COMPRESSED VIDEO; REAL TIME NETWORK; REAL TIME VIDEOS; REAL-TIME INFORMATION; REINFORCEMENT LEARNING APPROACH; VIDEO TRANSMISSIONS;

ADAPTIVE CONTROL SYSTEMS;

EID: 85027958784     PISSN: 15455955     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASE.2014.2387212     Document Type: Article

References (25)

1. H. E. Egilmez, S. Civanlar, and A. M. Tekalp, "An optimization framework for QoS-enabled adaptive video streaming over OpenFlow networks, " IEEE Trans. Multimedia, vol. 15, no. 3, pp. 710-715, Aug. 2013.
2. W. Ji, Z. Li, and Y. Q. Chen, "Joint source-channel coding and optimization for layered video broadcasting to heterogeneous devices, " IEEE Trans. Multimedia, pp. 443-455, Jun. 2012.
3. M. Bystrom and J. W. Modestino, "Combined source-channel coding schemes for video transmission over an additive white Gaussian noise channel, " IEEE J. Sel. Areas Commun., vol. 18, no. 6, pp. 880-890, Jun. 2000.
4. E. Maani and A. K. Katsaggelos, "Unequal error protection for robust streaming of scalable video over packet lossy networks, " IEEE Trans. Circuits Syst. Video Technol., vol. 20, no. 3, pp. 407-416, Mar. 2010.
5. S. Ahmad, R. Hamzaoui, and M. Al-Akaidi, "Adaptive unicast video streaming with rateless codes and feedback, " IEEE Trans. Circuits Syst. Video Technol., vol. 20, no. 2, pp. 275-285, Feb. 2010.
6. E. Dedu, W. Ramadan, and J. Bourgeois, "A taxonomy of the parameters used by decision methods for adaptive video transmission, " Multimedia Tools and Applications, Nov. 2013, DOI 10.1007/s11042-013-176-6.
7. C. Gong and X. Wang, "Adaptive transmission for delay-constrained wireless video, " IEEE Trans. Wireless Commun., vol. 13, no. 1, pp. 49-61, Jan. 2014.
8. Y. G. Lee and B. C. Song, "An intra-frame rate control algorithm for ultralow delay H.264/advanced video coding (AVC), " IEEE Trans.Circuits Syst. Video Technol., vol. 19, no. 5, pp. 747-752, May 2009.
9. H.-P. Shiang and M. van der Schaar, "A quality-centric TCP-friendly congestion control for multimedia transmission, " IEEE Trans. Multimedia, vol. 14, no. 2, pp. 896-909, Aug. 2012.
10. S. Soltani, K. Misra, and H. Radha, "Delay constraint error control protocol for real-time video communication, " IEEE Trans.Multimedia, vol. 11, no. 4, pp. 742-751, Jun. 2009.
11. C. Greco, M. Cagnazzo, and B. Pesquet-Popescu, "Low-latency video streaming with congestion control in mobile ad-hoc networks, " IEEE Trans. Multimedia, vol. 14, no. 4, pp. 1337-1350, Aug. 2012.
12. R. J. Wang, J. T. Fang, Y. T. Jiang, and P. C. Chang, "Quantization-distortion models for interlayer predictions in H.264/SVC spatial scalability, " IEEE Trans. Broadcasting, vol. 60, no. 2, pp. 413-419, Jun. 2014.
13. J. Y. Chen, C. W. Chiu, G. L. Li, and M. J. Chen, "Burst-aware dynamic rate control for H.264/AVC video streaming, " IEEE Trans. Broadcasting, vol. 57, no. 1, pp. 89-93, Mar. 2011.
14. A. Jimenez-Moreno, E. Martinez-Enriquez, and F. Diaz-de-Maria, "Mode decision-based algorithm for complexity control in H.264/AVC, " IEEE Trans. Multimedia, vol. 15, no. 5, pp. 1094-1109, Aug. 2013.
15. J. S. Harsini and M. Zorzi, "Transmission strategy design in cognitive radio systems with primary ARQ control and QoS provisioning, " IEEE Trans. Commun., vol. 62, no. 6, pp. 1790-1802, Jun. 2014.
16. M.-J. Kim, K.-H. Kim, and M.-C. Hong, "Adaptive rate control in frame-layer for real-time H.264/AVC, " in Proc. ICACT, 2008, pp. 1875-1880.
17. K. K. R. Kambhatla, S. Kumar, S. Paluri, and P. C. Cosman, "Wireless H.264 video quality enhancement through optimal prioritized packet fragmentation, " IEEE Trans. Multimedia, vol. 14, no. 5, pp. 1480-1495, Oct. 2012.
18. Y. M. Hsiao, C. H. Chen, J. F. Lee, and Y. S. Chu, "Designing and implementing a scalable video-streaming system using an adaptive control scheme, " IEEE Trans. Consumer Electron., vol. 58, no. 4, pp. 1314-1322, Nov. 2012.
19. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, "Image quality assessment: From error visibility to structural similarity, " IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, Apr. 2004.
20. L. P. Kaelbling, M. L. Littman, and A. W. Moore, "Reinforcement learning: A survey, " J. Artif. Intelligence Res., pp. 237-285, May 1996.
21. G. A. Rummery, "Problem solving with reinforcement learning, " Ph.D. dissertation, Eng. Dept., Cambridge University, Cambridge, U.K., 1995.
22. S. H. Robert, N. Y. Philip, and G. Maria, "Martini medical QoS provision based on reinforcement learning in ultrasound streaming over 3.5G wireless systems, " IEEE J. Sel. Areas Commun., vol. 27, no. 4, pp. 566-574, May 2009.
23. S. K. Pradhan and B. Subudhi, "Real-time adaptive control of a flexible manipulator using reinforcement learning, " IEEE Trans. Autom. Sci. Eng., vol. 9, no. 2, pp. 237-249, Apr. 2012.
24. N. Mastronarde and M. van der Schaar, "Fast reinforcement learning for energy-efficient wireless communication, " IEEE Trans. Signal Process., vol. 59, no. 12, pp. 6262-6266, Dec. 2011.
25. Q. M. Yang and S. Jagannathan, "Reinforcement learning controller design for affine nonlinear discrete-time systems using online approximators, " IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 42, no. 2, pp. 377-390, Apr. 2012.