On-line learning and optimization for wireless video transmission

IEEE Transactions on Signal Processing

Volumn 58, Issue 6, 2010, Pages 3108-3124

  Zhang, Yu ^a   Fu, Fangwen ^a   Van Der Schaar, Mihaela ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Layered Markov decision process; Layered real time dynamic programming; On line learning; Wireless video transmission

Indexed keywords

APRIORI; CROSS LAYER OPTIMIZATION; CROSS-LAYER; DELAY SENSITIVE; ENVIRONMENT DYNAMICS; LAYERED ARCHITECTURE; MARKOV DECISION PROCESSES; MESSAGE EXCHANGE; NETWORK DYNAMICS; NUMERICAL EXPERIMENTS; ON-LINE FASHION; ON-THE-FLY; ONLINE LEARNING; REAL-TIME DYNAMICS; TRANSMISSION TIME; VIDEO SOURCES; WIRELESS CHANNEL; WIRELESS VIDEO TRANSMISSION;

COMPUTATIONAL COMPLEXITY; DYNAMICS; FADING CHANNELS; FUZZY CONTROL; IMAGE COMMUNICATION SYSTEMS; MARKOV PROCESSES; OPTIMIZATION; VIDEOTEX;

DYNAMIC PROGRAMMING;

EID: 77952577245     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2010.2046040     Document Type: Article

References (41)

1. M. Van der Schaar and S. Shankar, "Cross-layer wireless multimedia transmission: Challenges, principles, and new paradigms, " IEEE Wireless Commun. Mag., vol. 12, no. 4, Aug. 2005.
2. Multimedia Over IP and Wireless Networks: Compression, Networking, and Systems, M. van der Schaar and P. Chou, Eds. New York: Academic, 2007.
3. Q. Liu, S. Zhou, and G. B. Giannakis, "Cross-layer combingofadaptive modulation and coding with truncated ARQ over wireless links, " IEEE Trans. Wireless Commun., vol. 3, no. 5, pp. 1746-1755, May 2005.
4. Y. J. Chang, F. T. Chien, and C. C. Kuo, "Cross-layer QoS analysis of opportunistic OFDM-TDMA and OFDMA networks, " IEEE J. Sel. Areas Commun., vol. 25, no. 4, pp. 657-666, May 2007.
5. M. Van der Schaar, Y. Andreopoulos, and Z. Hu, "Optimized scalable video streaming over IEEE 802.11 a/e HCCA wireless networks under delay constraints, " IEEE Trans. Mobile Comput., vol. 5, no. 6, pp. 755-768, Jun. 2006.
6. F. Fu and M. Van der Schaar, "A new systematic framework for autonomous cross-layer optimization, " IEEE Trans. Veh. Technol., vol. 58, no. 4, pp. 1887-1903, Apr. 2009.
7. A. Albanese and M. Luby, "PET-priority encoding transmission, " in High-Speed Networking for Multimedia Application. Boston, MA: Kluwer, 1996.
8. D. S. Turaga and T. Chen, "Hierarchical modeling of variable bit rate video sources, " in Proc. 11th Packet Video Workshop, 2001.
9. Q. Zhang and S. A. Kassam, "Finite-state Markov model for Rayleigh fading channels, " IEEE Trans. Commun., vol. 47, no. 11, Nov. 1999.
10. D. Krishnaswamy, "Network-assisted link adaptation with power control and channel reassignment in wireless networks, " in Proc. 3G Wireless Conf., 2002, pp. 165-170.
11. W. Chen, U. Mitra, and M. J. Neely, "Energy-efficient scheduling with individual packet delay constraints over a fading channel, " in Wireless Networks. New York: Springer, 2008.
12. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press, 1998.
13. A. G. Barto, S. J. Bradtke, and S. P. Singh, "Learning to act using realtime dynamic programming, " in Artificial Intelligence. New York: Elsevier, 1995.
14. D. P. Bertsekas and J. N. Tsitsiklis, Parallel and Distributed Computation: Numerical Methods. Englewood Cliffs, NJ: Prentice-Hall, 1989.
15. P. Chou and Z. Miao, "Rate-distortion optimized streaming of packe-tized media, " IEEE Trans. Multimedia, vol. 8, no. 2, pp. 390-404, Apr. 2006.
16. S. Singh, T. Jaakkola, M. L. Littman, and C. Szepesvari, "Convergence results for single-step on-policy reinforcement-learning algorithms, " in Machine Learning. New York: Springer, 2000.
17. N. Mastronarde and M. Van der Schaar, "Towards a general framework for cross-layer decision making in multimedia systems, " IEEE Trans. Circuits Syst. Video Technol., to be published.
18. IEEE 802.11e/D5.0, Wireless Medium Access Control (MAC) and Physical Layer (PHY) Specifications: Medium Access Control (MAC) Enhancements for Quality of Service (QoS) Jun. 2003, draft supplement, 802.11e/D5.0.
19. C. Curescu and S. Nadjm-Tehrani, "Time-aware utility-based resource allocation in wireless networks, " IEEE Trans. Parallel Distrib., vol. 16, no. 7, pp. 624-636, May 2005. (Pubitemid 41046830)
20. L. Breiman, "Probability, classic in applied mathematics, " Soc. Indust. Appl. Math., 1992.
21. A. J. Goldsmith and S. G. Chua, "Adaptive coded modulation for fading channels, " IEEE Commun. Mag., vol. 46, pp. 595-602, May 2007.
22. Y. J. Chang, F. T. Chien, and C. C. Kuo, "Cross-layer QoS analysis of opportunistic OFDM-TDMA and OFDMA networks, " IEEE J. Sel. Areas Commun., vol. 25, no. 4, pp. 657-666, May 2007.
23. V. Srivastava and M. Motani, "Cross-layer design: A survey and the road ahead, " IEEE Commun. Mag., vol. 43, no. 12, pp. 112-119, Dec. 2005.
24. R. Hamzaoui, V. Stankovic, and Z. Xiong, "Optimized error protection of scalable image bit streams, " IEEE Signal Process. Mag., vol. 22, no. 6, pp. 91-107, Nov. 2005.
25. F. Zhai, Y. Eisenberg, and A. K. Katsaggelos, "Joint source-channel coding for video communications, " in Handbook of Image and Video Processing, 2nd ed. New York: Elsevier, 2000.
26. D. V. Djonin and V. Krishnamurthy, "Q-Learning algorithms for constrained Markov decision processes with randomized monotone policies: Application to MIMO transmission control, " IEEE Trans. Signal Process., pp. 2170-2181, 2007. (Pubitemid 46691596)
27. T. Wiegand, G. J. Sullivan, G. Bjontegaard, and A. Luthra, "Overview of the H.264/AVC video coding standard, " IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 7, pp. 560-576, Jul. 2003.
28. T. Stockhammer and M. Bystrom, "H.264/AVC data partitioning for mobile video communication, " in Proc. IEEE Int. Conf. Image Process., Singapore, Oct. 2004, pp. 545-548.
29. S. P. Boyd and L. Vandenberghe, Convex Optimization. Cambridge, U. K.: Cambridge Univ. Press, 2004.
30. T. Holliday, A. Goldsmith, and P. Glynn, "Optimal power control and source-channel coding for delay constrained traffic over wireless channels, " in Proc. IEEE Int. Conf. Commun., May 2002, pp. 831-835.
31. P. Sadeghi, R. Kennedy, P. Rapajic, and R. Shams, "Finite-state Markov modeling of fading channels, " IEEE Signal Process. Mag., vol. 25, no. 5, pp. 57-80, Sep. 2008.
32. X. Wang, Q. Liu, and G. B. Giannakis, "Analyzing and optimizing adaptive modulation coding jointly with ARQ for QoS-guaranteed traffic, " IEEE Trans. Veh. Technol., vol. 56, no. 2, Mar. 2007.
33. Y. J. Chang, F. T. Chien, and C. C. Kuo, "Cross-layer QoS analysis of opportunistic OFDM-TDMA and OFDMA networks, " IEEE J. Select. Areas Commun., vol. 25, no. 4, pp. 657-666, May 2007.
34. High-Speed Physical Layer in the 5 GHz Band, IEEE Std., 802.11a-1999, 1999.
35. V. Kawadia and P. R. Kumar, "Principles and protocols for power control in wireless ad hoc networks, " IEEE J. Sel. Areas Commun., vol. 23, no. 1, Jan. 2005.
36. D. Djonin and V. Krishnamurthy, "MIMO transmission control in fading channels-A constrained Markov decision process formulation with monotone randomized policies, " IEEE Trans. Signal Process., vol. 55, no. 10, pp. 5069-5083, Oct. 2007. (Pubitemid 47534670)
37. M. Chiang, S. H. Low, A. R. Calderbank, and J. C. Doyle, "Layering as optimization decomposition: A mathematical theory of network architectures, " Proc. IEEE, vol. 95, no. 1, pp. 255-312, Jan. 2007.
38. J. W. Lee, R. R. Mazumdar, and N. B. Shroff, "Non-convex optimization and rate control for multi-class servicesin the internet, " IEEE/ACM Trans. Netw., vol. 13, no. 4, pp. 827-840, Aug. 2005.
39. E. Maani, P. Pahalawatta, R. Berry, T. N. Pappas, and A. K. Katsaggelos, "Resource allocation for downlink multiuser video transmission over wireless lossy networks, " IEEE Trans. Image Process., vol. 17, no. 9, pp. 1663-1671, Sep. 2008.
40. B. Girod, M. Kalman, Y. Liang, and R. Zhang, "Advances in channel-adaptive video streaming, " Wireless Commun. Mobile Comput., vol. 2, no. 6, pp. 549-552, Sep. 2002.
41. H. P. Shiang and M. Van der Schaar, "Multi-user video streaming over multi-hop wireless networks: A distributed, cross-layer approach based on priority queuing, " IEEE J. Sel. Areas Commun., vol. 25, no. 4, pp. 770-785, May 2007.