Advances in efficient resource allocation for packet-based real-time video transmission

Proceedings of the IEEE

Volumn 93, Issue 1, 2005, Pages 135-146

  Katsaggelos, Aggelos K ^a   Eisenberg, Yiftach ^a   Zhai, Fan ^a,b   Berry, Randall ^a   Pappas, Thrasyvoulos N ^a  

^a Northwestern University   (United States)

^b TEXAS INSTRUMENTS   (United States)

Author keywords

Cross layer design; Distortion estimation; Energy efficient; Error resilience; Internet video; Wireless video

Indexed keywords

COMMUNICATION CHANNELS (INFORMATION THEORY); COMPUTER SIMULATION; ENERGY EFFICIENCY; ERRORS; IMAGE CODING; IMAGE COMMUNICATION SYSTEMS; IMAGE QUALITY; INTERNET; MULTIMEDIA SYSTEMS; NETWORK PROTOCOLS; PACKET NETWORKS; QUALITY OF SERVICE; REAL TIME SYSTEMS; RESOURCE ALLOCATION; WIRELESS TELECOMMUNICATION SYSTEMS;

CROSS-LAYER DESIGN; DISTORTION ESTIMATION; ENERGY EFFICIENT; ERROR RESILIENCE; INTERNET VIDEO; WIRELESS VIDEO;

VIDEO SIGNAL PROCESSING;

EID: 15844375649     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/JPROC.2004.839621     Document Type: Article

References (81)

1. D. Wu, Y. T. Hou, and Y.-Q. Zhang, "Transporting real-time video over the Internet: Challenges and approaches," Proc. IEEE, vol. 88, no. 12, pp. 1855-1877, Dec. 2000.
2. B. Girod, J. Chakareski, M. Kalman, Y. J. Lang, E. Setton, and R. Zhang, "Advances in network-adaptive video streaming," presented at the Tyrrhenian Int. Workshop Digital Communications, Capri, Italy, Sept. 2002, pp. 1-8.
3. H. Zheng, "Optimizing wireless multimedia transmission through cross layer design," in Proc. ICME, Baltimore, MD, July 2003, pp. 185-188.
4. G. J. Conklin, G. S. Greenbaum, K. O. Lillevold, A. F. Lippman, and Y. A. Reznik, "Video coding for streaming media delivery on the Internet," IEEE Trans. Circuits Syst, Video Technol., vol. 11, no. 3, pp. 269-281, Mar. 2001.
5. P. A. Chou and Z. Miao, "Rate-distortion optimized streaming of packetized media,", 2001, submitted for publication.
6. S. MeCanne, M. Vetterli, and V. Jacobson, "Low-complexity video coding for receiver-driven layered multicast," IEEE J. Sel. Areas Commun., vol. 15, no. 6, pp. 983-1001, Aug. 1997.
7. P. A. Chou, A. E. Mohr, A. Wang, and S. Mehrotra, "Error control for receiver-driven layered multicast of audio and video," IEEE Trans. Multimedia, vol. 3, no. 1, pp. 108-122, Mar. 2001.
8. O. Sullivan and T. Wiegand, "Video compression - From concepts to the H.264/AVC standard," in Proc. IEEE, vol. 93, 2005, pp. 18-31.
9. J. Ohm, "Advances in scalable video coding," in Proc. IEEE, vol. 93, 2005, pp. 42-56.
10. Y. Wang, A. R. Reibman, and S. Lin, "Multiple description coding for video delivery," in Proc. IEEE, vol. 93, 2005, pp. 57-70.
11. Y. Wang, G. Wen, S. Wenger, and A. K. Katsaggelos, "Error resilient video coding techniques," IEEE Signal Process. Mag., vol. 17, pp. 61-82, July 2000.
12. Video Coding for Low Bitrate Communications, ITU, ITU Telecom. Standardization Sector of ITU, Draft ITU-T Recommendation H.263 Version 2, Sept. 1997.
13. Information Technology - Generic Coding of Audio-Visual Objects, July 1999. ISO/IEC 14496-2.
14. W. M. Lam, A. R. Reibman, and B. Liu, "Recovery of lost or erroneously received motion vectors," Proc. SPIE Visual Comm. Image Processing, pp. V417-V420.
15. M. C. Hong, L. Kondi, H. Scwab, and A. K. Katsaggelos, "Video error concealment techniques," Signal Process.: Image Communications, vol. 14, no. 6-8, pp. 437-492, 1999.
16. H. Sun and W. Kwok, "Concealment of damaged block transform coded images using projection onto convex sets," in IEEE Trans. Image Process., Apr. 1995, pp. 470-477.
17. S. Belfiore, M. Grangetto, E. Magli, and G. Olmo, "Spatio-temporal video error concealment with perceptually optimized mode selection," in Proc. ICME, Baltimore, MD, July 2003, pp. 169-172.
18. Y. Wang and Q.-F. Zhu, "Error control and concealment for video communication: A review," Proc. IEEE, vol. 86, no. 5, pp. 974-997, May 1998.
19. C. Y. Hsu, A. Ortega, and M. Khansari, "Rate control for robust video transmission over burst-error wireless channels," IEEE J. Select. Areas Comm., vol. 17, no. 5, pp. 756-773, May 1999.
20. F. Adler, "Minimum energy cost of an observation," IRE Trans. Inform. Theory, vol. IT-2, pp. 28-32, 1955.
21. R. G. Gallager, "Energy Limited Channels: Coding, Multi-Access, and Spread Spectrum," Massachusetts Insy. Technol., Cambridge, LIDS Rep. LIDS-P-1714, Nov. 1987.
22. E. Uysal-Biyikoglu, B. Prabhakar, and A. El Gamal, "Energy-efficient packet transmission over a wireless link," IEEE Trans. Networking, vol. 10, no. 8, pp. 487-499, Aug. 2002.
23. M. Luby et al., "Practical loss-resilient codes," presented at the 29th ACM Symp Theory of Computing, Atlanta, GA, 1997.
24. F. Zhai, Y. Eisenberg, C. E. Luna, T. N. Pappas, R. Berry, and A. K. Katsaggelos, "Packetization schemes for forward error correction in internet video streaming," presented at the 41st Allerton Conf. Communication, Control, and Computing, Monticello, IL, Oct. 2003.
25. F. Hartanto and H. R. Sirisena, "Hybrid error control mechanism for video transmission in the wireless IP networks," presented at the IEEE 10th Workshop Local and Metropolitan Area Networks (LANMAN'99), Sydney, Australia, Nov. 1999.
26. S. Falahati, A. Svensson, N. C. Ericsson, and A. Ahlen, "Hybrid type-II ARQ/AMS and scheduling using channel prediction for downlink packet transmission on fading channels," presented at the Nordic Radio Symp., Nanashamn, Sweden, 2001.
27. F. Zhai, Y. Eisenberg, T. N. Pappas, R. Berry, and A. K. Katsaggelos, "Rate-distortion optimized hybrid error control for real-time packetized video transmission," in Proc. IEEE Int. Conf. Commun. (ICC), Paris, France, 2004, pp. 1318-1322.
28. F. Zhai, C. Luna, Y. Eisenberg, T. N. Pappas, R. Berry, and A. K. Katsaggelos, "Joint source coding and packet classification for real-time video transmission over differentiated services networks," IEEE Trans. Multimedia, submitted for publication.
29. Q. Zhang, W. Zhu, and Y.-Q. Zhang, "Resource allocation for multimedia streaming over the internet," IEEE Trans. Multimedia, vol. 3, no. 3, pp. 339-355, Sept. 2001.
30. S. Blake et al., An Architecture for Differentiated Services, IETF, RFC 2475, Dec. 1998.
31. Y. Eisenberg, C. E. Luna, T. N. Pappas, R. Berry, and A. K. Katsaggelos, "Joint source coding and transmission power management for energy efficient wireless video communications," IEEE Trans. Circuits Syst, Video Technol., vol. 12, no. 6, pp. 411-424, June 2002.
32. L. Ozarow, S. Shamai, and A. D. Wyner, "Information theoretic considerations for cellular mobile radio," IEEE Trans. Veh. Technol., no. 2, pp. 359-378, May 1994.
33. F. Zhai, Y. Eisenberg, T. N. Pappas, R. Berry, and A. K. Katsaggelos, "Joint source-channel coding and power allocation for energy efficient wireless video communications," in Proc. 41st Allerton Conf. Communication, Control, and Computing, Monticello, IL, Oct. 2003.
34. S. Nanda, K. Balachandran, and S. Kumar, "Adaptation techniques in wireless packet data services," IEEE Commun. Mag., vol. 38, no. 1, pp. 54-64, Jan. 2000.
35. C. E. Luna, Y. Eisenberg, T. N. Pappas, R. Berry, and A. K. Katsaggelos, "Joint source coding and data rate adaptation for energy efficient wireless video streaming," IEEE J. Sel. Areas Commun., vol. 21, no. 10, pp. 1710-1720, Dec. 2003.
36. R. O. Hinds, T. N. Pappas, and J. S. Lim, "Joint block-based video source/channel coding for packet-switched networks," Proc. SPIE, vol. 3309, pp. 124-133, Jan. 1998.
37. T. Stockhammer, T. Wiegand, and S. Wenger, "Optimized transmission of H.26L/JVT coded video over packet-lossy networks," in Proc. ICIP, Rochester, NY, 2002, pp. 173-176.
38. R. O. Hinds, "Robust mode selection for block-motion-compensated video encoding," Ph.D. dissertation, Massachusetts Inst. Technol, Cambridge, MA, 1999.
39. R. Zhang, S. L. Regunathan, and K. Rose, "Video coding with optimal inter/intra-mode switching for packet loss resilience," IEEE J. Sel. Areas Commun., no. 6, pp. 966-976, June 2000.
40. D. Wu, Y. T. Hou, B. Li, W. Zhu, Y.-Q. Zhang, and H. J. Chao, "An end-to-end approach for optimal mode selection in Internet video communication: Theory and application," IEEE J. Select. Areas Commun., vol. 18, no. 6, pp. 977-995, June 2000.
41. A. Leontaris and P. C. Cosman, "Video compression with intra/inter mode switching and a dual frame buffer," presented at the IEEE Data Compression Conf., Snowbird, UT, Mar. 25-27, 2003.
42. H. Yang and K. Rose, "Recursive end-to-end distortion estimation with model-based cross-correlation approximation," presented at the ICIP, Barcelona, Spain, Sept. 2003.
43. G. Cote, S. Shirani, and F. Kossentini, "Optimal mode selection and synchronization for robust video communications over error-prone networks," IEEE J. Sel. Areas Commun., vol. 18, no. 6, pp. 952-965, June 2000.
44. T. Wiegand, N. Farber, K. Stuhlmuller, and B. Girod, "Error- resilient video transmission using long-term memory motion-compensated prediction," IEEE J. Sel. Areas Commun., vol. 18, no. 6, pp. 1050-1062, June 2000.
45. Y. J. Liang, J. Apostolopoulos, and B. Girod, "Analysis of packet loss for compressed video: Does burst-length matter," in Proc. ICASSP, vol. 5, Hong Kong, China, 2003, pp. 684-687.
46. J. Chakareski, J. Apostolopoulos, W. Tan, S. Wee, and B. Girod, "Distortion chains for predicting the video distortion for general packet loss patterns," in Proc. ICASSP, QC, Canada, 2004.
47. Z. He, J. Cai, and C. W. Chen, "Joint source channel rate-distortion analysis for adaptive mode selection and rate control in wireless video coding," IEEE Trans. Circuits Syst. Video Technol., vol. 12, no. 6, pp. 511-523, June 2002.
48. G. M. Schuster, G. Melnikov, and A. K. Katsaggelos, "A review of the minimum maximum criterion for optimal bit allocation among dependent quantizers," IEEE Trans. Multimedia, vol. 1, no. 1, pp. 3-17, Mar. 1999.
49. Y. Eisenberg, C. E. Luna, T. N. Pappas, R. Berry, and A. K. Katsaggelos, "Optimal source coding and transmission power management using a min-max expected distortion approach," in Proc. ICIP, Rochester, NY, 2002, pp. 537-540.
50. A. R. Reibman and B. G. Haskell, "Constraints on variable bit-rate video for ATM networks," IEEE Trans. Circuits Syst, Video Technol., vol. 2, no. 4, pp. 361-372, Dec. 1992.
51. Y. Sermadevi, M. Masry, and S. S. Hemami, "MINMAX rate control with a perceived distortion metric," presented at the SPIE Conf. Visual Communications and Image Process., San Jose, CA, Jan. 2004.
52. A. Munteanu, Y. Andreopoulos, M. van der Schaar, P. Schelkens, and J. Cornelis, "Control of the distortion variation in video coding systems based on motion compensated temporal filtering," presented at the ICIP, Barcelona, Spain, Sept. 2003.
53. Y. Eisenberg, F. Zhai, C. E. Luna, T. N. Pappas, R. Berry, and A. K. Katsaggelos, "Variance-aware distortion estimation for wireless video communications," presented at the ICIP, Barcelona, Spain, Sept. 2003.
54. _, "VAPOR: Variance-aware per-pixel optimal resource allocation," IEEE Trans. Image Process., submitted for publication.
55. G. M. Schuster and A. K. Katsaggelos, Rate-Distortion Based Video Compression: Optimal Video Frame Compression and Object Boundary Encoding. Norwell, MA: Kluwer, 1997.
56. A. Ortega and K. Ramchandran, "Rate-distortion methods for image and video compression," IEEE Signal Process. Mag., vol. 15, no. 6, pp. 23-50, Nov. 1998.
57. R. Fletcher, Practical Methods of Optimization, 2nd ed. New York: Wiley, 1987.
58. J. Wen and J. Villasenor, "Reversible variable length codes for robust image and video transmission," presented at the Asilomar, Pacific Grove, CA, Nov. 1997.
59. J. Liao and J. Villasenor, "Adaptive intra update for video coding over noisy channels," presented at the ICIP, Laussane, Switzerland, Oct. 1996.
60. P. Haskell and D. Messerschmitt, "Resynchronization of motion-compensated video affected by ATM cell loss," in Proc. ICASSP, vol. 3, 1992, pp. 545-548.
61. K. Stuhlmuller, N. Farber, M. Link, and B. Girod, "Analysis of video transmission over lossy channels," IEEE J. Sel. Areas Commun., vol. 18, no. 6, pp. 1012-1032, June 2000.
62. T. Fukuhara, K. Asai, and T. Murakami, "Very low bit-rate video coding with block partitioning and adaptive selection of two time-differential frame memories," IEEE Trans. Circuits Syst, Video Technol., vol. 7, no. 1, pp. 212-220, Feb. 1997.
63. M. Budagavi and J. D. Gibson, "Multiframe video coding for improved performance over wireless channels," IEEE Trans. Image Process., vol. 10, no. 2, pp. 252-265, Feb. 2001.
64. B. Girod and N. Farber, "Wireless video," in Compressed Video Over Networks, M.-T. Sun and A. R. Reibman, Eds. New York: Marcell-Dekker, 2001, pp. 465-511.
65. D. Wu, Y. T. Hou, and Y.-Q. Zhang, "Scalable video coding and transport over broad-band wireless networks," in Proc. IEEE, vol. 89, Jan. 2001, pp. 6-20.
66. S. Zhao, Z. Xiong, and X. Wang, "Joint error control and power allocation for video transmission over CDMA networks with multiuser detection," IEEE Trans. Circuits Syst, Video Technol., vol. 12, no. 6, pp. 425-437, June 2002.
67. I.-M. Kim and H.-M. Kim, "A new resource allocation scheme based on a PSNR criterion for wireless video transmission to stationary receivers over gaussian channels," IEEE Trans. Wireless Comm., vol. 1, no. 3, pp. 393-401, July 2002.
68. Y. S. Chan and J. W. Modestino, "Transport of scalable video over CDMA wireless networks: A joint source coding and power control approach," in Proc. ICIP, 2001, pp. 973-976.
69. Q. Zhang, Z. Ji, W. Zhu, and Y.-Q. Zhang, "Power-minimized bit allocation for video communication over wireless channels," IEEE Trans. Circuits Syst, Video Technol., vol. 12, no. 6, pp. 398-410, June 2002.
70. S. Appadwedula, M. Goel, N. R. Shanbhag, D. L. Jones, and K. Ramchandran, "Total system energy minimization for wireless image transmission," J. VLSI Signal. Process., pp. 99-117, Feb. 2001.
71. R. Puri and K. Ramchandran, "PRISM: A "reversed" multimedia coding paradigm," presented at the ICIP, Barcelona, Spain, Sept. 2003.
72. A. Aaron, E. Setton, and B. Girod, "Toward practical Wyner-Ziv coding of video," presented at the ICIP, Barcelona, Spain, Sept. 2003.
73. M. Gallant and F. Kossentini, "Rate-distortion optimized layered coding with unequal error protection for robust Internet video," IEEE Trans. Circuits Syst. Video Tehnol., vol. 11, no. 3, pp. 357-372, Mar. 2001.
74. R. Zhang, S. L. Regunathan, and K. Rose, "End-to-end distortion estimation for RD-based robust delivery of pre-compressed video," presented at the 35th Asilomar Conf. on Signals, Systems, and Computers, Pacific Grove, CA, Oct. 2001.
75. J. Shin, J. W. Kim, and C.-C. Kuo, "Quality-of-service mapping mechanism for packet video in differentiated services network," IEEE Trans. Multimedia, vol. 3, no. 2, pp. 219-231, June 2001.
76. D. Quaglia and J. C. De Martin, "Adaptive packet classification for constant perceptual quality of service delivery of video streams over time-varying networks," in Proc. ICME, vol. 3, Baltimore, MD, July 2003, pp. 369-372.
77. A. Sehgal and P. A. Chou, "Cost-distortion optimized streaming media over DiffServ networks," in Proc. ICME, vol. 1, Lausanne, Switzerland, Aug. 2002, pp. 857-860.
78. C. E. Luna, Y. Eisenberg, R. Berry, T. N. Pappas, and A. K. Katsaggelos, "Joint source coding and packet marking for video transmission over Diffserv networks," presented at the Tyrrhenian Int. Workshop Digital Communications, Capri, Italy, Sept. 2002.
79. G. Cheung, W. Tan, and T. Yoshimura, "Rate-distortion optimized application-level retransmission using streaming agent for video streaming over 3G wireless network," in Proc. ICIP, Rochester, NY, 2002, pp. I 529-I 532.
80. J. Chakareski and P. A. Chou, "Application layer error correction coding for rate-distortion optimized streaming to wireless clients," presented at the ICASSP, Orlando, FL, 2002.
81. F. Zhai, Y. Eisenberg, T. N. Pappas, R. Berry, and A. K. Katsaggelos, "Rate-distortion optimized product code forward error correction for video transmission over IP-based wireless networks," presented at the ICASSP, QC, Canada, May 2004.