Rate-distortion optimized streaming of packetized media

IEEE Transactions on Multimedia

Volumn 8, Issue 2, 2006, Pages 390-404

  Miao, Zhourong ^a,b  

^a IEEE   (United States)

^b SONY CORPORATION   (Japan)

Author keywords

Audio coding; Channel coding; Error correction; Internet; Markov processes; Multimedia communication; Optimal control; Protocols; Video coding

Indexed keywords

AUDIO CODING; CHANNEL CODING; MULTIMEDIA COMMUNICATION;

ALGORITHMS; DATABASE SYSTEMS; ERROR CORRECTION; IMAGE CODING; INTERNET; ITERATIVE METHODS; MARKOV PROCESSES; NETWORK PROTOCOLS; OPTIMAL CONTROL SYSTEMS; PACKET NETWORKS;

MULTIMEDIA SYSTEMS;

EID: 33645158811     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2005.864313     Document Type: Article

References (101)

1. P. A. Chou, A. E. Mohr, A. Wang, and S. Mehrotra, "FEC and pseudo-ARQ for receiver-driven layered multicast of audio and video," in Proc. Data Compression Conf.. Snowbird, UT, Mar. 2000, pp. 440-449.
2. _, "Error control for receiver-driven layered multicast of audio and video," IEEE Trans. Multimedia, vol. 3, no. 1, pp. 108-122, Mar. 2001.
3. Z. Miao and A. Ortega, "Optimal scheduling for streaming of scalable media," in Proc. Asilomar Conf. Signals, Systems, and Computers, vol. 2, Pacific Grove, CA, Nov. 2000, pp. 1357-1362.
4. Z. Miao, "Algorithms for streaming, caching and storage of digital media," Ph.D. dissertation, Univ. Southern California, Los Angeles, May 2002.
5. Z. Miao and A. Ortega, "Expected run-time distortion based scheduling for delivery of scalable media," in Proc. Int. Packet Video Workshop, Pittsburgh, PA, Apr. 2002.
6. J. Zhou and J. Li, "Scalable audio streaming over the Internet with network-aware rate-distortion optimization," in Proc. IEEE Int. Conf. Multimedia Exh. (ICME), Tokyo, Japan, Aug. 2001.
7. M. Podolsky, S. McCanne, and M. Vetterli, "Soft ARQ for layered streaming media," Univ. California, Comput. Sci. Div., Berkeley, Tech. Rep. UCB/CSD-98-1024, Nov. 1998.
8. _, "Soft ARQ for layered streaming media," J. VLSI Signal Process. Syst. Signal, Image Video Technol., Special Issue on Multimedia Signal Processing, vol. 27, no. 1-2, pp. 81-97, Feb. 2001.
9. V. Chande, H. Jafarkhani, and N. Farvardin, "Joint source-channel coding of images for channels with feedback," in Proc. IEEE Information Theory Workshop, San Diego, CA, Feb. 1998.
10. S. D. Servetto, "Compression and reliable transmission of digital image and video signals," Ph.D. dissertation, Univ. Illinois, Urbana-Champaign, 1999.
11. A. Ortega, K. Ramchandran, and M. Vetterli, "Optimal trellis-based buffered compression and fast approximation," IEEE Trans. Image Process., vol. 3, no. 1, pp. 26-40, Jan. 1994.
12. C.-Y. Hsu, A. Ortega, and A. Reibman, "Joint selection of source and channel rate for VBR video transmission under ATM policing constraints," IEEE J. Sel. Areas Commun., vol. 15, no. 5, pp. 1016-1028, Aug. 1997.
13. J.-J. Chen and D. W. Lin, "Optimal bit allocation for coding of video signals over ATM networks," IEEE J. Sel. Areas Commun., vol. 15, no. 6, pp. 1002-1015, Aug. 1997.
14. D. A. Turner and K. W. Ross, "Optimal streaming of layer-encoded multimedia presentations," in Proc. IEEE ICME, New York, NY, Jul. 2000.
15. I. Busse, B. Deffner, and H. Schulzrinne, "Dynamic QoS control of multimedia applications based on RTF," in First int. Workshop on High Speed Networks and Open Distributed Platforms, St. Petersburg, Russia, Jun. 1995.
16. H. Song, J. Kim, and C.-C. J. Kuo, "Real-time encoding frame rate control for H.263+ video over the Internet," Signal Process.: Image Commun., vol. 15, no. 1-2, pp. 127-148, Sep. 1999.
17. K. Chawla, Z. Jiang, X. Qiu, and A. Reibman, "Transmission of streaming video over an EGPRS wireless network," in Proc. IEEE ICME, New York, Jul. 2000.
18. A. Reibman, Y. Wang, X. Qiu, Z. Jiang, and K. Chawla, "Transmission of multiple description and layered video over an EGPRS wireless network," in Proc. Int. Conf. Image Processing (ICIP), vol. 2, Vancouver, BC, Canada, Oct. 2000, pp. 136-139.
19. T. Tian, A. H. Li, J. Wen, and J. D. Villasenor, "Prority dropping in network transmission of scalable video," in Proc. ICIP, vol. 3, Vancouver, BC, Canada, Oct. 2000, pp. 400-403.
20. P.-C. Hu, Z.-L. Zhang, and M. Kaveh, "Channel condition ARQ rate control for real-time wireless video under buffer constraints," in Proc. ICIP, vol. 2, Vancouver, BC, Canada, Oct. 2000, pp. 124-127.
21. A. Albanese, J. Blomer, J. Edmonds, M. Luby, and M. Sudan, "Priority encoding transmission," IEEE Trans. Inform. Theory, vol. 42, pp. 1737-1744, Nov. 1996.
22. G. Davis and J. Danskin, "Joint source and channel coding for image transmission over lossy packet networks," in Proc. SPIE Conf. Wavelet Applications to Digital Image Process.. Denver, CO, Aug. 1996.
23. J. M. Boyce, "Packet loss resilient transmission of MPEG video over the Internet," Signal Process.: Image Commun., vol. 15, no. 1-2, pp. 7-24, Sep. 1999.
24. U. Horn, K. Stuhlmiiller, M. Link, and B. Girod, "Robust Internet video transmission based on scalable coding and unequal error protection," Signal Process.: Image Commun., vol. 15, no. 1-2, pp. 77-94, Sep. 1999.
25. A. E. Mohr, E. A. Riskin, and R. E. Ladner, "Graceful degradation over packet erasure channels through forward error correction," in Proc. Data Compression Conf. Snowbird, UT, Mar. 1999, pp. 92-101.
26. _, "Unequal loss protection: Graceful degradation of image quality over packet erasure channels through forward error correction," IEEE J. Sel. Areas Commun., vol. 18, no. 6, pp. 819-829, Jun. 2000.
27. R. Puri and K. Ramchandran, "Multiple description source coding through forward error correction codes," in Proc. Asilomar Conf Signals, Systems, and Computers, vol. 1. Asilomar, CA, Oct. 1999, pp. 342-346.
28. W. Zhu, Q. Zhang, and Y.-Q. Zhang, "Network-adaptive rate control with unequal loss protection for scalable video over Internet," in Proc. IEEEInt. Symp. Circuits and Systems, Sydney, NSW, May 2001.
29. Q. Zhang, G. Wang, W. Zhu, and Y.-Q. Zhang, "Robust scalable video streaming over Internet with network-adaptive congestion control and unequal loss protection," in Proc. EURASIP/IEEEInt. Packet Video Workshop, Kyongju, Korea, Apr. 2001.
30. P. A. Chou and K. Ramchandran, "Clustering source/channel rate allocations for receiver-driven multicast with error control under a limited number of streams," in Proc. ICME, vol. 3, New York, Jul. 2000, pp. 1221-1224.
31. A. E. Mohr, R. E. Ladner, and E. A. Riskin, "Approximately optimal assignment for unequal loss protection," in Proc. ICIP. Vancouver, BC, Canada, Sep. 2000.
32. D. G. Sachs, R. Anand, and K. Ramchandran, "Wireless image transmission using multiple-description based concatenated codes," in Proc. SPIE Visual Commun. and Image Process., vol. 3974, San Jose, CA, Jan. 2000, pp. 300-311.
33. T. Stockhammer and C. Buchner, "Progressive texture video streaming for lossy packet networks," in Proc. EURASIP/IEEEInt. Packet Video Workshop, Kyongju, Korea, Apr. 2001.
34. V. Stankovic, R. Hamzaoui, and Z. Xiong, "Packet loss protection of embedded data with fast local search," in Proc. ICIP, Rochester, NY, Sep. 2002.
35. S. Dumitrescu, X. Wu, and Z. Wang, "Globally optimal uneven error-protected packetization of scalable code streams," IEEE Trans. Multimedia, vol. 6, no. 2, pp. 230-239, Apr. 2004.
36. J. Lu, A. Nosratinia, and B. Aazhang, "Progressive source-channel coding of images over bursty error channels," in Proc. ICIP, Chicago, IL, Oct. 1998.
37. M. J. Ruf and J. W. Modestino, "Operational rate-distortion performance for joint source and channel coding of images," IEEE Trans. Image Process., vol. 8, no. 3, pp. 305-320, Mar. 1999.
38. V. Chande and N. Farvardin, "Progressive transmission of images over memoryless noisy channels," IEEE J. Sel. Areas Commun., vol. 18, no. 6, pp. 850-860, Jun. 2000.
39. J.-C. Bolot and A. Vega-Garcia. The case for FEC-based error control for packet audio in the Internet. [Online], Available: http://www-sop.inria.fr/ rodeo/personnel/bolot/papers.html
40. M. Podolsky, C. Romer, and S. McCanne, "Simulation of FEC-based error control for packet audio on the internet," in Proc. IEEE Infocom, San Francsico, CA, Mar. 1998.
41. J. Bolot, S. Fosse-Parisis, and D. Towsley, "Adaptive FEC-based error control for interactive audio on the Internet," in Proc. IEEE Infocom, New York, Mar. 1999.
42. W. Jiang and A. Ortega, "Multiple description coding via polyphase transform and selective quantization," in Proc. SPIE Visual Commun. and Image Process., San Jose, CA, Jan. 1999.
43. A. C. Miguel, A. E. Mohr, and E. A. Riskin, "SPIHT for generalized multiple description coding," in Proc. ICIP, Kobe, Japan, Oct. 1999.
44. S. Mehrotra, "Multiple description coding using overcomplete linear expansions," Ph.D. dissertation, Stanford Univ., Stanford, CA, Jun. 2000.
45. C. Papadopoulos and G. M. Parulkar, "Retransmission-based error control for continuous media applications," in Proc. Int. Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV), Zushi, Japan, Jul. 1996.
46. G. Carle and E. W. Biersack, "Survey of error recovery techniques for IP-based audio-visual multicast applications," IEEE Network Mag., vol. 11, no. 6, pp. 24-36, Nov. 1997.
47. X. Li, S. Paul, P. Pancha, and M. H. Ammar, "Layered video multicast with retransmissions (LVMR)," in Proc. Int. Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV), St. Louis, MO, May 1997.
48. H. Radha, Y. Chen, K. Parthasarathy, and R. Cohen, "Scalable Internet video using MPEG-4," Signal Process.: Image Commun., vol. 15, no. 1-2, pp. 95-126, Sep. 1999.
49. D. Wu, Y. T. Hou, W. Zhu, H.-J. Lee, T. Chiang, Y.-Q. Zhang, and H. J. Chao, "On end-to-end architecture for transporting MPEG-4 video over the Internet," IEEE Trans. Circuits Syst. Video Technol., vol. 10, no. 6, pp. 923-941, Sep. 2000.
50. D. Wu, Y. T. Hou, and Y.-Q. Zhang, "Transporting real-time video over the Internet" challenges and approaches," in Proc. IEEE, vol. 88, Dec. 2000, pp. 1855-1875.
51. F. Yang, Q. Zhang, W. Zhu, and Y.-Q. Zhang, "An efficient transport scheme for multimedia over wireless Internet," in Proc. Int. Conf. Third Generation Wireless and Beyond, San Francisco, CA, May 2001.
52. S. D. Servetto, K. Ramchandran, K. Nahrstedt, and A. Ortega, "Optimal segmentation of a VBR source for its parallel transmission over multiple ATM connections," in Proc. ICIP, Santa Barbara, CA, Oct. 1997.
53. V. Padmanabhan, "Using differentiated services mechanisms to improve network protocol and application performance," in SPIE RTAS Workshop on QoS Support for Real-Time Internet Applications, Vancouver, BC, Canada, Jul. 1999.
54. J. Shin, J. Kim, and C.-C. J. Kuo, "Relative priority based QoS interaction between video applications and differentiated service networks," in Proc. ICIP, vol. 3, Vancouver, BC, Canada, Oct. 2000, pp. 536-539.
55. P. A. Chou and Z. Miao, "Rate-Distortion Optimized Streaming of Packetized Media," Microsoft Research, Redmond, WA, Tech. Rep. MSR-TR-2001-35, Feb. 2001.
56. J. Chakareski and P. A. Chou, "Application layer error correction coding for rate-distortion optimized streaming to wireless clients," in Proc. Int. Conf. Acoustics Speech, and Signal Process., vol. 3, Orlando, FL, May 2002, pp. 2513-2516.
57. J. Chakareski, P. A. Chou, and B. Aazhang, "Computing rate-distortion optimized policies for streaming media to wireless clients," in Proc. Data Compression Conf.. Snowbird, UT, Apr. 2002, pp. 53-62.
58. J. Chakareski and P. A. Chou, "Application Layer Error Correction Coding for Rate-Distortion Optimized Streaming to Wireless Clients," Microsoft Research, Redmond, WA, ftp://ftp.research.microsoft.com/pub/tr/TR- 2002-81.ps, Tech. Rep. MSR-TR-2002-81, Aug. 2002. Publicly available at.
59. _, (2002, Aug.) Application layer error correction coding for rate-distortion optimized streaming to wireless clients. IEEE Trans. Commun.. [Online], vol (8), pp. 1675-1687
60. J. Chakareski and B. Girod, "Rate-distortion optimized packet scheduling and routing for media streaming with path diversity," in Proc. Data Compression Conf.. Snowbird, UT, Mar. 2003, pp. 203-212.
61. J. Chakareski, S. Han, and B. Girod, "Layered coding vs. multiple descriptions for video streaming over multiple paths," in Proc. 11th ACM Int. Conf. on Multimedia, Berkeley, CA, Nov. 2003, pp. 422-431.
62. A. Sehgal and P. A. Chou, "Cost-distortion optimized streaming media over DiffServ networks," in Proc. IEEE ICME, vol. 1. Lausanne, Switzerland, Aug. 2002, pp. 857-860.
63. J. Chakareski and B. Girod, "Server diversity in rate-distortion optimized streaming of multimedia," in Proc. ICIP, Barcelona, Catalonia, Spain, Sep. 2003.
64. A. C. Begen, Y. Altunbasak, and M. A. Begen, "Rate-distortion optimized on-demand media streaming with server diversity," in Proc. ICIP, Barcelona, Catalonia, Spain, Sep. 2003.
65. A. Sehgal and P. A. Chou, "Cost-distortion optimized caching of streaming media," in Proc. Int. Conf. Acoustics, Speech, and Signal Process., vol. 2, Orlando, FL, May 2002, pp. 1973-1976.
66. J. Chakareski, P. A. Chou, and B. Girod, "Rate-distortion optimized streaming from the edge of the network," in Proc. Workshop on Multimedia Signal Process., S. Thomas, Ed., Dec. 2002, pp. 49-52.
67. _, "Computing rate-distortion optimized policies for hybrid receiver/sender driven streaming of multimedia," in Proc. Asilomar Conf. Signals, Systems, and Computers, vol. 2, Pacific Grove, CA, Nov. 2002, pp. 1310-1314.
68. _, RaDiO Edge: Rate-distortion optimized proxy-driven streaming from the network edge, in IEEE/ACM Trans. Networking. Submitted.
69. M. Kalman, E. Steinbach, and B. Girod, "R-D optimized media streaming enhanced with adaptive media playout," in Proc. IEEE ICME, vol. 1, Rochester, NY, Aug. 2002, pp. 869-872.
70. _, "Rate-distortion optimized video streaming with adaptive playout," in Proc. ICIP, vol. 3, Rochester, NY, Sep. 2002, pp. 189-192.
71. M. Kalman, P. Ramanathan, and B. Girod, "Rate-distortion optimized video streaming with multiple deadlines," in Proc. ICIP. Barcelona, Catalonia, Spain, Sep. 2003.
72. J. Chakareski and B. Girod, "Rate-distortion optimized video streaming with rich acknowledgments," in Proc. SPIE Visual Commun. and Image Process., San Jose, CA, Jan. 2004.
73. R. Zhang, S. L. Regunathan, and K. Rose, "End-to-end distortion estimation for RD-based robust delivery of pre-compressed video," in Conf. Rec. 35th Asilomar Conf. Signals, Systems and Computers, Asilomar, CA, Nov. 2001, pp. 210-214.
74. _, "Optimized video streaming over lossy networks with real-time estimation of end-to-end distortion," in Proc. IEEE ICME, vol. 1, Lausanne, Switzerland, Aug. 2002, pp. 861-864.
75. G. Cheung and W.-T. Tan, "Directed acyclic graph based source modeling for data unit selection of streaming media over QoS networks," in Proc. IEEE ICME, vol. 2. Lausanne, Switzerland, Aug. 2002, pp. 81-84.
76. P. Ramanathan, M. Kalman, and B. Girod, "Rate-distortion optimized streaming of compressed light fields," in Proc. ICIP, Barcelona, Catalonia, Spain, Sep. 2003.
77. C.-L. Chang and B. Girod, "Rate-distortion optimized interactive streaming for scalable bitstreams of light fields," in Proc. SPIE Visual Commun. and Image Process.. San Jose, CA, Jan. 2004.
78. B. Girod, M. Kalman, Y. Liang, and R. Zhang, "Advances in channel-adaptive video streaming," Wireless Commun. Mobile Comput., vol. 2, no. 6, pp. 549-552, Sep. 2002.
79. D. Quaglia and J. C. de Martin, "Delivery of MPEG video streams with constant perceptual quality of service," in Proc. ICME, vol. 2, Lausanne, Switzerland, Aug. 2002, pp. 85-88.
80. F. Zhai, R. Berry, T. N. Pappas, and A. K. Katsaggelos, "A rate-distortion optimized error control scheme for scalable video streaming over the Internet," in Proc. ICME, Baltimore, MD, Jul. 2003.
81. F. Zhai, C. E. Luna, Y. Eisenberg, T. N. Pappas, R. Berry, and A. K. Katsaggelos, "A novel cost-distortion optimization framework for video streaming over differentiated services networks," in Proc. ICIP, Barcelona, Catalonia, Spain, Sep. 2003.
82. _, "Joint source coding and packet classification for real-time video transmission over differentiated services networks," IEEE Trans. Multimedia, vol. 7, no. 4, pp. 716-726, Aug. 2004.
83. T. Stockhammer, H. Jenkac, and G. Kuhn, "Streaming video over variable bit-rate wireless channels," IEEE Trans. Multimedia, vol. 6, no. 2, pp. 268-277, Apr. 2004.
84. J. C. de Martin, "Source-driven packet marking for speech transmission over differentiated-services networks," in Proc. ICASSP, Salt Lake City, UT, May 2001.
85. J. C. de Martin and D. Quaglia, "Distortion-based packet marking for MPEG video transmission over DiffServ networks," in Proc. ICME, Tokyo, Japan, Aug. 2001.
86. F. De Vito, L. Farinetti, and J. C. De Martin, "Perceptual classification of MPEG video for differentiated-services communications," in Proc. ICME, vol. 1. Lausanne, Switzerland, Aug. 2002, pp. 141-144.
87. W. Li and Y. Chen, Experiment Result on Fine Granularity Scalability Seoul, Korea, Mar. 1999. Contribution M4473, ISO/TEC JTC1/SC29/WG11.
88. S. Li, F. Wu, and Y.-Q. Zhang, "Experimental Results with Progressive Fine Granularity Scalable (PFGS) Coding,", Noordwijkerhout, NL, Tech. Rep. m5742, Mar., 2000. ISO/IEC JTC1/SC29/WG11.
89. H. Wang and A. Ortega, "Robust video communication by combining scalability and multiple description coding techniques," in Proc. SPIE Symp. Electronic Imaging, San Jose, CA, Jan. 2003.
90. A. Mukherjee, "On the dynamics and significance of low frequency components of Internet load," Internetworking: Res. Exp., vol. 5, pp. 163-205, Dec. 1994.
91. A.M. Mood, F. A. Graybill, and D. C. Boes, Introduction to the Theory of Statistics, 3rd ed. New York: McGraw-Hill, 1974.
92. S. M. Ross, Stochastic Processes: Wiley, 1974.
93. D. Gunarwardena, P. Key, and L. Massoulie, "Network characteristics: modeling, measurements and admission control," in Proc. EEE/IFIP/ACM Int. Workshop on Quality of Service (IWQoS). Monterey, CA, Jun. 2003.
94. M. Röder, J. Cardinal, and R. Hamzaoui, "On the complexity of rate-distortion optimal streaming of packetized media," in Proc. Data Compression Conf. Snowbird, UT, Mar. 2004.
95. R. Fletcher, Practical Methods of Optimization, 2nd ed. New York: Wiley, 1987.
96. "Video codec test model number 10 (TMN-10) (H.263+)," ITU-TSG16/Q15 Doc. Q15-D-65, Apr. 1998. ITU-T SG16/Q15.
97. J. Choi and D. Park, "A stable feedback control of the buffer state using the controlled lagrange multiplier method," IEEE Trans. Image Process., vol. 3, no. 5, pp. 546-588, Sep. 1994.
98. G. J. Sullivan and T. Wiegand, "Rate-distortion optimization for video compression," IEEE Signal Process. Mag., vol. 15, no. 6, pp. 74-90, Nov. 1998.
99. Y. Shoham and A. Gersho, "Efficient bit allocation for an arbitrary set of quantizers," IEEE Trans. Acoust., Speech, Signal Process., vol. 36, no. 1, pp. 1445-1453, Sep. 1988.
100. P. A. Chou, T. Lookabaugh, and R. M. Gray, "Optimal pruning with applications to tree structured source coding and modeling," IEEE Trans. Inform. Theory, vol. 35, no. 2, pp. 299-315, Mar. 1989.
101. E. A. Riskin, "Optimal bit allocation via the generalized BFOS algorithm," IEEE Trans. Inform. Theory, vol. 37, no. 2, pp. 400-402, Mar. 1991.