Perceptually unequal packet loss protection by weighting saliency and error propagation

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 20, Issue 9, 2010, Pages 1187-1199

  Ha, Hojin ^a   Park, Jincheol ^b   Lee, Sanghoon ^b   Bovik, Alan Conrad ^c  

^a SAMSUNG Electronics   (South Korea)

^b Yonsei University   (South Korea)

^c The University of Texas at Austin   (United States)

Author keywords

Forward error correction; human visual system; internet video; perceptual coding; unequal loss protection (ULP)

Indexed keywords

BURST PACKET LOSS; CHANNEL STATE; COMPRESSED VIDEO; EFFICIENCY AND FAIRNESS; ELAPSED TIME; ERROR PROPAGATION; GROUP OF PICTURES; HUMAN VISUAL SYSTEM; INTERNET VIDEO; LOSS PROTECTION; NON-UNIFORM DISTRIBUTION; PERCEPTUAL CODING; ROBUST PERFORMANCE; SALIENT REGIONS; UNEQUAL LOSS PROTECTION; VIDEO DISTORTIONS; VISUAL QUALITIES; WEIGHTING SCHEME;

FORWARD ERROR CORRECTION; IMAGE COMPRESSION; INTERNET; PACKET LOSS;

IMAGE CODING;

EID: 77956820596     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2010.2051368     Document Type: Article

References (46)

1. M. R. Civanlar, A. Luthra, S. Wenger, and W. Zhu, Introduction to the special issue on sreaming video, IEEE Trans. Circuits Syst. Video Tech., vol.11, no.3, pp. 265-268, Mar. 2001.
2. Y. Wang and Q. Zhu, Error control and concealment for video communication: A review, Proc. IEEE, vol.86, no.5, pp. 974-997, May 1998.
3. B. Ciptpraset and K. R. Rao, Human visual weighting progressive image transmission, in Proc. ICCS, Nov. 1987, pp. 1040-1044.
4. B. Girod, Whats wrong with mean-square error? in Digital Images and Human Vision, A. B. Watson, Ed. Cambridge, MA: M.I.T. Univ. Press, 1993.
5. A. B. Watson, J. Hu, and J. F. McGowan, III, DVQ: A digital video quality metric based on human vision, J. Electron. Imag., vol.10, no.1, pp. 1164-1175, Aug. 1997.
6. S. Lee, M. S. Pattichis, and A. C. Bovik, Foveated video quality assessment, IEEE Trans. Multimedia, vol.4, no.1, pp. 129-132, Mar. 2002.
7. S. Lee, M. S. Pattichis, and A. C. Bovik, Foveated video compression with optimal rate control, IEEE Trans. Image Process., vol.10, no.7, pp. 977-992, Jul. 2001.
8. Z. Wang and A. C. Bovik, Embedded foveation image coding, IEEE Trans. Image Process., vol.10, no.10, pp. 1397-1410, Oct. 2001.
9. Z. Wang, L. Lu, and A. C. Bovik, Foveation scalable video coding with automatic fixation selection, IEEE Trans. Image Process., vol.12, no.2, pp. 243-254, Feb. 2003.
10. C. Tang, Spatiotemporal visual consideration for video coding, IEEE Trans. Multimedia, vol.9, no.2, pp. 231-238, Feb. 2007.
11. J. Chen, J. Zheng, and Y. He, Macroblock-level adaptive frequency weighting for perceptual video coding, IEEE Trans. Consumer Elec., vol.53, no.2, pp. 775-781, May 2007.
12. K. Yang, C. C. Guest, K. E. Maleh, and P. K. Das, Perceptual temporal quality metric for compressed video, IEEE Trans. Multimedia, vol.9, no.7, pp. 1528-1535, Nov. 2007.
13. P. Frossard and O. Verscheure, AMISP: A complete content-based error resilient scheme, IEEE Trans. Circuit Syst. Video Technol., vol.11, no.9, pp. 989-998, Sep. 2001.
14. A. E. Mohr, E. A. Riskin, and R. E. Ladner, Unequal loss protection: Graceful degradation of image quality over packet erasure channels through forward correction, IEEE J. Select. Areas Commun., vol.18, no.6, pp. 819-828, Jun. 2000.
15. X. Yang, C. Zhu, Z. G. Li, X. Lin, and N. Ling, An unequal packet loss resilience scheme for video over the internet, IEEE Trans. Multimedia, vol.7, no.4, pp. 753-765, Aug. 2005.
16. J. Albanese, J. Edmonds, M. Ludy, and U. Horn, Peioiry encoding transmission, IEEE Trans. Inform. Theory, vol.42, no.6, pp. 1737-1744, Nov. 1996.
17. F. Hartanto and H. R. Sirisena, Hybrid error control mechanism for video transmission in the wireless IP networks, in Proc. Select. Paper 10th IEEE Workshop Local Metropolitan Area Netw., 2001, pp. 126-132.
18. M. Andronico and O. Verscheure, Performance analysis of priority encoding transmission of MPEG video streams, in Proc. Global Telecommun. Conf., Nov. 1996, pp. 267-271.
19. J. Kim, R. M. Mercereau, and Y. Altunbasak, Error-resilient image and video transmission over the internet using unequal error protection, IEEE Trans. Image Process., vol.12, no.2, pp. 121-131, Feb. 2003.
20. K. Stuhlmuller, M. Link, and B. Girod, Robust internet video transmission based on scalable coding and unequal error protection, Signal Process. Image Comm., vol.15, no.1, pp. 99-194, 1999.
21. L. Zhuo, K.-M. Lam, and L. Shen, Channel-adaptive error protection for streaming stored MPEG-4 FGS over error-prone environments, IEEE Trans. Circuit Syst. Video Technol., vol.16, no.5, pp. 649-654, May 2006.
22. S. Lee, C. Podilchuk, V. Krishnan, and A. C. Bovik, Foveation-based error resilience and unequal error protection over mobile networks, Journal of VLSI Signal Processing Systems for Signal, Image and Video Technology, vol.34, pp. 149-166, May 2003 (special issues on multimedia communications).
23. L. Ning, Q. Zi-Yi, and M. Ai-Dong, Perceptual optimized error-resilient H.264 video streaming system over the best-effort internet, in Proc. PDCAT, Dec. 2005, pp. 1039-1043.
24. K. Stuhlmuller, N. Farber, M. Link, and B. Girod, Analysis of video transmission over lossy channels, IEEE J. Select. Areas Commun., vol.18, no.6, pp. 1012-1032, Jun. 2000.
25. X. K. Yang, C. Zhu, Z. G. Li, X. Lin, G. N. Feng, S. Wu, and N. Ling, Unequal loss protection for robust transmission of motion compensated video over the internet, Signal Process.: Image Commun., vol.18, no.3, pp. 157-167, Mar. 2003.
26. N. Feamster and H. Balakrishnan, Packet loss recovery for streaming video, in Proc. IEEE Int. Packet Video Workshop, Apr. 2002, pp. 1-11.
27. Z. Wang, A. C. Bovik, and L. Lu, Why is image quality assessment so difficult? in Proc. IEEE Int. Conf. Acoust. Speech Signal Proc., vol.4. May 2002, pp. 3313-3316.
28. Z. Wang and A. C. Bovik, Modern Image Quality Assessment. San Mateo, CA: Morgan and Claypool Publishers, 2006.
29. Z. Wang, L. Lu, and A. C. Bovik, Video quality assessment based on structual distortion measurement, Signal Process. Image Commun., vol.19, no.2, pp. 121-132, Feb. 2004.
30. H. Zheng, C. Ru, C. W. Chen, and L. Yu, Video transmission over MIMO-OFDM system: MDC and space-time coding-based approaches, Advances Multimedia, vol.2007, article 61491, pp. 1-8, 2007.
31. C. H. Kuo, C. S. Kim, and C. C. J. Kuo, Robust video transmission over wideband wireless channel using space-time coded OFDM systems, in Proc. WCNC, vol.2. Mar. 2002, pp. 931-936.
32. S. Wenger, Y.-K. Wang, and T. Schierl, Transport and signaling of SVC in IP networks, IEEE Trans. Circuits Syst. Video Technol., vol.17, no.9, pp. 1164-1173, Sep. 2007.
33. S. W. Yuk, M. G. Kang, B. C. Shin, and D. H. Cho, An adaptive redundancy control method for erasure-code-based real-time data transmission over the internet, IEEE Trans. Multimedia, vol.3, no.3, pp. 366-374, Sep. 2001.
34. Z. G. Li, C. Zhu, N. Ling, X. K. Yang, G. N. Feng, S. Wu, and F. Pan, A unified architecture for real-time video-coding system, IEEE Trans. Circuit Syst. Video Technol., vol.13, no.6, pp. 472-486, Jun. 2003.
35. Y. Ming and W. H. Yuan, A rate control scheme for H.264 video under low-bandwidth channel, J. Zhejiang Univ.-Sci. A, vol.7, no.6, pp. 990-995, 2006.
36. Y. Liu, Z. G. Li, and Y. C. Soh, A novel rate control scheme for low-delay video communication of H.264/AVC standard, IEEE Trans. Circuit Syst. Video Technol., vol.17, no.1, pp. 68-78, Jan. 2007.
37. J. Lee, Rate-distortion optimization of parameterized quantization matrix for MPEG-2 encoding, in Proc. ICIP, Oct. 1998, pp. 383-386.
38. H. Yin, Adaptive quanitization in perceptual MPEG video encoders, in Proc. PCS, Apr. 2006, pp. 3-14.
39. B. Girod, K. Stuhlmuller, M. Link, and U. Horn, Packet loss resilient internet video streaming, in Proc. SPIE VCIP, Jan. 1999, pp. 833-844.
40. T. Wiegand, G. J. Sullivan, G. Bjntegaard, and A. Luthra, Overview of the H.264/AVC video coding standard, IEEE Trans. Circuit Syst. Video Technol., vol.13, no.7, pp. 560-576, Jul. 2003.
41. W. S. Geisler and J. S. Perry, A real-time foveated multiresolution system for low-bandwidth video communication, in Proc. SPIE, vol.3299. 1998, pp. 1-13.
42. J. G. Robson and N. Graham, Probability summation and regional variation in contrast sensitivity across the visual field, Vis. Res., vol.21, no.3, pp. 409-418, 1981.
43. L. Itti, Quantifying the contribution of low-level saliency human eye motivement in dynamic scenes, Vis. Cognit., vol.12, no.6, pp. 1093-1123, Aug. 2005.
44. M. S. Banks, A. B. Sekuler, and S. J. Anderson, Peripheral spatial vision: Limited imposed by optics, photoreceptors and receptor pooling, J. Opt. Soc. Amer., vol.8, no.11, pp. 1775-1787, 1991.
45. H.264/AVC Software Coordination Online. Available: http://iphome.hhi.de/ suehring/tml/index.htm
46. E. O. Elliott, A model of the switched telephone network for data communications, J. Bell. Syst. Tech., vol.44, no.1, pp. 98-109, 1965.