Perceptually scalable extension of H.264

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 21, Issue 11, 2011, Pages 1667-1678

  Ha, Hojin ^a   Park, Jincheol ^b   Lee, Sanghoon ^b   Bovik, Alan Conrad ^c  

^a SAMSUNG Electronics   (South Korea)

^b Yonsei University   (South Korea)

^c The University of Texas at Austin   (United States)

Author keywords

Frequency weighting; H264 AVC; human visual system; perceptual coding; scalable video coding; visual attention

Indexed keywords

FREQUENCY WEIGHTING; H264/AVC; HUMAN VISUAL SYSTEM; PERCEPTUAL CODING; SCALABLE VIDEO CODING; VISUAL ATTENTION;

ALDEHYDES; IMAGE CODING; IMAGE COMPRESSION; MOTION PICTURE EXPERTS GROUP STANDARDS; VISUALIZATION;

QUALITY CONTROL;

EID: 80455145024     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2011.2133370     Document Type: Article

References (35)

1. H. Schulzrinne, S. Casner, R. Frederick, and V. Jacobson, "RTP: A transport protocol for real-time application," document RFC 1889, Internet Official Protocol Standards (STD 1), Jan. 1996.
2. S. J. Choi and J. W. Woods, "Motion-compensated 3-D subband coding of video," IEEE Trans. Image Process., vol. 8, no. 2, pp. 155-167, Feb. 1999.
3. H. M. Radha, M. V. D. Schaar, and Y. Chen, "The MPEG-4 find-grained scalable video coding method for multimedia streaming over IP," IEEE Trans. Multimedia, vol. 3, no. 1, pp. 53-68, Mar. 2001. (Pubitemid 32248387)
4. Y. W. Chen and W. A. Pearlman, "Three-dimensional subband coidng of video using the zerotree method," Proc. SPIE, vol. 2727, pp. 1302-1312, Mar. 1996.
5. J. Park, H. Lee, S. Lee, and A. C. Bovik, "Optimal channel adaptation of scalable video over a multi-carrier based multi-cell environment," IEEE Trans. Multimedia Special Issue, vol. 11, no. 6, pp. 1062-1071, Oct. 2009.
6. U. Jang, H. Lee, and S. Lee, "Optimal carrier loading control for the enhancement of visual quality over OFDMA cellular networks," IEEE Trans. Multimedia, vol. 10, no. 6, pp. 1181-1196, Oct. 2008.
7. J. Reichel, M. Wien, and H. Schwarz, "Scalable video model 3.0," document N6716, ISO/IEC JTC 1/SC 29/WG 11, Palma de Mallorca, Spain, Oct. 2004.
8. B. Ciptpraset and K. R. Rao, "Human visual weighting progressive image transmission," in Proc. ICCS, Nov. 1987, pp. 1040-1044.
9. S. Lee, M. S. Pattichis, and A. C. Bovik, "Foveated video quality assessment," IEEE Trans. Multimedia, vol. 4, no. 1, pp. 129-132, Mar. 2002. (Pubitemid 34291535)
10. S. Lee, M. S. Pattichis, and A. C. Bovik, "Foveated video compression with optimal rate control," IEEE Trans. Image Process., vol. 10, no. 7, pp. 977-992, Jul. 2001. (Pubitemid 32650874)
11. S. Lee and A. C. Bovik, "Fast algorithms for foveated video processing," IEEE Trans. Circuit Syst. Video Technol., vol. 13, no. 2, pp. 149-162, Feb. 2003.
12. S. Lee, A. C. Bovik, and Y. Y. Kim, "High quality, low delay foveated visual communications over mobile channels," J. Visual Commun. Image Representat., vol. 16, no. 2, pp. 180-211, Apr. 2005.
13. H. Lee and S. Lee, "Compression gain measurements by using ROI-based data reduction," IEICE Trans. Fundamentals, vol. E89-A, no. 11, pp. 2985-2989, Nov. 2006. (Pubitemid 44934402)
14. Z. Wang and A. C. Bovik, "Embedded foveation image coding," IEEE Trans. Image Process., vol. 10, no. 10, pp. 1397-1410, Oct. 2001. (Pubitemid 32981815)
15. Z. Wang, L. Lu, and A. C. Bovik, "Foveation scalable video coding with automatic fixation selection," IEEE Trans. Image Process., vol. 12, no. 2, pp. 243-254, Feb. 2003.
16. K. Yang, C. C. Guest, K. E. Maleh, and P. K. Das, "Perceptual temporal quality metric for compressed video," IEEE Trans. Multimedia, vol. 9, no. 7, pp. 1528-1535, Nov. 2007.
17. C. Tang, "Spatiotemporal visual considerationfor video coding," IEEE Trans. Multimedia, vol. 9, no. 2, pp. 231-238, Feb. 2007. (Pubitemid 46188196)
18. J. Chen, J. Zheng, and Y. He, "Macroblock-level adaptive frequency weighting for perceptual video coding," IEEE Trans. Consumer Electron., vol. 53, no. 2, pp. 775-781, May 2007. (Pubitemid 47215100)
19. J. Lee, "Rate-distortion optimization of parameterized quantization matrix for MPEG-2 encoding," in Proc. ICIP, Oct. 1998, pp. 383-386.
20. Y. F. Ma and H. J. Zhang, "A model of motion attention for video skimming," in Proc. ICIP, vol. 1. 2002, pp. I-129-132.
21. C. W. Ngo, T. C. Pong, and H. J. Zhang, "Motion analysis and segmentation through spatio-temporal slices processing," IEEE Trans. Image Process., vol. 12, no. 3, pp. 341-355, Mar. 2003.
22. H. B. Yin, "Adaptive quanitization in perceptual MPEG video encoders," in Proc. PCS, Apr. 2006, pp. 3-14.
23. R. A. Rensink, "A model of saliency-based visual attention for rapid scene analysis," in Proc. ACM 2nd Int. Symp. Smart Graphics, 2002, pp. 63-70.
24. A. B. Watson, G. Y. Yang, J. A. Solomon, and J. Villasenor, "Visibility of wavelet quantization noise," IEEE Trans. Image Process., vol. 6, no. 8, pp. 20-29, Aug. 1997.
25. A. B. Watson, J. Hu, and J. F. McGowan, III, "DVQ: A digital video quality metric based on human vision," J. Electron. Imag., vol. 10, no. 1, pp. 1164-1175, Aug. 1997.
26. R. A. Rensink, J. K. O. Regan, and J. J. Clark, "To see or not to see: The need for attention to perceive changes in scenes," Psychol. Sci., vol. 8, pp. 368-373, Sep. 1997. (Pubitemid 127455296)
27. B. Girod, "What's wrong with mean-square error?" in Digital Images Human Vision, A. B. Watson, Ed. Cambridge, MA: MIT Press, 1993.
28. H. Schwarz, D. Marpe, and T. Wiegand, "Overview of the scalable video coding extension of the H.264/AVC standard," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 9, pp. 1103-1120, Sep. 2007. (Pubitemid 47483052)
29. H. Schwarz, D. Marpe, and T. Wiegand, "Analysis of hierarchical B pictures and MCTF," in Proc. ICME, Jul. 2006, pp. 1929-1932. (Pubitemid 46680119)
30. I. Amonou, N. Cammas, S. Kervadec, and S. Pateux, "Optimized rate-distortion extraction with quality layers in the scalable extension of H.264/AVC," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 9, pp. 1186-1193, Sep. 2007. (Pubitemid 47483057)
31. L. Itti, "Quantifying the contribution of low-level saliency human eye movement in dynamic scenes," Vis. Cognit., vol. 12, no. 6, pp. 1093-1123, Aug. 2005. (Pubitemid 41283179)
32. L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Patt. Anal. Mach. Intell., vol. 20, no. 11, pp. 1254-1259, Nov. 1998. (Pubitemid 128742001)
33. W. S. Geisler and J. S. Perry, "A real-time foveated multiresolution system for low bandwidth video communication," Proc. SPIE, vol. 3299, pp. 294-305, Jul. 1998.
34. J. G. Robson and N. Graham, "Probability summation and regional variation in contrast sensitivity across the visual field," Vis. Res., vol. 21, no. 3, pp. 409-418, 1981. (Pubitemid 11143371)
35. M. S. Banks, A. B. Sekuler, and S. J. Anderson, "Peripheral spatial vision: Limited imposed by optics, photoreceptors and receptor pooling," J. Opt. Soc. Am., vol. 8, pp. 1775-1787, Nov. 1991.