SSIM-based perceptual rate control for video coding

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 21, Issue 5, 2011, Pages 682-691

  Ou, Tao Sheng ^a   Huang, Yi Hsin ^a   Chen, Homer H ^b  

^a MEDIATEK INC   (Taiwan)

^b NATIONAL TAIWAN UNIVERSITY   (Taiwan)

Author keywords

H.264 AVC; optimum bit allocation; rate control; rate distortion optimization; structural similarity index

Indexed keywords

H.264/AVC; OPTIMUM BIT ALLOCATION; RATE CONTROL; RATE-DISTORTION OPTIMIZATION; STRUCTURAL SIMILARITY;

ELECTRIC DISTORTION; MOTION PICTURE EXPERTS GROUP STANDARDS; SIGNAL DISTORTION; STRUCTURAL OPTIMIZATION; VIDEO SIGNAL PROCESSING;

IMAGE CODING;

EID: 79955628674     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2011.2129890     Document Type: Article

References (44)

1. MPEG-2 Test Model 5, document ISO/IEC JTC1/SC29/WG11/93-400, Moving Picture Experts Group (MPEG), Sydney, Australia, Apr. 1993.
2. Video Coding for Low Bit Rate Communication, ITU-T Rec. H.263, Nov. 1995.
3. MPEG-4 Video Verification Model v8.0, ISO/IEC JTC1/SC29/WG11 Coding of Moving Pictures and Associated Audio, document MPEG97/N1796, MPEG-4 Video Verification Model v8.0, Stockholm, Sweden, Jul. 1997.
4. Z. G. Li, F. Pan, K. P. Lim, G. N. Feng, X. Lin, and S. Rahardaj, Adaptive Basic Unit Layer Rate Control for JVT, document JVT-G012, Joint Video Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG16/Q.6, Pattaya, Thailand, Mar. 2003.
5. Z. Chen and K. N. Ngan, "Recent advances in rate control for video coding," Signal Process. Image Commun., vol. 22, no. 1, pp. 19-38, Jan. 2007. (Pubitemid 46150029)
6. T. Chiang and Y.-Q. Zhang, "A new rate control scheme using quadratic rate distortion model," IEEE Trans. Circuits Syst. Video Technol., vol. 7, no. 1, pp. 246-250, Feb. 1997. (Pubitemid 127765204)
7. H.-J. Lee, T. Chiang, and Y.-Q. Zhang, "Scalable rate control for MPEG-4 video," IEEE Trans. Circuits Syst. Video Technol., vol. 10, no. 6, pp. 878-894, Sep. 2000.
8. N. Kamaci, Y. Altunbasak, and R. M. Mersereau, "Frame bit allocation for the H.264/AVC video coder via Cauchy-density-based rate and distortion models," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 8, pp. 994-1006, Aug. 2005. (Pubitemid 41343370)
9. S. Ma, W. Gao, and Y. Lu, "Rate-distortion analysis for H.264/AVC video coding and its application to rate control," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 12, pp. 1533-1544, Dec. 2005.
10. Z. He, Y.-K. Kim, and S. K. Mitra, "Low-delay rate control for DCT video coding via ρ-domain source modeling," IEEE Trans. Circuits Syst. Video Technol., vol. 11, no. 8, pp. 928-940, Aug. 2001. (Pubitemid 32780002)
11. W. Yuan, S. Lin, Y. Zhang, W. Yuan, and H. Luo, "Optimum bit allocation and rate control for H.264/AVC," IEEE Trans. Circuits Syst. Video Technol., vol. 16, no. 6, pp. 705-715, Jun. 2006. (Pubitemid 44109544)
12. D.-K. Kwon, M.-Y. Shen, and C.-C. Jay Kuo, "Rate control for H.264 video with enhanced rate and distortion models," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 5, pp. 517-529, May 2007.
13. C. An and T. Q. Nguyen, "Iterative rate-distortion optimization of H.264 with constant bit rate constraint," IEEE Trans. Image Process., vol. 17, no. 9, pp. 1605-1615, Sep. 2008.
14. Z. He and S. K. Mitra, "Optimum bit allocation and accurate rate control for video coding via ρ-domain source modeling," IEEE Trans. Circuits Syst. Video Technol., vol. 12, no. 10, pp. 840-849, Oct. 2002. (Pubitemid 35468408)
15. Z. G. Li, F. Pan, K. P. Lim, and S. Rahardja, "Adaptive rate control for H.264," in Proc. IEEE Int. Conf. Image Process., Oct. 2004, pp. 745-748. (Pubitemid 40820141)
16. JVT Reference Software [Online]. Available: http://bs.hhi.de/?suehring/ tml/download
17. J. Dong and N. Ling, "A context-adaptive prediction scheme for parameter estimation in H.264/AVC macroblock layer rate control," IEEE Trans. Circuits Syst. Video Technol., vol. 19, no. 8, pp. 1108-1117, Aug. 2009.
18. X. Yang, W. Lin, Z. Lu, X. Lin, S. Rahardja, E. Ong, and S. Yao, "Rate control for videophone using local perceptual cues," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 4, pp. 496-507, Apr. 2005.
19. Y. Liu, Z. G. Li, and Y. C. Soh, "Region-of-interest based resource allocation for conversational video communication of H.264/AVC," IEEE Trans. Circuits Syst. Video Technol., vol. 18, no. 1, pp. 134-139, Jan. 2008.
20. H. Li, Z. Wang, H. Cui, and K. Tang, "An improved ROI-based rate control algorithm for H.264/AVC," in Proc. Int. Conf. Signal Process., vol. 2. Nov. 2006, pp. 16-20.
21. C.-W. Tang, C.-H. Chen, Y.-H. Yu, and C.-J. Tsai, "Visual sensitivity guided bit allocation for video coding," IEEE Trans. Circuits Syst. Video Technol., vol. 8, no. 1, pp. 11-18, Feb. 2006. (Pubitemid 43146126)
22. C.-W. Tang, "Spatiotemporal visual considerations for video coding," IEEE Trans. Circuits Syst. Video Technol., vol. 9, no. 2, pp. 231-238, Feb. 2007. (Pubitemid 46188196)
23. H. Yu, F. Pan, Z. Lin, and Y. Sun, "A perceptual bit allocation scheme for H.264," in Proc. IEEE Int. Conf. Multimedia Expo, Jul. 2005, p. 4.
24. Z. Liu, H. Yan, L. Shen, Y. Wang, and Z. Zhang, "A motion attention model based rate control algorithm for H.264/AVC," in Proc. IEEE/ACIS Int. Conf. Comput. Inform. Sci., Jun. 2009, pp. 568-573.
25. T.-H. Wu, G.-L. Wu, and S.-Y. Chien, "Bio-inspired perceptual video encoding based on H.264/AVC," in Proc. IEEE Int. Symp. Circuits Syst., May 2009, pp. 2826-2829.
26. Z. Chen and C. Guillemot, "Perceptually-friendly H.264/AVC video coding based on foveated just-noticeable-distortion model," IEEE Trans. Circuits Syst. Video Technol., vol. 20, no. 6, pp. 806-819, Jun. 2010.
27. S. Lee, M. S. Pattichis, and A. C. Bovik, "Foveated video compression with optimal rate control," IEEE Trans. Image Process., vol. 10, no. 7, pp. 977-992, Jul. 2001. (Pubitemid 32650874)
28. Z. Wang, L. Lu, and A. C. Bovik, "Foveation scalable video coding with automatic fixation selection," IEEE Trans. Image Process., vol. 12, no. 2, pp. 243-254, Feb. 2003.
29. D. M. Chandler and S. S. Hemami, "VSNR: A wavelet-based visual signal-to-noise ratio for natural images," IEEE Trans. Image Process., vol. 16, no. 9, pp. 2284-2298, Sep. 2007. (Pubitemid 47316675)
30. H. R. Sheikh and A. C. Bovik, "Image information and visual quality," IEEE Trans. Image Process., vol. 15, no. 2, pp. 430-444, Feb. 2006. (Pubitemid 43126168)
31. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, "Image quality assessment: From error visibility to structural similarity," IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, Apr. 2004.
32. B. Wang, Z. Wang, Y. Liao, and X. Lin, "HVS-based structural similarity for image quality assessment," in Proc. Int. Conf. Signal Process., Oct. 2008, pp. 1194-1197.
33. Z. Wang, L. Lu, and A. C. Bovik, "Video quality assessment based on structural distortion measurement," Signal Process. Image Commun. Special Issue Objective Video Quality Metrics, vol. 19, no. 2, pp. 121- 132, Feb. 2004.
34. H. R. Sheikh, M. F. Sabir, and A. C. Bovik, "A statistical evaluation of recent full reference image quality assessment algorithms," IEEE Trans. Image Process., vol. 15, no. 11, pp. 3440-3451, Nov. 2006. (Pubitemid 44615139)
35. Z. Wang, Q. Li, and X. Shang, "Perceptual image coding based on a maximum of minimal structural similarity criterion," in Proc. IEEE Int. Conf. Image Process., vol. 2. Sep. 2007, pp. 121-124.
36. T. Richter and K. J. Kim, "A MS-SSIM optimal JPEG 2000 encoder," in Proc. Data Compression Conf., Mar. 2009, pp. 401-410.
37. Y.-H. Huang, T.-S. Ou, P.-Y. Su, and H. H. Chen, "Perceptual rate-distortion optimization using structural similarity index as quality metric," IEEE Trans. Circuits Syst. Video Technol, vol. 20, no. 11, pp. 1614- 1624, Nov. 2010.
38. S. S. Channappayya, A. C. Bovik, C. Caramanis, and R. W. Heath, "Design of linear equalizers optimized for the structural similarity index," IEEE Trans. Image Process., vol. 17, no. 6, pp. 857-872, Jun. 2008. (Pubitemid 351772605)
39. S. S. Channappayya, A. C. Bovik, and R. W. Heath, "Rate bounds on SSIM index of quantized images," IEEE Trans. Image Process., vol. 17, no. 9, pp. 1624-1639, Sep. 2008.
40. Z. Wang and A. C. Bovik, "Mean squared error: Love it or leave it-a new look at signal fidelity measures," IEEE Signal Process. Mag., vol. 26, no. 1, pp. 98-117, Jan. 2009.
41. J. L. Devore and N. R. Farnum, Applied Statistics for Engineers and Scientists. New York: Duxbury, 1999.
42. S. Boyd and L. Vandenberghe, Convex Optimization. Cambridge, U.K.: Cambridge Univ. Press, 2004.
43. G. Bjontegaard, Calculation of Average PSNR Differences Between RD-Curves, document VCEG-M33, Visual Coding Experts Group (VCEG), Apr. 2001.
44. Performance Evaluation of Perceptual-Based Rate Control [Online]. Available: http://mpac.ee.ntu.edu.tw/?odeson/projects/ssimrc