Rate-distortion modeling for efficient H.264/AVC encoding

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 17, Issue 5, 2007, Pages 530-543

  Tu, Yu Kuang ^b,c   Yang, Jar Ferr ^a,b   Sun, Ming Ting ^a,d  

^a IEEE

^b NATIONAL CHENG KUNG UNIVERSITY   (Taiwan)

^c SUNPLUS TECHNOLOGY CO LTD   (Taiwan)

^d University of Washington   (United States)

Author keywords

Bit allocation; H.264 AVC; Mode decision; R D optimization; Rate control; Rate distortion (R D) modeling

Indexed keywords

ALGORITHMS; BIT ERROR RATE; COMPUTATIONAL COMPLEXITY; OPTIMIZATION; SIGNAL DISTORTION; THRESHOLD ELEMENTS;

BIT ALLOCATION; MODE DECISION; RATE CONTROL; RATE DISTORTION (R D) MODELING;

IMAGE CODING;

EID: 34247598510     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2007.894041     Document Type: Article

References (46)

1. Information Technology-Coding of Moving Pictures and Associated Audio for Digital Storage Media at Up to About 1.5 Mbit/s: Video, ISO/IEC 11172-2 (MPEG-1 Video), ISO/IEC, 1993.
2. Information Technology-Generic Coding of Moving Pictures and Associated Audio Information: Video, 13818-2-ITU-T Rec. H.262 (MPEG-2 Video), ISO/IEC, 1995.
3. Information Technology-Generic Coding of Audio-Visual Objects Part 2: Visual, ISO/IEC 14496-2 (MPEG-4 Video), ISO/IEC, 1999.
4. Video Coding for Low Bitrate Communication, ITU-T Recommendation H.263, 1995, Version 1, Version 2, Sep. 1997.
5. Draft ITU-T Recommendation and Final Draft International Standaid of Joint Video Specification (ITU-T Rec.H.264|ISO/IEC 14496-10 AVC), Joint Video Team, Mar. 2003, Joint Video Team (JVT) of ISO/IEC MPEG and ITU-T VCEG, JVT-G050.
6. G. J. Sullivan and T. Wiegand, "Rate-distortion optimization for video compression," IEEE Signal Processing Mag., vol. 15, pp. 74-90, Nov. 1998.
7. A. Ortega and K. Ramchandran, "Rate-distortion methods for image and video compression: An overview," IEEE Signal Processing Mag., pp. 23-50, Nov. 1998.
8. T. Wiegand, M. Lightstone, D. Mukherjee, T. G. Campbell, and S. K. Mitra, "Rate-distortion optimized mode selection for very low bit rate video coding and the emerging H.263 standard," IEEE Trans. Circuits Syst. Video Technol., vol. 6, no. 2, pp. 182-190, Apr. 1996.
9. D. Mukherjee and S. K. Mitra, "Combined mode selection and macroblock quantization step adaptation for the H.263 video encoder," in Proc. Int. Conf. Image Process., Aug. 1997, pp. 37-40.
10. G. J. Sullivan and R. L. Baker, "Rate-distortion optimized motion compensation for video compression using fixed or variable size blocks," in Proc. Global Telecomm. Conf. (GLOBECOM'91), Dec. 1991, pp. 85-90.
11. M. C. Chen and A. N. Willson, Jr., "Rate-distortion optimal motion estimation algorithms for motion-compensated transform video coding," IEEE Trans. Circuits Syst. Video Technol., vol. 8, no. 2, pp. 147-158, Apr. 1998.
12. Y.-K. Chen and S. Y. Kung, "Rate optimization by true motion estimation," in Proc. IEEE Workshop Multimedia Signal Process., Jun. 1997, pp. 187-194.
13. J. Ribas-Corbera and S. Lei, "Rate control in DCT video coding for low-delay communications," IEEE Trans. Circuits Syst. Video Technol., vol. 9, no. 1, pp. 172-185, Feb. 1999.
14. Z. He and S. K. Mitra, "Optimum bit allocation and accurate rate control for video coding via p-domain source modeling," IEEE Trans. Circuits Syst. Video Technol., vol. 12, no. 10, pp. 840-849, Oct. 2002.
15. G. M. Schuster and A. K. Katsaggelos, "A theory for the optimal bit allocation between displacement vector field and displaced frame difference," IEEE J. Sel. Areas Commun., vol. 15, no. 12, pp. 1739-1751, Dec. 1997.
16. _, "A video compression scheme with optimal bit allocation among segmentation, motion, and residual error," IEEE Trans. Image Process., vol. 6, no. 11, pp. 1487-1502, Nov. 1997.
17. K. Ramchandran, A. Ortega, and M. Vetterli, "Bit allocation for dependent quantization with applications to multiresolution and MPEG video coders," IEEE Trans. Image Process., vol. 3, no. 9, pp. 533-545, Sep. 1994.
18. K. Ramchandran and M. Vetterli, "Rate-distortion optimal fast thresholding with complete JPEG/MPEG decoder compatibility," IEEE Trans. Image Process., vol. 3, no. 9, pp. 700-704, Sep. 1994.
19. M. Crouse and K. Ramchandran, "Joint thresholding and quantizer selection for transform image coding: Entropy-constrained analysis and applications to baseline JPEG," IEEE Trans. Image Process., vol. 6, no. 2, pp. 285-297, Feb. 1997.
20. I.-M. Pao and M.-T. Sun, "Encoding DCT coefficients based on rate-distortion measurement," J. Vis. Commun. Image Representation, pp. 29-43, Mar. 2001.
21. H. Everett, "Generalized Lagrange multiplier method for solving problems of optimum allocation of resources," Oper. Res., vol. 11, pp. 399-417, 1963.
22. H.-M. Hang and J.-J. Chen, "Source model for transform video coder and its application - Part I: Fundamental theory," IEEE Trans. Circuits Syst. Video Technol., vol. 7, no. 2, pp. 287-298, Apr. 1997.
23. W. Ding and B. Liu, "Rate control of MPEG video coding and recording by rate-quantization modeling," IEEE Trans. Circuits Syst. Video Technol., vol. 6, no. 1, pp. 12-20, Feb. 1996.
24. S.-C. Chang, J.-F. Yang, C.-F. Lee, and J.-N. Hwang, "A novel rate predictor based on quantized DCT indexes and its rate control mechanism," Signal Process.: Image Commun., vol. 18, pp. 427-441, Jul. 2003.
25. T. Chiang and Y.-Q. Zhang, "A new rate control scheme using quadratic rate distortion model," IEEE Trans. Circuits Syst. Video Technol., vol. 7, no. 1, pp. 246-250, Feb. 1997.
26. H.-J. Lee, T. Chiang, and Y.-Q. Zhang, "Scalable rate control for MPEG-4 video," IEEE Trans. Circuits Syst. Video Technol., vol. 10, no. 9, pp. 878-894, Sep. 2000.
27. L.-J. Lin and A. Ortega, "Bit-rate control using piecewise approximated rate-distortion characteristics," IEEE Trans. Circuits Syst. Video Technol., vol. 8, no. 4, pp. 446-159, Aug. 1998.
28. J. Bai, Q. Liao, X. Lin, and X. Zhuang, "Rate-distortion model based rate control for real-time VBR video coding and low-delay communications," Signal Process.: Image Commun., vol. 17, pp. 187-199, Feb. 2002.
29. Z. He, Y. K. Kim, and S. K. Mitra, "Low-delay rate control for DCT video coding via p-domain source modeling," IEEE Trans. Circuits Syst. Video Technol., vol. 11, no. 8, pp. 928-940, Aug. 2001.
30. Z. He and S. K. Mitra, "A linear source model and a unified rate control algorithm for DCT video coding," IEEE Trans. Circuits Syst. Video Technol., vol. 12, no. 11, pp. 970-982, Nov. 2002.
31. MPEG-2 Video Test Model 5, ISO/IEC JTC1/SC29/WG11 MPEG93/ 457, 1993.
32. Video Codec Test Model TMN8, ITU-T/SG15, Jun. 1997.
33. Text of ISO/IEC 14496-2 MPEG4 Video VM - Version 8.0, ISO/IEC JTC1/SC29/WG11, 1997, Coding of Moving Pictures and Associated Audio MPEG 97/W1796. Stockholm, Sweden: Video Group.
34. H. Kim, N. Kamaci, and Y. Altunbasak, "Low-complexity rate-distortion optimal macroblock mode selection and motion estimation for MPEG-like video coders," IEEE Trans. Circuits Syst. Video Technol. vol. 15, no. 7, pp. 823-834, Jul. 2005.
35. Y.-K. Tu, J.-F. Yang, and M.-T. Sun, "Efficient rate-distortion estimation for H.264/AVC coders," IEEE Trans. Circuits Syst. Video Technol., vol. 16, no. 5, pp. 600-611, May 2006.
36. I.-M. Pao and M.-T. Sun, "Modeling DCT coefficients for fast video encoding," IEEE Trans. Circuits Syst. Video Technol., vol. 9, no. 6, pp. 608-616, Jun. 1999.
37. A. Hallapuro and M. Karczewicz, "Low complexity transform and quantization," Joint Video Team (JVT) Docs. JVT-B038 and JVT-B039, Jan. 2002.
38. A. K. Jain, Fundamentals of Digital Image Processing. Englewood Cliffs, NJ: Prentice-Hall, 1989.
39. E. Y. Lam and J. W. Goodman, "A mathematical analysis of the DCT coefficient distributions for images," IEEE Trans. Image. Process., vol. 9, no. 10, pp. 1661-1666, Oct. 2000.
40. Joint Video Team (JVT) Reference Software [Online]. Available: http://bs.hhi.de/~suehring/tml/download/
41. G. Sullivan, T. Wiegand, and K.-P. Lim, "Joint Model Reference Encoding Methods and Decoding Concealment Methods," in Joint Video Team (JVT) Doc. JVT-I049, Sep. 2003.
42. F. Pan, X. Lin, R. Susanto, K. P. Lim, Z. G. Li, G. N. Feng, D. J. Wu, and S. Wu, "Fast Mode Decision for Intra Prediction," in Joint Video Team (JVT) Doc. JVT-G013, Mar. 2003.
43. K. P. Lim, S. Wu, D. J. Wu, S. Rahardja, X. Lin, F. Pan, and Z. G. Li, "Fast Inter Mode Selection," in Joint Video Team (JVT) Doc. JVT-I020, Sep. 2003.
44. B. Jeon and J. Lee, "Fast Mode Decision for H.264," in Joint Video Team (JVT) Doc. JVT-J033, Dec. 2003.
45. Z. Li, F. Pan, K. P. Lim, G. Feng, X. Lin, and S. Rahardja, "Adaptive Basic Unit Layer Rate Control for JVT," in Joint Video Team (JVT) Doc. JVT-G012, Mar. 2003.
46. G. Bjontegaard, "Calculation of average PSNR differences between RD-curves," in Proc. ITU-T Q.6/SG16 VCEG 13th Meeting, Austin, TX, Apr. 2001, Doc. VCEG-M33.