Video coding with H.264/AVC: Tools, performance, and complexity

IEEE Circuits and Systems Magazine

Volumn 4, Issue 1, 2004, Pages 7-28

  Ostermann, Jörn ^a   Bormans, Jan ^b   List, Peter ^c   Marpe, Detlev ^d   Narroschke, Matthias ^a   Pereira, Fernando ^e   Stockhammer, Thomas ^f   Wedi, Thomas ^a  

^a LEIBNIZ UNIVERSITY HANNOVER   (Germany)

^b IMEC   (Belgium)

^c T SYSTEMS   (Germany)

^d FRAUNHOFER HEINRICH HERTZ INSTITUTE   (Germany)

^e INSTITUTO SUPERIOR TÉCNICO   (Portugal)

^f TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

H.263; H.264; JVT; Motion compensation; MPEG 1; MPEG 2; MPEG 4; Standards; Streaming; Transform coding; Video coding

Indexed keywords

ALGORITHMS; COSINE TRANSFORMS; DECODING; ENCODING (SYMBOLS); EXPERT SYSTEMS; INTERNET; MATHEMATICAL MODELS; MOBILE TELECOMMUNICATION SYSTEMS; MOTION COMPENSATION; MOTION ESTIMATION; MOTION PICTURES; SATELLITES;

COMPRESSION EFFICIENCY; H.263; H.264; JVT; MPEG-1; MPEG-2; MPEG-4; TRANSFORM CODING; VIDEO RESOLUTIONS;

IMAGE CODING;

EID: 2442422056     PISSN: 1531636X     EISSN: None     Source Type: Journal    
DOI: 10.1109/MCAS.2004.1286980     Document Type: Review

References (51)

1. ISO/IEC 14496-10:2003, "Coding of Audiovisual Objects - Part 10: Advanced Video Coding," 2003, also ITU-T Recommendation H.264 "Advanced video coding for generic audiovisual services."
2. ISO/IEC 14496-10:2003, "Coding of Audiovisual Objects - Part 10: Advanced Video Coding," 2003, also ITU-T Recommendation H.264 "Advanced video coding for generic audiovisual services."
3. ITU-T Recommendation H.261, "Video codec for Audiovisual Services at p X 64 kbit/s," March 1993.
4. ISO/IEC 11172: "Information technology - coding of moving pictures and associated audio for digital storage media at up to about 1.5 Mbit/s," Geneva, 1993.
5. ISO/IEC 13818-2: "Generic coding of moving pictures and associated audio information - Part 2: Video," 1994, also ITU-T Recommendation H.262.
6. ITU-T Recommendation H.263, "Video Coding for Low bit rate Communication," version 1, Nov. 1995; version 2, Jan. 1998; version 3, Nov. 2000.
7. ISO/IEC 14496-2: "Information technology - coding of audiovisual objects - part 2: visual," Geneva, 2000.
8. T. Stockhammer, M.M. Hannuksela, and T. Wiegand, "H.264/AVC in wireless environments," IEEE Transactions on Circuits and Systems, vol. 13, no. 7, pp. 657-673, July 2003.
9. T. Wedi and H.G. Musmann, "Motion- and aliasing-compensated prediction for hybrid video coding," IEEE Transactions on Circuits and Systems for Video Technology, vol. 13, pp. 577-587, July 2003.
10. T. Wiegand, X. Zhang, and B. Girod, "Long-term memory motion-compensated prediction for video coding," IEEE Trans. Circuits Syst. Video Technol., vol. 9, pp. 70-84, Feb. 1999.
11. T. Wiegand, H. Schwarz, A. Joch, and F. Kossentini, "Rate- constrained coder control and comparison of video coding standards," IEEE Transactions on Circuits and Systems for Video Technology, vol. 13, pp. 688-703, July 2003.
12. B. Girod, "Efficiency analysis of multihypothesis motion-compensated prediction for video coding," IEEE Trans. Image Processing, vol. 9, Feb. 1999.
13. M. Flierl, T. Wiegand, and B. Girod, "Rate-constrained multi-hypothesis motion-compensated prediction for video coding," in Proc. IEEE Int. Conf. Image Processing, Vancouver, BC, Canada, Sept. 2000, vol. 3, pp. 150-153.
14. N. Ahmed, T. Natarajan, and R. Rao, "Discrete cosine transform," IEEE Transactions on Computers, vol. C-23, pp. 90-93, Jan. 1974.
15. Iain E G Richardson, "H.264/MPEG-4 Part 10 White Paper." Available: http://www.vcodex.fsnet.co.uk/resources.html
16. H. Malvar, A. Hallapuro, M. Karczewicz, and L. Kerofsky, "Low-Complexity transform and quantization in H.264/AVC," IEEE Transactions on Circuits and Systems for Video Technology, vol. 13, pp. 598-603, July 2003.
17. D. Marpe, H. Schwarz, and T. Wiegand, "Context-based adaptive binary arithmetic coding in the H.264/AVC video compression standard," IEEE Transactions on Circuits and Systems for Video Technology, vol. 13, pp. 620-636, July 2003.
18. P. List, A. Joch, J. Lainema, and G. Bjontegaard, "Adaptive deblocking filter" IEEE Transactions on Circuits and Systems for Video Technology, vol. 13, pp. 614-619, July 2003.
19. J. Ribas-Corbera, P.A. Chou, and S. Regunathan, "A generalized hypothetical reference decoder for H.264/AVC," IEEE Transactions on Circuits and Systems, vol. 13, no. 7, pp. 674-687, July 2003.
20. B. Girod, M. Kalman, Y.J. Liang, and R. Zhang, "Advances in video channel-adaptive streaming," in Proc. ICIP 2002, Rochester, NY, Sept. 2002.
21. Y.J. Liang and B. Girod, "Rate-distortion optimized low-latency video streaming using channel-adaptive bitstream assembly," in Proc. ICME 2002, Lausanne, Switzerland, Aug. 2002.
22. S.H. Kang and A. Zakhor, "Packet scheduling algorithm for wireless video streaming," in Proc. International Packet Video Workshop 2002, Pittsburgh, PY, April 2002.
23. M. Karczewicz and R. Kurçeren, "The SP and SI frames design for H.264/AVC," IEEE Transactions on Circuits and Systems, vol. 13, no. 7, pp. 637-644, July 2003.
24. S. Wenger. (September 2001). Common Conditions for wire-line, low delay IP/UDP/RTP packet loss resilient testing. VCEG-N79rl. Available: http://standard.pictel.com/ftp/video-site/0109_San/VCEG-N79rl.doc,.
25. S. Wenger, "H.264/AVC over IP," IEEE Transactions on Circuits and Systems, vol. 13, no. 7, pp. 645-656, July 2003.
26. Y.-K. Wang, M.M. Hannuksela, V. Varsa, A. Hourunranta, and M. Gabbouj, "The error concealment feature in the H.26L test model," in Proc. ICIP, vol. 2, pp. 729-732, Sept. 2002.
27. Y.-K. Wang, M.M. Hannuksela, and M. Gabbouj, "Error-robust inter/intra mode selection using isolated regions," in Proc. Int. Packet Video Workshop 2003, Apr. 2003.
28. R. Zhang, S.L. Regunathan, and K. Rose, "Video coding with optimal inter/intra-mode switching for packet loss resilience," IEEE JSAC, vol. 18, no. 6, pp. 966-976, July 2000.
29. +," 1997 International Workshop on Audio-Visual Services over Packet Networks, Sept. 1997.
30. Y.-K. Wang, M.M. Hannuksela, and M. Gabbouj, "Error resilient video coding using unequally protected key pictures," in Proc. International Workshop VLBV03, Sept. 2003.
31. B. Girod and N. Färber, "Feedback-based error control for mobile video transmission," in Proc. of IEEE, vol. 97, no. 10, Oct. 1999, pp. 1707-1723.
32. S. Fukunaga, T. Nakai, and H. Inoue, "Error resilient video coding by dynamic replacing of reference pictures," in Proc. IEEE Globecom, vol. 3, Nov. 1996.
33. A. Ortega and K. Ramchandran, "Rate-distortion methods for image and video compression," IEEE Signal Processing Magazine, vol. 15 no. 6, pp. 23-50, Nov. 1998.
34. G.J. Sullivan and T. Wiegand, "Rate-distortion optimization for video compression," IEEE Signal Processing Magazine, vol. 15, pp. 74-90, Nov. 1998.
35. T. Wiegand and B. Girod, "Lagrangian multiplier selection in hybrid video coder control," in Proc. of ICIP 2001, Thessaloniki, Greece, Oct. 2001.
36. T. Stockhammer, D. Kontopodis, and T. Wiegand, "Rate-distortion optimization for H.26L video coding in packet loss environment," in Proc. Packet Video Workshop 2002, Pittsburgh, PY, April 2002.
37. A. Joch, F. Kossentini, H. Schwarz, T. Wiegand, and G. Sullivan, "Performance comparison of video coding standards using Lagrangian coder control," Proc. of the IEEE ICIP 2002, part II, pp. 501-504, Sept. 2002.
38. ISO/EC 15444-3, "Motion-JPEG2000" (JPEG2000 Part 3), Geneva, 2002.
39. D. Marpe, V. George, H.L. Cycon, and K.U. Barthel, "Performance evaluation of Motion-JPEG2000 in comparison with H.264/AVC operated in intra coding mode," in Proc. SPIE Conf. on Wavelet Applications in Industrial Processing, Photonics East, Rhode Island, USA, Oct. 2003.
40. F. Catthoor, et al., Custom Memory Management Methodology. Kluwer Academic Publishers, 1998
41. J. Bormans et al., "Integrating system-level low power methodologies into a real-life design flow," in Proc. IEEE PATMOS '99, Kos, Greece, Oct. 1999, pp. 19-28.
42. Chimienti, L. Fanucci, R. Locatelli, and S. Saponara, "VLSI architecture for a low-power video codec system," Microelectronics Journal, vol. 33, no. 5, pp. 417-427, 2002.
43. T. Meng et al., "Portable video-on-demand in wireless communication," Proc. of the IEEE, vol. 83 no. 4, pp. 659-680, 1995.
44. J. Jung, E. Lesellier, Y. Le Maguet, C. Miro, and J. Gobert, "Philips deblocking solution (PDS), a low complexity deblocking for JVT," Joint Video Team of ISO/IEC MPEG and ITU-T VCEG, JVT-B037, Geneva, CH, Feb. 2002.
45. L. Nachtergaele et al., "System-Level power optimization of video codecs on embedded cores: A systematic approach," Journal of VLSI Signal Processing, Kluwer Academic Publisher, vol. 18, no. 2, pp. 89-111, 1998.
46. http://www.imec.be/atomium
47. S. Bauer, et al., "The MPEG-4 multimedia coding standard: Algorithms, architectures and applications," Journal of VLSI Signal Processing. Boston: Kluwer, vol. 23, no. 1, pp. 7-26, Oct. 1999.
48. S. Saponara, C. Blanch, K. Denolf, and J. Bormans, "The JVT advanced video coding standard: Complexity and performance analysis on a tool-by-tool basis," Packet Video Workshop (PV'03), Nantes, France, April 2003.
49. V. Lappalainen et al., "Optimization of emerging H.26L video encoder," in Proc. IEEE SIPS'01, Sept. 2001, pp. 406-415.
50. V. Lappalainen, A. Hallapuro, and T. Hamalainen, "Performance analysis of low bit rate H.26L video encoder," in Proc. IEEE ICASSP'01, May 2001, pp. 1129-1132.
51. M. Horowitz, A. Joch, F. Kossentini, and A. Hallapuro, "H.264/AVC baseline profile decoder complexity analysis," IEEE Tran. Circ. Sys. Video Tech., vol. 13, no 7, pp. 715-727, 2003.