Overview of the scalable video coding extension of the H.264/AVC standard

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 17, Issue 9, 2007, Pages 1103-1120

  Schwarz, Heiko ^b   Marpe, Detlev ^a,b   Wiegand, Thomas ^a,b  

^a IEEE

^b FRAUNHOFER HEINRICH HERTZ INSTITUTE   (Germany)

Author keywords

H.264 AVC; MPEG 4; Scalable Video Coding (SVC); Standards; Video

Indexed keywords

BIT ERROR RATE; DECODING; IMAGE COMPRESSION; MOTION PICTURE EXPERTS GROUP STANDARDS; SCALABILITY;

FIDELITY; LOSSY TRANSMISSION ENVIRONMENTS; SCALABLE VIDEO CODING EXTENSIONS; SPATIAL RESOLUTIONS; VIDEO COMPRESSION CAPABILITIES;

IMAGE CODING;

EID: 34748835762     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2007.905532     Document Type: Conference Paper

References (51)

1. Video Codec for Audiovisual Services at p × 64 kbit/s, ITU-T Rec. H.261, ITU-T. Version 1: Nov. 1990, Version 2: Mar. 1993.
2. Coding of Moving Pictures and Associated Audio for Digital Storage Media at up to About 1.5 Mbit/s - Part 2: Video, ISO/IEC 11172-2 (MPEG-1 Video), ISO/IEC JTC 1, Mar. 1993.
3. Generic Coding of Moving Pictures and Associated Audio Information - Part 2: Video, ITU-T Rec. H.262 and ISO/IEC 13818-2 (MPEG-2 Video). ITU-T and ISO/IEC JTC 1, Nov. 1994.
4. Video Coding for Low Bit Rate communication, ITU-T Rec. H.263, ITU-T, Version 1: Nov. 1995, Version 2: Jan. 1998, Version 3: Nov. 2000.
5. Coding of audio-visual objects - Part 2: Visual, ISO/IEC 14492-2 (MPEG-4 Visual). ISO/IEC JTC 1, Version 1: Apr. 1999, Version 2: Feb. 2000, Version 3: May 2004.
6. Advanced Video Coding for Generic Audiovisual Services, ITU-T Rec. H.264 and ISO/IEC 14496-10 (MPEG-4 AVC), ITU-T and ISO/IEC JTC 1, Version 1: May 2003. Version 2: May 2004, Version 3: Mar. 2005, Version 4: Sept. 2005, Version 5 and Version 6: June 2006, Version 7: Apr. 2007, Version 8 (including SVC extension): Consented in July 2007.
7. Generic Coding of Moving Pictures and Associated Audio Information - Part 1: Systems, ITU-T Rec. H.222.0 and ISO/IEC 13818-1 (MPEG-2 Systems). ITU-T and ISO/IEC JTC 1, Nov. 1994.
8. Narrow-Band Visual Telephone Systems and Terminal Equipment, ITU-T Rec. H.320, ITU-T, Mar. 1993.
9. H. Schulzrinne, S. Casner, R. Frederick, and V. Jacobson, "RTP: A transport protocol for real-time applications," RFC 1889, Jan. 1996.
10. T. Wiegand, G. J. Sullivan, J. Reichel, H. Schwarz, and M. Wien, Joint Draft 11 of SVC Amendment, Joint Video Team, Doc. JVT-X201, Jul. 2007.
11. A. Eleftheriadis, M. R. Civanlar, and O. Shapiro, "Multipoint video-conferencing with scalable video coding," J. Zhejiang Univ. Sci. A. vol. 7, no. 5, pp. 696-705. May 2006.
12. T. Schierl and T. Wiegand, "Mobile video transmission using SVC," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 9, Sep. 2007.
13. M. Wien, R. Cazoulat, A. Graffunder, A. Hutter, and P. Amon, "Real-time system for adaptive video streaming based on SVC," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 9, pp. 1227-1237, Sep. 2007.
14. T. Wiegand, H. Schwarz, A. Joch, F. Kossentini, and G. J. Sullivan, "Rate-constrained coder control and comparison of video coding standards," IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 7, pp. 688-703, Jul. 2003.
15. N. S. Jayant and P. Noll, Digital Coding of Waveforms. Englewood Cliffs, NJ: Prentice-Hall, Mar. 1984.
16. S.-J. Choi and J. W. Woods, "Motion-compensated 3-D subband coding of video." IEEE Trans. Image Process., vol. 8, no. 2, pp. 155-167, Feb. 1999.
17. B. Pesquet-Popescu and V. Bottreau, "Three-dimensional lifting schemes for motion-compensated video compression." in Proc. ICASSP. May 2001, pp. 1793-1796.
18. L. Luo, J. Li, S. Li, Z. Zhuang, and Y.-Q. Zhang, "Motion compensated lifting wavelet and its application in video coding," in Proc. ICME, Aug. 2001, pp. 365-368.
19. A. Secker and D. Taubman, "Motion-compensated highly scalable video compression using an adaptive 3D wavelet transform based on lifting," in Proc. ICIP, Oct. 2001. vol. 2, pp. 1029-1032.
20. MPEG Video Subgroup Chair, Registered Responses to the Call for Proposals on Scalable Video Coding, ISO/IEC JTC 1/SC29/WG11, Doc. M10569, Mar. 2004.
21. H. Schwarz, T. Hinz, H. Kirchhoffer, D. Marpe, and T. Wiegand, Technical Description of the HHI Proposal for SVC CE1, ISO/IEC JTC 1/SC 29/WG 11, Doc. M11244, Oct. 2004.
22. J. Reichel, M. Wien, and H. Schwarz, Scalable Video Model 3.0, ISO/IEC JTC 1/SC 29/WG 11, Doc. N6716, Oct. 2004.
23. T. Wiegand, G. J. Sullivan, G. Bjøntegaard, and A. Luthra, "Overview of the H.264/AVC video coding standard," IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 7, pp. 560-576, Jul. 2003.
24. G. J. Sullivan and T. Wiegand, "Video compression-From concepts to the H.264/AVC standard," Proc. IEEE, vol. 93, no. 1, pp. 18-31, Jan. 2005.
25. D. Marpe, T. Wiegand, and G. J. Sullivan, "The H.264/MPEG4 advanced video coding standard and its applications," IEEE Commun. Mag., vol. 44, no. 8, pp. 134-144, Aug. 2006.
26. G. J. Sullivan, H. Yu, S. Sekiguchi, H. Sun, T. Wedi, S. Wittmann, Y.-L. Lee, A. Segall, and T. Suzuki, "New standardized extensions of MPEG4-AVC/H.264 for professional-quality video applications," presented at the ICIP, San Antonio, TX, Sep. 2007.
27. T. Wiegand, X. Zhang, and B. Girod, "Long-term memory motion-compensated prediction." IEEE Trans. Circuits Syst. Video Technol., vol. 9, no. 1, pp. 70-84, Feb. 1999.
28. H. Schwarz, D. Marpe, and T. Wiegand, Hierarchical B Pictures, Joint Video Team, Doc. JVT-P014. Jul. 2005.
29. H. Schwarz, D. Marpe, and T. Wiegand, "Analysis of hierarchical B-pictures and MCTF," in Proc. ICME, Toronto. ON, Canada, Jul. 2006, pp. 1929-1932.
30. K. Ramchandran, A. Ortega, and M. Vetterli, "Bit allocation for dependent quantization with applications to multiresolution and MPEG video coders," IEEE Trans. Image Process, vol. 3, no. 5, pp. 533-545, Sep. 1994.
31. J. Reichel, H. Schwarz, and M. Wien, Joint Scalable Video Model 11 (JSVM 11), Joint Video Team, Doc. JVT-X202, Jul. 2007.
32. M. Flierl, T. Wiegand, and B. Girod, "A locally optimal design algorithm for block-based multi-hypothesis motion-compensated prediction," in Proc. Data Compression Conf., Apr. 1998, pp. 239-248.
33. H. Schwarz, D. Marpe, and T. Wiegand. SVC Core Experiment 2.1: Inter-Layer Prediction of Motion and Residual Data, ISO/IEC JTC 1/SC 29/WG 11, Doc. M11043, Jul. 2004.
34. A. Segall and G. J. Sullivan, "Spatial scalability," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 9, pp. 1121-1135, Sep. 2007.
35. E. François and J. Vieron, "Interlaced coding in SVC," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 9, pp. 1136-1148, Sep. 2007.
36. H. Schwarz, D. Marpe, and T. Wiegand, Further Results for the HHI Proposal on Combined Scalability, ISO/IEC JTC 1/SC 29/WG 11, Doc. M11399, Oct. 2004.
37. H. Schwarz, D. Marpe, and T. Wiegand, "Constrained inter-layer prediction for single-loop decoding in spatial scalability," in Proc. ICIP, Genoa. Italy, Sep. 2005, vol. 2, pp. 870-873.
38. H. Schwarz, D. Marpe, and T. Wiegand, Further Results on Constrained Inter-layer Prediction, Joint Video Team, Doc. JVT-O074, Apr. 2005.
39. H. Schwarz, D. Marpe, and T. Wiegand, Independent Parsing of Spatial and CGS Layers, Joint Video Team, Doc. JVT-S069, Mar. 2006.
40. H. Schwarz and T. Wiegand, "R-D optimized multi-layer encoder control for SVC," presented at the ICIP, San Antonio, TX, Sep. 2007.
41. H. Kirchhoffer, H. Schwarz, and T. Wiegand, CE1: Simplified FGS, Joint Video Team. Doc. JVT-W090, Apr. 2007.
42. J.-R. Ohm, "Advances in scalable video coding," Proc. IEEE. vol. 93, no. 1, pp. 42-56, Jan. 2005.
43. M. Winken, H. Schwarz, D. Marpe, and T. Wiegand, "Adaptive refinement of motion information for fine-granular SNR scalable video coding," presented at the EuMob, Alghero, Italy, Sep. 2006.
44. H. Schwarz, D. Marpe, and T. Wiegand. Comparison of MCTF and Closed-Loop Hierarchical B Pictures, Joint Video Team, Doc. JVT-P059, Jul. 2005.
45. X. Wang, Y. Bao, M. Karczewicz, and J. Ridge, Implementation of Closed-Loop Coding in JSVM, Joint Video Team, Doc. JVT-P057, Jul. 2005.
46. I. Amonou, N. Cammas, S. Kervadec, and S. Pateux, "Optimized rate-distortion extraction with quality layers," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 9, pp. 1186-1193, Sep. 2007.
47. A. Segall, CE 8: SVC-to-AVC Bit-Stream Rewriting for Coarse Grain Scalability, Joint Video Team, Doc. JVT-V035, Jan. 2007.
48. M. Wien, H. Schwarz, and T. Oelbaum, "Performance analysis of SVC," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 9, pp. 1194-1203, Sep. 2007.
49. S. Pateux, Y.-K. Wang, M. Hannuksela, and A. Eleftheriadis, "System and transport interface of the emerging SVC standard," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 9, pp. 1149-1163, Sep. 2007.
50. S. Wenger and T. Schierl, "RTP payload for SVC," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 9, pp. 1204-1217, Sep. 2007.
51. D. Singer, T. Rathgen, and P. Amon, "File format for SVC," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 9, pp. 1174-1185, Sep. 2007.