State-of-the-art and trends in scalable video compression with wavelet-based approaches

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 17, Issue 9, 2007, Pages 1238-1255

  Adami, Nicola ^a,b   Signoroni, Alberto ^a,b   Leonardi, Riccardo ^a,b  

^a IEEE   (Italy)

^b UNIVERSITY OF BRESCIA   (Italy)

Author keywords

Entropy coding; Motion compensated temporal filtering (MCTF); MPEG; Scalable Video Coding (SVC); Spatio temporal multiresolution representations; Video coding architectures; Video quality assessment; Wavelets

Indexed keywords

BIT STREAMS; ENTROPY CODING; MOTION COMPENSATED TEMPORAL FILTERING (MCTF); SCALABLE VIDEO CODING (SVC); SCALABLE VIDEO COMPRESSIONS; SPATIO TEMPORAL MULTIRESOLUTION REPRESENTATIONS; VIDEO CODING ARCHITECTURES; VIDEO QUALITY ASSESSMENTS; WAVELET BASED MOTION COMPENSATED APPROACHES (WSVC);

IMAGE CODING; IMAGE QUALITY; MOTION PICTURE EXPERTS GROUP STANDARDS; SCALABILITY; WAVELET ANALYSIS; WAVELET TRANSFORMS;

IMAGE COMPRESSION;

EID: 34748886035     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2007.906828     Document Type: Article

References (88)

1. "Registered Responses to the Call for Proposals on Scalable Video Coding," Munich, Germany, ISO/MPEG Video, Tech. Rep. M10569/S01-S24, Mar. 2004.
2. "Joint Scalable Video Model (JSVM) 6.0," Montreux, Switzerland, ISO/MPEG Video, Tech. Rep. N8015, Apr. 2006.
3. R. Leonardi, T. Oelbaum, and J.-R. Ohm, "Status report on wavelet video coding exploration," Montreux, Switzerland, Tech. Rep. N8043, Apr. 2006.
4. "Applications and Requirements For Scalable Video Coding, ISO/IEC JTC1/SC29/WG11, 71st MPEG Meeting." Hong Kong, China, ISO/ MPEG Requirements, Tech. Rep. N6880, Jan. 2005.
5. "Description of Core Experiments in MPEG-21 Scalable Video Coding ISO/IEC JTC1/SC29/WG11, 69th MPEG Meeting Redmond," WA. USA, ISO/MPEG Video, Tech. Rep. N6521, Jul. 2004.
6. P. Burt and E. Adelson, "The laplacian pyramid as a compact image code," IEEE Trans. Commun., vol. COM-31, no. 4, pp. 532-540, Apr. 1983.
7. S. Mallat, A Wavelet Tour of Signal Processing. San Diego. CA: Academic, 1998.
8. P. Vaidyanathan, Multirate Systems and Filter Banks. Englewood Cliffs, NJ: Prentice-Hall. 1992.
9. M. Vetterli and J. Kovačević, Wavelets and Subband Coding., Englewood Cliffs, NJ: Prentice-Hall, 1995.
10. I. Daubechies, Ten Lectures on Wavelets. Philadelphia, PA: SIAM, 1992.
11. W. Sweldens. "The lifting scheme: A construction of second generation wavelets," SIAM J. Math. Anal., vol. 29, no. 2, pp. 511-546, 1997.
12. I. Daubechies and W. Sweldens, "Factoring wavelet transforms into lifting steps," J. Fourier Anal. Appl., vol. 4. no. 3, pp. 247-269, 1998.
13. A. Calderbank, I. Daubechies, W. Sweldensand, and B.-L. Yeo, "Wavelet transforms that map integers to integers," Appl. Comput. Harmon. Anal. vol. 5, no. 3, pp. 332-369, 1998.
14. H. Heijmans and J. Goutsias, "Multiresolution signal decomposition schemes. Part 2: Morphological wavelets," The Netherlands, CWI, Amsterdam, Tech. Rep. PNA-R9905, Jun. 1999.
15. J.-R. Ohm, Multimedia Communication Technology., New York: Springer Verlag, 2003.
16. J. Ohm, "Three-dimensional subband coding with motion compensation." IEEE Trans, Image Process., vol. 3, no. 9, pp. 559-571, Sep. 1994.
17. S.-J. Choi and J. Woods, "Motion-compensated 3-D subband coding of video," IEEE Trans. Image Process., vol. 8, no. 2, pp. 155-167, Feb. 1999.
18. B.-J. Kim, Z. Xiong, and W. Pearlman, "Low bit-Rate scalable video coding with 3-D set partitioning in hierarchical trees (3D SPIHT)," IEEE Trans. Circuits Syst. Video Technol., vol. 10, no. 8, pp. 1374-1387, Dec. 2000.
19. A. Secker and D. Taubman, "Lifting-based invertible motion adaptive transform (LIMAT) framework for highly scalable video compression," IEEE Trans. Image. Processing, vol. 12, no. 12, pp. 1530-1542, Dec. 2003.
20. G. Pau, C. Tillier, B. Pesquet-Popescu, and H. Heijmans, "Motion compensation and scalability in lifting-based video coding," Signal Process.: Image Commun., vol. 19, no. 7, pp. 577-600, Aug. 2004.
21. B. Pesquet-Popescu and V. Bottreau, "Three dimensional lifting schemes for motion compensated video compression," in Proc. ICASSP, Salt Lake City, UT, May 2001, vol. 3, pp. 1793-1796.
22. J. Ohm, "Motion-compensated wavelet lifting filters with, flexible adaptation," in Proc. Thyrrenian Int. Workshop Digital Commun. (IWDC), Capri, Italy, Sep. 2002, pp. 113-120.
23. Y. Zhan, M. Picard, B. Pesquet-Popescu, and H. Heijmans, "Long temporal filters in lifting schemes for Scalable Video Coding," ISO/IEC JTC1/SC29/WG11, 61th MPEG Meeting, Klagenfurt, Austria, Tech. Rep. M8680, Jul. 2002.
24. J. Xu, Z. Xiong, S. Li, and Y.-Q. Zhang, "Three-dimensional embedded subband coding with optimal truncation (3D ESCOT)," Appl. Comput. Harmon. Anal., vol. 10, pp. 290-315, 2001.
25. H. Schwarz, D. Marpe, and T. Wiegand, "Scalable extension of H.264/AVC, ISO/IEC JTC1/SC29/WG11," 68th MPEG Meeting Munich, Germany, Tech. Rep. M10569/S03, Mar. 2004.
26. R. Xiong, F. Wu, S. Li, Z. Xiong, and Y.-Q. Zhang, "Exploiting temporal correlation with block-size adaptive motion alignment for 3-D wavelet coding," in Proc. Visual Commun. Image Process., San Jose, CA, Jan. 2004, vol. 5308, pp. 144-155.
27. A. Secker and D. Taubman, "Highly scalable video compression using a lifting-based 3-D wavelet transform, with deformable mesh motion compensation," in Proc. Int. Conf. Image Process. (ICIP), Sep. 2002, vol. 3, pp. 749-752.
28. L. Luo, F. Wu, S. Li, Z. Xiong, and Z. Zhuang, "Advanced motion threading for 3-D wavelet video coding," Signal Process.: Image. Commun., vol. 19, no. 7, pp. 601-616, 2004.
29. D. Turaga, M. van der Schaar, and B. Pesquet-Popescu, "Temporal prediction and differential coding of motion vectors in the MCTF framework," in Proc. Int. Conf. Image Process. (ICIP), Barcelona, Spain, Sep. 2003, vol. 2, pp. 57-60.
30. V. Valéntin, M. Cagnazzo, M. Antonini, and M. Barlaud, "Scalable context-based motion vector coding for video compression," in Proc. Picture Coding Symp. (PCS), Apr. 2003, pp. 63-68.
31. J. Xu, R. Xiong, B. Feng, G. Sullivan, M.-C. Lee, F. Wu, and S. Li, "3D subband video coding using barbell lifting," ISO/IEC JTC1/SC29/ WG11, 68th MPEG Meeting Munich, Germany, Tech. Rep. M10569/ S05, Mar. 2004.
32. C. Tillier, B. Pesquet-Popescu, and M. van der Schaar, "Highly scalable video coding by bidirectional predict-update 3-band schemes," in Proc. Int. Conf. Acoust. Speech Signal Process. (ICASSP), Montreal, Canada, May 2004, vol. 3, pp. 125-128.
33. M. V. der Schaar and D. Turaga, "Unconstrained motion compensated temporal filtering (UMCTF) framework for wavelet video coding," in Proc. Int. Conf. Acoust. Speech and Signal Process. (ICASSP), Hong-Kong, Apr. 2003, vol. 3, pp. 81-84.
34. N. Mehrseresht and D. Taubman., "Adaptively weighted update steps in motion compensated lifting based on scalable video compression," in Proc. Int. Conf. on Image Process. (ICIP), Barcelona, Spain, Sep. 2003, vol. 3, pp. 771-774.
35. D. Maestroni, M. Tagliasacchi, and S. Tubaro, "In-band adaptive up-date step based on local content activity," in Proc. Visual Commun. Image Process., Beijing, China, Jul. 2005, vol. 5960, pp. 169-176.
36. "Wavelet Codec Reference Document and Software Manual," ISO/IEC JTC1/SC29/WG11, 73th MPEG Meeting, Poznan, Poland, ISO/MPEG Video, Tech. Rep. N7334, Jul. 2005.
37. H. Schwarz, D. Marpe, and T. Wiegand, "Analysis of hierarchical B-pictures and MCTF," presented at the nt. Conf. Multimedia Expo (ICME), Toronto, ON, Canada, Jul. 2006.
38. D. Turaga, M. van der Schaar, and B. Pesquet-Popescu, "Complexity scalable motion compensated wavelet video encoding," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 8, pp. 982-993, Aug. 2005.
39. C. Parisot, M. Antonini, and M. Barlaud, "Motion-conpensated scan based wavelet transform for video coding," in Proc. Thyrrenian Int. Workshop on Digital Commun. (IWDC), Capri, Italy, Sep. 2002, pp. 121-128.
40. G. Pau, B. Pesquet-Popescu, M. van der Schaar, and J. Viéron, "Delay-performance tradeoffs in motion-compensated scalable subband video compression," presented at the ACIVS, Brussels, Belgium, Sep. 2004.
41. J. Shapiro, "Embedded image coding using zerotrees of wavelet coefficients," IEEE Trans. Signal Process., vol. 41, no. 12, pp. 3445-3462, Dec. 1993.
42. A. Said and W. A. Pearlman, "A new fast and efficient image codec based on set partitioning in hierarchical trees," IEEE Trans. Circuits Syst. Video Technol., vol. 6, no. 3, pp. 243-250, Jun. 1996.
43. S.-T. Hsiang and J. W. Woods, "Embedded image coding using zeroblocks of subband/wavelet coefficients and context modeling," in Proc. MPEG-4 Workshop Exhibition ISCAS, Geneva, Switzerland, May 2000, vol. 3, pp. 662-665.
44. S. D. Servetto, K. Ramchandran, and M. T. Orchard, "Image coding based on a morphological representation of wavelet data," IEEE Trans. Image Process., vol. 8, no. 9, pp. 1161-1174, Sep. 1999.
45. F. Lazzaroni, R. Leonardi, and A. Signoroni, "High-performance embedded morphological wavelet coding," IEEE Signal Process. Lett., vol. 10, no. 10, pp. 293-295, Oct. 2003.
46. F. Lazzaroni, R. Leonardi, and A. Signoroni, "High-performance embedded morphological wavelet coding," in Proc. Thyrrenian Int. Workshop Digital Commun. (IWDC), Capri, Italy, Sep. 2002, pp. 319-326.
47. F. Lazzaroni, A. Signoroni, and R. Leonardi, "Embedded morphological dilation coding for 2-D and 3-D images," in Proc. Visual Commun. Image Process., San José, CA, Jan. 2002, vol. 4671, pp. 923-934.
48. D. Taubman, "High performance scalable image compression with EBCOT," IEEE Trans. Image Process., vol. 9, no. 7, pp. 1158-1170, Jul. 2000.
49. D. Taubman, E. Ordentlich, M. Weinberger, and G. Seroussi, "Embedded block coding in JPEG 2000," Signal Process.: Image. Commun., vol. 17, pp. 49-72, Jan. 2002.
50. J. Li and S. Lei, "Rate-distortion optimized embedding," in Proc. Picture Coding Symp., Sep. 1997, pp. 201-206.
51. S.-T. Hsiang and J. Woods, "Embedded video coding using invertible motion compensated 3-D subband/wavelet filter bank," Signal Process.: Image Commun., vol. 16, no. 8, pp. 705-724, May 2001.
52. P. Chen and J. W. Woods, "Bidirectional MC-EZBC with lifting implementation," IEEE Trans. Circuits Syst. Video Technol., vol. 14, no. 10, pp. 1183-1194, Oct. 2004.
53. N. Adami, M. Brescianini, M. Dalai, R. Leonardi, and A. Signoroni, "A fully scalable video coder with inter-scale wavelet prediction and morphological coding," in Proc. Visual Commun. Image Process., Beijing, China, Jul. 2005, vol. 5960, pp. 535-546.
54. V. Bottreau, M. Benetiere, B. Felts, and B. Pesquet-Popescu, "A fully scalable 3-D subband video codec," in Proc. Int. Conf. Image Process. (ICIP), Thessaloniki, Greece, Oct. 2001, vol. 2, pp. 1017-1020.
55. K. Ho and D. Lun, "Efficient wavelet based temporally scalable video coding," in Proc. Int. Conf. Image Process. (ICIP), New York, USA, Aug. 2002, vol. 1, pp. 881-884.
56. N. Gammas, "Codage video scalable par maillages et ondelettes t + 2 D" Ph.D. dissertation, Univ. Rennes, Rennes, France, Nov. 2004 [On-line]. Available: http:www.inria.fr/rrrt/tu-1122.html
57. G. Pau, "Ondlettes et décompositions spatio-temporelles avancées; application au codage vidéo scalable," Ph.D. dissertation, Ecole Nat. Supér. Télecomun., Paris, France, 2007.
58. M. Flierl and B. Girod, "Video coding with motion-compensated lifted wavelet transforms," Signal Process.: Image Commun., vol. 19, no. 7, pp. 561-575, Aug. 2004.
59. J. Barbarien, A. Munteanu, F. Verdicchio, Y. Andreopoulos, J. Cornells, and P. Schelkens, "Motion and texture rate-allocation for prediction-based scalable motion-vector coding," Signal Process.: Image Commun., vol. 20, no. 4, pp. 315-342, Apr. 2005.
60. M. Mrak, N. Sprljan, G. Abhayaratne, and E. Izquierdo, "Scalable generation and coding of motion vectors for highly scalable video coding," presented at the Picture Coding Symp. (PCS), San Francisco, CA, 2004.
61. V. Bottreau, C. Guillemot, R. Ansari, and E. Francois, "SVC CE5: Spatial Transform Using Three Lifting Steps Filters," ISO/IEC JTC1/ SC29/WG11, 70th MPEG Meeting, Palma de Mallorca, Spain, Tech. Rep. M11328, Oct. 2004.
62. Y. Wu and J. Woods, "Aliasing Reduction for Scalable Subband/Wavelet Video Coding," ISO/IEC JTC1/SC29/WG11, 73rd MPEG Meeting, Poznan, Poland, Tech. Rep. M12376, Jul. 2005.
63. Y. Andreopoulos, A. Munteanu, J. Barbarien, M. van der Schaar, J. Cornelis, and P. Schelkens, "Inband motion compensated temporal filtering," Signal Process.: Image Commun., vol. 19, no. 7, pp. 653-673, Aug. 2004.
64. H.-W. Park and H.-S. Kim, "Motion estimation using low-band-shift method for wavelet-based moving-picture coding," IEEE Trans. Image Process., vol. 9, pp. 577-587, 2000.
65. Y. Andreopoulos, A. Munteanu, G. V. D. Auwera, J. Cornelis, and P. Schelkens, "Complete-to-overcomplete discrete wavelet transforms: Theory and applications," IEEE Trans. Signal Process., vol. 53, no. 4, pp. 1398-1412, 2005.
66. "Subjective test results for the CfP on Scalable Video Coding technology," ISO/IEC JTC1/SC29/WG11, 68th MPEG Meeting, Munich, Germany, Tech. Rep. N6383, Mar. 2004.
67. N. Mehrseresht and D. Taubman, "An efficient content-adaptive MC 3D-DWT with enhanced spatial and temporal scalability." in Proc. Int. Conf. Image Process. (ICIP). Oct. 2004. vol. 2, pp. 1329-1332.
68. D. Taubman, N. Mehrseresht. and R. Leung}, "SVC technical contribution: Overview of recent technology developments at UNSW ISO/IEC JTC1/SC29/WG11," 69th MPEG Meeting, Redmond, WA, USA, Tech. Rep. M10868, Jul. 2004.
69. N. Sprljan. M. Mrak, T. Zgaljic, and E. Izquierdo, "Software proposal for Wavelet Video Coding Exploration Group ISO/IEC JTC1/SC29/WG11, " 75th MPEG Meeting, Bangkok, Thailand, Tech. Rep. M12941, Jan. 2006.
70. M. Mrak, N. Sprljan, T. Zgaljic. N. Ramzan, S. Wan, and E. Izquierdo, "Performance evidence of software proposal for Wavelet Video Coding Exploration Group", ISO/IEC JTC1/SC29/WG11, 6th MPEG Meeting, Montreux, Switzerland, Tech. Rep. M13146, Apr. 2006.
71. C. Ong, S. Shen, M. Lee, and Y. Honda, "Wavelet Video Coding - Generalized Spatial Temporal Scalability (GSTS)," ISO/IEC JTC1/SC29/ WG11. 72nd MPEG Meeting, Busan, Korea, Tech. Rep. M11952. Apr. 2005.
72. "Scalable Video Model v2.0 ISO/IEC JTC1/SC29/WG11," 69th MPEG Meeting, Redmond, WA, USA, Tech. Rep. N6520, Jul. 2004, ISO/MPEG Video.
73. M. N. Do and M. Vetterli, "Framing pyramids," IEEE Trans. Signal Processing, vol. 51, no. 9, pp. 2329-2342, Sep. 2003.
74. M. Flierl and P. Vandergheynst, "An improved pyramid for spatially scalable video coding." in Proc. Int. Conf. Image Process. (ICIP), Genova, Italy, Sep. 2005, vol. 2, pp. 878-881.
75. G. Rath and C. Guillemot, "Representing laplacian pyramids with varying amount of redundancy," presented at the Eur. Signal Process. Conf. (EUSIPCO), Florence, Italy, Sep. 2006.
76. N. Adami, M. Brescianini, R. Leonardi, and A. Signoroni, SVC CE1: STool - A native spatially scalable approach to SVC ISO/IEC JTC1/ SC29/WG11," 70th MPEG Meeting, Palma de Mallorca, Spain, Tech. Rep. M11368, Oct. 2004.
77. "Report of the subjective quality evaluation for SVC CE1 ISO/IEC JTC1/SC29/WG11," 70th MPEG Meeting, Palma de Mallorca, Spain, Tech. Rep. N6736, Oct. 2004, ISO/MPEG Video.
78. R. Leonardi and S. Brangoulo, "Wavelet codec reference document and software manual v2.0," ISO/IEC JTC1/SC29/WG11. 74th MPEG Meeting. Nice, France, Tech. Rep. N7573, Oct. 2005.
79. D. Zhang, S. Jiao, J. Xu, F. Wu, W. Zhang, and H. Xiong, "Mode-based temporal filtering for in-band wavelet video coding with spatial scalability," in Proc. Visual Commun. Image Process., Beijing, China, Jul. 2005, vol. 5960, pp. 355-363.
80. M. Beermann and M. Wien, "Wavelet video coding, EE4: Joint reduction of ringing and blocking, ISO/IEC JTC1/SC29/WG11," 74th MPEG Meeting, Nice, France, Tech. Rep. M12640, Oct. 2005.
81. M. Li and T. Nguyen, "Optimal wavelet filter design in scalable video coding." in Proc. Int. Conf. Image Process. (ICIP), Genova, Italy, Sep. 2005, pp. 473-476.
82. Description of testing in wavelet video coding ISO/IEC JTC1/SC29/ WG11," 75th MPEG Meeting, Bangkok, Thailand, Tech. Rep. N7823, Jan. 2006, ISO/MPEG Video.
83. C. Fenimore, V. Baroncini, T. Oelbaum, and T. K. Tan, "Subjective testing methodology in MPEG video verification," in Proc. Appl. Digital Image Process. XXVlI, Aug. 2004, vol. 5558, pp. 503-511.
84. M. Ouaret, F. Dufaux, and T. Ebrahimi, "On comparing JPEG2000 and intraframe AVC," presented at the Appl. Digit. Image Process. XXIX, Genova, Italy, Aug. 2006, 63120U.
85. D. Marpe, S. Gordon, and T. Wiegand, "H.264/MPEG4-AVC fidelity range extensions: Tools, profiles, performance, and application areas," in Proc. Int. Conf. Image Process. (ICIP), Genova, Italy, Sep. 2005. vol. 1, pp. 593-596.
86. L. Lima, F. Manerba, N. Adami, A. Signoroni, and R. Leonardi, "Wavelet-based encoding for HD applications," presented at the Proc. Int. Conf. Multimedia Expo (ICME), Beijing, China, Jul. 2006.
87. G. Pau and B. Pesquet-Popescu, "Image coding with rational spatial scalability," presented at the Proc. Eur. Signal Process. Conf. (EU-SIPCO), Florence, Italy, Sep. 2006.
88. B. Wang. Y. Wang, I. Selesnick, and A. Vetro, "An investigation of 3-D dual-tree wavelet transform for video coding," in Proc. Int. Conf. Image Process. (ICIP), Singapore, Oct. 2004, pp. 1317-1320.