3-band motion-compensated temporal structures for scalable video coding

IEEE Transactions on Image Processing

Volumn 15, Issue 9, 2006, Pages 2545-2557

  Tillier, Christopher ^a   Pesquet Popescu, Béatrice ^a   van der Schaar, Mihaela ^b  

^a TELECOM PARISTECH   (France)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

3 band temporal decomposition; Motion compensated temporal filtering (MCTF); Nonlinear lifting; Scalable video compression; Three band (3 band) bidirectional temporal filtering; Video coding

Indexed keywords

DECODING; IMAGE COMPRESSION; MOTION COMPENSATION; SIGNAL FILTERING AND PREDICTION; WAVELET TRANSFORMS;

MOTION-COMPENSATED TEMPORAL FILTERING; NONLINEAR LIFTING; SCALABLE VIDEO COMPRESSION; VIDEO CODECS;

IMAGE CODING;

ALGORITHM; ARTICLE; COMPUTER ASSISTED DIAGNOSIS; IMAGE ENHANCEMENT; IMAGE SUBTRACTION; INFORMATION PROCESSING; MATHEMATICAL COMPUTING; METHODOLOGY; PHOTOGRAPHY; SIGNAL PROCESSING; THREE DIMENSIONAL IMAGING; TIME; VIDEORECORDING;

ALGORITHMS; DATA COMPRESSION; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGING, THREE-DIMENSIONAL; NUMERICAL ANALYSIS, COMPUTER-ASSISTED; PHOTOGRAPHY; SIGNAL PROCESSING, COMPUTER-ASSISTED; SUBTRACTION TECHNIQUE; TIME FACTORS; VIDEO RECORDING;

EID: 33747649766     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2006.877411     Document Type: Article

References (40)

1. Information Technology - JPEG 2000 Image Coding System, ISO/IEC 15444-1, 2000.
2. D MC-EZBC Software Package MPEG CVS repository.
3. B.-J. Kim, Z. Xiong, and W. A. Pearlman, "Very low bit-rate embedded video coding with 3-D set partitioning in hierarchical trees (3D-SPIHT)," IEEE Trans. Circuits Syst. Video Technol., vol. 8, pp. 1365-1374, 2000.
4. U. Horn and B. Girod, "Scalable video transmission for the internet," Comput. Networks ISDN Syst., vol. 29, pp. 1833-1842, 1997.
5. S. J. Choi and J. W.Woods, "Motion-compensated 3-D subband coding of video," IEEE Trans. Image Process., vol. 8, pp. 155-167, 1999.
6. J.-R. Ohm, "Three-dimensional subband coding with motion compensation," IEEE Trans. Image Process., vol. 3, pp. 559-589, 1994.
7. S. T. Hsiang and J. W. Woods, "Invertible three-dimensional analysis/synthesis system for video coding with half-pixel accurate motion compensation," in Proc. VCIP 99, SPIE, 1999, vol. 3653, pp. 537-546.
8. B. Pesquet-Popescu and V. Bottreau, "Three-dimensional lifting schemes for motion compensated video compression," in Proc. IEEE Int. Conf. Acoustics, Speech and Signal Processing, Salt Lake City, UT, May 2001, vol. 3, pp. 1793-1796.
9. A. Secker and D. Taubman, "Motion-compensated highly scalable video compression using an adaptive 3D wavelet transform based on lifting," in Proc. IEEE Int. Conf. Image Processing, Thessaloniki, Greece, Oct. 2001, vol. 2, pp. 1029-1032.
10. T. Russert and K. Hanke, "Optimized quantization in interframe wavelet coding," presented at the Shanghai MPEG Meeting Shanghai, China, Oct. 2002, doc. m9003.
11. J. W. Woods, P. Chen, and S.-T. Hsiang, "Exploration experimental results and software," presented at the Klagenfurt MPEG Meeting Klagenfurt, Germany, Jul. 2002, doc. m8524.
12. Y. Zhan, M. Picard, B. Pesquet-Popescu, and H. Heijmans, "Long temporal filters in lifting schemes for scalable video coding," presented at the Klagenfurt MPEG Meeting Klagenfurt, Germany, Jul. 2002, doc. m8680.
13. J.-R. Ohm, "Complexity and delay analysis of MCTF interframe wavelet structures," presented at the Klagenfurt MPEG Meeting Klagenfurt, Germany, Jul. 2002, doc. m8520.
14. M. Flierl and B. Girod, "Investigation of motion-compensated lifted wavelet transforms," in Proc. Int. Picture Coding Symp., St. Malo, France, Apr. 2003, pp. 59-62.
15. M. Flierl, "Video coding with lifted wavelet transforms and frame-adaptive motion compensation," Lecture Notes Comput. Sci., vol. 2849, pp. 243-251, 2003.
16. J. Xu, Z. Xiong, S. Li, and Y. Zhang, "Three-dimensional embedded subband coding with optimized truncation (3D-ESCOT)," Appl. Comput. Harmon. Anal., vol. 10, pp. 290-315, 2001.
17. D. Turaga and M. van der Schaar, "Unconstrained temporal scalability with multiple reference and bi-directional motion compensated temporal filtering," presented at the Fairfax MPEG Meeting Fairfax, VA, 2002.
18. A. Secker and D. Taubman, "Highly scalable video compression using a lifting-based 3D wavelet transform with deformable mesh motion compensation," in Proc. IEEE Int. Conf. Image Processing, New York, Oct. 2002, vol. 3, pp. 749-752.
19. F. J. Hampson and J.-C. Pesquet, "M-band nonlinear subband decompositions with perfect reconstruction," IEEE Trans. Image Process., vol. 7, no. pp. 1547-1560, 1998.
20. T. Tran, "M-channel linear phase perfect reconstruction filter bank with rational coefficients," IEEE Trans. Circuits Syst. I, vol. 49, no., pp. 914-927, 2002.
21. Y. J. Chen, S. Oraintara, and K. Amaratunga, "M-channel lifting-based design of paraunitary and biorthogonal filter banks with structural regularity," in Proc. IEEE Int. Conf. Circuits Systems, May 2003, pp. IV 221-IV 224.
22. C. Tillier and B. Pesquet-Popescu, "3D, 3-band, 3-tap temporal lifting for scalable video coding," in Proc. IEEE Int. Conf. Image Processing, Barcelona, Spain, Sep. 2003, vol. 3, pp. 779-782.
23. M. van der Schaar and D. S. Turaga, "Unconstrained motion compensated temporal filtering (UMCTF) framework for wavelet video coding," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, Hong Kong, Apr. 2003, vol. 3, p. 84.
24. D. S. Turaga, M. van der Schaar, and B. Pesquet-Popescu, "Complexity scalable motion compensated wavelet video encoding," IEEE Trans. Circuits Syst. Video Technol., 15, no. 8, pp. 982-993, Aug. 2005.
25. C. Tillier, B. Pesquet-Popescu, and M. van der Schaar, "Highly scalable video coding by bidirectional predict-update 3-band schemes," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, Montreal, QC, Canada, May 2004, vol. 3, pp. 125-128.
26. G. Pau, C. Tillier, B. Pesquet-Popescu, and H. Heijmans, "Motion compensation and scalability in lifting-based video coding," Signal Process.: Image Commun., Special Issue on Wavelet Video Coding, pp. 577-600, 2004.
27. A. Benazza-Benyahia, J.-C. Pesquet, and H. Krim, "A nonlinear diffusion-based three-band filter bank," IEEE Signal Process. Lett., vol. 10, pp. 360-363, 2003.
28. D. S. Turaga, M. van der Schaar, and B. Pesquet-Popescu, "Differential motion vector coding with application to spatial scalable coding," in Proc. Image and Video Communications and Processing, Santa Clara, CA, Jan. 2003, vol. 5022, SPIE.
29. I. Daubechies and W. Sweldens, "Factoring wavelet transforms into lifting steps," J. Fourier Anal. Appl., vol. 4, no. 3, pp. 245-267, 1998.
30. J. Konrad, "Transversal versus lifting approach to motion-compensated temporal discrete wavelet transform of image sequences: Equivalence and tradeoffs," presented at the SPIE Conf. Visual Comm. Image Processing Jan. 2004.
31. M. Flierl, P. Vandergheynst, and B. Girod, "Video coding with lifted wavelet transforms and complementary motion-compensated signals," presented at the SPIE Conf. Visual Comm. Image Processing San Jose, Jan. 2004.
32. G. Pau, C. Tillier, B. Pesquet-Popescu, and H. Heijmans, "Iterative predict optimization in MCTF video," presented at the MPEG Jul. 2003, doc. m9929.
33. S.-W. Wu and A. Gersho, "Joint estimation of forward and backward motion vectors for interpolative prediction of video," IEEE Trans. Image Process., vol. 3, pp. 684-687, 1994.
34. S. S. Tsai, H.-M. Hang, and T. Chiang, Exploration Experiments on the Temporal Scalability of Interframe Wavelet Coding. Shanghai, China, Oct. 2002, SO/IEC JTC1/SC 29/WG 11 doc.M8959.
35. G. Feideropoulou and B. Pesquet-Popescu, "Stochastic modelling of the spatio-temporal wavelet coefficients. Application to quality enhancement and error concealment," J. Appl. Signal Process., vol. 12, pp. 1931-1942, 2004.
36. M. van der Schaar and D. S. Turaga, "Content-adaptive filtering in the UMCTF framework," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, Hong Kong, Apr. 2003, vol. 3, pp. 621-624.
37. B. Girod, "Motion-compensating prediction with fractional-pel accuracy," IEEE Trans. Commun., vol. 41, pp. 604-612, 1993.
38. J. Viéron, C. Guillemot, and S. Pateux, "Motion compensated 2D + t wavelet analysis for low rate FGS video compression," presented at the Int. Thyrrhenian Workshop on Digital Communications 2002 Capri, Italy, Sep. 2002.
39. C. Parisot, M. Antonini, and M. Barlaud, "3D scan based wavelet transform for video coding," in Proc. 4th IEEE Workshop on Multimedia Signal Proc., 2001, pp. 403-408.
40. Video Reference Software, Version: Microsoft-FDAMI-2.3-001213, ISO/IEC 14496 (MPEG-4), 2000.