Video super-resolution algorithm using bi-directional overlapped block motion compensation and on-the-fly dictionary training

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 21, Issue 3, 2011, Pages 274-285

  Song, Byung Cheol ^a,b   Jeong, Shin Cheol ^a   Choi, Yanglim ^a  

^a Inha University   (South Korea)

^b SAMSUNG Electronics   (South Korea)

Author keywords

Bi directional overlapped block motion compensation; dictionary; hierarchical motion estimation; key frames; super resolution; training

Indexed keywords

BLOCK MOTION; DICTIONARY; HIERARCHICAL MOTION ESTIMATION; KEY-FRAMES; SUPER RESOLUTION; TRAINING;

ALGORITHMS; ERROR COMPENSATION; ESTIMATION; IMAGE SEGMENTATION; MOTION COMPENSATION; OPTICAL RESOLVING POWER; SIGNAL TO NOISE RATIO;

MOTION ESTIMATION;

EID: 79953039636     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2010.2087454     Document Type: Article

References (22)

1. X. Li and M. T. Orchard, "New edge-directed interpolation," IEEE Trans. Image Process., vol. 10, no. 10, pp. 1521-1527, Oct. 2001. (Pubitemid 32981825)
2. Q. Wang and R. K. Ward, "A new orientation-adaptive interpolation method," IEEE Trans. Image Process., vol. 16, no. 4, pp. 889-900, Apr. 2007. (Pubitemid 46546105)
3. S. M. Kwak, J. H. Moon, and J. K. Han, "Modified cubic convolution scaler for edge-directed nonuniform data," Opt. Eng., vol. 46, no. 10, p. 107001, 2007.
4. M. Zhao, M. Bosma, and G. De Haan, "Making the best of legacy video on modern displays," J. Soc. Inform. Display, vol. 15, no. 1, pp. 49-60, 2007.
5. S. C. Park, M. K. Park, and M. G. Kang, "Super-resolution image reconstruction: A technical overview," IEEE Signal Process. Mag., vol. 20, no. 3, pp. 21-36, May 2003.
6. S. Farsiu, D. Robinson, M. Elad, and P. Milanfar, "Fast and robust multiframe super-resolution," IEEE Trans. Image Process., vol. 13, no. 10, pp. 1327-1344, Oct. 2004.
7. M. Protter, M. Elad, H. Takeda, and P. Milanfar, "Generalizing the non-local-means to super-resolution reconstruction," IEEE Trans. Image Process., vol. 18, no. 1, pp. 36-51, Jan. 2009.
8. M. V. Zibetti and J. Mayer, "A robust and computationally efficient simultaneous super-resolution scheme for image sequences," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 10, pp. 1288-1300, Oct. 2007. (Pubitemid 47525324)
9. W. Freeman, T. Jones, and E. Pasztor, "Example-based super-resolution," IEEE Comput. Graph. Applicat., vol. 22, no. 2, pp. 55-65, Mar.-Apr. 2002.
10. J. Sun, N. Zheng, H. Tao, and H. Shum, "Image hallucination with primal sketch priors," in Proc. CVPR, vol. 2. 2003, pp. 729-736.
11. J. Sun, Z. Xu, and H. Shum, "Image super-resolution using gradient profile prior," in Proc. CVPR, 2008, pp. 1-8.
12. W. Fan and D. Y. Yeung, "Image hallucination using neighbor embedding over visual primitive manifolds," in Proc. CVPR, 2007, pp. 1-7.
13. X. Li, K. M. Lam, G. Qiu, L. Shen, and S. Wang, "Example-based image super-resolution with class-specific predictors," J. Vis. Commun. Image Representation, vol. 20, no. 5, pp. 312-322, 2009.
14. F. Brandi, R. Queiroz, and D. Mukherjee, "Super-resolution of video using key frames and motion estimation," in Proc. IEEE ICIP, Oct. 2008, pp. 321-324.
15. B. C. Song, K. W. Chun, and J. B. Ra, "A rate-constrained fast full-search algorithm based on block sum pyramid," IEEE Trans. Image Process., vol. 14, no. 3, pp. 308-311, Mar. 2005. (Pubitemid 40351908)
16. K. Illgner and F. Muller, "Multiresolution video compression: Motion estimation and vector field coding," in Proc. GLOBECOM, vol. 3. Nov. 1996, pp. 1478-1482.
17. M. T. Orchard and G. J. Sullivan, "Overlapped block motion compensation: An estimation-theoretic approach," IEEE Trans. Image Process., vol. 3, no. 5, pp. 693-699, Sep. 1994.
18. T. Y. Kuo and C. C. J. Kuo, "Fast overlapped block motion compensation with checkerboard block partitioning," IEEE Trans. Circuits Syst. Video Technol., vol. 8, no. 6, pp. 705-712, Oct. 1998.
19. Information Technology-Coding of Audio-Visual Objects: Visual, Committee Draft, ISO/IEC 144962-2, Oct. 1997.
20. S. Haykin, Adaptive Filter Theory, 3rd ed. Englewood Cliffs, NJ: Prentice-Hall, 1996, ch. 9.
21. Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification, ITU-T Rec., H.264/ISO/IEC 14496-10 AVC, 2003.
22. A. M. Tourapis, "Enhanced predictive zonal search for single and multiple frame motion estimation," in Proc. SPIE Visual Commun. Image Process., Jan. 2002, pp. 1069-1079. (Pubitemid 35229586)