Video super-resolution with registration-reliability regulation and adaptive total variation

Journal of Visual Communication and Image Representation

Volumn 30, Issue , 2015, Pages 181-190

  Zhang, Xinfeng ^a   Xiong, Ruiqin ^b   Ma, Siwei ^b   Li, Ge ^b   Gao, Wen ^b  

^a INSTITUTE OF COMPUTING TECHNOLOGY   (China)

^b PEKING UNIVERSITY   (China)

Author keywords

Interpolation; Nonlocal similarity; Optical flow; Registration reliability; Regularization; Structure tensor; Super resolution; Total variation

Indexed keywords

ADAPTIVE OPTICS; IMAGE DENOISING; IMAGE PROCESSING; INTERPOLATION; OPTICAL FLOWS; PIXELS; RELIABILITY; TENSORS;

NON-LOCAL SIMILARITIES; REGULARIZATION; STRUCTURE TENSORS; SUPER RESOLUTION; TOTAL VARIATION;

OPTICAL RESOLVING POWER;

EID: 84928787312     PISSN: 10473203     EISSN: 10959076     Source Type: Journal    
DOI: 10.1016/j.jvcir.2015.04.002     Document Type: Article

References (32)

1. H. Takeda, S. Farsiu, and P. Milanfar Kernel regression for image processing and reconstruction IEEE Trans. Image Process. 16 2 2007 349 366
2. X. Zhang, and X. Wu Image interpolation by 2-d autoregressive modeling and soft-decision estimation IEEE Trans. Image Process. 17 6 2008 887 896
3. X. Zhang, S. Ma, Y. Zhang, L. Zhang, W. Gao, Nonlocal edge-directed interpolation, in: Proceedings of IEEE Pacific-Rim Conference International Conference on Multimedia.
4. W. Freeman, T. Jones, and E. Pasztor Example-based super-resolution IEEE Comput. Graph. Appl. 22 2 2002 56 65
5. H. Chang, D.Y. Yeung, Y. Xiong, Super-resolution through neighbor embedding, in: IEEE Proceedings on Computer Vision and Pattern Recognition, 2004. CVPR 2004, vol. 1, 2004, pp. 275-282.
6. J. Yang, J. Wright, T. Huang, and Y. Ma Image super-resolution via sparse representation IEEE Trans. Image Process. 19 11 2010 2861 2873
7. S. Farsiu, M. Robinson, M. Elad, and P. Milanfar Fast and robust multiframe super-resolution IEEE Trans. Image Process. 13 10 2004 1327 1344
8. O. Omer, T. Tanaka, Multiframe image and video super-resolution algorithm with inaccurate motion registration errors rejection, in: Proceedings of the SPIE Conference on Visual Communication and Image Processing, vol. 1, 2008, pp. 275-282.
9. M. Dennis, P. Thomas, S. Thomas, C. Danie, Video super resolution using duality based tv-l1 optical flow, in: Proceedings of the 31st DAGM Symposium on Pattern Recognition, vol. 1, 2009, pp. 432-441.
10. X. Zhang, R. Xiong, S. Ma, W. Gao, A robust video super-resolution algorithm, in: Picture Coding Symposium (PCS), 2010, pp. 574-577.
11. S. Izadpanahi, H. Demirel, Multi-frame super resolution using edge directed interpolation and complex wavelet transform, 2012, pp. 1-5.
12. S. Izadpanahi, and H. Demirel Motion based video super resolution using edge directed interpolation and complex wavelet transform Signal Process. 93 7 2013 2076 2086
13. P. Rasti, H. Demirel, G. Anbarjafari, Improved iterative back projection for video super-resolution, in: Signal Processing and Communications Applications Conference (SIU), 2014 22nd, 2014, pp. 552-555.
14. B.D. Lucas, and T. Kanade An iterative image registration technique with an application to stereo vision Int. Joint Conf. Artif. Intell. 3 1981 674 679
15. J.-Y. Bouguet Pyramidal Implementation of the Affine Lucas Kanade Feature Tracker Description of the algorithm vol. 5 2001 Intel Corporation 1 10
16. S. Volz, A. Bruhn, L. Valgaerts, and H. Zimmer Modeling temporal coherence for optical flow IEEE Int. Conf. Comput. Vis. (ICCV) 2011 1116 1123
17. B.K. Horn, and B.G. Schunck Determining optical flow Artif. Intell. 17 1-3 1981 185 203
18. T. Brox, A.Bruhn, N. Papenberg, J. Weickert, High accuracy optical flow estimation based on a theory for warping, in: Proceedings of the European Conference on Computer Vision, 2004, pp. 25-36.
19. H. He, and L. Kondi An image super-resolution algorithm for different error levels per frame IEEE Trans. Image Process. 15 3 2006 592 603
20. A. Kanaev, and C.W. Miller Multi-frame super-resolution algorithm for complex motion patterns Opt. Express 21 17 2013 19850 19866
21. O. Omer, T. Tanaka, Region-based super resolution for video sequences considering registration error, in: Proceedings of the 3rd Pacific-Rim Symposium on Image and Video Technology, vol. 5414, 2009, pp. 944-954.
22. O. Omer, T. Tanaka, Region-based weighted-norm approach to video super-resolution with adaptive regularization, in: Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2009, pp. 833-836.
23. H. Takeda, P. van Beek, P. Milanfar, Spatio-temporal video interpolation and denoising using motion-assisted steering kernel (mask) regression, in: Proceedings of IEEE International Conference on Image Processing, 2008, pp. 637-640.
24. L. Rudin, S. Osher, and E. Fatemi Nonlinear total variation based noise removal algorithms Physica D 60 14 1992 259 268
25. Q. Yuan, L. Zhang, and H. Shen Regional spatially adaptive total variation super-resolution with spatial information filter and clustering IEEE Trans. Image Process. 22 6 2013 2327 2342
26. A.K. Katsaggelos, R. Molina, and J. Mateos Super resolution of images and video Synth. Lect. Image Video Multimedia Process. 3 1 2007 1 134
27. X. Zhang, R. Xiong, S. Ma, L. Zhang, W. Gao, Robust video super-resolution with registration efficiency adaptation, in: the SPIE Conference on Visual Communication and Image Processing, 2010, pp. 774432-774432.
28. J. van de Weijer, L.J. van Vliet, P.W. Verbeek, and M. van Ginkeli Curvature estimation in oriented patterns using curvilinear models applied to gradient vector fields IEEE Trans. Pattern Anal. Mach. Intell. 23 9 2001 1035 1042
29. V. Dor, R. Farrahi Moghaddam, and M. Cheriet Non-local adaptive structure tensors: application to anisotropic diffusion and shock filtering Image Vis. Comput. 29 11 2011 730 743
30. Y. Wang, J. Yang, W. Yin, and Y. Zhang A new alternating minimization algorithm for total variation image reconstruction J. Sci. Comput. 45 1-3 2010 272 293
31. A. Beck, and M. Teboulle A fast iterative shrinkage-thresholding algorithm for linear inverse problems SIAM J. Imaging Sci. 2 1 2009 183 202
32. Opencv 2.4.7, .