Spatially adaptive block-based super-resolution

IEEE Transactions on Image Processing

Volumn 21, Issue 3, 2012, Pages 1031-1045

  Su, Heng ^a   Tang, Liang ^b   Wu, Ying ^c   Tretter, Daniel ^d   Zhou, Jie ^a  

^a TSINGHUA UNIVERSITY   (China)

^b CHINA ELECTRONICS TECHNOLOGY GROUP CORPORATION   (China)

^c Northwestern University   (United States)

^d HEWLETT PACKARD LABORATORIES   (United States)

Author keywords

Block based; motion registration error; spatially adaptive framework; super resolution; super resolution benchmark

Indexed keywords

BLOCK BASED; BLOCK EDGES; DEBLOCKING; HIGH RESOLUTION IMAGE; INPUT IMAGE; REGISTRATION ERROR; RELATIVE PERFORMANCE; SINGLE IMAGES; SPATIALLY ADAPTIVE; SUPER RESOLUTION; SUPER RESOLUTION ALGORITHMS; TRAINING SAMPLE;

ADAPTIVE ALGORITHMS; IMAGE RESOLUTION;

BENCHMARKING;

EID: 84863118922     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2011.2166971     Document Type: Article

References (39)

1. R. Y. Tsai and T. S. Huang, "Multiframe image restoration and registration," Adv. Comput. Vis. Image Process., vol. 1, pp. 317-339, 1984.
2. S. C. Park, M. K. Park, and M. G. Kan, "Super-resolution image reconstruction: A technical overview," IEEE Signal Process. Mag., vol. 20, no. 3, pp. 21-36, May 2003.
3. M. Irani and S. Peleg, "Motion analysis for image enhancement: Resolution, occlusion, and transparency," J. Vis. Commun. Image Represent., vol. 4, no. 4, pp. 324-335, Dec. 1993.
4. A. Tekalp, M. Ozkan, and M. Sezan, "High-resolution image reconstruction from lower-resolution image sequences and space-varying image restoration," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 1992, pp. 169-172.
5. S. Farsiu, M. Robinson, M. Elad, and P. Milanfar, "Fast and robust multiframe super-resolution," IEEE Trans. Image Process., vol. 13, no. 10, pp. 1327-1344, Oct. 2004.
6. G. Chantas, N. Galatsanos, and N. Woods, "Super-resolution based on fast registration and maximum a posteriori reconstruction," IEEE Trans. Image Process., vol. 16, no. 7, pp. 1821-1830, Jul. 2007. (Pubitemid 47018879)
7. S. Belekos, N. Galatsanos, and A. Katsaggelos, "Maximum a posteriori video super-resolution using a new multichannel image prior," IEEE Trans. Image Process., vol. 19, no. 6, pp. 1451-1464, Jun. 2010.
8. A. Patti, M. Sezan, and A. Murat Tekalp, "Super resolution video reconstruction with arbitrary sampling lattices and nonzero aperture time," IEEE Trans. Image Process., vol. 6, no. 8, pp. 1064-1076, Aug. 1997. (Pubitemid 127768403)
9. C. Fan, J. Zhu, J. Gong, and C. Kuang, "POCS super-resolution sequence image reconstruction based on improvement approach of Keren registration method," in Proc. 6th Int. Conf. ISDA, Oct. 16-18, 2006, vol. 2, pp. 333-337.
10. H. Ji and C. Fermuller, "Robust wavelet-based super-resolution reconstruction: Theory and algorithm," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 4, pp. 649-660, Apr. 2009.
11. A. Sanchez-Beato and G. Pajares, "Noniterative interpolation-based super-resolution minimizing aliasing in the reconstructed image," IEEE Trans. Image Process., vol. 17, no. 10, pp. 1817-1826, Oct. 2008.
12. W. Freeman and E. Pasztor, "Markov networks for super-resolution, " in Proc. 34th Annu. Conf. Inf. Sci. Syst., 2000.
13. H. Chang, D.-Y. Yeung, and Y. Xiong, "Super-resolution through neighbor embedding," in Proc. IEEE Comput. Soc. CVPR, 2004, vol. 1, pp. I-275-I-282.
14. W. Fan and D.-Y. Yeung, "Image hallucination using neighbor embedding over visual primitive manifolds," in Proc. IEEE Conf. CVPR, 2007, pp. 1-7.
15. D. Glasner, S. Bagon, and M. Irani, "Super-resolution from a single image," in Proc. 12th Int. Conf. Comput. Vis., 2009, pp. 349-356.
16. W. Freeman, T. Jones, and E. Pasztor, "Example-based super-resolution," IEEE Comput. Graph. Appl., vol. 22, no. 2, pp. 56-65, Mar./Apr. 2002. (Pubitemid 34265891)
17. M. Elad and D. Datsenko, "Example-based regularization deployed to super-resolution reconstruction of a single image," Comput. J., vol. 52, no. 1, pp. 15-30, Jan. 2009.
18. J. Yang, J. Wright, T. S. Huang, and Y. Ma, "Image super-resolution as sparse representation of raw image patches," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., 2008, pp. 1-8.
19. W. Zhao and H. Sawhney, "Is super-resolution with optical flow feasible?," in Proc. 7th Eur. Conf. Comput. Vis.-Part I, 2002, pp. 599-613.
20. S. Dai, M. Han, W. Xu, Y. Wu, and Y. Gong, "Soft edge smoothness prior for alpha channel super resolution," in Proc. IEEE Conf. CVPR, Jun. 17-22, 2007, pp. 1-8.
21. Y. Cha and S. Kim, "Edge-forming methods for color image zooming," IEEE Trans. Image Process., vol. 15, no. 8, pp. 2315-2323, Aug. 2006. (Pubitemid 44089104)
22. J. Kim, R. Park, and S. Yang, "Super-resolution using POCS-based reconstruction with artifact reduction constraints," Vis. Commun. Image Process., vol. 5960, p. 596 05B, 2005.
23. M. Chen, "Dynamic content adaptive super-resolution," Image Anal. Recognit., vol. 3212, Lecture Notes in Computer Science, pp. 220-227, 2004. (Pubitemid 39747473)
24. A. Yau, N. Bose, and M. Ng, "An efficient algorithm for superresolution in medium field imaging," Multidimensional Syst. Signal Process., vol. 18, no. 2, pp. 173-188, Sep. 2007. (Pubitemid 46753785)
25. Y. He, K.-H. Yap, L. Chen, and L.-P. Chau, "A nonlinear least square technique for simultaneous image registration and super-resolution," IEEE Trans. Image Process., vol. 16, no. 11, pp. 2830-2841, Nov 2007. (Pubitemid 350141855)
26. L. Baboulaz and P. L. Dragotti, "Exact feature extraction using finite rate of innovation principles with an application to image super-resolution," IEEE Trans. Image Process., vol. 18, no. 2, pp. 281-298, Feb. 2009.
27. H. Shen, L. Zhang, B. Huang, and P. Li, "A map approach for joint motion estimation, segmentation, and super resolution," IEEE Trans. Image Process., vol. 16, no. 2, pp. 479-490, Feb. 2007. (Pubitemid 46421688)
28. R. C. Hardie, K. J. Barnard, and E. E. Armstrong, "Joint map registration and high-resolution image estimation using a sequence of undersampled images," IEEE Trans. Image Process., vol. 6, no. 12, pp. 1621-1633, Dec. 1997. (Pubitemid 127770518)
29. A. Danielyan, A. Foi, V. Katkovnik, and K. Egiazarian, "Image and video super-resolution via spatially adaptive block-matching filtering," in Proc. Int. Workshop LNLA, 2008.
30. M. Protter and M. Elad, "Super resolution with probabilistic motion estimation," IEEE Trans. Image Process., vol. 18, no. 8, pp. 1899-1904, Aug. 2009.
31. M. Protter,M. Elad, H. Takeda, and P. Milanfar, "Generalizing the nonlocal-means to super-resolution reconstruction," IEEE Trans. Image Process., vol. 18, no. 1, pp. 36-51, Jan. 2009.
32. H. Takeda, S. Farsiu, and P. Milanfar, "Kernel regression for image processing and reconstruction," IEEE Trans. Image Process., vol. 16, no. 2, pp. 349-366, Feb. 2007. (Pubitemid 46421678)
33. H. Takeda, P. Milanfar, M. Protter, and M. Elad, "Super-resolution without explicit subpixel motion estimation," IEEE Trans. Image Process., vol. 18, no. 9, pp. 1958-1975, Sep. 2009.
34. H. Su, L. Tang, D. Tretter, and J. Zhou, "A practical and adaptive framework for super-resolution," in Proc. 15th IEEE ICIP, 2008, pp. 1236-1239.
35. D. Marpe, T.Wiegand, and G. Sullivan, "The H.264/MPEG4 advanced video coding standard and its applications," IEEE Commun. Mag., vol. 44, no. 8, pp. 134-143, Aug. 2006.
36. Y. Freund and R. E. Schapire, "Experiments with a new boosting algorithm," in Proc. Int. Conf. Mach. Learn., 1996, pp. 148-156.
37. L. Breiman, "Random forests," Mach. Learn., vol. 45, no. 1, pp. 5-32, Oct. 2001. (Pubitemid 32933532)
38. M. Black and P. Anandan, "The robust estimation of multiple motions: Parametric and piecewise-smooth flow fields," Comput. Vis. Image Understanding, vol. 63, no. 1, pp. 75-104, 1996. (Pubitemid 126342808)
39. O. Mac Aodha, G. Brostow, and M. Pollefeys, "Segmenting video into classes of algorithm-suitability," in Proc. IEEE Conf. CVPR, 2010, pp. 1054-1061.