Regional spatially adaptive total variation super-resolution with spatial information filtering and clustering

IEEE Transactions on Image Processing

Volumn 22, Issue 6, 2013, Pages 2327-2342

  Yuan, Qiangqiang ^a   Zhang, Liangpei ^a   Shen, Huanfeng ^a  

^a WUHAN UNIVERSITY   (China)

Author keywords

Majorization minimization; regional spatially adaptive; super resolution; total variation

Indexed keywords

ADAPTIVE TOTAL VARIATIONS; HIGH RESOLUTION IMAGE; MAJORIZATION-MINIMIZATION; SPATIAL INFORMATION EXTRACTION; SPATIALLY ADAPTIVE; SUPER RESOLUTION; TOTAL VARIATION; TOTAL VARIATION REGULARIZATION;

IMAGE DENOISING; IMAGE PROCESSING; PIXELS;

OPTICAL RESOLVING POWER;

ALGORITHM; CLUSTER ANALYSIS; COMPUTER SIMULATION; FACTUAL DATABASE; HUMAN; IMAGE PROCESSING; PROCEDURES; SIGNAL NOISE RATIO; VIDEORECORDING; ARTICLE; METHODOLOGY;

ALGORITHMS; CLUSTER ANALYSIS; COMPUTER SIMULATION; DATABASES, FACTUAL; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; SIGNAL-TO-NOISE RATIO; VIDEO RECORDING;

EID: 84876218439     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2013.2251648     Document Type: Article

References (56)

1. H. Greenspan, "Super-resolution in medical imaging," Comput. J., vol. 52, no. 1, pp. 43-63, Jan. 2009.
2. X. Huang, L. Zhang, and P. Li, "Classification and extraction of spatial features in urban areas using high-resolution multispectral imagery," IEEE Trans. Geosci. Remote Sens. Lett., vol. 4, no. 2, pp. 260-264, Apr. 2007. (Pubitemid 46645144)
3. X. Huang and L. Zhang, "An adaptive mean-shift analysis approach for object extraction and classification from urban hyperspectral imagery," IEEE Trans. Geosci. Remote Sens., vol. 46, no. 12, pp. 4173-4185, Dec. 2008.
4. L. Zhang, H. Zhang, H. Shen, and P. Li, "A super-resolution reconstruction algorithm for surveillance images," Signal Process., vol. 90, no. 3, pp. 848-859, 2010.
5. R. Tsai and T. Huang, "Multiple frame image restoration and registration," Adv. Comput. Vis. Image Process., vol. 1, no. 2, pp. 317-339, 1984.
6. S. Kim, N. Bose, and H. Valenzuela, "Recursive reconstruction of high resolution image from noisy undersampled multiframes," IEEE Trans. Acoust., Speech, Signal Process., vol. 38, no. 6, pp. 1013-1027, Jun. 1990. (Pubitemid 20713538)
7. S. Kim and W. Su, "Recursive high-resolution reconstruction of blurred multiframe images," IEEE Trans. Image Process., vol. 2, no. 4, pp. 534-539, Oct. 1993.
8. H. Ur and D. Gross, "Improved resolution from sub-pixel shifted pictures," Comput. Vis. Graph., Graph. Models Image Process., vol. 54, no. 2, pp. 181-186, 1992.
9. M. Alam, J. Bognar, R. Hardie, and B. Yasuda, "Infrared image registration and high-resolution reconstruction using multiple translationally shifted aliased video frames," IEEE Trans. Instrum. Meas., vol. 49, no. 5, pp. 915-923, Oct. 2000.
10. B. Tom and A. Katsaggelos, "Reconstruction of a high-resolution image by simultaneous registration, restoration, and interpolation of lowresolution images," in Proc. IEEE Int. Conf. Image Process., vol. 2. Washington, DC, USA, 1995, pp. 539-542.
11. R. Schultz and R. Stevenson, "Extraction of high-resolution frames from video sequences," IEEE Trans. Image Process., vol. 5, no. 6, pp. 996-1011, Jun. 1996. (Pubitemid 126776754)
12. S. Belekos, N. Galatsanos, and A. Katsaggelos, "Maximum a posteriori video super-resolution using a new multichannel image prior," IEEE Trans. Image Process., vol. 19, no. 6, pp. 1451-1464, Jun. 2010.
13. R. Hardie, K. Barnard, and E. Armstrong, "Joint MAP registration and high-resolution image estimation using a sequence of undersampled images," IEEE Trans. Image Process., vol. 6, no. 12, pp. 1621-1633, Dec. 1997. (Pubitemid 127770518)
14. H. Shen, L. Zhang, B. Huang, and P. Li, "A MAP approach for joint motion estimation, segmentation and super-resolution," IEEE Trans. Image Process., vol. 16, no. 2, pp. 479-490, Feb. 2007. (Pubitemid 46421688)
15. M. Elad and A. Feuer, "Restoration of a single super resolution image from several blurred, noisy, and undersampled measured images," IEEE Trans. Image Process., vol. 6, no. 12, pp. 1646-1658, Dec. 1997. (Pubitemid 127770520)
16. M. Protter, M. Elad, H. Takeda, and P. Milanfar "Generalizing the nonlocal-means to super-resolution reconstruction," IEEE Trans. Image Process., vol. 18, no. 1, pp. 36-51, Jan. 2009.
17. H. Takeda, P. Milanfar, M. Protter, and M. Elad, "Super-resolution without explicit subpixel motion estimation," IEEE Trans. Image Process., vol. 18, no. 9, pp. 1958-1975, Sep. 2009.
18. N. Nguyen and P. Milanfar, "A wavelet-based interpolation restoration method for superresolution (wavelet superresolution)," Circuits, Syst., Signal Process., vol. 19, no. 4, pp. 321-338, Apr. 2000.
19. H. Ji and C. Fermuller, "Robust wavelet-based super-resolution reconstruction: Theory and algorithm," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 4, pp. 649-660, Apr. 2009.
20. S. Park, M. Park, and M. Kang, "Super-resolution image reconstruction: A technical overview," IEEE Signal Process. Mag., vol. 20, no. 3, pp. 21-36, Mar. 2003.
21. S. Farsiu, M. Robinson, M. Elad, and P. Milanfar, "Fast and robust multiframe super-resolution," IEEE Trans. Image Process., vol. 13, no. 10, pp. 1327-1344, Oct. 2004.
22. S. Farsiu, M. D. Robinson, M. Elad, and P. Milanfar, "Advances and challenges in super-resolution," Int. J. Imag. Syst. Tech., vol. 14, no. 2, pp. 47-57, Feb. 2004.
23. A. K. Katsaggelos, R. Molina, and J.Mateos, Super Resolution of Images and Video, 1st ed. San Mateo, CA, USA: Morgan Kaufmann, 2007.
24. P. Milanfar, Super Resolution Imaging, 1st ed. Boca Raton, FL, USA: CRC Press, 2010.
25. L. Rudin, S. Osher, and E. Fatemi, "Nonlinear total variation based noise removal algorithms," Phys. D, Nonlinear Phenomena, vol. 60, no. 1, pp. 259-268, Jan. 1992.
26. M. Ng, H. Shen, E. Lam, and L. Zhang, "A total variation regularization based super-resolution reconstruction algorithm for digital video," EURASIP J. Adv. Signal Process., vol. 2007, no. 074585, pp. 1-16, Jun. 2007.
27. A. Marquina and S. Osher, "Image super-resolution by TV-regularization and Bregman iteration," J. Sci. Comput., vol. 37, no. 3, pp. 367-382, Dec. 2008.
28. J. Yang, J. Wright, T. S. Huang, and Y. Ma, "Image super-resolution via sparse representation," IEEE Trans. Image Process., vol. 19, no. 11, pp. 2861-2873, Nov. 2010.
29. W. Dong, L. Zhang, G. Shi, and X. Wu, "Image deblurring and supper-resolution by adaptive sparse domain selection and adaptive regularization," IEEE Trans. Image Process., vol. 20, no. 7, pp. 1838-1857, Jul. 2011.
30. W. Dong, X. Li, L. Zhang, and G. Shi, "Sparsity-based image denoising via dictionary learning and structural clustering," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 457-464.
31. W. Dong, X. Li, L. Zhang, and G. Shi, "Sparsity-based image deblurring with locally adaptive and non locally robust regularization," in Proc. IEEE 18th Int. Conf. Image Process., Sep. 2011, pp. 1841-1844.
32. T. Chan, S. Esedoglu, F. Park, A. Yip, "Recent developments in total variation image restoration," in Handbook of Mathematical Models in Computer Vision, N. Paragios, Y. Chen, and O. Faugeras Eds. New York, USA: Springer-Verlag, 2004.
33. D. M. Strong, P. Blomgren, and T. F. Chan, "Spatially adaptive local feature-driven total variation minimizing image restoration," in Proc. Conf. Stat. Stochastic Methods Image Process. II, San Diego, CA, USA, 1997, pp. 222-233.
34. Q. Chen, P. Montesinos, Q. Sun, P. Heng, and D. Xia, "Adaptive total variation denoising based on difference curvature," Image Vis. Comput., vol. 28, no. 3, pp. 298-306, Mar. 2010.
35. W. Guo and F. Huang, "Adaptive total variation based filtering for MRI images with spatially inhomogeneous noise and artifacts," in Proc. IEEE Int. Symp. Biomed. Imaging, Nano Macro, Jul. 2009, pp. 101-104.
36. G. Chantas, N. P. Galatsanos, R. Molina, and A. K. Katsaggelos, "Variational bayesian image restoration with a product of spatially weighted total variation image priors," IEEE Trans. Image Process., vol. 19, no. 2, pp. 351-362, Feb. 2010.
37. A. Chopra and H. Lian, "Total variation, adaptive total variation and nonconvex smoothly clipped absolute deviation penalty for denoising blocky images," Pattern Recogn., vol. 43, no. 8, pp. 2609-2619, Aug. 2010.
38. T. Saito and T. Komatsu, "Super-resolution sharpening-demosaicking with spatially adaptive total-variation image regularization," in Proc. 6th Pacific Rim Conf. Multimedia, Nov. 2005, pp. 246-256. (Pubitemid 43741608)
39. Q. Yuan, L. Zhang, H. Shen, and P. Li, "Adaptive multiple-frame image super-resolution based on U-curve," IEEE Trans. Image Process., vol. 19, no. 12, pp. 3157-3170, Dec. 2010.
40. D. Strong and T. Chan, "Edge-preserving and scale-dependent properties of total variation regularization," Inverse Probl., vol. 19, no. 6, pp. 165-187, Dec. 2003.
41. J. Yang, W. Yin, Y. Zhang, and Y. Wang, "A fast algorithm for edgepreserving variational multichannel image restoration," SIAM J. Imag. Sci., vol. 2, no. 2, pp. 569-592, May 2009.
42. P. Chatterjee and P. Milanfar, "Clustering-based denoising with locally learned dictionaries," IEEE Trans. Image Process., vol. 18, no. 7, pp. 1438-1451, Jul. 2009.
43. P. Chatterjee and P. Milanfar, "Patch-based near-optimal image denoising," IEEE Trans. Image Process., vol. 21, no. 4, pp. 1635-1649, Apr. 2012.
44. J. Bioucas-Dias, M. Figueiredo, and J. Oliveira, "Total variation-based image deconvolution: A majorization-minimization approach," in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Process., vol. 2. May 2006, pp. 1-2.
45. D. Hunter and K. Lange, "A tutorial on MM algorithms," Amer. Stat., vol. 58, no. 2, pp. 30-37, Feb. 2004. (Pubitemid 38260327)
46. J. Bioucas-Dias, M. Figueiredo, and J. Oliveira, "Adaptive total-variation image deconvolution: A majorization-minimization approach," in Proc. Eur. Signal Process. Conf., Sep. 2006, pp. 1-4.
47. J. Oliveira, J. Bioucas-Dias, and M. Figueiredo, "Adaptive total variation image deblurring: A majorization-minimization approach," Signal Process., vol. 89, no. 9, pp. 1683-1693, Sep. 2009.
48. P. Rodriguez and B. Wohlberg, "Efficient minimization method for a generalized total variation functional," IEEE Trans. Image Process., vol. 18, no. 2, pp. 322-332, Feb. 2009.
49. [Online]. Available: http://users.soe.ucsc.edu/?milanfar/software/ srdatasets. html
50. P. Vandewalle, S. Susstrunk, and M. Vetterli, "A frequency domain approach to registration of aliased images with application to superresolution," EURASIP J. Adv. Signal Process., vol. 2006, no. 71459, pp. 1-14, 2006.
51. Z. Wang, A. Bovik, and H. Sheikh, "Image quality assessment: From error visibility to structural similarity," IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, Apr. 2004.
52. Z. Wang and A. Bovik, "Mean squared error: Love it or leave it?-A new look at signal fidelity measures," IEEE Signal Processing Mag., vol. 26, no. 1, pp. 98-117, Jan. 2009.
53. A. Beck and M. Teboulle, "A fast iterative shrinkage-thresholding algorithm for linear inverse problems," SIAM J. Imag. Sci., vol. 2, no. 1, pp. 183-202, 2009.
54. A. Beck and M. Teboulle, "Fast Gradient-Based Algorithms for Constrained Total Variation Image Denoising and Deblurring Problems," IEEE Trans. Image Process., vol. 18, no. 11, pp. 2419-2434, Nov. 2009.
55. Y. E. Nesterov, "Gradient methods for minimizing composite objective function," Dept. Math. Eng., Univ. Catholique de Louvain, Tournai, Belgium, Tech. Rep. 76, Sep. 2007.
56. H. Takeda, S. Farsiu, and P. Milanfar, "Kernel regression for image processing and reconstruction," IEEE Trans. Image Process., vol. 16, no. 2, pp. 349-366, Feb. 2007. (Pubitemid 46421678)