Adaptive multiple-frame image super-resolution based on U-curve

IEEE Transactions on Image Processing

Volumn 19, Issue 12, 2010, Pages 3157-3170

  Yuan, Qiangqiang ^a   Zhang, Liangpei ^a   Shen, Huanfeng ^a   Li, Pingxiang ^a  

^a WUHAN UNIVERSITY   (China)

Author keywords

L curve; regularization; super resolution (SR) reconstruction; U curve

Indexed keywords

CURVATURE POINTS; DATA FIDELITY; HIGH RESOLUTION IMAGE; HOT RESEARCH TOPICS; IMAGE SUPER-RESOLUTION; L-CURVE; LOW RESOLUTION IMAGES; MAP RECONSTRUCTION; MAXIMUM A POSTERIORI MODELS; MULTIPLE-FRAME; OPTIMAL PARAMETER; OPTIMAL REGULARIZATION; REGULARIZATION; REGULARIZATION PARAMETERS; SUPERRESOLUTION; U-CURVE; VISUAL EFFECTS;

OPTIMIZATION; PARAMETERIZATION;

OPTICAL RESOLVING POWER;

ALGORITHM; ARTICLE; AUTOMATED PATTERN RECOGNITION; COMPUTER SIMULATION; IMAGE ENHANCEMENT; IMAGE PROCESSING; METHODOLOGY;

ALGORITHMS; COMPUTER SIMULATION; IMAGE ENHANCEMENT; IMAGE PROCESSING, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED;

EID: 78649286493     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2010.2055571     Document Type: Article

References (45)

1. A. J. Martin, A. I. Gotlieb, and R. M. Henkelman, "High-resolution MR imaging of human arteries", J. Magn. Reson. Imag., vol. 5, no. 1, pp. 93-100, 1995.
2. X. Huang, L. Zhang, and P. Li, "Classification and extraction of spatial features in Urban areas using high-resolution multispectral imagery", IEEE Geosci. Remote Sens. Lett., vol. 4, no. 2, pp. 260-264, Apr. 2007.
3. L. Zhang, H. Zhang, H. Shen, and P. Li, "A super-resolution reconstruction algorithm for surveillance images", Signal Process., vol. 90, no. 3, pp. 848-859, 2010.
4. R. Y. Tsai and T. S. Huang, "Multiple frame image restoration and registration", in Advances in Computer Vision and Image Processing. Greenwich, CT: JAI Press, 1984, pp. 317-339.
5. S. P. Kim, N. K. Bose, and H. M. Valenzuela, "Recursive reconstruction of high resolution image from noisy undersampled multiframes", IEEE Trans. Acoust., Speech, Signal Process., vol. 38, no. 6, pp. 1013-1027, Jun. 1990.
6. S. P. Kim and W.-Y. Su, "Recursive high-resolution reconstruction of blurred multiframe images", IEEE Trans. Image Proc., vol. 2, no. 4, pp. 534-539, Oct. 1993.
7. N. K. Bose, H. C. Kim, and H. M. Valenzuela, "Recursive implementation of total least squares algorithm for image reconstruction from noisy, undersampled multiframes", in Proc. IEEE Conf. Acoust., Speech Signal Process., Minneapolis, MN, Apr. 1993, vol. 5, pp. 269-272.
8. S. Rhee and M. G. Kang, "Discrete cosine transform based regularized high-resolution image reconstruction algorithm", Opt. Eng., vol. 38, no. 8, pp. 1348-1356, 1999.
9. R. H. Chan, T. F. Chan, L. Shen, and Z. Shen, "Wavelet algorithms for high-resolution image reconstruction", SIAM J. Sci. Comput., vol. 24, no. 4, pp. 1408-1432, 2003.
10. M. K. Ng, C. K. Sze, and S. P. Yung, "Wavelet algorithms for deblurring models", Int. J. Imag. Syst. Technol., vol. 14, no. 3, pp. 113-121, 2004.
11. N. Nguyen and P. Milanfar, "A wavelet-based interpolation restoration method for superresolution (wavelet superresolution)", Circuits Syst. Signal Process., vol. 19, no. 4, pp. 321-338, 2000.
12. H. Ji and C. Fermuller, "Robust wavelet-based super-resolution reconstruction: Theory and algorithm", IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 4, pp. 649-660, Apr. 2009.
13. H. Ur and D. Gross, "Improved resolution from sub-pixel shifted pictures", CVGIP, Graph. Models Image Process., vol. 53, pp. 181-186, 1992.
14. M. S. Alam, J. G. Bognar, R. C. Hardie, and B. J. Yasuda, "Infrared image registration and high-resolution reconstruction using multiple translationally shifted aliased video frames", IEEE Trans. Instrum. Meas., vol. 49, no. 5, pp. 915-923, Oct. 2000.
15. M. Irani and S. Peleg, "Improving resolution by image registration", CVGIP, Graph. Models Image Process., vol. 53, pp. 231-239, 1991.
16. M. Irani and S. Peleg, "Motion analysis for image enhancement resolution, occlusion, and transparency", J. Vis. Commun. Image Represent., vol. 4, no. 4, pp. 324-335, 1993.
17. H. Stark and P. Oskoui, "High resolution image recovery from imageplane arrays, using convex projections", J. Opt. Soc. Amer. A, vol. 6, pp. 1715-1726, 1989.
18. A. J. Patti, M. I. Sezan, and A. M. Tekalp, "Super resolution video reconstruction with arbitrary sampling lattices and nonzero aperture time", IEEE Trans. Image Process., vol. 6, no. 8, pp. 1064-1076, Aug. 1997.
19. R. C. Hardie, K. J. Barnard, J. G. Bognar, E. E. Armstrong, and E. A. Watson, "High-resolution image reconstruction from a sequence of rotated and translated frames and its application to an infrared imaging system", Opt. Eng., vol. 37, no. 1, pp. 247-260, 1998.
20. B. C. Tom and A. K. Katsaggelos, "Reconstruction of a high-resolution image by simultaneous registration, restoration, and interpolation of low-resolution images", in Proc. IEEE Int. Conf. Image Process., Washington, DC, 1995, vol. 2, pp. 539-542.
21. R. R. Schulz and R. L. Stevenson, "Extraction of high-resolution frames from video sequences", IEEE Trans. Image Process., vol. 5, no. 6, pp. 996-1011, Jun. 1996.
22. R. C. Hardie, K. J. Barnard, and E. E. Armstrong, "Joint MAP registration and high-resolution image estimation using a sequence of undersampled images", IEEE Trans. Image Process., vol. 6, no. 12, pp. 1621-1633, Dec. 1997.
23. H. Shen, L. Zhang, B. Huang, and P. Li, "A MAP approach for joint motion estimation, segmentation and super-resolution", IEEE Trans. Image Process., vol. 16, no. 2, pp. 479-490, Feb. 2007.
24. N. A. Woods, N. P. Galatsanos, and A. K. Katsaggelos, "Stochastic methods for joint registration, restoration, and interpolation of multiple undersampled images", IEEE Trans. Image Process., vol. 15, no. 1, pp. 201-213, Jan. 2006.
25. M. Elad and A. Feuer, "Restoration of a single superresolution image from several blurred, noisy, and undersampled measured images", IEEE Trans. Image Process., vol. 6, no. 12, pp. 1646-1658, Dec. 1997.
26. S. Farsiu, M. Elad, and P. Milanfar, "Multiframe demosaicing and super-resolution of color images", IEEE Trans. Image Process., vol. 15, no. 1, pp. 141-159, Jan. 2006.
27. T. Akgun, Y. Altunbasak, and R. M. Mersereau, "Superresolution reconstruction of hyperspectral images", IEEE Trans. Image Process., vol. 14, no. 11, pp. 1860-1875, Nov. 2005.
28. H. Shen, M. K. Ng, P. Li, and L. Zhang, "Super-resolution reconstruction algorithm to MODIS remote sensing images", Comput. J., vol. 52, no. 1, pp. 90-100, 2009.
29. M. Vega, J. Mateos, R. Molina, and A. K. Katsaggelos, "Super-resolution of multispectral images", Comput. J., vol. 52, no. 1, pp. 153-167, 2009.
30. N. K. Bose, S. Lertrattanapanich, and J. Koo, "Advances in superresolution using L-curve", in Proc. Int. Symp. Circuits Syst., 2001, vol. 2, pp. 433-436.
31. C. L. Lawson and R. J. Hanson, Solving Least Squares Problems. Upper Saddle River, NJ: Prentice-Hall, 1974.
32. P. C. Hansen and D. P. O'Leary, "The use of the L-curve in the regularization of discrete ill-posed problems", SIAM J. Sci. Comput., vol. 14, no. 6, pp. 1487-1503, 1993.
33. N. Nguyen, P. Milanfar, and G. Golub, "A computationally efficient superresolution image reconstruction algorithm", IEEE Trans. Image Process., vol. 10, no. 4, pp. 573-583, Apr. 2001.
34. G. Golub, M. Heath, and G. Wahba, "Generalized cross-validation as a method for choosing a good ridge parameter", Technometrics, vol. 21, pp. 215-223, 1979.
35. M. G. Kang and A. K. Katsaggelos, "General choice of the regularization functional in regularized mage restoration", IEEE Trans. Image Process., vol. 4, no. 5, pp. 594-602, May 1995.
36. H. He and L. P. Kondi, "An image super-resolution algorithm for different error levels per frame", IEEE Trans. Image Process., vol. 15, no. 3, pp. 592-603, Mar. 2006.
37. R. Molina, M. Vega, J. Abad, and A. K. Katsaggelos, "Parameter estimation in Bayesian high-resolution image reconstruction with multisensors", IEEE Trans. Image Process., vol. 12, no. 12, pp. 1655-1667, Dec. 2003.
38. M. V. W. Zibetti, F. S. V. Baz'an, and J. Mayer, "Determining the regularization parameters for super-resolution problems", Signal Process., vol. 88, no. 12, pp. 2890-2901, 2008.
39. D. Krawczy-Stando and M. Rudnicki, "Regularization parameter selection in discrete-ill posed problems-The use of the U-curve", Int. J. Appl. Math. Comput. Sci., vol. 2, no. 17, pp. 157-164, 2007.
40. Z. Wang, A. C. Bovik, and H. R. Sheikh, "Image quality assessment: From error visibility to structural similarity", IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, Apr. 2004.
41. EPFL, EPFL Software [Online]. Available: http://lcavwww.epfl.ch/software/ superresolution/index.html
42. University of California, Santa Cruz, Milanfar Software [Online]. Available: http://users.soe.ucsc.edu/~milanfar/software/sr-datasets.html
43. P. Vandewalle, S. Susstrunk, and M. Vetterli, "A frequency domain approach to registration of aliased images with application to superresolution", EURASIP J. Appl. Signal Process., pp. 1-14, 2006.
44. M. K. Ng, H. Shen, E. Y. Lam, and L. Zhang, "A total variation regularization based super-resolution reconstruction algorithm for digital video", EURASIP J. Adv. Signal Process., pp. 1-16, 2007.
45. S. Farsiu, M. D. Robinson, M. Elad, and P. Milanfar, "Fast and robust multiframe super-resolution", IEEE Trans. Image Process., vol. 13, no. 10, pp. 1327-1344, Oct. 2004.