Zoom-based super-resolution reconstruction approach using prior total variation

Optical Engineering

Volumn 46, Issue 12, 2007, Pages

  Ng, Michael K ^a   Shen, Huanfeng ^b   Chaudhuri, Subhasis ^c   Yau, Andy C ^d  

^a HONG KONG BAPTIST UNIVERSITY   (Hong Kong)

^b WUHAN UNIVERSITY   (China)

^c INDIAN INSTITUTE OF TECHNOLOGY BOMBAY   (India)

^d UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Inpainting; Preconditioning; Registration; Total variation; Zoom super resolution reconstruction

Indexed keywords

IMAGE REGISTRATION; IMAGE RESOLUTION; ITERATIVE METHODS; PHOTOMETRY; PROBLEM SOLVING; VARIATIONAL TECHNIQUES;

IMAGE INPAINTING; PRECONDITIONING; TOTAL VARIATION; ZOOM SUPER RESOLUTION RECONSTRUCTION; ZOOMING FACTORS;

IMAGE RECONSTRUCTION;

EID: 37549038175     PISSN: 00913286     EISSN: 15602303     Source Type: Journal    
DOI: 10.1117/1.2818797     Document Type: Article

References (46)

1. R. Y. Tsai and T. S. Huang, " Multi-frame image restoration and registration., " Comput. Graph. Image Process. 1 (2), 317-339 (1984).
2. S. P. Kim, N. K. Bose, and H. M. Valenzuela, " Recursive reconstruction of high resolution image from noisy undersampled multiframes., " IEEE Trans. Acoust., Speech, Signal Process. 38 (6), 1013-1027 (June 1990).
3. S. Rhee and M. G. Kang, " Discrete cosine transform based regularized high-resolution image reconstruction algorithm., " Opt. Eng. 38 (8), 1348-1356 (1999).
4. R. Chan, T. Chan, L. Shen, and Z. Shen, " Wavelet algorithms for high-resolution image reconstruction., " SIAM J. Sci. Comput. (USA) 24 (4), 1408-1432 (2003).
5. M. K. Ng, C. K. Sze, and S. P. Yung, " Wavelet algorithms for deblurring models., " Int. J. Imaging Syst. Technol. 14 (3), 113-121 (2004).
6. N. Nguyen and P. Milanfar, " A wavelet-based interpolation- restoration method for superresolution (wavelet superresolution)., " Circuits Syst. Signal Process. 19 (4), 321-338 (2000).
7. H. Ur and D. Gross, " Improved resolution from sub-pixel shifted pictures., " CVGIP: Graph. Models Image Process. 54, 181-186 (Mar. 1992).
8. M. Irani and S. Peleg, " Improving resolution by image registration., " CVGIP: Graph. Models Image Process. 53 (3), 231-239 (1991).
9. H. Stark and P. Oskoui, " High-resolution image recovery from image plane arrays, using convex projections., " J. Opt. Soc. Am. A 6, 1715-1726 (1989).
10. A. M. Tekalp and M. K. Ozkan, " High-resolution image reconstruction from lower-resolution image sequences and space-varying image restoration., " IEEE Proc. Intl. Conf. Acoustics, Speech Signal Process., San Francisco, CA (1992), Vol. 3, pp. 169-172.
11. A. J. Patti, M. I. Sezan, and A. M. Tekalp, " High-resolution image reconstruction from a low-resolution image sequence in the presence of time-varying motion blur., " IEEE Proc. Intl. Conf. Image Process., Austin, TX (1994), pp. 343-347.
12. A. J. Patti, M. I. Sezan, and A. M. Tekalp, " Superresolution video reconstruction with arbitrary sampling lattices and nonzero aperture time., " IEEE Trans. Image Process. 6 (8), 1064-1076 (Aug. 1997).
13. R. R. Schultz and R. L. Stevenson, " Extraction of high-resolution frames from video sequences., " IEEE Trans. Image Process. 5 (6), 996-1011 (June 1996).
14. M. K. Ng and A. M. Yip, " A fast MAP algorithm for high-resolution image reconstruction with multisensors., " Multidimens. Syst. Signal Process. 12 (2), 143-164 (Apr. 2001).
15. M. K. Ng, W. C. Kwan, and R. H. Chan, " A fast algorithm for high-resolution color image reconstruction with multisensors., " in Numerical Analysis and Its Applications, Lecture Notes in Computer Science, vol. 1988, pp. 615-627 (2001).
16. M. K. Ng and N. K. Bose, " Mathematical analysis of super-resolution methodology., " IEEE Signal Process. Mag. 20 (3), 62-74 (2003).
17. R. C. Hardie, K. J. Barnard, and E. E. Armstrong, " Joint MAP registration and high-resolution image estimation using a sequence of undersampled images., " IEEE Trans. Image Process. 6 (12), 1621-1633 (Dec. 1997).
18. N. A. Woods, N. P. Galatsanos, and A. K. Katsaggelos, " Stochastic methods for joint registration, restoration, and interpolation of multiple undersampled images., " IEEE Trans. Image Process. 15 (1), 201-213 (Jan. 2006).
19. H. Shen, L. Zhang, B. Huang, and P. Li, " A MAP approach for joint motion estimation, segmentation, and super resolution., " IEEE Trans. Image Process. 16 (2), 479-490 (Feb. 2007).
20. M. Elad and A. Feuer, " Restoration of a single superresolution image from several blurred, noisy, and undersampled measured images., " IEEE Trans. Image Process. 6 (12), 1646-1658 (Dec. 1997).
21. S. Farsiu, M. Elad, and P. Milanfar, " Multiframe demosaicing and super-resolution of color images., " IEEE Trans. Image Process. 15 (1), 141-159 (2006).
22. A. Zomet and S. Peleg, " Multi-sensor super-resolution., " IEEE Proc. Workshop Appl. Computer Vision (2002), pp. 27-31.
23. B. K. Gunturk, Y. Altunbasak, and R. M. Mersereau, " Super-resolution reconstruction of compressed video using transform-domain statistics., " IEEE Trans. Image Process. 13 (1), 33-43 (2004).
24. C. A. Segall, R. Molina, and A. K. Katsaggelos, " High-resolution images from low-resolution compressed video., " IEEE Signal Process. Mag. 20 (3), 37-48 (May 2003).
25. S. Farsiu, D. Robinson, M. Elad, and P. Milanfar, " Dynamic demosaicing and color super-resolution of video sequences., " Proc. SPIE 5562, 169-178 (2004).
26. D. Capel and A. Zisserman, " Computer vision applied to super resolution., " IEEE Signal Process. Mag. 20 (3), 75-86 (2003).
27. R. R. Schultz, L. Meng, and R. L. Stevenson, " Subpixel motion estimation for super-resolution image sequence enhancement., " J. Visual Commun. Image Represent 9 (1), 38-50 (1998).
28. S. Chaudhuri and J. Manjunath, Motion-Free Super-Resolution, Springer-Verlag, New York (2005).
29. X. Li, " Super-resolution for synthetic zooming., " EURASIP J. Appl. Signal Process. 2006, 12 (2006).
30. M. V. Joshi, S. Chaudhuri, and R. Panuganti, " Super-resolution imaging: Use of zoom as a cue., " Image Vis. Comput. 22 (14), 1185-1196 (2004).
31. M. V. Joshi, S. Chaudhuri, and R. Panuganti, " A learning-based method for image super-resolution from zoomed observations., " IEEE Trans. Syst., Man, Cybern., Part B: Cybern. 35 (3), 527-537 (2005).
32. M. Bertalmio, G. Sapiro, V. Caselles, and C. Ballester, " Image inpainting., " Proc. ACM SIGGRAPH 2000, New Orleans, LA (2000), pp. 417-424.
33. T. F. Chan and J. H. Shen, " Variational image inpainting., " Commun. Pure Appl. Math. 58 (5), 579-619 (May 2005).
34. M. Fornasier, " Nonlinear projection recovery in digital inpainting for color image restoration., " J. Math. Imaging Vision 24 (3), 359-373 (2006).
35. S. Farsiu, D. Robinson, M. Elad, and P. Milanfar, " Advances and challenges in super-resolution., " Int. J. Imaging Syst. Technol. 14 (2), 47-57 (2004).
36. S. Farsiu, M. D. Robinson, M. Elad, and P. Milanfar, " Fast and robust multiframe super resolution., " IEEE Trans. Image Process. 13 (10), 1327-1344 (Oct. 2004).
37. L. Rudin, S. Osher, and E. Fatemi, " Nonlinear total variation based noise removal algorithms., " Physica D 60, 259-268 (1992).
38. T. F. Chan and J. Shen, " Mathematical models for local nontexture inpaintings., " SIAM J. Appl. Math. 62 (3), 1019-1043 (2002).
39. D. Capel and A. Zisserman, " Super-resolution enhancement of text image sequences., " presented at 15th Intl. Conf. Patt. Recog., Barcelona, Spain (2000).
40. H. Yu Bing and L. Nan Wu, " Super resolution reconstruction of video sequence based on total variation., " Proc. Intl. Symp. Intelligent Multimedia, Video and Speech Process., Hong Kong, China (2004), pp. 575-578.
41. C. Vogel and M. Oman, " Iterative methods for total variation denoising., " SIAM J. Sci. Comput. (USA) 17 (1), 227-238 (1996).
42. F. R. Lin, M. K. Mg, and W. K. Ching, " Factorized banded inverse preconditioners for matrices with Toeplitz structure., " SIAM J. Sci. Comput. (USA) 26 (6), 1852-1870 (2005).
43. R. H. Chan, T. F. Chan, and C. K. Wong, " Cosine transform based preconditioners for total variation deblurring., " IEEE Trans. Image Process. 8 (10), 1472-1478 (Oct. 1999).
44. M. K. Ng, R. H. Chan, T. F. Chan, and A. M. Yip, " Cosine transform preconditioners for high resolution image reconstruction., " Linear Algebr. Appl. 316 (1-3), 89-104 (Sep. 1 2000).
45. L. Kolotilina and A. Yeremin, " Factorized sparse approximate inverse preconditionings I: theory., " SIAM J. Matrix Anal. Appl. 14, 45-58 (1993).
46. D. Roberts, Y. Yamaguchi, and R. Lyon, " Calibration of airborne imaging spectrometer data to percent reflectance using field spectral measurements., " presented at 19th Intl. Symp. Remote Sens. Environment, MI (1985).