Superresolution image reconstruction from a sequence of aliased imagery

Applied Optics

Volumn 45, Issue 21, 2006, Pages 5073-5085

  Young, S Susan ^a   Driggers, Ronald G ^b  

^a U S ARMY RESEARCH LABORATORY   (United States)

^b NIGHT VISION AND ELECTRONIC SENSORS DIRECTORATE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; CONSTRAINT THEORY; CORRELATION METHODS; IMAGE ANALYSIS; JITTER; OPTICAL RESOLVING POWER;

ERROR ENERGY REDUCTION ALGORITHMS; FORWARD LOOKING INFRARED (FLIR) IMAGES; INTERPOLATION ALGORITHMS; SUBPIXEL SHIFTS;

IMAGE RECONSTRUCTION;

ALGORITHM; ARTICLE; ARTIFACT; COMPUTER ASSISTED DIAGNOSIS; EVALUATION; IMAGE ENHANCEMENT; INFORMATION RETRIEVAL; INFRARED SPECTROPHOTOMETRY; METHODOLOGY; REPRODUCIBILITY; SAMPLE SIZE; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING; VIDEORECORDING;

ALGORITHMS; ARTIFACTS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; INFORMATION STORAGE AND RETRIEVAL; REPRODUCIBILITY OF RESULTS; SAMPLE SIZE; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING, COMPUTER-ASSISTED; SPECTROPHOTOMETRY, INFRARED; VIDEO RECORDING;

EID: 33748695076     PISSN: 1559128X     EISSN: 15394522     Source Type: Journal    
DOI: 10.1364/AO.45.005073     Document Type: Article

References (43)

1. S. C. Park, M. K. Park, and M. G. Kang, "Superresolution image reconstruction: a technical overview," IEEE Signal Process. Mag. 20(3), 21-36 (2003).
2. J. M. Schuler and D. A. Scribner, "Dynamic sampling, resolution enhancement, and superresolution," in Analysis of Sampled Imaging Systems, R. H. Vollmerhausen and R. G. Driggers, eds. (SPIE Press, 2000), pp. 125-138.
3. S. Borman and R. L. Stevenson, "Superresolution from image sequences - a review," Proc. 1998 Midwest Symp. Circuits and Systems (IEEE, 1998), pp. 374-378.
4. M. Bertero and C. Demol, "Superresolution by data inversion," Progress In Optics, Vol. 36 (Elsevier North-Holland, 1996), pp. 129-178.
5. Z. Zalevsky, N. Shamir, and D. Mendlovic, "Geometrical superresolution in infrared sensor: experimental verification," Opt. Eng. 43, 1401-1406 (2004).
6. M. Ben-Ezra, A. Zomet, and S. K. Nayar, "Video superresolution using controlled subpixel detector shifts," IEEE Trans. Pattern Anal. Mach. Intell. 27, 977-987 (2005).
7. B. K. P. Horn and B. G. Schunk, "Determining optical flow," Artif. Intell. 17, 185-203 (1981).
8. D. J. Heeger, "Model for the extraction of image flow," J. Opt. Soc. Am. A 4, 1455-1471 (1987).
9. J. R. Bergen, P. J. Burt, K. Hanna, R. Hingorari, P. Jeanne, and S. Peleg, "Dynamic multiple-motion computation, in Artificial Intelligence and Computer Vision: Proceedings of the Israeli Conference, Y. A. Feldman and A. Bruckstein, eds. (Elsevier, 1991), pp. 147-156.
10. M. Bierling, "Displacement estimation by hierarchical block-matching," in Visual Communications and Image Processing '88, Proc. SPIE 1001, 942-951 (1988).
11. R. P. Kleihorst, R. L. Lagendijk, and J. Biemond, "Noise reduction of image sequences using motion compensation and signal decomposition," IEEE Trans. Image Processing 4, 274-284 (1985).
12. H. S. Stone, M. T. Orchard, E.-C. Chang, and S. A. Martucci, "A fast direct Fourier-based algorithm for subpixel registration of images," IEEE Trans. Geosci. Remote Sens. 39, 2235-2243 (2001).
13. S. P. Kim and W. Y. Su, "Subpixel accuracy image registration by spectrum cancellation," Proceedings of ICASSP-93-1993 IEEE International Conference on Acoustics, Speech, and Signal Processing (1993), Vol. 5, pp. 153-156.
14. C. L. L. Hendriks and L. J. van Vliet, "Improving resolution to reduce aliasing in an undersampled image sequence," in Sensors and Camera Systems for Scientific, Industrial, and Digital Photography Applications, Proc. SPIE 3965, 214-222 (2000).
15. H. Foroosh, J. B. Zerubia, and M. Berthod, "Extension of phase correlation to subpixel registration," IEEE Trans. Image Process. 11, 188-200 (2002).
16. A. J. Patti, M. I. Sezan, and A. M. Tekalp, "Superresolution video reconstruction with arbitrary sampling lattices and nonzero aperture time, " IEEE Trans. Image Process. 6, 1064-1076 (1997).
17. N. K. Bose, "Superresolution from image sequence," Proceedings of IEEE International Conference on Image Processing 2004 (IEEE, 2004), pp. 81-86.
18. D. T. Sandwell, "Biharmonic spline interpolation of Geo-3 and Seasat altimeter data," Geophys. Res. Lett. 14, 139-142 (1987).
19. S. Lertrattanapanich and N. K. Bose, "High resolution image formation from low resolution frams using Delaunay Triangulation," IEEE Trans. Image Process. 11, 1427-1441 (2002).
20. H. Ur and D. Gross, "Improved resolution from subpixel shifted pictures," CVGIP: Graph. Models Image Process. 54, 181-186 (1992).
21. M. C. Chiang and T. E. Boult, "Efficient superresolution via image warping," Image Vis. Comput. 18, 761-771 (2000).
22. R. A. Gonsalves and F. Khaghani, "Superresolution based on low-resolution, warped images," in Applications of Digital Image Processing XXV, Proc. SPIE 4790, 11-20 (2002).
23. M. S. Alam, J. G. Bognar, R. C. Hardie, and B. J. Yasuda, "Infrared image registration and high-resolution reconstruction using multiple translationally shifted aliased video frames," IEEE Trans. Instrum. Meas. 49, 915-923 (2000).
24. F. M. Candocia and J. C. Principe, "Superresolution of images based on local correlations," IEEE Trans. Neural Netw. 10, 372-380 (1999).
25. M. Irani and S. Peleg, "Image sequence enhancement using multiple motions analysis," Proceedings of 1992 IEEE Computer Society Conference on Computer Vision and Pattern Analysis (IEEE, 1992), pp. 216-221.
26. R. Y. Tsai and T. S. Huang, "Multiple frame image restoration and registration," in Advances in Computer Vision and Image Processing (JAI Press Inc., 1984), pp. 317-339.
27. J. Mateos, M. Vega, R. Molina, and A. K. Katsaggelos, "Baysian image estimation from an incomplete set of blurred, undersampled low resolution images," Proceedings Lecture Notes in Computer Science 2652, Pattern Recognition and Image Analysis (IEEE, 2003), pp. 538-546.
28. R. R. Schulz and R. L. Stevenson, "Extraction of highresolution frames from video sequences," IEEE Trans. Image Process. 5, 996-1011 (1996).
29. R. C. Hardie, K. J. Barnard, and E. E. Armstrong, "Joint MAP registration and high-resolution image estimation using a sequence of undersampled images," IEEE Trans. Image Process. 6, 1621-1633 (1997).
30. M. Elad and Y. Hel-Or, "A fast superresolution reconstruction algorithm for pure translational motion and common spaceinvariant blur," IEEE Trans. Image Process. 10, 1187-1193 (2001).
31. D. Rajan and S. Chaudhuri, "Simultaneous estimation of superresolved scene and depth map from low resolution defocused observations," IEEE Trans. Pattern Anal. Mach. Intell. 25, 1102-1115 (2003).
32. S. Farsiu, M. D. Robinson, M. Elad, and P. Milanfar, "Fast and robust multiframe superresolution," IEEE Trans. Image Process. 13, 1327-1344 (2004).
33. E. S. Lee and M. G. Kang, "Regularized adaptive high-resolution image reconstruction considering inaccurate subpixel registration," IEEE Trans. Image Process. 12, 826-837 (2003).
34. A. Papoulis, "A new algorithm in spectral analysis and bandlimited extrapolation," IEEE Trans, on Circuits Syst. 22, 735-742 (1975).
35. R. W. Gerchberg, "Superresolution through error energy reduction," Opt. Acta 21, 709-720 (1974).
36. P. De Santis and F. Gori, "On an iterative method for superresolution," Opt. Acta 22, 691-695 (1975).
37. H. Stark and P. Oskoui, "High-resolution image recovery from image-plane arrays, using convex projections," J. Opt. Soc. Am. A 6, 1715-1726 (1989).
38. K. Krapels, R. G. Driggers, S. Murrill, J. Schuler, M. Thielke, and S. S. Young, "Superresolution performance for undersampled imagers," in Defense and Security Symposium (Formerly AeroSense), Proc. SPIE 5407, 139-149 (2004).
39. P. Vandewalle, S. Susstrunk, and M. Vetterli, "Superresolution images reconstruction from aliased images," in Visual Communications and Image Processing, Proc. SPIE 5150, 1398-1405 (2003).
40. P. Vandewalle, L. Sbaiz, J. Vandewalle, and M. Vetterli, "How to take advantage of aliasing in bandlimited signals," Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (IEEE, 2004), pp. 948-951.
41. S. S. Young, "Alias-free image subsampling using Fourier-based windowing methods," Opt. Eng. 43, 843-855 (2004).
42. http://www.cns.nvu.edu/~david/ftp/registration/.
43. J. M. Schuler, J. G. Howard, P. Warren, and D. Scrib ner, "TARID-based image superresolution," in Infrared and Passive Millimeter-Wave Imaging Systems; Design, Analysis, Modeling, and Testing, Proc SPIE 4719, 247-254 (2002).