Superresolution reconstruction of a video captured by a vibrated time delay and integration camera

Journal of Electronic Imaging

Volumn 15, Issue 2, 2006, Pages

  Haik, Oren ^a   Yitzhaky, Yitzhak ^a  

^a BEN GURION UNIVERSITY OF THE NEGEV   (Israel)

Author keywords

[No Author keywords available]

Indexed keywords

GEOMETRIC DISTORTIONS; SUPERRESOLUTION RECONSTRUCTION; TIME DELAY AND INTEGRATION CAMERA; VIDEO SEQUENCE;

CAMERAS; COMPUTER SIMULATION; IMAGE ENHANCEMENT; IMAGE QUALITY; IMAGING TECHNIQUES; MOTION ESTIMATION; OPTICAL TRANSFER FUNCTION; VIBRATIONS (MECHANICAL);

IMAGE RECONSTRUCTION;

EID: 33748090270     PISSN: 10179909     EISSN: 1560229X     Source Type: Journal    
DOI: 10.1117/1.2194042     Document Type: Article

References (38)

1. S. X. Godber, M. Robinson, and J. P. O. Evans, "The line-scan sensor: an alternative sensor modality for the extraction of 3-D coordinate information," Opt. Eng. 34(10), 3044-3054 (1995).
2. H. S. Wong, Y. L. Yao, and E. S. Schlig, "TDI charge coupled devices: Design and applications," IBM J. Res. Dev. 36(1), 83-104 (1992).
3. D. F. Barbe, "Charge-coupled imaging devices," in Charge-Coupled Devices: Technology and Applications, R. Melen and D. Buss, Eds., pp. 144-147, IEEE Press, New York (1977).
4. M. Zucker, I. Pivnik, E. Malkinson et al., "Long mid-wave infrared detector with time delayed integration," Proc. SPIE 4820, 580-592 (2002).
5. N. S. Kopeika, A System Engineering Approach to Imaging, 2nd ed., SPIE Press, Bellingham, WA (1998).
6. O. Hadar, I. Dror, and N. S. Kopeika, "Image resolution limits resulting from mechanical vibration. Part IV: Real time numerical calculation of the OTF and experimental verification," Opt. Eng. 33(2), 566-578 (1994).
7. Y. Yitzhaky, G. Boshusha, Y. Levi, and N. S. Kopeika, "Restoration of an image degraded by vibrations using only a single frame," Opt. Eng. 38, 2083-2091 (2000).
8. Y. Yitzhaky and A. Stern, "Restoration of interlaced images degraded by variable velocity motion," Opt. Eng. 42, 3557-3565 (2003).
9. J. Miettinen and H. Ailisto, "Using a time delay integration camera at nonzero viewing angle under vibration conditions," Opt. Lasers Eng. 31, 223-238 (1999).
10. S. Borman and R. L. Stevenson, "Super-resolution from image sequences - a review," in Proc. of the IEEE Midwest Symp. on Circuits and Systems, Vol. 5, pp. 374-378 (1998).
11. S. Park, M. Park, and M. Kang, "Super-resolution image reconstruction: A technical overview," IEEE Signal Process. Mag. 20, 21-36 (2003).
12. S. Farsiu, D. Robinson, M. Elad, and P. Milanfar, "Advances and challenges in super-resolution," Int. J. Imaging Syst. Technol. 14(2), 47-57 (2004).
13. S. Chaudhuri, Super-Resolution Imaging, Kluwer Academic, Boston (2001).
14. H. Stark and P. Oskoui, "High-resolution image recovery from image-plane arrays using convex projections," J. Opt. Soc. Am. A 6, 1715-1726 (1989).
15. H. Stark and Y. Yang, Vector Space Projections: A Numerical Approach to Signal and Image Processing, Neural Nets, and Optics, John Wiley & Sons, New York (1998).
16. M. N. Wernick and C. T. Chen, "Superresolved tomography by convex projections and detector motion," J. Opt. Soc. Am. A 9(9), 1547-1553 (1992).
17. A. Stern, Y. Porat, A. Ben-Dor, and N. S. Kopeika, "Enhanced resolution image restoration from a sequence of low-frequency vibrated images by use of convex projections," Appl. Opt. 40(26), 4706-4715 (2001).
18. D. Rajan and S. Chaudhuri, "Simultaneous estimation of super-resolved scene and depth map from low resolution defocused observations," IEEE Trans. Pattern Anal. Mach. Intell. 25(9), 1102-1117 (2003).
19. M. C. Chiang and T. E. Boult, "Local blur estimation and super-resolution," in Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pp. 821-826 (1997).
20. M. K. Ozkan, A. M. Tekalp, and M. I. Sezan, "POCS based restoration of space varying blurred images," IEEE Trans. Image Process. 3(4), 450-454 (1994).
21. A. J. Patti, M. I. Sezan, and A. M. Tekalp, "Super resolution video reconstruction with arbitrary sampling lattices and non-zero aperture time," IEEE Trans. Image Process. 6(8), 1064-1076 (1997).
22. G. Hochman, Y. Yitzhaky, N. S. Kopeika, Y. Lauber, M. Citroen, and A. Stern, "Restoration of images captured by a staggered TDI camera in the presence of mechanical vibrations," Appl. Opt. 43(22), 4345-4354 (2004).
23. O. Haik and Y. Yitzhaky, "Superresolution reconstruction of a video captured by a translational vibrated staggered TDI camera," in Applications of Digital Image Processing XXVII, Proc. SPIE 5558, 815-826 (2004).
24. C. Stiller and J. Konrad, "Estimating motion in image sequences - a tutorial on modeling and computation of 2D motion," IEEE Signal Process. Mag. 16(4), 70-91 (1999).
25. J. L. Barron, D. J. Fleet, and S. Beauchemin, "Performance of optical flow techniques," Int. J. Comput. Vis. 12, 43-77 (1994).
26. G. L. Brown, "A survey on image registration techniques," ACM Comput. Surv. 24(4), 325-376 (1992).
27. E. Trucco and A. Verri, Introductory Techniques for 3-D Computer Vision, pp. 177-218, Prentice Hall, Upper Saddle River, NJ (1998).
28. B. Lucas and T. Kanade, "An iterative image registration with an application to stereo vision," in Proc. DARPA Imaging Understanding Workshops, pp. 121-130 (1981).
29. M. Elad, P. Teo, and Y. Hel-Or, "Optimal filters for gradient based motion estimation," in Proc. IEEE Int. Conf. on Computer Vision, pp. 559-565, Corfu, Corfu, Greece (1999).
30. D. Keren, S. Peleg, and R. Brada, "Image sequence enhancement using sub-pixel displacements," in Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pp. 742-746, Ann Arbor, MI (1988).
31. M. Irani and S. Peleg, "Improving resolution by image registration," CVGIP: Graph. Models Image Process. 53(3), 231-239 (1991).
32. A. Rosenfeld, Multiresolution Image Processing and Analysis, Springer-Verlag, Berlin/New York (1984).
33. V. Avrin and I. Dinstein, "Restoration and resolution enhancement of video sequences," in Proc. IEEE Int. Conf. Acoust., Speech, and Signal Processing, Vol. 4, pp. 2549-2553 (1997).
34. M. Elad and A. Feuer, "Super-resolution restoration of continuous image sequence - adaptive filtering approach," IEEE Trans. Image Process. 8(3), 387-395 (1999).
35. Y. Yitzhaky's, Home Page at Ben-Gurion University, Israel, http:// www.ee.bgu.ac.il/~itzik/TDImotion/ (accessed December 25, 2005).
36. M. S. Alam, J. G. Bognar, R. C. Hardie, and B. J. Yasuda, "Infrared image registration and high-resolution reconstruction using multiple translationally shifted aliased video frames," IEEE Trans. Instrum. Meas. 49, 915-923 (2000).
37. S. Lertrattanapanich and N. K. Bose, "High resolution image formation from low resolution frames using Delaunay triangulation," IEEE Trans. Image Process. 11(12), 1427-1441 (2002).
38. R. S. Wagner, D. Waagen, and M. Cassabaum, "Image super resolution for improved automatic target recognition," Proc. SPIE 5426, 188-196 (2004).