A robust and computationally efficient simultaneous super-resolution scheme for image sequences

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 17, Issue 10, 2007, Pages 1288-1300

  Zibetti, Marcelo Victor Wüst ^a,b   Mayer, Joceli ^a,b  

^a IEEE

^b FEDERAL UNIVERSITY OF SANTA CATARINA   (Brazil)

Author keywords

Image processing; Image restoration; Simultaneous super resolution; Super resolution (SR); Video restoration

Indexed keywords

ALGORITHMS; COMPUTATIONAL COMPLEXITY; ERROR ANALYSIS; INFORMATION ANALYSIS; MOTION ESTIMATION;

SIMULTANEOUS SUPER-RESOLUTION; VIDEO RESTORATION;

IMAGE RECONSTRUCTION;

EID: 34948895585     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2007.903801     Document Type: Article

References (47)

1. S. Borman and R. L. Stevenson., "Simultaneous multi-frame map super-resolution video enhancement using spatio-temporal priors," in Proc. IEEE Int. Conf. on Image Process., Oct. 1999, vol. 3, pp. 469-473.
2. S. Chaudhuri, Super-Resolution Imaging, ser. Kluwer International Series in Engineering and Computer Science. Norwood, MA: Kluwer, 2001.
3. S. Farsiu, D. Robinson, M. Elad, and P. Milanfar, "Advances and challenges in super-resolution," Int. J. Imaging Syst. Technol., vol. 14, no. 3, pp. 47-57, Aug. 2004.
4. S. C. Park, M. K. Park, and M. G. Kang, "Super-resolution image reconstruction: A technical overview," IEEE Signal Process. Mag., vol. 20, no. 3, pp. 21-36, May 2003.
5. M. Bertero and P. Boccacci, "Super-resolution in computational imaging," Micron, vol. 34, no. 6, pp. 265-273, Oct. 2003.
6. S. Borman and R. L. Stevenson, "Spatial resolution enhancement of low-resolution image sequences, a comprehensive review with directions for future research," Univ. Notre Dame, South Bend, IN, 1998, Res. Rep.
7. S. Borman and R. L. Stevenson, "Super-resolution from image sequences - A review," in Proc. Midwest Symp. Circuits and Systems, 1999, pp. 374-378.
8. N. K. Bose, R. H. Chan, and M. K. Ng, Int. J. Imaging Syst. Technol., Special Issue on High-Resolution Reconstruction, Parts I and II, vol. 14, no. 2-3, 2004.
9. M. K. Ng, T. Chan, M. G. Kang, and P. Milanfar, EURASIP J. Appl. Signal Process., Special Issue on Super-Resolution Imaging: Analysis, Algorithms, and Applications, vol. 1, 2006.
10. M. Elad and A. Feuer, "Restoration of a single superresolution image from several blurred, noisy, and undersampled measured images," IEEE Trans. Image Process., vol. 6, pp. 1646-1658, Dec. 1997.
11. C. Stiller and J. Konrad, "Estimating motion in image sequences," IEEE Signal Process. Mag., vol. 16, no. 4, pp. 70-91, Jul. 1999.
12. L. D. Alvarez, J. Mateos, R. Molina, and A. K. Katsaggelos, "High-resolution images from compressed low-resolution video: Motion estimation and observable pixels," Int. J. Imag. Syst Technol., vol. 14, no. 3, pp. 58-66, Aug. 2004.
13. R. R. Schultz and R. L. Stevenson, "Extraction of high-resolution frames from, video sequences," IEEE Trans. Image Process., vol. 5, pp. 996-1011, Jun. 1996.
14. P. E. Eren, M. I. Sezan, and A. M. Tekalp, "Robust, object-based high-resolution image reconstruction from low-resolution video," IEEE Trans. Image Process., vol. 6, pp. 1446-1451, Oct. 1997.
15. S. Farsiu, D. Robinson, M. Elad, and P. Milanfar, "Fast and robust super-resolution," in IEEE Int. Conf. on Image Process., Sep. 2003, vol. 2, pp. 291-294.
16. S. Farsiu, D. Robinson, M. Elad, and P. Milanfar, "Fast and robust multi-frame super-resolution," IEEE Trans. Image Process., vol. 13, pp. 1327-1344, Oct. 2004.
17. M. V. W. Zibetti and J. Mayer, "Adaptive regularization for resolution restoration of multiframes considering subpixel contributions," in Proc. 3rd Int. Symp. on Image and Signal. Process, and Analysis, Sep. 2003, vol. 2, pp. 952-956.
18. M. Elad and A. Feuer, "Super-resolution reconstruction of image sequences," IEEE Trans. Pattern Anal. Mach. Intell., vol. 21, no. 9, pp. 817-834, Sep. 1999.
19. J. Mateos, A. K. Katsaggelos, and R. Molina, "Resolution enhancement of compressed low resolution video," in Proc. IEEE Int. Conf. on Acoust, Speech, and Signal Process., Jun. 2000, vol. 4, pp. 1919-1922.
20. J. Tian and K.-K. Ma, "A new state-space approach for super-resolution image sequence reconstruction," in Proc. IEEE Int. Conf. on Image. Process. ICIP'05, Sep. 2005, vol. 1, pp. I-881.
21. M. V. W. Zibetti and J. Mayer, "Simultaneous super-resolution for video sequences," in Proc. IEEE Int. Conf. on Image Process., Sep. 2005, vol. 1, pp. 877-880.
22. M. V. W. Zibetti and J. Mayer, "Outlier robust and edge-preserving simultaneous super-resolution," in Proc. IEEE Int. Conf. on Image Process., Oct. 2006, vol. 1, pp. 1741-1744.
23. Y. Saad, Iterative Methods for Sparse Linear Systems. Boston, MA: PWS, 1996.
24. S. Borman and R. Stevenson, "Linear models for multi-frame super-resolution restoration under non-affine registration and spatially varying PSF," presented at the SPIE 16th Annu. Symp. Elect. Imag., San Jose, CA, Jan. 18-22, 2004.
25. H. H. Barrett and K. J. Myers, Foundations of Image Science, ser. Wiley Series in Pure and Applied Optics. New York: Wiley, 2004.
26. R. R. Schultz, L. Meng, and R. L. Stevenson, "Subpixel motion estimation for super-resolution image sequence enhancement," J. Visual Commun. Image Represent., vol. 9, no. 1, pp. 38-50, Mar. 1998.
27. P. J. Huber, Robust Statistics. New York: Wiley, 1981.
28. D. Hasler, L. Sbaiz, S. Süsstrunk, and M. Vetterli, "Outlier modeling in image matching," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 3, pp. 301-315, Mar. 2003.
29. C. R. Vogel, Computational Methods for Inverse Problems, ser. Frontiers in Applied Mathematics. Philadelphia, PA: SIAM, 2002.
30. P. C. Hansen, Ed., Rank-Deficient and Discrete Ill-Posed Problems, ser. SIAM Monographs and Mathematical Modeling and Computation. Philadelphia, PA: SIAM, 1998.
31. A. Bovik, Ed., Handbook of Image and Video Process.. Norwood, MA: Academic, 2000.
32. A. Srivastava, "Stochastic models for capturing image variability," IEEE Signal Process. Mag., vol. 19, no. 5, pp. 63-76, Sep. 2002.
33. R. L. Stevenson, B. E. Schmitz, and E. J. Delp, "Discontinuity preserving regularization of inverse visual problems," IEEE Trans. Syst., Man Cybern., vol. 24, no. 2, pp. 455-469, Mar. 1994.
34. C. Bouman and K. Sauer, "A generalized Gaussian image model for edge-preserving map estimation," IEEE Trans. Image. Process., vol. 2, no. 7, pp. 269-310, Jul. 1993.
35. P. Thévenaz, T. Blu, and M. Unser, "Image Interpolation and Resampling," in Handbook of Medical Imaging, Process, and Analysis. San Diego, CA: Academic, 2000, pp. 393-420.
36. P. Thévenaz, T. Blu, and M. Unser, "Interpolation revisited," IEEE Trans. Med. Imag., vol. 19, pp. 739-758, Jul. 2000.
37. N. Nguyen, P. Milanfar, and G. Golub, "A computationally efficient superresolution image reconstruction algorithm," IEEE Trans. Image Process., vol. 10, pp. 573-583, Apr. 2001.
38. N. K. Bose, S. Lertrattanapanich, and J. Koo, "Advances in superresolution using 1-curve," in Proc. IEEE Int. Symp. on Circuits and Syst., May 2001, vol. 2, pp. 433-436.
39. R. R. Schultz and R. L. Stevenson, "A Bayesian approach to image expansion for improved definition," IEEE Trans. Image Process., vol. 3, no. 5, pp. 233-242, May 1994.
40. S. El-Khamy, M. Hadhoud, M. Dessouky, B. Salam, and F. A. El-Samier, "Efficient implementation of image interpolation as an inverse problem," Digital Signal Process., vol. 15, no. 2, pp. 137-152, Mar. 2005.
41. M. S. Bazaraa, H. D. Sherali, and C. M. Shetty, Nonlinear Programming: Theory and Algorithms, 2nd ed. New York: Wiley, 1993.
42. M. Beige, M. E. Kilmer, and E. L. Miller, "Efficient determination of multiple regularization parameters in a generalized 1-curve framework," Inverse Problems, vol. 18, no. 4, pp. 1161-1183, Aug. 2002.
43. J. R. Shewchuk, An Introduction to Conjugate Gradient Method Without the Agonizing Pain. Pittsburg, PA: Carnegie Mellon Univ., 1994.
44. Y. Dai, J. Han, G. Liu, D. Sun, H. Yin, and Y. Yuan, "Convergence properties of nonlinear conjugate gradient methods," SIAM J. Optimiz., vol. 10, no. 2, pp. 345-348, 1999.
45. G. H. Golub and C. F. V. Loan, Matrix Computations, ser. Johns Hopkins Series in the Mathematical Sciences. Baltimore, MD: The Johns Hopkins Univ. Press, 1996.
46. B. K. P. Horn and B. G. Schunck, "Determining optical flow," Artificial Intell., vol. 17, pp. 185-203, Aug. 1981.
47. M. J. Black and P. Anandan, "The robust estimation of multiple motions: Parametric and piecewise-smooth flow fields," Comput. Vision Image Understanding, vol. 63, no. 1, pp. 75-104, Jan. 1996.