Image up-sampling using total-variation regularization with a new observation model

IEEE Transactions on Image Processing

Volumn 14, Issue 10, 2005, Pages 1647-1659

  Aly, Hussein A ^a   Dubois, Eric ^b  

^a Ministry of Defence   (Egypt)

^b UNIVERSITY OF OTTAWA   (Canada)

Author keywords

Data fidelity; Gamma correction; Image up sampling; Interpolation; Level sets motion (LSM); Observation model; Regularization; Total variation

Indexed keywords

EDGE DETECTION; FOURIER TRANSFORMS; INTERPOLATION; MATHEMATICAL MODELS; OPTIMIZATION; SIGNAL PROCESSING; VARIATIONAL TECHNIQUES;

DATA FIDELITY; GAMMA CORRECTION; IMAGE UP-SAMPLING; LEVEL-SETS MOTION (LSM); OBSERVATION MODEL; TOTAL VARIATION REGULARIZATION;

IMAGE ANALYSIS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; COMPUTER SIMULATION; EVALUATION; IMAGE ENHANCEMENT; INFORMATION RETRIEVAL; METHODOLOGY; SAMPLE SIZE; STATISTICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; INFORMATION STORAGE AND RETRIEVAL; MODELS, STATISTICAL; PATTERN RECOGNITION, AUTOMATED; SAMPLE SIZE;

EID: 27744520250     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2005.851684     Document Type: Article

References (54)

1. E. DuBois, "Video sampling and interpolation" in Handbook of Image and Video Processing, A. Bovik, Ed. San Diego, CA: Academic, 2000, ch. 7.2, pp. 645-654. E. Dubois, "Video sampling and interpolation".
2. E. Dubois, "The sampling and reconstruction of time-varying imagery with application in video systems," Proc. IEEE, vol. 73, no. 4, pp. 502-522, Apr. 1985.
3. R. Keys, "Cubic convolution interpolation for digital image processing," IEEE Trans. Acoust. Speech, Signal, Process., vol. ASSP-29, no. 6, pp. 1153-1160, Dec. 1981.
4. A. Muñoz, T. Blu, and M. Unser, "Least-squares image resizing using finite differences," IEEE Trans. Image Process., vol. 10, no. 9, pp. 1365-1378,Sep.2001.
5. M. Unser, "Splines: A perfect fit for signal and image processing," IEEE Signal Process. Mag., vol. 16, no. 6, pp. 22-38, Nov. 1999.
6. A. Gotchev, K. Egiazarian, J. Vesma, and T. Saramk̈i, "Edge-preserving image resizing using modified B-splines," in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Processing, vol. 3, 2001, pp. 1865-1868.
7. T. Blu, P. Thévenaz, and M. Unser, "Linear interpolation revitalized," IEEE Trans. Image Process., vol. 13, no. 5, pp. 710-719, May 2004.
8. Q. Wang, R. Ward, and H. Shi, "Isophote estimation by cubic-spline interpolation," in Proc. IEEE Int. Conf. Image Processing, vol. 3, 2002, pp.401-404.
9. J. P. Allebach, "Image scanning, sampling, and interpolation," in Handbook of image and Video Processing, A. Bovik, Ed. San Diego, CA: Academic, 2000, ch. 7. 1, pp. 629-643.
10. A. Biancardi, L. Cinque, and L. Lombardi, "Improvements to image magnification," Pattern Recognit., vol. 35, pp. 677-687, Mar. 2002.
11. S. Carrato, G. Ramponi, and S. Marsi, "A simple edge-sensitive image interpolation filter," in Proc. IEEE Int. Conf. Image Processing, vol. 3, 1996, pp.711-714.
12. Q. Wang and R. Ward, "A new edge-directed image expansion scheme," in Proc. IEEE Int. Conf. Image Processing, vol. 3, 2001, pp. 899-902.
13. W. K. Carrey, D. B. Chuang, and S. S. Hemami, "Regularity-preserving image interpolation," IEEE Trans. Image Process., vol. 8, no. 9, pp. 1293-1297, Sep.1999.
14. T. Chen, H. R. Wu, and B. Qiu, "Image interpolation using across-scale pixel correlation," in Proc. IEEE Int. Conf Acoustics Speech Signal Processing, vol. 3, 2001, pp. 1857-1860.
15. X. Li and T. Orchard, "New edge-directed interpolation," IEEE Trans. Image Process., vol. 10, no. 10, pp. 1521-1527, Oct. 2001.
16. Y. Takahashi and A. Taguchi, "An enlargement method of digital images with the prediction of high-frequency components," in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Processing, vol. 4, 2002, pp. 3700-3703.
17. A. Darwish, M. Bedair, and S. Shaheen, "Adaptive resampling algorithm for image zooming," Proc. Inst. Elect. Eng. Vis., Image, Signal Process., vol. 144, pp. 207-212, Aug. 1997.
18. H. A. Aly and E. Dubois, "Specification of the observation model for regularized image up-sampling," IEEE Trans. Image Process., vol. 14, no. 5, pp. 567-576, May 2005.
19. G. Golub and C. V. Loan, Matrix Computations, 3rd ed. Baltimore, MD: Johns Hopkins Univ. Press, 1996.
20. J. Hadamard, Lectures on Cauchy's Problem in Linear Partial Differential Equations. New York: Dover, 1952.
21. R. R. Schulz and R. L. Stevenson, "A Bayesian approach to image expansion for improved definition," IEEE Trans. Image Process., vol. 3, no. 5, pp. 233-242, May 1994.
22. S. Geman and D. Geman, "Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images," IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-6, no. 7, pp. 721-741, Jul. 1984.
23. D. Rajan and S. Chaudhuri, "Generation of super-resolution images from blurred observations using Markov random fields," in Proc. IEEE Int. Conf Acoustics, Speech, Signal Processing, vol. 3, 2001, pp. 1837-1840.
24. C. Bouman and K. Sauer, "A generalized Gaussian image model for edge-preserving MAP estimation" IEEE Trans. Image Process., vol. 2, no. 7, pp. 296-310, Jul. 1993.
25. F. Malgouyres and E Guichard, "Edge direction preserving image zooming: A mathematical and numerical analysis," SIAM J. Numer Anal., vol. 39, pp. 1-37, 2001.
26. B. Morse and D. Schwartzwald, "Image magnification using level-set reconstruction," in Proc. IEEE Conf Computer Vision Pattern Recognition, vol. 1, 2001, pp. 333-340.
27. W. C. Karl, "Regularization in image restoration and reconstruction," in Handbook of Image and Video Processing, A. Bovik, Ed. San Diego, CA: Academic, 2000, ch. 3.6, pp. 141-160.
28. P. D. Welch, "The use of fast Fourier transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms," IEEE Trans. Audio Electroacoust., vol. AU-15, pp. 70-73, Jun. 1967.
29. E. Dubois, "Spectral analysis of image sequences," Institut national de la recherche scientifique (INRS), Montreal, QC, Canada, Tech. Rep. 83-03, Feb. 1983.
30. P. Perona and J. Malik, "Scale-space and edge detection using anisotropic diffusion," IEEE Trans. Pattern Anal. Mach. Intell., vol. 12, no. 7, pp. 629-639, Jul. 1990.
31. L. Rudin, S. Osher, and E. Fatemi, "Nonlinear total variation based noise removal algorithms," Phys. D, vol. 60, pp. 259-268, 1992.
32. L. Alvarez, P. Lions, and J. Morel, "Image selective smoothing and edge detection by nonlinear diffusion," SIAM J. Numer Anal., vol. 29, pp. 845-866,Jun.1992.
33. Y. You, W. Xu, A. Tannenbaum, and M. Kaveh, "Behavioral analysis of anisotropic diffusion in image processing," IEEE Trans. Image Process., vol. 5, no. 11, pp. 1539-1552, Nov. 1996.
34. M. Giaquinta and S. Hildebrandt, Calculus of Variations. New York: Springer-Verlag, 1996.
35. W. F. Ames, Numerical Methods for Partial Differential Equations. London, U.K.: Nelson, 1969.
36. H. A. Aly, "Regularized image up-sampling," Ph.D. dissertation, School Inf. Technol. Eng. (SITE), Univ. Ottawa, Ottawa, ON, Canada, Mar. 2004.
37. D. Strong and T. Chan, "Edge-preserving and scale-dependent properties of total variation regularization," Inv. Probl., vol. 19, pp. 165-187, 2003.
38. S. Osher and J. Sethian, "Fronts propagating with curvature dependent speed: Algorithms based on the Hamilton-Jacobi formulation," Comput. Phys. J, vol. 79, pp. 12-49, 1988.
39. J. Sethian, Level Set Methods and Fast Marching Methods, 2nd ed. Cambridge, U.K.: Cambridge Univ. Press, 1999.
40. A. Marquina and S. Osher, "Explicit algorithms for a new time dependent model based on level set motion for nonlinear deblurring and noise removal" SIAM J. Sci. Comput., vol. 22, pp. 387-405, 2000.
41. B. Tom and A. Katsaggelos, "Resolution enhancement of monochrome and color video using motion compensation" IEEE Trans. Image Process., vol. 10, no. 2, pp. 278-287, Feb. 2001.
42. S. Baker and T. Kanade, "Limits on super-resolution and how to break them" IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 9, pp. 1167-1183, Sep. 2002.
43. B. Morse and D. Schwartzwald, "Isophote-based interpolation" in Proc. IEEE Int. Conf. Image Processing, vol. 3, 1998, pp. 227-231.
44. B. Morse and D. Schwartzwald, "Image magnification using level-set reconstruction," in Proc IEEE Conf. Computer Vision Pattern Recognition, vol. 1, 2001, pp. 333-340.
45. H. Jiang and C. Moloney, "A new direction adaptive scheme for image interpolation," in Proc. IEEE Int. Conf. Image Processing, vol. 3, 2002, pp.369-372.
46. G. Gilboa, Y Zeevi, and N. Sochen, "Anisotropic selective inverse diffusion for signal enhancement in the presence of noise," in Proc. IEEE Int. Conf Acoustics, Speech, Signal Processing, vol. 1, Istanbul, Turkey, Jun. 2000, pp.221-224.
47. G. Gilboa, N. Sochen, and Y Y Zeevi, "Forward-and-backward diffusion processes for adaptive image enhancement and denoising," IEEE Trans. Image Process., vol. 5, no. 7, pp. 689-703, Jul. 2002.
48. S. Borman and R. L. Stevenson, "Super-resolution for image sequences-A review," in Proc. IEEE Int. Symp. Circuits Systems, 1998, pp. 374-378.
49. H. Aly and E. Dubois, "Regularized image up-sampling using a new observation model and the level set method, in Proc. IEEE Int. Conf. Image Processing, vol. 3, 2003, pp. 665-668.
50. S. Osher and R. Fedkiw, Level Set Methods and Dynamic Implicit Surfaces. New York: Springer-Verlag, 2003.
51. P. L. Combettes and J. Luo, "An adaptive level set method for nondifferentiable constrained image recovery," IEEE Trans. Image Process., vol. 11, no. 11, pp. 1295-1304, Nov. 2002.
52. C. Poynton, Digital Video and HDTV: Algorithms and Interfaces. Amsterdam, The Netherlands: Morgan Kaufmann, 2003.
53. P. L. Combettes, "A block-iterative surrogate constraint splitting method for quadratic signal recovery," IEEE Trans. Signal Process., vol. 51, no. 7, pp. 1771-1782, Jul. 2003.
54. H. H. Bauschke and P. L. Combettes, "Construction of best Bergman approximations in reflexive Banach spaces," in Proc. Amer. Math. Soc., vol. 131, 2003, pp. 3757-3766.