The equivalence of half-quadratic minimization and the gradient linearization iteration

IEEE Transactions on Image Processing

Volumn 16, Issue 6, 2007, Pages 1623-1627

  Nikolova, Mila ^a   Chan, Raymond H ^b  

^a UNIVERSITÉ PARIS SACLAY   (France)

^b CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Gradient linearization; Half quadratic (HQ) regularization; Inverse problems; Optimization; Signal and image restoration; Variational methods

Indexed keywords

CONVERGENCE OF NUMERICAL METHODS; EDGE DETECTION; INVERSE PROBLEMS; ITERATIVE METHODS; LINEARIZATION; MATHEMATICAL MODELS; OPTIMIZATION; VARIATIONAL TECHNIQUES;

HALF-QUADRATIC (HQ) REGULARIZATION; QUASI-NEWTON METHOD;

IMAGE RECONSTRUCTION;

ALGORITHM; ARTICLE; ARTIFACT; COMPUTER ASSISTED DIAGNOSIS; COMPUTER SIMULATION; EVALUATION; IMAGE ENHANCEMENT; MATHEMATICAL COMPUTING; METHODOLOGY; SIGNAL PROCESSING; STATISTICAL MODEL;

ALGORITHMS; ARTIFACTS; COMPUTER SIMULATION; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; LINEAR MODELS; NUMERICAL ANALYSIS, COMPUTER-ASSISTED; SIGNAL PROCESSING, COMPUTER-ASSISTED;

EID: 34249073050     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2007.896622     Document Type: Article

References (35)

1. G. Demoment, "Image reconstruction and restoration: Overview of common estimation structure and problems," IEEE Trans. Acoust. Speech Signal Process., vol. ASSP-37, no. 12, pp. 2024-2036, Dec. 1989.
2. A. Tarantola, Inverse Problem Theory: Methods for Data Fitting and Model Parameter Estimation. Amsterdam, The Netherlands: Elsevier, 1987.
3. G. Aubert and P. Kornprobst, Mathematical Problems in Images Processing. Berlin, Germany: Springer-Verlag, 2002.
4. A. Tikhonov and V. Arsenin, Solutions of Ill-Posed Problems. Washington, DC: Winston, 1977.
5. S. Geman and D. Geman, "Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images," IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-6, no. 6, pp. 721-741, Nov. 1984.
6. J. E. Besag, "Digital image processing: Towards Bayesian image analysis," J. Appl. Statist., vol. 16, no. 3, pp. 395-407, 1989.
7. D. Geman, "École d'Été de Probabilités de Saint-Flour XVIII - 1988," in Random Fields and Inverse Problems in Imaging. New York: Springer-Verlag, 1990, vol. 1427, pp. 117-193, Lecture Notes in Mathematics edition.
8. D. Geman and G. Reynolds, "Constrained restoration and recovery of discontinuities," IEEE Trans. Pattern Anal. Mach. Intell., vol. 14, no. 3, pp. 367-383, Mar. 1992.
9. C. Bouman and K. Sauer, "A generalized Gaussian image model for edge-preserving MAP estimation," IEEE Trans. Image Process., vol. 2, no. 3, pp. 296-310, Jul. 1993.
10. D. Geman and C. Yang, "Nonlinear image recovery with half-quadratic regularization," IEEE Trans. Image Process., vol. IP-4, no. 7, pp. 932-946, Jul. 1995.
11. A. Blake and A. Zisserman, Visual Reconstruction. Cambridge, MA: MIT Press, 1987.
12. P. Perona and J. Malik, "Scale-space and edge detection using anisotropic diffusion," IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-12, pp. 629-639, Jul. 1990.
13. P. Charbonnier, L. Blanc-Féraud, G. Aubert, and M. Barlaud, "Deterministic edge-preserving regularization in computed imaging," IEEE Trans. Image Process., vol. 6, no. 2, pp. 298-311, Feb. 1997.
14. S. Teboul, L. Blanc-Féraud, G. Aubert, and M. Barlaud, "Variational approach for edge-preserving regularization using coupled PDE's," IEEE Trans. Image Process., vol. 7, no. 3, pp. 387-397, Mar. 1998.
15. M. Nikolova and M. Ng, "Analysis of half-quadratic minimization methods for signal and image recovery," SIAM J. Sci. Comput., vol. 27, no. 3, pp. 937-966, 2005.
16. M. Black and A. Rangarajan, "On the unification of line processes, outlier rejection, and robust statistics with applications to early vision," Int. J. Comput. Vis., vol. 19, no. 1, pp. 57-91, 1996.
17. S. Li, Markov Random Field Modeling in Computer Vision, 1st ed. New York: Springer-Verlag, 1995.
18. M. Nikolova, "Weakly constrained minimization. Application to the estimation of images and signals involving constant regions," J. Math. Imag. Vis., vol. 21, no. 2, pp. 155-175, Sep. 2004.
19. M. Nikolova, "Analysis of the recovery of edges in images and signals by minimizing nonconvex regularized least-squares," SIAM J. Multiscale Model. Simul., vol. 4, no. 3, pp. 960-991, 2005.
20. P. Charbonnier, L. Blanc-Féraud, G. Aubert, and M. Barlaud, "Two deterministic half-quadratic regularization algorithms for computed imaging," in Proc. IEEE Int. Conf. Image Processing, 1994, vol. 2, pp. 168-172.
21. A. H. Delaney and Y. Bresler, "Globally convergent edge-preserving regularized reconstruction: An application to limited-angle tomography," IEEE Trans. Image Process., vol. 7, no. 2, pp. 204-221, Feb. 1998.
22. P. Kornprobst, R. Deriche, and G. Aubert, "Image sequence analysis via partial differential equations," J. Math. Imag. Vis., vol. 11, no. 1, pp. 5-26, Oct. 1999.
23. J. Idier, "Convex half-quadratic criteria and auxiliary interacting variables for image restoration," IEEE Trans. Image Process., vol. 10, no. 7, pp. 1001-1009, Jul. 2001.
24. G. Aubert and L. Vese, "A variational method in image recovery," SIAM J. Numer. Anal., vol. 34, no. 5, pp. 1948-1979, 1997.
25. T. Chan and P. Mulet, "On the convergence of the lagged diffusivity fixed point method in total variation image restoration," SIAM J. Numer. Anal., vol. 36, no. 2, pp. 354-367, 1999.
26. F. Champagnat and J. Idier, "A connection between half-quadratic criteria and em algorithms," IEEE Signal Process. Lett., vol. 11, no. 9, pp. 709-712, Sep. 2004.
27. J.-P. Tarel, S.-S. Ieng, and P. Charbonnier, "Using robust estimation algorithms for tracking explicit curves," in Proc. ECCV, 2002, vol. 2350, pp. 492-507, Lecture Notes Comput. Sci..
28. M. Allain, J. Idier, and Y. Goussard, "On global and local convergence of half-quadratic algorithms," IEEE Trans. Image Process., vol. 15, no. 5, pp. 1130-1142, May 2006.
29. C. R. Vogel and M. E. Oman, "Fast, robust total variation-based reconstruction of noisy, blurred images," IEEE Trans. Image Process. vol. 7, no. 6, pp. 813-824, Jun. 1998.
30. R. T. Rockafellar, Convex Analysis. Princeton, NJ: Princeton Univ. Press, 1970.
31. H. Brezis, "Collection mathématiques appliquées pour la maîtrise," in Analyse fonctionnelle. Paris, France: Masson, 1992.
32. P. Ciuciu and J. Idier, "A half-quadratic block-coordinate descent method for spectral estimation," Signal Process., no. 82, pp. 941-959, 2002.
33. S. Z. Li, "On discontinuity-adaptive smoothness priors in computer vision," IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-17, no. 6, pp. 576-586, Jun. 1995.
34. L. Blanc-Féraud, P. Charbonnier, G. Aubert, and M. Barlaud, "Nonlinear image processing: Modelling and fast algorithm for regularisation with edge detection," in Proc. IEEE Int. Conf. Image Processing, 1995, vol. 2, pp. 474-477.
35. C. R. Vogel and M. E. Oman, "Iterative method for total variation denoising," SIAM J. Sci. Comput., vol. 17, no. 1, pp. 227-238, 1996.