On global and local convergence of half-quadratic algorithms

IEEE Transactions on Image Processing

Volumn 15, Issue 5, 2006, Pages 1130-1142

  Allain, Marc ^a   Idier, Jérôme ^a   Goussard, Yves ^b  

^a INSTITUT DE RECHERCHE EN COMMUNICATIONS ET CYBERNÉTIQUE DE NANTES   (France)

^b ÉCOLE POLYTECHNIQUE DE MONTRÉAL   (Canada)

Author keywords

Algorithms; Asymptotic rate; Convergence analysis; Half quadratic (HQ) iterations; Image reconstruction; Image restoration; Robust statistics

Indexed keywords

ALGORITHMS; CONVERGENCE OF NUMERICAL METHODS; ITERATIVE METHODS; STATISTICS;

ASYMPTOTIC RATE; CONVERGENCE ANALYSIS; CONVERGENCE RATE; HALF-QUADRATIC ALGORITHMS; ROBUST STATISTICS;

IMAGE RECONSTRUCTION;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; COMPUTER ASSISTED DIAGNOSIS; COMPUTER SIMULATION; EVALUATION; IMAGE ENHANCEMENT; INFORMATION RETRIEVAL; METHODOLOGY; STATISTICAL MODEL; THREE DIMENSIONAL IMAGING;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGING, THREE-DIMENSIONAL; INFORMATION STORAGE AND RETRIEVAL; MODELS, STATISTICAL;

EID: 33645674847     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2005.864173     Document Type: Article

References (44)

1. R. T. Rockafellar, Convex Analysis. Princeton, NJ: Princeton Univ. Press, 1970.
2. D. Geman and G. Reynolds, "Constrained restoration and the recovery of discontinuities," IEEE Trans. Pattern Anal. Mach. Intell., vol. 14, no. 3, pp. 367-383, Mar. 1992.
3. D. Geman and C. Yang, "Nonlinear image recovery with half-quadratic regularization," IEEE Trans. Image Process., vol. 4, no. 7, pp. 932-946, Jul. 1995.
4. M. Çetin and W. Karl, "Feature-enhanced synthetic aperture radar image formation based on nonquadratic regularization," IEEE Trans. Image Process., vol. 10, no. 4, pp. 623-631, Apr. 2001.
5. E. Roullot, A. Herment, I. Bloch, A. de Cesare, M. Nikolova, and E. Mousseaux, "Modeling anisotropic undersampling of magnetic resonance angiographies and reconstruction of a high-resolution isotropic volume using half-quadratic regularization techniques," Signal Process., vol. 84, pp. 743-762, Apr. 2004.
6. V. Mazet, C. Carteret, D. Brie, J. Idier, and B. Humbert, "Background removal from spectra by designing and minimizing a nonquadratic cost function," Chemometrics Intell. Lab. Syst., vol. 76, pp. 121-133, 2005.
7. P. J. Huber, Robust Statistics. New York: Wiley, 1981.
8. E. Weiszfeld, "Sur le point pour lequel la somme des distances de n points donnés est minimum," Tôhoku Math. J., vol. 43, pp. 355-386, 1937.
9. B. R. Hunt, "Bayesian methods in nonlinear digital image restoration," IEEE Trans. Commun., vol. COM-26, no. 3, pp. 219-229, Mar. 1977.
10. N. Villain, Y. Goussard, J. Idier, and M. Allain, "3D edge-preserving image enhancement for computed tomography," IEEE Trans. Med. Imag., vol. 22, no. 10, pp. 1275-1287, Oct. 2003.
11. G. T. Herman, Image Reconstruction From Projections. The Fundamentals of Computerized Tomography. New York: Academic, 1980.
12. C. A. Bouman and K. D. Sauer, "A unified approach to statistical tomography using coordinate descent optimization," IEEE Trans. Image Process., vol. 5, no. 3, pp. 480-492, Mar. 1996.
13. M. Allain, J. Idier, and Y. Goussard, "Regularized approach in 3-D helical computed tomography," in Proc. IEEE EMBS, vol. 2, Houston, TX, Oct. 2002, pp. 843-844.
14. G. Demoment, "Image reconstruction and restoration: Overview of common estimation structure and problems," IEEE Trans. Acoust. Speech, Signal Process., vol. ASSP-37, no. 12, pp. 2024-2036, Dec. 1989.
15. C. A. Bouman and K. D. Sauer, "A generalized Gaussian image model for edge-preserving MAP estimation," IEEE Trans. Image Process., vol. 2, no. 3, pp. 296-310, Jul. 1993.
16. P. Charbonnier, L. Blanc-Féraud, G. Aubert, and M. Barlaud, "Deterministic edge-preserving regularization in computed imaging," IEEE Trans. Image Process., vol. 6, no. 2, pp. 298-311, Feb. 1997.
17. S. Geman and D. McClure, "Statistical methods for tomographic image reconstruction," in Proc. 46th Session ICI, Bull. ICI, vol. 52, 1987, pp. 5-21.
18. p deconvolution," IEEE Trans. Acoust. Speech, Signal Process., vol. ASSP-33, no. 1, pp. 174-182, Feb. 1985.
19. C. Burrus, J. Barreto, and I. Selesnick, "Iterative reweighted least-squares design of FIR filters," IEEE Trans. Signal Process., vol. 42, no. 11, pp. 2926-2936, Nov. 1994.
20. J. Nocedal and S. J. Wright, Numerical Optimization, ser. Operations Research. New York: Springer Verlag, 1999.
21. J. Idier, "Convex half-quadratic criteria and interacting auxiliary variables for image restoration," IEEE Trans. Image Process., vol. 10, no. 7, pp. 1001-1009, Jul. 2001.
22. M. Allain, J. Idier, and Y. Goussard, "On global and local convergence of half-quadratic algorithms," in Proc. IEEE ICIP, vol. 2, Rochester, MN, Sep. 2002.
23. P. Charbonnier, L. Blanc-Féraud, G. Aubert, and M. Barlaud, "Two deterministic half-quadratic regularization algorithms for computed imaging," in Proc. IEEE ICIP, vol. 2, Austin, TX, Nov. 1994, pp. 168-172.
24. S. Husse, Y. Goussard, and J. Idier, "Extended forms of Geman and Yang algorithm: Application to MRI reconstruction," in Proc. IEEE ICASSP, vol. III, Montreal, QC, Canada, May 2004, pp. 513-516.
25. A. H. Delaney and Y. Bresler, "Globally convergent edge-preserving regularized reconstruction: An application to limited-angle tomography," IEEE Trans. Image Process., vol. 7, no. 2, pp. 204-221, Feb. 1998.
26. 2 minimization with application to tomography," Geophysics, vol. 62, pp. 1183-1195, 1997.
27. T. F. Chan and P. Mulet, "On the convergence of the lagged diffusivity fixed point method in total variation image restoration," SIAM J. Numer. Anal., vol. 36, no. 2, pp. 354-367, 1999.
28. H. Voss and H. Eckhardt, "Linear convergence of generalized Weiszfeld's method," Computing, vol. 25, pp. 243-251, 1980.
29. K. Lange, D. R. Hunter, and I. Yang, "Optimization transfer using surrogate objective functions (with discussion)," J. Comput. Graph. Statist., vol. 9, no. 1, pp. 1-20, Mar. 2000.
30. J. Fessler, E. Ficaro, N. Clinthorne, and K. Lange, "Grouped-coordinate ascent algorithms for penalized-likelihood transmission image reconstruction," IEEE Trans. Med. Imag., vol. 16, no. 2, pp. 166-175, Apr. 1997.
31. H. Erdogan and J. Fessler, "Monotonic algorithms for transmission tomography," IEEE Trans. Med. Imag., vol. 18, no. 9, pp. 801-814, Sep. 1999.
32. J. Zheng, S. S. Saquib, K. Sauer, and C. A. Bouman, "Parallelizable Bayesian tomography algorithms with rapid, guaranteed convergence," IEEE Trans. Image Process., vol. 9, no. 10, pp. 1745-1759, Oct. 2000.
33. S. Sotthivirat and J. Fessler, "Image recovery using partitioned-separable paraboloidal surrogate coordinate ascent algorithms," IEEE Trans. Image Process., vol. 11, no. 3, pp. 306-317, Mar. 2002.
34. M.Allain, "Approche pénalisée en tomographie hélicoïdale. Application à la conception d'une prothèse personnalisée du genou," Ph.D. dissertation (in French), Univ. de Paris-Sud, Orsay, France, Dec. 2002. [Online] http://tel.ccsd.cnrs.fr/documents/archives0 /00/00/37/56.
35. J. Ortega and W. Rheinboldt, Iterative Solution of Nonlinear Equations in Several Variables. New York: Academic, 1970.
36. T. F. Chan, H. M. Zhou, and R. H. Chan, "Continuation method for total variation denoising problems," in Proc. SPIE, Conf. Adv. Signal Process. Algorithms, vol. 2563, Jul. 1995, pp. 314-325.
37. D. P. Bertsekas, Nonlinear Programming, 2nd ed. Belmont, MA: Athena Scientific, 1999.
38. M. Nikolova and M. Ng, "Comparison of the main forms of half quadratic regularization," in Proc. IEEE ICIP, Rochester, MN, Sep. 2002, pp. 349-352.
39. M. Nikolova and M. Ng, "Analysis of Half-Quadratic Minimization Methods for Signal and Image Recovery," SIAM J. Sci. Comput., vol. 27, no. 3, pp. 937-966, 2005.
40. K. D. Sauer and C. A. Bouman, "A local update strategy for iterative reconstruction from projections," IEEE Trans. Signal Process., vol. 41, no. 2, pp. 534-548, Feb. 1993.
41. S. Husse and Y. Goussard, "Image reconstruction in MRI: Regularized approach by Markov random fields," in Proc. IEEE ICIP, vol. 2, Barcelona, Spain, 2003, pp. 851-854.
42. R. Deriche, P. Kornprobst, M. Nikolova, and M. Ng, "Half-quadratic regularization for MRI image restoration," in Proc. IEEE ICIP, vol. 6, 2003, pp. 585-588.
43. M. Nikolova and M. Ng, "Fast image reconstruction algorithms combining half-quadratic regularization and preconditioning," in Proc. IEEE ICIP, Thessaloniki, Greece, Oct. 2001, pp. 277-280.
44. J. Fessler, "Grouped-coordinate descent algorithms for robust edge-preserving image restoration," Proc. SPIE, vol. 3170, pp. 184-194, 1997.