A Douglas-Rachford splitting approach to nonsmooth convex variational signal recovery

IEEE Journal on Selected Topics in Signal Processing

Volumn 1, Issue 4, 2007, Pages 564-574

  Combettes, Patrick L ^a   Pesquet, Jean Christophe ^b  

^a UNIVERSITÉ PIERRE ET MARIE CURIE   (France)

^b UNIVERSITÉ PARIS EST   (France)

Author keywords

Convex optimization; Denoising; Douglas Rachford; Frame; Nondifferentiable optimization; Poisson noise; Proximal algorithm; Wavelets

Indexed keywords

ALGORITHMS; HILBERT SPACES; OPTIMIZATION; POISSON EQUATION; VARIATIONAL TECHNIQUES; WAVELET TRANSFORMS;

DENOISING; NONDIFFERENTIABLE OPTIMIZATION; PROXIMAL ALGORITHM;

SIGNAL PROCESSING;

EID: 39449085530     PISSN: 19324553     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSTSP.2007.910264     Document Type: Article

References (58)

1. T. Akgun, Y. Altunbasak, and R. M. Mersereau, "Super-resolution reconstruction of hyperspectral images," IEEE Trans. Image Process. vol. 14, pp. 1860-1875, Nov. 2005.
2. H. C. Andrews and B. R. Hunt, Digital Image Restoration. Englewood Cliffs, NJ: Prentice-Hall, 1977.
3. A. Antoniadis, D. Leporini, and J.-C. Pesquet, "Wavelet thresholding for some classes of non-Gaussian noise," Statist. Neerlandica, vol. 56, pp. 434-453, 2002.
4. J.-P. Aubin, Optima and Equilibria - An Introduction to Nonlinear Analysis, 2nd ed. New York: Springer-Verlag, 1998.
5. J.-P. Aubin and H. Frankowska, Set-Valued Analysis. Boston, MA: Birkhäuser, 1990.
6. H. H. Bauschke and J. M. Borwein, "On projection algorithms for solving convex feasibility problems," SIAM Rev., vol. 38,pp. 367-426, 1996.
7. H. H. Bauschke, P. L. Combettes, and S. G. Kruk, "Extrapolation algorithm for affine-convex feasibility problems," Numer. Algor., vol. 41, pp. 239-274, 2006.
8. H. H. Bauschke, P. L. Combettes, and D. R. Luke, "Finding best approximation pairs relative to two closed convex sets in Hilbert spaces," J. Approx. Theory, vol. 127, pp. 178-192, 2004.
9. P. Besbeas, I. De Feis, and T. Sapatinas, "A comparative simulation study of wavelet shrinkage estimators for Poisson counts," Int. Statist. Rev., vol. 72, pp. 209-237, 2004.
10. J. M. Bioucas-Dias, "Bayesian wavelet-based image deconvolution: A GEM algorithm exploiting a class of heavy-tailed priors," IEEE Trans. Image Process., vol. 15, pp. 937-951, Apr. 2006.
11. E. J. Candès and D. L. Donoho, "Recovering edges in ill-posed inverse problems: Optimality of curvelet frames," Ann. Statist., vol. 30, pp. 784-842, 2002.
12. Y. Censor, T. Bortfeld, B. Martin, and A. Tromov, "A unified approach for inversion problems in intensity-modulated radiation therapy," Phys. Med. Biol., vol. 51, pp. 2353-2365, 2006.
13. C. Chaux, P. L. Combettes, J.-C. Pesquet, and V. R. Wajs, "A variational formulation for frame-based inverse problems," Inv. Probl., vol. 23, pp. 1495-1518, 2007.
14. C. Chaux, L. Duval, and J.-C. Pesquet, "Image analysis using a dual-tree M-band wavelet transform," IEEE Trans. Image Process., vol. 15, pp. 2397-2412, Aug. 2006.
15. P. L. Combettes, "The foundations of set theoretic estimation," Proc. IEEE, vol. 81, pp. 182-208, 1993.
16. P. L. Combettes, "Inconsistent signal feasibility problems: Least-squares solutions in a product space," IEEE Trans. Signal Process., vol. 42, pp. 2955-2966, Nov. 1994.
17. P. L. Combettes, "The convex feasibility problem in image recovery," in Advances in Imaging and Electron Physics, P. Hawkes, Ed. New York: Academic, 1996, vol. 95, pp. 155-270.
18. P. L. Combettes, "Convex set theoretic image recovery by extrapolated iterations of parallel subgradient projections," IEEE Trans. Image Process., vol. 6, pp. 493-506, 1997.
19. P. L. Combettes, "Hilbertian convex feasibility problem: Convergence of projection methods," Appl. Math. Optim., vol. 35, pp. 311-330, 1997.
20. P. L. Combettes, "Convexité et signal," in Proc. Congr. Mathématiques Appliquées et Industrielles SMAI'01, Pompadour, France, May 28-Jun. 1 2001, pp. 6-16.
21. P. L. Combettes, "Solving monotone inclusions via compositions of nonexpansive averaged operators," Optimization, vol. 53, pp. 475-504, 2004.
22. P. L. Combettes and J. Luo, "An adaptive level set method for nondifferentiable constrained image recovery," IEEE Trans. Image Process., vol. 11, pp. 1295-1304, 2002.
23. P. L. Combettes and J.-C. Pesquet, "Image restoration subject to a total variation constraint," IEEE Trans. Image Process., vol. 13, pp. 1213-1222, 2004.
24. P. L. Combettes and J.-C. Pesquet, "Proximal thresholding algorithm for minimization over orthonormal bases," SIAM J. Optim., vol. 18, pp. 1351-1376, 2007.
25. P. L. Combettes and V. R. Wajs, "Signal recovery by proximal forward-backward splitting," Multiscale Model. Simul., vol. 4, pp. 1168-1200, 2005.
26. I. Daubechies, Ten Lectures on Wavelets. Philadelphia, PA: SIAM, 1992.
27. I. Daubechies, M. Defrise, and C. De Mol, "An iterative thresholding algorithm for linear inverse problems with a sparsity constraint," Comm. Pure Appl. Math., vol. 57, pp. 1413-1457, 2004.
28. F. Deutsch, Best Approximation in Inner Product Spaces. New York: Springer-Verlag, 2001.
29. M. N. Do and M. Vetterli, "The contourlet transform: An efficient directional multiresolution image representation," IEEE Trans. Image Process., vol. 14, pp. 2091-2106, 2005.
30. J. Douglas and H. H. Rachford, "On the numerical solution of heat conduction problems in two or three space variables," Trans. Amer. Math. Soc., vol. 82, pp. 421-439, 1956.
31. J. Eckstein and D. P. Bertsekas, "On the Douglas-Rachford splitting method and the proximal point algorithm for maximal monotone operators," Math. Progr., vol. 55, pp. 293-318, 1992.
32. B. Eicke, "Iteration methods for convexly constrained ill-posed problems in Hilbert space," Numer. Funct. Anal. Optim., vol. 13, pp. 413-429, 1992.
33. M. Elad, "Why simple shrinkage is still relevant for redundant representations?," IEEE Trans. Inform. Theory, vol. 52, pp. 5559-5569, 2006.
34. X. Fan, H. Huang, D. Liang, and C. Qi, "A hybrid parallel projection approach to object-based image restoration," Pattern Recognit. Lett. vol. 27, pp. 1045-1053, 2006.
35. F. J. González-Castaño, U. M. García-Palomares, J. L. Alba-Castro, and J. M. Pousada-Carballo, "Fast image recovery using dynamic load balancing in parallel architectures, by means of incomplete projections," IEEE Trans. Image Process., vol. 10, pp. 493-499, 2001.
36. D. Han and D. R. Larson, "Frames, bases, and group representations," Mem. Amer. Math. Soc., vol. 147, 2000.
37. G. T. Herman, Image Reconstruction from Projections, the Fundamentals of Computerized Tomography. New York: Academic, 1980.
38. P.-L. Lions and B. Mercier, "Splitting algorithms for the sum of two nonlinear operators," SIAM J. Numer. Anal., vol. 16, pp. 964-979, 1979.
39. J.-J. Moreau, "Fonctions convexes duales et points proximaux dans un espace hilbertien," C. R. Acad. Sci. Paris Sér. A Math., vol. 255, pp. 2897-2899, 1962.
40. J.-J. Moreau, "Proximité et dualité dans un espace hilbertien," Bull. Soc. Math. France, vol. 93, pp. 273-299, 1965.
41. J.-C. Pesquet, H. Krim, and H. Carfantan, "Time-invariant orthonormal wavelet representations," IEEE Trans. Signal Process., vol. 44, pp. 1964-1970, 1996.
42. R. T. Rockafellar, Convex Analysis. Princeton, NJ: Princeton Univ. Press, 1970.
43. A. A. Samsonov, E. G. Kholmovski, D. L. Parker, and C. R. Johnson, "POCSENSE: POCS-based reconstruction for sensitivity encoded magnetic resonance imaging," Magn. Reson. Med., vol. 52, pp. 1397-1406, 2004.
44. S. Sardy, A. Antoniadis, and P. Tseng, "Automatic smoothing with wavelets for a wide class of distributions," J. Comput. Graph. Statist., vol. 13, pp. 399-421, 2004.
45. N. Z. Shor, Minimization Methods for Non-Differentiable Functions. New York: Springer-Verlag, 1985.
46. H. Stark, Ed., Image Recovery: Theory and Application. San Diego, CA: Academic, 1987.
47. H. Stark and Y. Yang, Vector Space Projections: A Numerical Approach to Signal and Image Processing, Neural Nets, and Optics. New York: Wiley, 1998.
48. A. M. Thompson and J. Kay, "On some Bayesian choices of regularization parameter in image restoration," Inv. Probl., vol. 9, pp. 749-761, 1993.
49. R. Tolimieri and M. An, Time-Frequency Representations. Boston, MA: Birkhäuser, 1998.
50. H. J. Trussell, "A priori knowledge in algebraic reconstruction methods," in Advances in Computer Vision and Image Processing, T. S. Huang, Ed. Greenwich, CT: JAI, 1984, vol. 1, pp. 265-316.
51. R. S. Varga, Matrix Iterative Analysis, 2nd ed. New York: Springer-Verlag, 2000.
52. I. Yamada, K. Slavakis, and K. Yamada, "An efficient robust adaptive filtering algorithm based on parallel subgradient projection techniques," IEEE Trans. Signal Process., vol. 50, pp. 1091-1101, 2002.
53. D. C. Youla, "Generalized image restoration by the method of alternating orthogonal projections," IEEE Trans. Circuits Syst., vol. 25, pp. 694-702, 1978.
54. D. C. Youla and V. Velasco, "Extensions of a result on the synthesis of signals in the presence of inconsistent constraints," IEEE Trans. Circuits Syst., vol. 33, pp. 465-468, 1986.
55. D. C. Youla and H. Webb, "Image restoration by the method of convex projections: Part 1 - Theory," IEEE Trans. Med. Imag., vol. 1, pp. 81-94, 1982.
56. M. Yukawa and I. Yamada, "Pairwise optimal weight realization - Acceleration technique for set-theoretic adaptive parallel subgradient projection algorithm," IEEE Trans. Signal Process., vol. 54, pp. 4557-4571, 2006.
57. C. Zšlinescu, Convex Analysis in General Vector Spaces. River Edge, NJ: World Scientific, 2002.
58. E. Zeidler, Nonlinear Functional Analysis and Its Applications. New York: Springer-Verlag, 1985, vol. I-V.