Split bregman methods and frame based image restoration

Multiscale Modeling and Simulation

Volumn 8, Issue 2, 2009, Pages 337-369

  Cai, Jian Feng ^a   Osher, Stanley ^a   Shen, Zuowei ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Image restorations; Split Bregman; Wavelet frames

Indexed keywords

BREGMAN ITERATION; DEBLURRING; FRAMELETS; IMAGE DE-NOISING; IMAGE RESTORATION; IMAGE RESTORATION ALGORITHMS; INNER ITERATION; INPAINTING; MINIMIZATION PROBLEMS; NUMERICAL SIMULATION; SPARSE SAMPLE; SPLIT BREGMAN; TEXTURE IMAGE; TOTAL VARIATION NORM; WAVELET FRAME;

COMPUTER SIMULATION; DIFFERENTIAL EQUATIONS; IMAGE RECONSTRUCTION; MAGNETIC RESONANCE IMAGING; MATHEMATICAL OPERATORS; NOISE POLLUTION CONTROL; OPTIMIZATION; RESONANCE;

RESTORATION;

EID: 77952921188     PISSN: 15403459     EISSN: 15403467     Source Type: Journal    
DOI: 10.1137/090753504     Document Type: Article

References (69)

1. M. Benzi, G. H. Golub, and J. Liesen, Numerical solution of saddle point problems, Acta Numer., 14 (2005), pp. 1-137.
2. M. Bertalḿo, G. Sapiro, V. Caselles, and C. Ballester, Image inpainting, in Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, ACM Press/Addison-Wesley, New York, 2000, pp. 417-424.
3. M. Bertalḿo, L. Vese, G. Sapiro, and S. Osher, Simultaneous structure and texture image inpainting, IEEE Trans. Image Process., 12 (2003), pp. 882-889.
4. J. H. Bramble, J. E. Pasciak, and A. T. Vassilev, Analysis of the inexact Uzawa algorithm for saddle point problems, SIAM J. Numer. Anal., 34 (1997), pp. 1072-1092.
5. J. H. Bramble, J. E. Pasciak, and A. T. Vassilev, Uzawa type algorithms for nonsymmetric saddle point problems, Math. Comp., 69 (2000), pp. 667-689.
6. L. M. Brégman, A relaxation method of finding a common point of convex sets and its application to the solution of problems in convex programming, Ž. Vyčisl. Mat. i Mat. Fiz., 7 (1967), pp. 620-631.
7. J.-F. Cai, E. J. Candés, and Z. Shen, A Singular Value Thresholding Algorithm for Matrix Completion, http://arxiv.org/abs/0810.3286 (2008).
8. J.-F. Cai, R. Chan, L. Shen, and Z. Shen, Restoration of chopped and nodded images by framelets, SIAM J. Sci. Comput., 30 (2008), pp. 1205-1227.
9. J.-F. Cai, R. H. Chan, L. Shen, and Z. Shen, Convergence analysis of tight framelet approach for missing data recovery, Adv. Comput. Math., 31 (2009), pp. 87-113.
10. J.-F. Cai, R. H. Chan, and Z. Shen, A framelet-based image inpainting algorithm, Appl. Comput. Harmon. Anal., 24 (2008), pp. 131-149.
11. J.-F. Cai, R. H. Chan, and Z. Shen, Simultaneous Cartoon and Texture Inpainting, preprint, 2008.
12. J.-F. Cai, S. Osher, and Z. Shen, Convergence of the linearized Bregman iteration forℓ1-norm minimization, Math. Comp., 78 (2009), pp. 2127-2136.
13. J.-F. Cai, S. Osher, and Z. Shen, Linearized Bregman iterations for compressed sensing, Math. Comp., 78 (2009), pp. 1515-1536.
14. J.-F. Cai, S. Osher, and Z. Shen, Linearized Bregman iterations for frame-based image deblurring, SIAM J. Imaging Sci., 2 (2009), pp. 226-252.
15. J.-F. Cai and Z. Shen, Framelet based deconvolution, J. Comput. Math., to appear.
16. E. J. Candés and D. L. Donoho, Curvelets-a surprisingly effective nonadaptive representation for objects with edges, in Curves and Surfaces, Vanderbilt University Press, Nashville, TN, 2000, pp. 105-120.
17. 2 singularities, Comm. Pure Appl. Math., 57 (2004), pp. 219-266.
18. E. J. Candés and B. Recht, Exact Matrix Completion via Convex Optimization, http:// arxiv.org/abs/0805.4471 (2008).
19. E. J. Candés, J. Romberg, and T. Tao, Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information, IEEE Trans. Inform. Theory, 52 (2006), pp. 489-509.
20. Z.-H. Cao, Fast Uzawa algorithm for generalized saddle point problems, Appl. Numer. Math., 46 (2003), pp. 157-171.
21. A. E. Çetin, Reconstruction of signals from Fourier transform samples, Signal Process., 16 (1989), pp. 129-148.
22. A. Chai and Z. Shen, Deconvolution: A wavelet frame approach, Numer. Math., 106 (2007), pp. 529-587.
23. A. Chambolle, An algorithm for total variation minimization and applications, J. Math. Imaging Vision, 20 (2004), pp. 89-97.
24. A. Chambolle, R. A. DeVore, N.-y. Lee, and B. J. Lucier, Nonlinear wavelet image processing: Variational problems, compression, and noise removal through wavelet shrinkage, IEEE Trans. Image Process., 7 (1998), pp. 319-335.
25. R. H. Chan, T. F. Chan, L. Shen, and Z. Shen, Wavelet algorithms for high-resolution image reconstruction, SIAM J. Sci. Comput., 24 (2003), pp. 1408-1432.
26. R. H. Chan, S. D. Riemenschneider, L. Shen, and Z. Shen, Tight frame: An efficient way for high-resolution image reconstruction, Appl. Comput. Harmon. Anal., 17 (2004), pp. 91-115.
27. R. H. Chan, Z. Shen, and T. Xia, A framelet algorithm for enhancing video stills, Appl. Comput. Harmon. Anal., 23 (2007), pp. 153-170.
28. T. F. Chan, G. H. Golub, and P. Mulet, A nonlinear primal-dual method for total variationbased image restoration, SIAM J. Sci. Comput., 20 (1999), pp. 1964-1977.
29. T. F. Chan and J. Shen, Mathematical models for local nontexture inpaintings, SIAM J. Appl. Math., 62 (2002), pp. 1019-1043.
30. T. F. Chan and J. Shen, Image Processing and Analysis: Variational, PDE, Wavelet, and Stochastic Methods, SIAM, Philadelphia, 2005.
31. C. Chaux, P. L. Combettes, J.-C. Pesquet, and V. R. Wajs, A variational formulation for frame-based inverse problems, Inverse Problems, 23 (2007), pp. 1495-1518.
32. S. S. Chen, D. L. Donoho, and M. A. Saunders, Atomic decomposition by basis pursuit, SIAM Rev., 43 (2001), pp. 129-159.
33. X. Chen, Global and superlinear convergence of inexact Uzawa methods for saddle point problems with nondifferentiable mappings, SIAM J. Numer. Anal., 35 (1998), pp. 1130-1148.
34. R. R. Coifman and D. L. Donoho, Translation-invariant de-noising, in Wavelets and Statistics, Lecture Notes in Statist. 103, A. Antoniadis and G. Oppenheim, eds., Springer-Verlag, New York, 1995, pp. 125-150.
35. P. L. Combettes and V. R. Wajs, Signal recovery by proximal forward-backward splitting, Multiscale Model. Simul., 4 (2005), pp. 1168-1200.
36. J. Darbon and S. Osher, Fast Discrete Optimization for Sparse Approximations and Deconvolutions, preprint, 2007.
37. I. Daubechies, Ten Lectures on Wavelets, CBMS-NSF Regional Conf. Ser. in Appl. Math. 61, SIAM, Philadelphia, 1992.
38. I. Daubechies, M. Defrise, and C. De Mol, An iterative thresholding algorithm for linear inverse problems with a sparsity constraint, Comm. Pure Appl. Math., 57 (2004), pp. 1413-1457.
39. I. Daubechies, B. Han, A. Ron, and Z. Shen, Framelets: MRA-based constructions of wavelet frames, Appl. Comput. Harmon. Anal., 14 (2003), pp. 1-46.
40. I. Daubechies, G. Teschke, and L. Vese, Iteratively solving linear inverse problems under general convex constraints, Inverse Probl. Imaging, 1 (2007), pp. 29-46.
41. D. L. Donoho, Compressed sensing, IEEE Trans. Inform. Theory, 52 (2006), pp. 1289-1306.
42. M. Elad, P. Milanfar, and R. Rubinstein, Analysis versus synthesis in signal priors, Inverse Problems, 23 (2007), pp. 947-968.
43. M. Elad, J.-L. Starck, P. Querre, and D. L. Donoho, Simultaneous cartoon and texture image inpainting using morphological component analysis (MCA), Appl. Comput. Harmon. Anal., 19 (2005), pp. 340-358.
44. M. Fadili and J.-L. Starck, Sparse representations and Bayesian image inpainting, in Proceedings of SPARS'05, Vol. I, Rennes, France, 2005.
45. M. Fadili, J.-L. Starck, and F. Murtagh, Inpainting and zooming using sparse representations, Comput. J., 52 (2009), pp. 64-79.
46. M. A. T. Figueiredo and R. D. Nowak, An EM algorithm for wavelet-based image restoration, IEEE Trans. Image Process., 12 (2003), pp. 906-916.
47. T. Goldstein and S. Osher, The split Bregman algorithm for L1-regularized problems, SIAM J. Imaging Sci., 2 (2009), pp. 323-343.
48. O. G. Guleryuz, Nonlinear approximation based image recovery using adaptive sparse reconstructions and iterated denoising-part II: Adaptive algorithms, IEEE Trans. Image Process., 15 (2006), pp. 555-571.
49. E. T. Hale, W. Yin, and Y. Zhang, Fixed-point continuation forℓ1-minimization: Methodology and convergence, SIAM J. Optim., 19 (2008), pp. 1107-1130.
50. Q. Hu and J. Zou, Two new variants of nonlinear inexact Uzawa algorithms for saddle-point problems, Numer. Math., 93 (2002), pp. 333-359.
51. Q. Hu and J. Zou, Nonlinear inexact Uzawa algorithms for linear and nonlinear saddle-point problems, SIAM J. Optim., 16 (2006), pp. 798-825.
52. R.-Q. Jia, H. Zhao, and W. Zhao, Convergence analysis of the Bregman method for the variational model of image denoising, Appl. Comput. Harmon. Anal., 27 (2009), pp. 367-379.
53. M. Li, B. Hao, and X. Feng, Iterative regularization and nonlinear inverse scale space based on translation invariant wavelet shrinkage, Int. J. Wavelets Multiresolut. Inf. Process., 6 (2008), pp. 83-95.
54. Y. Meyer, Oscillating Patterns in Image Processing and Nonlinear Evolution Equations: The Fifteenth Dean Jacqueline B. Lewis Memorial Lectures, Univ. Lecture Ser. 22, American Mathematical Society, Providence, RI, 2001.
55. M. Nikolova, Local strong homogeneity of a regularized estimator, SIAM J. Appl. Math., 61 (2000), pp. 633-658.
56. M. Nikolova, Minimizers of cost-functions involving nonsmooth data-fidelity terms. Application to the processing of outliers, SIAM J. Numer. Anal., 40 (2002), pp. 965-994.
57. S. Osher, M. Burger, D. Goldfarb, J. Xu, and W. Yin, An iterative regularization method for total variation-based image restoration, Multiscale Model. Simul., 4 (2005), pp. 460-489.
58. S. Osher, Y. Mao, B. Dong, and W. Yin, Fast linearized Bregman iteration for compressed sensing and sparse denoising, Commun. Math. Sci., to appear.
59. d): The analysis of the analysis operator, J. Funct. Anal., 148 (1997), pp. 408-447.
60. L. Rudin, S. Osher, and E. Fatemi, Nonlinear total variation based noise removal algorithms, Phys. D, 60 (1992), pp. 259-268.
61. S. Setzer, Split Bregman algorithm, Douglas-Rachford splitting and frame shrinkage, in Proceedings of SSVM'09, Lecture Notes in Comput. Sci. 5567, Springer, Berlin, 2009, pp. 464-476.
62. S. Setzer and G. Steidl, Split Bregman Method, Gradient Descent Reprojection Method and Parseval Frames, preprint, 2008.
63. J.-L. Starck, M. Elad, and D. L. Donoho, Image decomposition via the combination of sparse representations and a variational approach, IEEE Trans. Image Process., 14 (2005), pp. 1570-1582.
64. L. A. Vese and S. J. Osher, Modeling textures with total variation minimization and oscillating patterns in image processing, J. Sci. Comput., 19 (2003), pp. 553-572.
65. C. Vogel and M. Oman, Fast, robust total variation-based reconstruction of noisy, blurred images, IEEE Trans. Image Process., 7 (1998), pp. 813-824.
66. Y. Wang, J. Yang, W. Yin, and Y. Zhang, A new alternating minimization algorithm for total variation image reconstruction, SIAM J. Imaging Sci., 1 (2008), pp. 248-272.
67. J. Xu and S. J. Osher, Iterative regularization and nonlinear inverse scale space applied to wavelet-based denoising, IEEE Trans. Image Process., 16 (2007), pp. 534-544.
68. W. Yin, S. Osher, D. Goldfarb, and J. Darbon, Bregman iterative algorithms forℓ1-minimization with applications to compressed sensing, SIAM J. Imaging Sci., 1 (2008), pp. 143-168.
69. X. Zhang, M. Burger, X. Bresson, and S. Osher, Bregmanized Nonlocal Regularization for Deconvolution and Sparse Reconstruction, UCLA CAM Report (09-03), UCLA, Los Angeles, CA, 2009.