Error forgetting of Bregman iteration

Journal of Scientific Computing

Volumn 54, Issue 2-3, 2013, Pages 684-695

  Yin, Wotao ^a   Osher, Stanley ^b  

^a Rice University   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

1 minimization; Augmented Lagrangian method; Bregman iteration; Error forgetting; Method of multipliers; Piece wise linear function; Polyhedral function; Sparse optimization

Indexed keywords

AUGMENTED LAGRANGIAN METHODS; BREGMAN ITERATION; METHOD OF MULTIPLIERS; PIECE-WISE LINEAR FUNCTIONS; SPARSE OPTIMIZATIONS;

LAGRANGE MULTIPLIERS; OPTIMIZATION;

ITERATIVE METHODS;

EID: 84888094246     PISSN: 08857474     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10915-012-9616-5     Document Type: Article

References (28)

1. Osher, S., Burger, M., Goldfarb, D., Xu, J., Yin, W.: An iterative regularization method for total variationbased image restoration. Multiscale Model. Simul. 4(2), 460-489 (2005)
2. Yin, W., Osher, S., Goldfarb, D., Darbon, J.: Bregman iterative algorithms for I1-minimization with applications to compressed sensing. SIAM J. Imaging Sci. 1(1), 143-168 (2008)
3. Figueiredo, M., Nowak, R., Wright, S. J.: Gradient projection for sparse reconstruction: application to compressed sensing and other inverse problems. IEEE J. Sel. Top. Signal Process. 4(1), 586-597 (2007). Special Issue on Convex Optimization Methods for Signal Processing
4. Hale, E. T., Yin, W., Zhang, Y: Fixed-point continuation for l1-minimization: methodology and convergence. SIAM J. Optim. 19(3), 1107-1130 (2008)
5. Wright, S. J., Nowak, R. D., Figueiredo, M. A. T.: Sparse reconstruction by separable approximation. IEEE Trans. Signal Process. 57(7), 2479-2493 (2009)
6. Xu, J., Osher, S.: Iterative regularization and nonlinear inverse scale space applied to wavelet-based denoising. IEEE Trans. Image Process. 16(2), 534-544 (2006)
7. Burger, M., Gilboa, G., Osher, S., Xu, J.: Nonlinear inverse scale space methods. Commun. Math. Sci. 4(1), 175-208 (2006)
8. Burger, M., Osher, S., Xu, J., Gilboa, G.: Nonlinear inverse scale space methods for image restoration. In: Variational, Geometric, and Level Set Methods in Computer Vision. Lecture Notes in Computer Science, vol. 3752, pp. 25-36 (2005)
9. He, L., Chang, T.-C, Osher, S., Fang, T., Speier, P.: MR image reconstruction by using the iterative refinement method and nonlinear inverse scale space methods. UCLA CAM Report 06-35 (2006)
10. Ma, S., Goldfarb, D., Chen, L.: Fixed point and Bregman iterative methods for matrix rank minimization. Math. Program. pp 1-33 (2009)
11. Guo, Z., Wittman, T., Osher, S.: L1 unmixing and its application to hyperspectral image enhancement. In: Proceedings of SPIE Algorithms and Technologies for Multispectral, Hyperspectral, and Ultraspectral Imagery XV, 7334:73341M (2009)
12. Bregman, L.: The relaxation method of finding the common points of convex sets and its application to the solution of problems in convex programming. U. S. S. R. Comput. Math. Math. Phys. 7, 200-217 (1967)
13. Cai, J.-F, Osher, S., Shen, Z.: Linearized Bregman iterations for compressed sensing. Math. Comput. 78(267), 1515-1536 (2008)
14. Cai, J.-F, Osher, S., Shen, Z.: Convergence of the linearized Bregman iteration for 1-norm minimization. Math. Comput. 78(268), 2127-2136 (2009)
15. Yin, W.: Analysis and generalizations of the linearized Bregman method. SIAM J. Imaging Sci. 3(4), 856-877 (2010)
16. Friedlander, M., Tseng, P.: Exact regularization of convex programs. SIAM J. Optim. 18, 4 (2007)
17. Lai, M.-J., Yin, W.: Augmented l1 and nuclear-norm models with a globally linearly convergent algorithm. Rice University CAAM Technical Report TR 12-02 (2012)
18. Cai, J.-F, Candes, E., Shen, Z.: A singular value thresholding algorithm for matrix completion. SIAM J. Optim. 20(4), 2008 (1956-1982)
19. Hestenes, M. R.: Multiplier and gradient methods. J. Optim. Theory Appl. 4, 303-320 (1969)
20. Powell, M. J. D.: A method for nonlinear constraints in minimization problems. In: Fletcher, R. (ed.) Optimization, pp. 283-298. Academic Press, New York (1972)
21. Esser, E.: Applications of Lagrangian-based alternating direction methods and connections to split Bregman. UCLA CAM Report 09-31 (2009)
22. Bertsekas, D. P: Combined primal-dual and penalty methods for constrained minimization. SIAM J. Control 13(3), 521-544 (1975)
23. Bertsekas, D. P: Constrained Optimization and Lagrange Multiplier Methods. Scientific, Athena (1996)
24. Mosek ApS Inc.: The Mosek optimization tools, ver. 4 (2006)
25. Bertsekas, D. P: Necessary and sufficient conditions for a penalty method to be exact. Math. Program. 9(1), 87-99 (1975)
26. Rockafellar, R. T.: Monotone operators and the proximal point algorithm. SIAM J. Control Optim. 14, 877-898 (1976)
27. Eckstein, J., Silva, P. J. S.: A practical relative error criterion for augmented Lagrangians. Math. Program. pp. 1-30 (2010)
28. Burger, M., Moller, M., Benning, M., Osher, S.: An adaptive inverse scale space method for compressed sensing. UCLA CAM Report 11-08 (2011)