Split Bregman method for large scale fused Lasso

Computational Statistics and Data Analysis

Volumn 55, Issue 4, 2011, Pages 1552-1569

  Ye, Gui Bo ^a   Xie, Xiaohui ^a  

^a 5226 Donald Bren Hall   (United States)

Author keywords

1 norm; Bregman iteration; Fused Lasso; Fused Lasso support vector classifier

Indexed keywords

ARTIFICIAL DATA; AUGMENTED LAGRANGIAN METHODS; BREGMAN ITERATION; COMPARATIVE GENOMIC HYBRIDIZATIONS; CONVERGENCE PROPERTIES; FUSED LASSO; FUSED LASSO SUPPORT VECTOR CLASSIFIER; GENOMIC DATA; IDENTITY MATRICES; ITERATIVE ALGORITHM; MATRIX; MEDIUM SIZE; NON-SEPARABILITY; NON-SMOOTHNESS; NUMBER OF SAMPLES; REAL-WORLD APPLICATION; REGULARIZER; SUPPORT VECTOR CLASSIFIERS;

ALGORITHMS; CLASSIFIERS; GENES; ITERATIVE METHODS; LAGRANGE MULTIPLIERS; MASS SPECTROMETRY;

CONVERGENCE OF NUMERICAL METHODS;

EID: 78650851477     PISSN: 01679473     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.csda.2010.10.021     Document Type: Article

References (37)

1. A. Ahmed, and E.P. Xing Recovering time-varying networks of dependencies in social and biological studies Proceedings of the National Academy of Sciences 106 29 2009 11878
2. M. Bredel, C. Bredel, D. Juric, G.R. Harsh, H. Vogel, L.D. Recht, and B.I. Sikic High-resolution genome-wide mapping of genetic alterations in human glial brain tumors Cancer Research 65 10 2005 4088
3. L.M. Brgman A relaxation method of finding a common point of convex sets and its application to the solution of problems in convex programming Zhurnal Vychislitel'noi Matematiki i Matematicheskoi Fiziki 0044-4669 7 1967 620 631
4. J.-F. Cai, E.J. Cands, and Z. Shen A singular value thresholding algorithm for matrix completion SIAM Journal on Optimization 1052-6234 20 4 2010 1956 1982
5. J.-F. Cai, S. Osher, and Z. Shen Split Bregman methods and frame based image restoration Multiscale Modeling and Simulation 8 2 2009 337 369
6. J.-F. Cai, S. Osher, and Z. Shen Linearized Bregman iterations for compressed sensing Mathematics of Computation 78 267 2009 1515 1536
7. Candes, E.J., Li, X., Ma, Y., Wright, J., 2009. Robust principal component analysis? Preprint. arXiv:0912.3599.
8. M. Ceccarelli, A. d'Acierno, and A. Facchiano A scale space approach for unsupervised feature selection in mass spectra classification for ovarian cancer detection BMC Bioinformatics 10 Suppl. 12 2009 S9
9. A.E. etin Reconstruction of signals from Fourier transform samples Signal Processing 0165-1684 16 2 1989 129 148
10. J. Eckstein, and D.P. Bertsekas On the Douglas Rachford splitting method and the proximal point algorithm for maximal monotone operators Mathematical Programming 55 1 1992 293 318
11. Esser, E., 2009. Applications of Lagrangian-based alternating direction methods and connections to split Bregman. CAM Report. 9. p. 31. URL: ftp://ftp.math.ucla.edu/pub/camreport/cam09-31.pdf.
12. J. Friedman, T. Hastie, H. Hfling, and R. Tibshirani Pathwise coordinate optimization The Annals of Applied Statistics 1 2 2007 302 332
13. D. Gabay, and B. Mercier A dual algorithm for the solution of nonlinear variational problems via finite element approximation Computers and Mathematics with Applications 2 1 1976 17 40
14. H. Gao, and H. Zhao Multilevel bioluminescence tomography based on radiative transfer equation part 1: l1 regularization Optics Express 18 3 2010 1854 1871
15. Glowinski, R., Marroco, A., 1978. Sur l'approximation, par lments finis d'ordre un, et la rsolution, par penalisation-dualit, d'une classe de problmes de dirichlet non linaires. Revue Francaise d'Automatique Informatique Recherche Operationnelle.
16. T. Goldstein, and S. Osher The split Bregman method for L 1 -regularized problems SIAM Journal on Imaging Sciences 1936-4954 2 2 2009 323 343
17. Grant, M., Boyd, S., Ye, Y., 2008. CVX: Matlab software for disciplined convex programming. Available at: http://www.stanford.edu/boyd/cvx.
18. M.R. Hestenes Multiplier and gradient methods Journal Optimization Theory & Applications 0022-3239 4 1969 303 320
19. J.B. Hiriart-Urruty, and C. Lemarchal Convex Analysis and Minimization Algorithms 1993 Springer-Verlag Berlin
20. Hoefling, H., 2009. A path algorithm for the fused lasso signal approximator. Preprint. arXiv:0910.0526.
21. S. Kim, K.A. Sohn, and E.P. Xing A multivariate regression approach to association analysis of a quantitative trait network Bioinformatics 25 12 2009 i204
22. S. Osher, M. Burger, D. Goldfarb, J. Xu, and W. Yin An iterative regularization method for total variation-based image restoration Multiscale Modeling and Simulation 1540-3459 4 2 2005 460 489 (electronic)
23. S. Osher, Y. Mao, B. Dong, and W. Yin Fast linearized Bregman iteration for compressive sensing and sparse denoising Communications in Mathematical Sciences 8 2 2010 93 111
24. Philip, E., Murray, W., Michael, A.S., 2006. User's guide for sqopt version 7: software for large-scale linear and quadratic programming.
25. R.T. Rockafellar A dual approach to solving nonlinear programming problems by unconstrained optimization Mathematical Programming 0025-5610 5 1973 354 373
26. R. Tyrrell Rockafellar Convex Analysis Princeton Landmarks in Mathematics 1997 Princeton University Press Princeton, NJ 0-691-01586-4 Reprint of the 1970 original, Princeton Paperbacks
27. S. Rosset, and J. Zhu Piecewise linear regularized solution paths Annals of Statistics 35 3 2007 1012
28. Y. Saad Iterative Methods for Sparse Linear Systems 2003 Society for Industrial Mathematics
29. S. Setzer Split Bregman algorithm, DouglasRachford splitting and frame shrinkage Scale Space and Variational Methods in Computer Vision 2009 464 476
30. R. Tibshirani, M. Saunders, S. Rosset, J. Zhu, and K. Knight Sparsity and smoothness via the fused lasso Journal of the Royal Statistical Society: Series B (Statistical Methodology) 1369-7412 67 1 2005 91 108
31. R. Tibshirani, and P. Wang Spatial smoothing and hot spot detection for CGH data using the fused lasso Biostatistics 9 2008 18 29
32. P. Tseng Convergence of a block coordinate descent method for nondifferentiable minimization Journal of Optimization Theory and Applications 109 3 2001 475 494
33. V.N. Vapnik Statistical Learning Theory Adaptive and Learning Systems for Signal Processing, Communications, and Control 1998 John Wiley & Sons Inc. New York A Wiley-Interscience Publication
34. C. Wu, and X.C. Tai Augmented Lagrangian method, dual methods, and split Bregman iteration for ROF, vectorial TV, and high order models SIAM Journal on Imaging Sciences 3 2010 300
35. W. Yin, S. Osher, D. Goldfarb, and J. Darbon Bregman iterative algorithms for l 1 -minimization with applications to compressed sensing SIAM Journal on Imaging Sciences 1936-4954 1 1 2008 143 168
36. X. Zhang, M. Burger, X. Bresson, and S. Osher Bregmanized nonlocal regularization for deconvolution and sparse reconstruction SIAM Journal on Imaging Sciences 3 2010 253 276
37. X. Zhang, M. Burger, and S. Osher A unified primal-dual algorithm framework based on Bregman iteration Journal of Scientific Computing 2010 10.1007/s10915-010-9408-8