Robust sparse analysis regularization

IEEE Transactions on Information Theory

Volumn 59, Issue 4, 2013, Pages 2001-2016

  Vaiter, Samuel ^a   Peyré, Gabriel ^a   Dossal, Charles ^b   Fadili, Jalal ^c  

^a UNIVERSITÉ PARIS DAUPHINE   (France)

^b UNIVERSITÉ BORDEAUX 1   (France)

^c UNIVERSITÉ DE CAEN   (France)

Author keywords

Analysis regularization; Fused Lasso; Inverse problems; Noise robustness; Sparsity; Synthesis regularization; Total variation (TV); Union of subspaces; Wavelets

Indexed keywords

DIFFERENTIAL EQUATIONS; INVERSE PROBLEMS;

ANALYSIS REGULARIZATION; FUSED LASSOS; NOISE ROBUSTNESS; SPARSITY; TOTAL VARIATION; UNION OF SUBSPACES; WAVELETS;

RECOVERY;

EID: 84896689725     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2012.2233859     Document Type: Article

References (49)

1. A. Kirsch, An Introduction to the Mathematical Theory of Inverse Problems. New York: Springer-Verlag, 2011, vol. 120.
2. S. Mallat, AWavelet Tour of Signal Processing, 3rd ed. Amsterdam, The Netherlands: Elsevier, 2009.
3. B. Natarajan, "Sparse approximate solutions to linear systems," SIAM J. Comput., vol. 24, no. 2, pp. 227-234, 1995.
4. D. Needell, J. Tropp, and R. Vershynin, "Greedy signal recovery review," in Proc. 42nd Asilomar Conf. IEEE Signals, Syst. Comput., 2008, pp. 1048-1050.
5. S.Mallat and Z. Zhang, "Matching pursuitswith time-frequency dictionaries," IEEE Trans. Signal Process., vol. 41, no. 12, pp. 3397-3415, Dec. 1993.
6. Y. Pati, R. Rezaiifar, and P. Krishnaprasad, "Orthogonal matching pursuit: Recursive function approximation with applications to wavelet decomposition," in Proc. 27th Asilomar Conf. IEEE Signals, Syst. Comput. Conf. Rec., 1993, pp. 40-44.
7. G. Davis, S. Mallat, and Z. Zhang, Adaptive time-frequency approximations with matching pursuits Courant Inst. Math. Sci., New York, Tech. Rep., 1994.
8. D. Donoho, "For most large underdetermined systems of linear equations the minimal-norm solution is also the sparsest solution," Commun. Pure Appl. Math., vol. 59, no. 6, pp. 797-829, 2006. (Pubitemid 43667226)
9. R. Tibshirani, "Regression shrinkage and selection via the Lasso," J. Royal Statist. Soc. Series B. Methodol., vol. 58, no. 1, pp. 267-288, 1996.
10. S. Chen, D. Donoho, and M. Saunders, "Atomic decomposition by basis pursuit," SIAM J. Sci. Comput., vol. 20, no. 1, pp. 33-61, 1999. (Pubitemid 128689501)
11. F. Santosa and W. Symes, "Linear inversion of band-limited reflection seismograms," SIAM J. Sci. Statist. Comput., vol. 7, no. 4, pp. 1307-1330, 1986.
12. L. Rudin, S. Osher, and E. Fatemi, "Nonlinear total variation based noise removal algorithms," Physica D: Nonlinear Phenomena, vol. 60, no. 1-4, pp. 259-268, 1992.
13. A. Chambolle, V. Caselles, D. Cremers, M. Novaga, and T. Pock, "An introduction to total variation for image analysis," in Theoretical Foundations and Numerical Methods for Sparse Recovery. Berlin, Germany: De Gruyter, 2010.
14. M. Nikolova, "Local strong homogeneity of a regularized estimator," SIAM J. Appl. Math., vol. 61, no. 2, pp. 633-658, 2000.
15. W. Ring, "Structural properties of solutions to total variation regularization problems," ESAIM Math. Modell. Numer. Anal., vol. 34, no. 4, pp. 799-810, 2000.
16. V. Caselles, A. Chambolle, and M. Novaga, "The discontinuity set of solutions of the TV denoising problem and some extensions," Multiscale Model. Simulat., vol. 6, no. 3, pp. 879-894, 2007.
17. G. Steidl, J.Weickert, T. Brox, P.Mràzek, andM.Welk, "On the equivalence of soft wavelet shrinkage, total variation diffusion, total variation regularization, and sides," SIAM J. Numer. Anal., vol. 42, no. 2, pp. 686-713, 2005. (Pubitemid 40645211)
18. I. Selesnick and M. Figueiredo, "Signal restoration with overcomplete wavelet transforms: Comparison of analysis and synthesis priors," Proc. SPIE, vol. 7446, p. 74460D, 2009.
19. R. Tibshirani,M. Saunders, S. Rosset, J. Zhu, and K. Knight, "Sparsity and smoothness via the fused Lasso," J. Roy. Statist. Soc.: Series B (Statist. Methodol.), vol. 67, no. 1, pp. 91-108, 2005. (Pubitemid 40167043)
20. M. Elad, P. Milanfar, and R. Rubinstein, "Analysis versus synthesis in signal priors," Inverse Probl., vol. 23, no. 3, pp. 947-968, 2007. (Pubitemid 46838835)
21. S. Nam, M. Davies, M. Elad, and R. Gribonval, The cosparse analysis model and algorithms 2011 [Online]. Available: arxiv-1106.4987v1
22. Y. Lu and M. Do, "A theory for sampling signals from a union of subspaces," IEEE Trans. Signal Process., vol. 56, no. 6, pp. 2334-2345, Jun. 2008. (Pubitemid 351795887)
23. Y. Eldar and M. Mishali, "Robust recovery of signals from a structured union of subspaces," IEEE Trans. Inf. Theory, vol. 55, no. 11, pp. 5302-5316, Nov. 2009.
24. R. Baraniuk, V. Cevher, M. Duarte, and C. Hegde, "Model-based compressive sensing," IEEE Trans. Inf. Theory, vol. 56, no. 4, pp. 1982-2001, Apr. 2010.
25. T. Blumensath andM.Davies, "Sampling theorems for signals from the union of finite-dimensional linear subspaces," IEEE Trans. Inf. Theory, vol. 55, no. 4, pp. 1872-1882, Apr. 2009.
26. P. Boufounos, G. Kutyniok, and H. Rauhut, "Sparse recovery from combined fusion frame measurements," IEEE Trans. Inf. Theory, vol. 57, no. 6, pp. 3864-3876, Jun. 2011.
27. C. Dossal,Anecessary and sufficient condition for exact recovery by minimization 2007 [Online]. Available: http://hal.archives-ouvertes.fr/ hal-00164738
28. J. Fuchs, "On sparse representations in arbitrary redundant bases," IEEE Trans. Inf. Theory, vol. 50, no. 6, pp. 1341-1344, Jun. 2004.
29. J. Tropp, "Just relax: Convex programming methods for identifying sparse signals in noise," IEEE Trans. Inf. Theory, vol. 52, no. 3, pp. 1030-1051, Mar. 2006. (Pubitemid 46444890)
30. J. Tropp, "Greed is good: Algorithmic results for sparse approximation," IEEE Trans. Inf. Theory, vol. 50, no. 10, pp. 2231-2242, Oct. 2004.
31. E. Candès, J. Romberg, and T. Tao, "Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information," IEEE Trans. Inf. Theory, vol. 52, no. 2, pp. 489-509, Feb. 2006. (Pubitemid 43174093)
32. E. Candès, Y. Eldar, D. Needell, and P. Randall, "Compressed sensing with coherent and redundant dictionaries," Appl. Comput. Harmon. Anal., vol. 31, no. 1, pp. 59-73, 2010.
33. R. Giryes, S. Nam, R. Gribonval, andM. E. Davies, "Iterative cosparse projection algorithms for the recovery of cosparse vectors," presented at the 19th Eur. Signal Process. Conf., Barcelona, Spain, 2011.
34. T. Peleg and M. Elad, "Performance guarantees of the thresholding algorithm for the co-sparse analysis model," CoRR, vol. abs/1203.2769, 2012.
35. M. Grasmair, "Linear convergence rates for Tikhonov regularization with positively homogeneous functionals," Inverse Probl., vol. 27, no. 7, p. 075014, 2011.
36. M. Burger and S. Osher, "Convergence rates of convex variational regularization," Inverse Probl., vol. 20, no. 5, p. 1411, 2004.
37. D. Needell and R.Ward, "Stable image reconstruction using total variation minimization," CoRR, vol. abs/1202.6429, 2012.
38. A. Bruckstein, D. Donoho, and M. Elad, "From sparse solutions of systems of equations to sparse modeling of signals and images," SIAM Rev., vol. 51, no. 1, pp. 34-81, 2009.
39. D. Donoho, "Compressed sensing," IEEE Trans. Inf. Theory, vol. 52, no. 4, pp. 1289-1306, Apr. 2006.
40. D. A. Lorenz, "Convergence rates and source conditions for Tikhonov regularization with sparsity constraints," J. Inverse Ill-Posed Probl., vol. 16, no. 5, pp. 463-478, 2008.
41. M. Grasmair, M. Haltmeier, and O. Scherzer, "Sparse regularization with penalty term," Inverse Probl., vol. 24, no. 5, p. 055020, 2008.
42. M. Grasmair, "The residual method for regularizing ill-posed problems," Appl. Math. Comput., vol. 218, no. 6, pp. 2693-2710, 2011.
43. M. Grasmair, O. Scherzer, and M. Haltmeier, "Necessary and sufficient conditions for linear convergence of-regularization," Commun. Pure Appl. Math., vol. 64, no. 2, pp. 161-182, 2011.
44. O. Scherzer,M. Grasmair, H. Grossauer, M. Haltmeier, and F. Lenzen, Variational Methods in Imaging, ser. Applied Mathematical Sciences Series. New York: Springer-Verlag, 2009, vol. 167.
45. D. L. Donoho and X. Huo, "Uncertainty principles and ideal atomic decomposition," IEEE Trans. Inf. Theory, vol. 47, no. 7, pp. 2845-2862, Nov. 2001. (Pubitemid 33053488)
46. A. Chambolle, "An algorithm for total variation minimization and applications," J. Math. Imag. Vis., vol. 20, no. 1, pp. 89-97, 2004.
47. A. Chambolle and T. Pock, "First-order primal-dual algorithm for convex problems with applications to imaging," J. Math. Imag. Vis., vol. 40, no. 1, pp. 120-145, 2011.
48. P. Combettes and J.-C. Pesquet, "A Douglas-Rachford splitting approach to nonsmooth convex variational signal recovery," IEEE J. Sel. Top. Signal Process., vol. 1, no. 4, pp. 564-574, Dec. 2007. (Pubitemid 351266623)
49. M. J. Fadili and G. Peyré, "Total variation projection with first order schemes," IEEE Trans. Image Process., vol. 20, no. 3, pp. 657-669, Mar. 2011.