Local behavior of sparse analysis regularization: Applications to risk estimation

Applied and Computational Harmonic Analysis

Volumn 35, Issue 3, 2013, Pages 433-451

  Vaiter, Samuel ^a   Deledalle, Charles Alban ^a   Peyré, Gabriel ^a   Dossal, Charles ^b   Fadili, Jalal ^c  

^a UNIVERSITÉ PARIS DAUPHINE   (France)

^b UNIVERSITÉ BORDEAUX 1   (France)

^c UNIVERSITÉ DE CAEN   (France)

Author keywords

1 minimization; Analysis regularization; Degrees of freedom; GSURE; Inverse problems; Local behavior; Sparsity; SURE; Unbiased risk estimation

Indexed keywords

ANALYSIS REGULARIZATION; GSURE; LOCAL BEHAVIOR; RISK ESTIMATION; SPARSITY; SURE;

CONVEX OPTIMIZATION; DEGREES OF FREEDOM (MECHANICS); ESTIMATION; INVERSE PROBLEMS; MATHEMATICAL OPERATORS; PARAMETERIZATION; RISK PERCEPTION;

RISK ASSESSMENT;

EID: 84883858239     PISSN: 10635203     EISSN: 1096603X     Source Type: Journal    
DOI: 10.1016/j.acha.2012.11.006     Document Type: Article

References (56)

1. A. Kirsch An Introduction to the Mathematical Theory of Inverse Problems Appl. Math. Sci. vol. 120 2011 Springer-Verlag
2. L. Rudin, S. Osher, and E. Fatemi Nonlinear total variation based noise removal algorithms Phys. D 60 1992 259 268
3. A. Chambolle, V. Caselles, M. Novaga, D. Cremers, and T. Pock An introduction to total variation for image analysis Theoretical Foundations and Numerical Methods for Sparse Recovery Radon Series Comp. Appl. Math. vol. 9 2010 De Gruyter 978-3110226140 263 340
4. M. Nikolova Local strong homogeneity of a regularized estimator SIAM J. Appl. Math. 61 2000 633 658
5. W. Ring Structural properties of solutions to total variation regularization problems M2AN Math. Model. Numer. Anal. 34 2000 799 810
6. V. Caselles, A. Chambolle, and M. Novaga The discontinuity set of solutions of the TV denoising problem and some extensions Multiscale Model. Simul. 6 2008 879 894
7. R. Tibshirani Regression shrinkage and selection via the Lasso J. Roy. Statist. Soc. Ser. B 58 1996 267 288
8. S. Chen, D. Donoho, and M. Saunders Atomic decomposition by basis pursuit SIAM J. Sci. Comput. 20 1999 33 61
9. M. Elad, P. Milanfar, and R. Rubinstein Analysis versus synthesis in signal priors Inverse Problems 23 2007 947 968
10. E. Candès, Y. Eldar, D. Needell, and P. Randall Compressed sensing with coherent and redundant dictionaries Appl. Comput. Harmon. Anal. 31 2010 59 73
11. M. Grasmair Linear convergence rates for Tikhonov regularization with positively homogeneous functionals Inverse Problems 27 2011 075014
12. S. Nam, M. Davies, M. Elad, and R. Gribonval The cosparse analysis model and algorithms arXiv:1106.4987v1 2011
13. S. Vaiter, G. Peyré, C. Dossal, M.J. Fadili, Robust sparse analysis regularization, Trans. Inform. Theory (2012), in press.
14. Y. Lu, and M. Do A theory for sampling signals from a union of subspaces IEEE Trans. Signal Process. 56 2008 2334 2345
15. J. Bonnans, and A. Shapiro Perturbation Analysis of Optimization Problems 2000 Springer-Verlag
16. B. Mordukhovich Sensitivity analysis in nonsmooth optimization D.A. Field, V. Komkov, Theoretical Aspects of Industrial Design SIAM Vol. Appl. Math. vol. 58 1992 32 46
17. M. Osborne, B. Presnell, and B. Turlach On the LASSO and its dual J. Comput. Graph. Statist. 2000 319 337
18. M. Osborne, B. Presnell, and B. Turlach A new approach to variable selection in least squares problems IMA J. Numer. Anal. 20 2000 389
19. D. Malioutov, M. Cetin, and A. Willsky Homotopy continuation for sparse signal representation Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP'05), vol. 5 2005 IEEE 733 736
20. 1-norm minimization problems when the solution may be sparse IEEE Trans. Inform. Theory 54 2008 4789 4812
21. R. Tibshirani, and J. Taylor The solution path of the generalized lasso Ann. Statist. 39 2011 1335 1371
22. B. Efron How biased is the apparent error rate of a prediction rule? J. Amer. Statist. Assoc. 81 1986 461 470
23. Cp Technometrics 15 1973 661 675
24. H. Akaike Information theory and an extension of the maximum likelihood principle Second International Symposium On Information Theory vol. 1 1973 Springer-Verlag 267 281
25. G. Schwarz Estimating the dimension of a model Ann. Statist. 6 1978 461 464
26. G. Golub, M. Heath, and G. Wahba Generalized cross-validation as a method for choosing a good ridge parameter Technometrics 1979 215 223
27. C. Stein Estimation of the mean of a multivariate normal distribution Ann. Statist. 9 1981 1135 1151
28. K.-C. Li From Stein's unbiased risk estimates to the method of generalized cross validation Ann. Statist. 13 1985 1352 1377
29. B. Efron The estimation of prediction error: Covariance penalties and cross-validation J. Amer. Statist. Assoc. 99 2004 619 632
30. D. Donoho, and I. Johnstone Adapting to unknown smoothness via wavelet shrinkage J. Amer. Statist. Assoc. 90 1995 1200 1224
31. T. Cai, and H. Zhou A data-driven block thresholding approach to wavelet estimation Ann. Statist. 37 2009 569 595
32. T. Blu, and F. Luisier The SURE-LET approach to image denoising IEEE Trans. Image Process. 16 2007 2778 2786
33. I.M. Johnstone Wavelet shrinkage for correlated data and inverse problems: Adaptivity results Statist. Sinica 9 1999 51 83
34. D. Van de Ville, and M. Kocher SURE-based non-local means IEEE Signal Process. Lett. 16 2009 973 976
35. V. Duval, J.-F. Aujol, and Y. Gousseau A bias-variance approach for the non-local means SIAM J. Imaging Sci. 4 2011 760 788
36. C.-A. Deledalle, V. Duval, and J. Salmon Non-local methods with shape-adaptive patches (NLM-SAP) J. Math. Imaging Vision 2011 1 18
37. J. Rice Choice of smoothing parameter in deconvolution problems Contemp. Math. vol. 59 1986 137 151
38. C. Vonesch, S. Ramani, and M. Unser Recursive risk estimation for non-linear image deconvolution with a wavelet-domain sparsity constraint ICIP 2008 IEEE 665 668
39. L. Desbat, and D. Girard The 'minimum reconstruction error' choice of regularization parameters: Some more efficient methods and their application to deconvolution problems SIAM J. Sci. Comput. 16 1995 1387 1403
40. Y.C. Eldar Generalized SURE for exponential families: Applications to regularization IEEE Trans. Signal Process. 57 2009 471 481
41. H. Zou, T. Hastie, and R. Tibshirani On the "degrees of freedom" of the lasso Ann. Statist. 35 2007 2173 2192
42. M. Kachour, C. Dossal, M. Fadili, G. Peyré, C. Chesneau, The degrees of freedom of penalized l1 minimization, Statist. Sinica (2012), in press, http://dx.doi.org/10.5705/ss.2011.281.
43. R.J. Tibshirani, and J. Taylor Degrees of freedom in lasso problems Technical Report arXiv:1111.0653 2012
44. J.-C. Pesquet, A. Benazza-Benyahia, and C. Chaux A SURE approach for digital signal/image deconvolution problems IEEE Trans. Signal Process. 57 2009 4616 4632
45. V. Solo A SURE-fired way to choose smoothing parameters in ill-conditioned inverse problems IEEE Int. Conf. Image Process. (ICIP), vol. 3 1996 IEEE 89 92
46. J. Ye On measuring and correcting the effects of data mining and model selection J. Amer. Statist. Assoc. 1998 120 131
47. X. Shen, and J. Ye Adaptive model selection J. Amer. Statist. Assoc. 97 2002 210 221
48. S. Ramani, T. Blu, and M. Unser Monte-Carlo SURE: A black-box optimization of regularization parameters for general denoising algorithms IEEE Trans. Image Process. 17 2008 1540 1554
49. R. Giryes, M. Elad, and Y. Eldar The projected GSURE for automatic parameter tuning in iterative shrinkage methods Appl. Comput. Harmon. Anal. 30 2011 407 422
50. C. Deledalle, S. Vaiter, G. Peyré, M.J. Fadili, C. Dossal, Proximal splitting derivatives for risk estimation, in: 2nd International Workshop on New Computational Methods for Inverse Problems (NCMIP), Paris.
51. A. Chambolle An algorithm for total variation minimization and applications J. Math. Imaging Vision 20 2004 89 97
52. A. Chambolle, and T. Pock A first-order primal-dual algorithm for convex problems with applications to imaging J. Math. Imaging Vision 40 2011 120 145
53. H. Raguet, M.J. Fadili, G. Peyré, Generalized forward-backward splitting, Technical Report, 2011, Preprint Hal-00613637.
54. N. Pustelnik, C. Chaux, and J.-C. Pesquet Parallel ProXimal Algorithm for image restoration using hybrid regularization IEEE Trans. Image Process. 20 2011 2450 2462
55. P.L. Combettes, and J.-C. Pesquet Primal-dual splitting algorithm for solving inclusions with mixtures of composite, Lipschitzian, and parallel-sum monotone operators Set-Valued Var. Anal. 20 2012 307 330
56. F. Luisier, The SURE-LET approach to image denoising, PhD thesis, École Polytechnique Fédérale de Lausanne, 2010.