Hessian schatten-norm regularization for linear inverse problems

IEEE Transactions on Image Processing

Volumn 22, Issue 5, 2013, Pages 1873-1888

  Lefkimmiatis, Stamatios ^a   Ward, John Paul ^a   Unser, Michael ^a  

^a EPFL   (Switzerland)

Author keywords

Eigenvalue optimization; Hessian operator; image reconstruction; matrix projections; Schatten norms

Indexed keywords

EIGENVALUE OPTIMIZATION; HESSIAN OPERATOR; LINEAR INVERSE PROBLEMS; MATRIX PROJECTION; PRIMAL-DUAL FORMULATIONS; SCHATTEN NORMS; SECOND ORDER DERIVATIVES; SECOND-ORDER EXTENSION;

ALGORITHMS; EIGENVALUES AND EIGENFUNCTIONS; IMAGE RECONSTRUCTION; INVERSE PROBLEMS; OPTIMIZATION;

MATRIX ALGEBRA;

ALGORITHM; ARTICLE; DIAGNOSTIC IMAGING; FACE; HISTOLOGY; HUMAN; IMAGE PROCESSING; METHODOLOGY; THEORETICAL MODEL;

ALGORITHMS; DIAGNOSTIC IMAGING; FACE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MODELS, THEORETICAL;

EID: 84875143201     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2013.2237919     Document Type: Article

References (49)

1. M. Bertero and P. Boccacci, Introduction to Inverse Problems in Imaging. Boca Raton, FL: CRC Press, 1998.
2. L. Rudin, S. Osher, and E. Fatemi, "Nonlinear total variation based noiseremoval algorithms, " Phys. D, vol. 60, nos. 1-4, pp. 259-268, 1992.
3. J. Bioucas-Dias, J. Oliveira, and M. Figueiredo, "Total variation-basedimage deconvolution: A majorization-minimization approach, " in Proc. Int. Conf. Acoust. , Speech Signal Process. , vol. 2. Toulouse, France, 2006, pp. 861-864.
4. A. Beck and M. Teboulle, "Fast gradient-based algorithms for constrainedtotal variation image denoising and deblurring problems, " IEEETrans. Image Process. , vol. 18, no. 11, pp. 2419-2434, Nov. 2009.
5. T. F. Chan and J. Shen, "Mathematical models for local nontextureinpaintings, " SIAM J. Appl. Math. , vol. 62, no. 3, pp. 1019-1043, 2002.
6. A. Chambolle, "An algorithm for total variation minimization and applications, " J. Math. Imag. Vis. , vol. 20, nos. 1-2, pp. 89-97, 2004.
7. M. Lustig, D. Donoho, and J. M. Pauly, "Sparse MRI: The application ofcompressed sensing for rapid MR imaging, " Magn. Reson. Med. , vol. 58, no. 6, pp. 1182-1195, 2007. (Pubitemid 350234205)
8. T. Chan, A. Marquina, and P. Mulet, "High-order total variation-basedimage restoration, " Soc. Ind. Appl. Math. J. Sci. Comput. , vol. 22, no. 2, pp. 503-516, 2000.
9. A. Chambolle and P.-L. Lions, "Image recovery via total variationminimization and related problems, " Numer. Math. , vol. 76, no. 2, pp. 167-188, 1997.
10. M. Lysaker and X.-C. Tai, "Iterative image restoration combining totalvariation minimization and a second-order functional, " Int. J. Comput. Vis. , vol. 66, no. 1, pp. 5-18, 2006. (Pubitemid 43004669)
11. T. F. Chan, S. Esedoglu, and F. E. Park, "Image decomposition combiningstaircase reduction and texture extraction, " J. Visual Commun. Image Represent. , vol. 18, no. 6, pp. 464-486, 2007. (Pubitemid 47633232)
12. S. Setzer, G. Steidl, and T. Teuber, "Infimal convolution regularizationswith discrete 1-type functionals, " Commun. Math. Sci. , vol. 9, no. 3, pp. 797-827, 2011.
13. Y.-L. You and M. Kaveh, "Fourth-order partial differential equationsfor noise removal, " IEEE Trans. Image Process. , vol. 9, no. 10, pp. 1723-1730, Oct. 2000.
14. M. Lysaker, A. Lundervold, and X.-C. Tai, "Noise removal using fourthorderpartial differential equation with applications to medical magneticresonance images in space and time, " IEEE Trans. Image Process. , vol. 12, no. 12, pp. 1579-1590, Dec. 2003.
15. G. Steidl, "A note on the dual treatment of higher-order regularizationfunctionals, " Computing, vol. 76, nos. 1-2, pp. 135-148, 2006. (Pubitemid 41577708)
16. J. Yuan, C. Schnörr, and G. Steidl, "Total-variation based piecewiseaffine regularization, " in Proc. Sec. Int. Conf. Scale Space MethodsVariat. Methods Comput. Vis. , 2009, pp. 552-564.
17. K. Bredies, K. Kunisch, and T. Pock, "Total generalized variation, " SIAMJ. Imaging Sci. , vol. 3, no. 3, pp. 492-526, 2010.
18. R. Bhatia, Matrix Analysis. New York: Springer-Verlag, 1997.
19. S. Lefkimmiatis, A. Bourquard, and M. Unser, "Hessian-based normregularization for image restoration with biomedical applications, " IEEETrans. Image Process. , vol. 21, no. 3, pp. 983-995, Mar. 2012.
20. P. C. Hansen, J. G. Nagy, and D. P. O'Leary, Deblurring Images:Matrices, Spectra, and Filtering. Philadelphia, PA: SIAM, 2006.
21. J. E. Denis and R. B. Schnabel, Numerical Methods for UnconstrainedOptimization and Nonlinear Equations. Philadelphia, PA: SIAM, 1983.
22. I. Daubechies, M. Defrise, and C. De Mol, "An iterative thresholdingalgorithm for linear inverse problems with a sparsity constraint, " Commun. Pure Appl. Math. , vol. 57, no. 11, pp. 1413-1457, 2004. (Pubitemid 39427442)
23. M. Figueiredo, J. Bioucas-Dias, and R. Nowak, "Majorization- minimization algorithms for wavelet-based image restoration, " IEEETrans. Image Process. , vol. 16, no. 12, pp. 2980-2991, Dec. 2007. (Pubitemid 350201231)
24. A. Beck and M. Teboulle, "A fast iterative shrinkage- thresholdingalgorithm for linear inverse problems, " SIAM J. Imag. Sci. , vol. 2, no. 1, pp. 183-202, 2009.
25. D. Hunter and K. Lange, "A tutorial on MM algorithms, " Amer. Stat. , vol. 58, no. 1, pp. 30-37, 2004. (Pubitemid 38260327)
26. M. Zibulevsky and M. Elad, "L1-L2 optimization in signal and imageprocessing, " IEEE Signal Process. Mag. , vol. 27, no. 3, pp. 76-88, May2010.
27. P. L. Combettes and V. R. Wajs, "Signal recovery by proximalforward-backward splitting, " Multiscale Model. Simul. , vol. 4, no. 4, pp. 1168-1200, 2005.
28. A. Lewis and J. Malick, "Alternating projections on manifolds, " Math. Oper. Res. , vol. 33, no. 1, pp. 216-234, 2008.
29. F. Bach, R. Jenatton, J. Mairal, and G. Obozinski, "Optimization withsparsity-inducing penalties, " Found. Trends Mach. Learn. , vol. 4, no. 1, pp. 1-106, 2011.
30. S. Suvrit, "Fast projections onto1, q-norm balls for grouped featureselection, " in Proc. Eur. Conf. Mach. Learn. Knowl. Discovery Databases, vol. 3. 2011, pp. 305-317.
31. R. T. Rokcafellar, Convex Analysis. Princeton, NJ: Princeton Univ. Press, 1970.
32. Y. Nesterov, "A method for solving a convex programming problemwith convergence rates O(1/k2), " Soviet Math. Dokl, vol. 27, no. 2, pp. 372-376, 1983.
33. J. Liu and J. Ye, "Efficient1/q norm regularization, " 2010, Arxivpreprint arXiv: 1009. 4766
34. J.-F. Cai, E. J. Candes, and Z. Shen, "A singular value thresholdingalgorithm for matrix completion, " SIAM J. Optim. , vol. 20, no. 4, pp. 1956-1982, 2008.
35. S. Ma, D. Godfarb, and L. Chen, "Fixed point and Bregman iterativemethods for matrix rank minimization, " Math. Program. , vol. 128, no. 1, pp. 321-353, 2011.
36. G. A. Watson, "Characterization of the subdifferential of some matrixnorms, " Linear Algebra Appl. , vol. 170, pp. 33-45, Jun. 1992.
37. D. L. Donoho, "Denoising by soft-thresholding, " IEEE Trans. Inf. Theory, vol. 41, no. 3, pp. 613-627, May 1995.
38. E. Candes and J. Romberg, "Practical signal recovery from randomprojections, " Proc. SPIE, vol. 5674, pp. 76-86, Jan. 2005.
39. I. Daubechies, M. Fornasier, and I. Loris, "Accelerated projected gradientmethod for linear inverse problems with sparsity constraints, " J. FourierAnal. Appl. , vol. 14, nos. 5-6, pp. 764-792, 2008.
40. E. Van De Berg, M. Friedlander, and K. Murphy, "Group sparsity vialinear-time projection, " Dept. Comput. Sci. , Univ. British Columbia, Vancouver, BC, Canada, Tech. Rep. TR-2008-09, 2008.
41. J. Duchi, S. Shalev-Shwartz, Y. Singer, and T. Chandra, "Efficientprojections onto the1-ball for learning in high dimensions, " in Proc. 25th Int. Conf. Mach. Learn. , 2008, pp. 272-279.
42. K. Dabov, A. Foi, V. Katkovnik, and K. Egiazarian, "Image restorationby sparse 3D transform-domain collaborative filtering, " Proc. SPIE, vol. 6812, p. 681207, Mar. 2008.
43. I. Selesnick and M. Figueiredo, "Signal restoration with overcompletewavelet transforms: Comparison of analysis and synthesis priors, " Proc. SPIE, vol. 7446, p. 74460D, Aug. 2009.
44. C. Vonesch, F. Aguet, J.-L. Vonesch, and M. Unser, "The coloredrevolution of bioimaging, " IEEE Sig. Process. Mag. , vol. 23, no. 3, pp. 20-31, May 2006.
45. C. Vonesch and M. Unser, "A fast thresholded Landweber algorithmfor wavelet-regularized multidimensional deconvolution, " IEEE Trans. Image Process. , vol. 17, no. 4, pp. 539-549, Apr. 2008. (Pubitemid 351493877)
46. J. R. Shewchuk. (1994). An Introduction to the Conjugate GradientMethod without the Agonizing Pain [Online]. Available:http://www.cs. cmu. edu/~jrs/jrspapers. html
47. L. Mirsky, "A trace inequality of John von Neumann, " Monatshefte FurMathematik, vol. 79, no. 4, pp. 303-306, 1975.
48. H. H. Bauschke and P. L. Combettes, "Convexity and nonexpansiveness, "in Convex Analysis and Monotone Operator Theory in Hilbert Spaces, J. M. Borwein and P. Borwein, Eds. New York: Springer-Verlag, 2011, pp. 59-74.
49. V. Hutson, J. S. Pym, and M. J. Cloud, Applications of FunctionalAnalysis and Operator Theory, 2nd ed. New York: Elsevier, 2005.