A fast multilevel algorithm for wavelet-regularized image restoration

IEEE Transactions on Image Processing

Volumn 18, Issue 3, 2009, Pages 509-523

  Vonesch, Cédric ^a   Unser, Michael ^a  

^a EPFL   (Switzerland)

Author keywords

1 regularization; 3 D; Bound optimization; Confocal; Convergence acceleration; Deconvolution; Fast; Fluorescence; Inverse problems; Majorize minimize; Microscopy; Multigrid; Multilevel; Multiresolution; Multiscale; Nonlinear; Optimization transfer; Preconditioning; Reconstruction; Restoration; Sparsity; Surrogate optimization; Variational; Wavelets; Widefield

Indexed keywords

APPROXIMATION ALGORITHMS; CONVERGENCE OF NUMERICAL METHODS; CONVOLUTION; DIFFERENTIAL EQUATIONS; FLUORESCENCE; FLUORESCENCE MICROSCOPY; IMAGE RECONSTRUCTION; INVERSE PROBLEMS; MULTIRESOLUTION ANALYSIS; OPTIMIZATION; RESTORATION; THREE DIMENSIONAL;

3-D; BOUND OPTIMIZATION; CONFOCAL; CONVERGENCE ACCELERATION; FAST; MAJORIZE-MINIMIZE; MICROSCOPY; MULTIGRID; MULTILEVEL; MULTIRESOLUTION; MULTISCALE; NONLINEAR; PRECONDITIONING; RECONSTRUCTION; SPARSITY; SURROGATE OPTIMIZATION; VARIATIONAL; WAVELETS; WIDEFIELD;

DECONVOLUTION;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; EVALUATION; FLUORESCENCE MICROSCOPY; IMAGE ENHANCEMENT; METHODOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING; THREE DIMENSIONAL IMAGING;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGING, THREE-DIMENSIONAL; MICROSCOPY, FLUORESCENCE; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING, COMPUTER-ASSISTED;

EID: 61349142394     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2008.2008073     Document Type: Article

References (59)

1. C. Vonesch, F. Aguet, J.-L. Vonesch, and M. Unser, "The colored revolution of bioimaging," IEEE Signal Process. Mag., vol. 23, no. 3, pp. 20-31, May 2006.
2. P. Sarder and A. Nehorai, "Deconvolution methods for 3-D fluorescence microscopy images," IEEE Signal Process. Mag., vol. 23, no. 3, pp. 32-45, May 2006.
3. A. K. Louis, "Medical imaging: State of the art and future development," Inv. Probl., vol. 8, no. 5, pp. 709-738, Oct. 1992.
4. Handbook of Medical Imaging: Physics and Psychophysics, J. Beutel, H. L. Kundel, and R. L. Van Metter, Eds. Bellingham, WA: SPIE, Feb. 2000, vol. 1.
5. R. Molina, J. Nunez, F. J. Cortijo, and J. Mateos, "Image restoration in astronomy: A Bayesian perspective," IEEE Signal Process. Mag., vol. 18, no. 2, pp. 11-29, Mar. 2001.
6. J. L. Starck, E. Pantin, and F. Murtagh, "Deconvolution in astronomy: A review," Pub. Astron. Soc. Pacific, vol. 114, no. 800, pp. 1051-1069, Oct. 2002.
7. M. A. T. Figueiredoa and R. D. Nowak, "AnEMalgorithm for waveletbased image restoration," IEEE Trans. Image Process., vol. 12, no. 8, pp. 906-916, Aug. 2003.
8. I. Daubechies, M. Defrise, and C. De Mol, "An iterative thresholding algorithm for linear inverse problems with a sparsity constraint," Commun. Pure Appl. Math., vol. 57, no. 11, pp. 1413-1457, Aug. 2004.
9. J. Bect, L. Blanc-Féraud, G. Aubert, and A. Chambolle, "A l 1-unified variational framework for image restoration," in Proc. ECCV, 2004, vol. 3024, pp. 1-13, Part IV.
10. 1-regularization of wavelet coefficients," Geophys. J. Int., vol. 170, no. 1, pp. 359-370, July 2007.
11. J. M. Bioucas-Dias and M. A. T. Figueiredo, "A new TwIST: Twostep iterative shrinkage/thresholding algorithms for image restoration," IEEE Trans. Image Process., vol. 16, no. 12, pp. 2992-3004, Dec. 2007.
12. C. Vonesch and M. Unser, "A fast thresholded Landweber algorithm for wavelet-regularized multidimensional deconvolution," IEEE Trans. Image Process., vol. 17, no. 4, pp. 539-549, Apr. 2008.
13. S. Mallat, "A theory for multiresolution signal decomposition: The wavelet representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 11, no. 7, pp. 674-693, Jul. 1989.
14. W. Hackbusch, Multi-Grid Methods and Applications. Berlin, Germany: Springer-Verlag, 1985, vol. 4, Springer Ser. Comput. Math.
15. W. L. Briggs, V. E. Henson, and S. F. McCormick, A Multigrid Tutorial 2nd ed. Philadelphia, PA: SIAM, 2000.
16. W. M. Lawton, "Multiresolution properties of the wavelet Galerkin operator," J. Math. Phys., vol. 32, no. 6, pp. 1440-1443, June 1991.
17. Z. Cai and W. E, "Hierarchical method for elliptic problems using wavelet," Commun. Appl. Numer. Meth., vol. 8, no. 11, pp. 819-825, Nov. 1992.
18. W. Dahmen and A. Kunoth, "Multilevel preconditioning," Numer. Math. vol. 63, no. 1, pp. 315-344, Dec. 1992.
19. W. L. Briggs and V. E. Henson, "Wavelets and multigrid," SIAM J. Sci. Comput., vol. 14, no. 2, pp. 506-510, Mar. 1993.
20. G. Wang, J. Zhang, and G.-W. Pan, "Solution of inverse problems in image processing by wavelet expansion," IEEE Trans. Image Process. vol. 4, no. 5, pp. 579-593, May 1995.
21. K. Lange, D. R. Hunter, and I. Yang, "Optimization transfer using surrogate objective functions," J. Comput. Graph. Statist., vol. 9, no. 1, pp. 1-20, Mar. 2000.
22. D. R. Hunter and K. Lange, "A tutorial on MM algorithms," Amer. Statist., vol. 58, no. 1, pp. 30-37, Feb. 2004.
23. M. W. Jacobson and J. A. Fessler, "An expanded theoretical treatment of iteration-dependent majorize-minimize algorithms," IEEE Trans. Image Process., vol. 16, no. 10, pp. 2411-2422, Oct. 2007.
24. J. A. Fessler and A. O. Hero, "Space-alternating generalized expectation- maximization algorithm," IEEE Trans. Signal Process. vol. 42, no. 10, pp. 2664-2677, Oct. 1994.
25. S. Oh, A. B. Milstein, C. A. Bouman, and K. J. Webb, "A general framework for nonlinear multigrid inversion," IEEE Trans. Image Process., vol. 14, no. 1, pp. 125-140, Jan. 2005.
26. S. Mallat, A Wavelet Tour of Signal Processing. New York: Academic, 1998.
27. H. Yserentant, "On the multi-level splitting of finite element spaces," Numer. Math., vol. 49, pp. 379-412, 1986.
28. R. E. Bank, T. F. Dupont, and H. Yserentant, "The hierarchical basis multigrid method," Numer. Math., vol. 52, no. 4, pp. 427-458, Jul. 1988.
29. P. S. Vassilevski and J. Wang, "Stabilizing the hierarchical basis by approximate wavelets I: Theory," Numer. Lin. Algebra Appl., vol. 4, no. 2, pp. 103-126, Mar./Apr. 1998.
30. M. Bertero and P. Boccacci, Introduction to Inverse Problems in Imaging. Bristol, U.K.: IOP, 1998.
31. C. Christopoulos, A. Skodras, and T. Ebrahimi, "The JPEG2000 still image coding system: An overview," IEEE Trans. Consum. Electron., vol. 46, no. 4, pp. 1103-1127, Nov. 2000.
32. C. De Mol and M. Defrise, "A note on wavelet-based inversion algorithms," in Inverse Problems, Image Analysis and Medical Imaging M. Z. Nashed and O. Scherzer, Eds. Providence, RI: American Mathematical Society, Nov. 2002, vol. 313, Contemporary Mathematics, pp. 85-96, (Special Session on Interaction of Inverse Problems and Image Analysis. AMS Joint Mathematics Meetings, New Orleans, LA, Jan. 10-13, 2001).
33. R. D. Nowak and M. A. T. Figueiredo, "Fast wavelet-based image deconvolution using the EM algorithm," presented at the 35th Asilomar Conf. Signals, Systems and Computers, Pacific Grove, CA, Nov. 2001.
34. J. L. Starck, D. L. Donoho, and E. J. Candès, "Astronomical image representation by the curvelet transform," Astron. Astrophys., vol. 398, no. 2, pp. 785-800, February 2003.
35. J.-L. Starck, M. K. Nguyen, and F. Murtagh, "Wavelets and curvelets for image deconvolution: A combined approach," Signal Process., vol. 83, no. 10, pp. 2279-2283, October 2003.
36. L. Landweber, "An iterative formula for Fredholm integral equations of the first kind," Amer. J. Math., vol. 73, no. 3, pp. 615-624, Jul. 1951.
37. J. B. Weaver, Y. S. Xu, D. M. Healy, and L. D. Cromwell, "Filtering noise from images with wavelet transforms," Magn. Res. Med., vol. 21, no. 2, pp. 288-295, Oct. 1991.
38. D. L. Donoho, "De-noising by soft-thresholding," IEEE Trans. Inf. Theory, vol. 41, no. 3, pp. 613-627, May 1995.
39. M. Liebling and M. Unser, "Autofocus for digital fresnel holograms by use of a fresnelet-sparsity criterion," J. Opt. Soc. Amer. A, vol. 21, no.\ 12, pp. 2424-2430, Dec. 2004.
40. C. Chaux, P. L. Combettes, J.-C. Pesquet, and V. R. Wajs, "A variational formulation for frame-based inverse problems," Inv. Probl., vol. 23, no. 4, pp. 1495-1518, Aug. 2007.
41. J. M. Bioucas-Dias, "Bayesian wavelet-based image deconvolution: A GEM algorithm exploiting a class of heavy-tailed priors," IEEE Trans. Image Process., vol. 15, no. 4, pp. 937-951, Apr. 2006.
42. M. A. T. Figueiredo, J. M. Bioucas-Dias, and R. D. Nowak, "Majorization-minimization algorithms for wavelet-based image restoration," IEEE Trans. Image Process., vol. 16, no. 12, pp. 2980-2991, Dec. 2007.
43. M. Elad, "Why simple shrinkage is still relevant for redundant representations?," IEEE Trans. Inf. Theory, vol. 52, no. 12, pp. 5559-5569, Dec. 2006.
44. M. Elad, B. Matalon, and M. Zibulevsky, "Coordinate and subspace optimization methods for linear least squares with non-quadratic regularization," Appl. Comput. Harmon. Anal., vol. 23, no. 3, pp. 346-367, Nov. 2007.
45. M. A. T. Figueiredo, R. D. Nowak, and S. J. Wright, "Gradient projection for sparse reconstruction: Application to compressed sensing and other inverse problems," IEEE J. Sel. Topics Signal Process., vol. 2007, no. 4, pp. 586-597, Dec. 2007.
46. J. Friedman, T. Hastie, H. Hofling, and R. Tibshirani, "Pathwise coordinate optimization," Ann. Appl. Statist., vol. 1, no. 2, pp. 302-332, Dec. 2007.
47. M. Fornasier, "Domain decomposition methods for linear inverse problems with sparsity constraints," Inv. Probl., vol. 23, no. 6, pp. 2505-2526, Dec. 2007.
48. A. Chambolle, R. A. DeVore, N.-Y. Lee, and B. J. Lucier, "Nonlinear wavelet image processing: Variational problems, compression, and noise removal through wavelet shrinkage," IEEE Trans. Image Process., vol. 7, no. 3, pp. 319-335, Mar. 1998.
49. G. H. Golub and C. F. van Loan, Matrix Computations. Baltimore,\ MD: Johns Hopkins Univ. Press, 1996.
50. T. Blu and M. Unser, "The fractional spline wavelet transform: Definition and implementation," in Proc. 25th IEEE Int. Conf. Acoust., Speech, Signal Process., Jun. 2000, vol. I, pp. 512-515.
51. J. Xu, "The method of subspace corrections," J. Comput. Appl. Math. vol. 128, no. 1-2, pp. 335-362, Mar. 2001.
52. K. Zhou and C. K. Rushforth, "Image restoration using multigrid methods," Appl. Opt., vol. 30, no. 20, pp. 2906-2912, Jul. 1991.
53. T.-S. Pan and A. E. Yagle, "Numerical study of multigrid implementations of some iterative image reconstruction algorithms," IEEE Trans. Med. Imag., vol. 10, no. 4, pp. 572-288, Dec. 1991.
54. W. Hackbusch, Iterative Solution of Large Sparse Systems of Equations New York: Springer-Verlag, 1994, vol. 95, Appl. Math. Sci.
55. P. L. Combettes and V. R. Wajs, "Signal recovery by proximal forward-backward splitting," Multiscale Model. Simul., vol. 4, no. 4, pp. 1168-1200, 2005.
56. T. Blu and F. Luisier, "The SURE-LET approach to image denoising," IEEE Trans. Image Process., vol. 16, no. 11, pp. 2778-2786, Nov. 2007.
57. D. van de Ville, T. Blu, and M. Unser, "Isotropic polyharmonic B-splines: Scaling functions and wavelets," IEEE Trans. Image Process., vol. 14, no. 11, pp. 1798-1813, Nov. 2005.
58. I. Khalidov and M. Unser, "From differential equations to the construction of new wavelet-like bases," IEEE Trans. Signal Process. vol. 54, no. 4, pp. 1256-1267, Apr. 2006.
59. C. Vonesch, T. Blu, and M. Unser, "Generalized Daubechies wavelet families," IEEE Trans. Signal Process., vol. 55, no. 9, pp. 4415-4429, Sep. 2007.