A review of adaptive image representations

IEEE Journal on Selected Topics in Signal Processing

Volumn 5, Issue 5, 2011, Pages 896-911

  Peyré, Gabriel ^a  

^a UNIVERSITÉ PARIS DAUPHINE   (France)

Author keywords

Adaptivity; approximation; best basis; denoising; dictionary learning; inverse problems; non local regularization; sparse regularization; texture synthesis; triangulations

Indexed keywords

COMPUTER GRAPHICS; DIFFERENTIAL EQUATIONS; GEOMETRY; IMAGE ENHANCEMENT; IMAGE RECONSTRUCTION; INVERSE PROBLEMS; TRIANGULATION;

ADAPTIVITY; APPROXIMATION; BEST BASIS; DE-NOISING; DICTIONARY LEARNING; NON-LOCAL REGULARIZATION; SPARSE REGULARIZATIONS; TEXTURE SYNTHESIS;

IMAGE TEXTURE;

EID: 80051709376     PISSN: 19324553     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSTSP.2011.2120592     Document Type: Review

References (102)

1. P. Agarwal and S. Suri, "Surface approximation and geometric partitions," SIAM J. Comput., vol. 27, no. 4, pp. 1016-1035, 1998. (Pubitemid 128689442)
2. M. Aharon, M. Elad, and A. M. Bruckstein, "The K-SVD: An algorithm for designing of overcomplete dictionaries for sparse representation," IEEE Trans. Signal Process., vol. 54, no. 11, pp. 4311-4322, Nov. 2006. (Pubitemid 44637761)
3. J.-F. Aujol and A. Chambolle, "Dual norms and image decomposition models," Int. J. Comput. Vis., vol. 63, no. 1, pp. 85-104, Jun 2005. (Pubitemid 40356832)
4. I. Babuška and A. K. Aziz, "On the angle condition in the finite element method," SIAM J. Numer. Anal., vol. 13, no. 2, pp. 214-226, Apr. 1976.
5. M. Bertalmio, G. Sapiro, V. Caselles, and C. Ballester, "Image inpainting," in Proc. Siggraph'00, 2000, pp. 417-424. (Pubitemid 32394006)
6. S. Bougleux, G. Peyré, and L. Cohen, "Image compression with geodesic anisotropic triangulations," in Proc. ICCV'09, 2009, pp. 2343-2348.
7. L. Breiman, J. H. Friedman, R. A. Olshen, and C. J. Stone, Classification and Regression Trees. Belmont, CA: Wadsworth, 1984.
8. A. Buades, B. Coll, and J. M. Morel, "A review of image denoising algorithms, with a new one," SIAM Multiscale Modeling Simul., vol. 4, no. 2, pp. 490-530, 2005. (Pubitemid 43890582)
9. A. Buades, B. Coll, J.-M. Morel, and C. Sbert, "Self similarity driven demosaicking," IEEE Trans. Image Process., vol. 18, no. 6, pp. 1192-1202, Jun. 2009.
10. E. Candès and D. Donoho, "New tight frames of curvelets and optimal representations of objects with piecewise singularities," Commun. Pure Appl. Math., vol. 57, no. 2, pp. 219-266, 2004.
11. E. Candès, J. Romberg, and T. Tao, "Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information," IEEE Trans. Inf. Theory, vol. 52, no. 2, pp. 489-509, Feb. 2006. (Pubitemid 43174093)
12. E. J. Candès, L. Demanet, D. L. Donoho, and L. Ying, "Fast discrete curvelet transforms," SIAM Multiscale Modeling Simul., vol. 3, no. 5, pp. 861-899, 2003. (Pubitemid 47381814)
13. E. J. Candès and D. L. Donoho, "Recovering edges in ill-posed inverse problems: Optimality of curvelet frames," Ann. Statist., vol. 30, no. 3, pp. 784-842, 2000. (Pubitemid 37095352)
14. V. Chappelier and C. Guillemot, "Oriented wavelet transform for image compression and denoising," IEEE Trans. Image Process., vol. 15, no. 10, pp. 2892-2903, Oct. 2006. (Pubitemid 44473634)
15. S. S. Chen,D. L.Donoho, andM.A. Saunders, "Atomic decomposition by basis pursuit," SIAM J. Sci. Comput., vol. 20, no. 1, pp. 33-61, 1999. (Pubitemid 128689501)
16. L. P. Chew, "Guaranteed-qualitymesh generation for curved surfaces," in SCG '93: Proc. 9th Annu. Symp. Comput. Geom., New York, 1993, pp. 274-280, ACM.
17. R.L.Claypoole, G.M. Davis,W. Sweldens, andR.G. Baraniuk, "Nonlinear wavelet transforms for image coding via lifting," IEEE Trans. Image Process., vol. 12, no. 12, pp. 1449-1459, Dec. 2003.
18. A. Cohen and N. Dyn, "Nonstationary subdivision schemes and multiresolution analysis," SIAM J. Math. Anal., vol. 27, no. 6, pp. 1745-1769, 1996.
19. A. Cohen, N. Dyn, F. Hecht, and J.-M. Mirebeau, "Adaptive multiresolution analysis based on anisotropic triangulations," Math. Comput., 2011, preprint: arXiv:1101.1512, to be published.
20. R. Coifman and V. Wickerhauser, "Entropy-based algorithms for best basis selection," IEEE Trans. Inf. Theory, vol. IT-38, no. 2, pp. 713-718, Mar. 1992.
21. R. R. Coifman, S. Lafon, A. B. Lee, M. Maggioni, B.Nadler, F.Warner, and S. W. Zucker, "Geometric diffusions as a tool for harmonic analysis and structure definition of data: Diffusion maps," Proc. Nat. Acad. Sci., vol. 102, pp. 7426-7431, May 2005. (Pubitemid 40740988)
22. R. R. Coifman, G. Matviyenko, and Y. Meyer, "Modulated Malvar-Wilson bases," J. Appl. Comput. Harmon. Anal., vol. 4, no. 1, pp. 58-61, 1997. (Pubitemid 127403098)
23. R. R. Coifman and D. L. Donoho, "Translation-invariant de-noising," in Wavelets and Statistics, Lecture Notes in Statistics. NewYork: Springer-Verlag, 1995, pp. 125-150.
24. P. L. Combettes and V. R.Wajs, "Signal recovery by proximal forwardbackward splitting," SIAM Multiscale Model. Simul., vol. 4, no. 4, pp. 1168-1200, 2005. (Pubitemid 44932287)
25. I. Daubechies, M. Defrise, and C. De Mol, "An iterative thresholding algorithm for linear inverse problems with a sparsity constraint," Commun. Pure Appl. Math., vol. 57, pp. 1413-1541, 2004.
26. I. Daubechies and W. Sweldens, "Factoring wavelet transforms into lifting steps," J. Fourier Anal. Appl., vol. 4, no. 3, pp. 245-267, 1998.
27. G. Davis, S. Mallat, and M. Avellaneda, "Greedy adaptive approximation," J. Construct. Approx., vol. 13, no. 1, pp. 57-98, 1997.
28. X. Delaunay,M. Chabert, V. Charvillat, and G.Morin, "Satellite image compression by post-transforms in the wavelet domain," Elsevier Signal Process., vol. 90, no. 2, pp. 599-610, 2010.
29. L. Demanet and L. Ying, "Wave atoms and sparsity of oscillatory patterns," J. Appl. Comput. Harmon. Anal., vol. 3, no. 23, pp. 368-387, 2007. (Pubitemid 47552875)
30. L. Demaret, N. Dyn, and A. Iske, "Image compression by linear splines over adaptive triangulations," Signal Process. J., vol. 86, no. 7, pp. 1604-1616, 2006.
31. L. Demaret, F. Friedrich, H. Führ, and T. Szygowski, "Multiscale wedgelet denoising algorithms," in Proc. SPIE, Wavelets XI, 2006, vol. 5914, p. X1-12.
32. R. Distasi, M. Nappi, and S. Vitulano, "Image compression by B-tree triangular coding," IEEE Trans. Commun., vol. 45, no. 9, pp. 1095-1100, Sep. 1997. (Pubitemid 127767208)
33. D. Donoho, "Wedgelets: Nearly minimax estimation of edges," Ann. Statist., vol. 27, no. 3, pp. 859-897, 1999.
34. D. Donoho, "Compressed sensing," IEEE Trans. Inf. Theory, vol. 52, no. 4, pp. 1289-1306, 2006.
35. D. L. Donoho, "Cart and best-ortho-basis: A connection," Ann. Statist., vol. 25, no. 5, pp. 1870-1911, 1997.
36. D. L. Donoho and I. Johnstone, "Minimax estimation by wavelet shrinkage," Ann. Statist., vol. 26, pp. 879-921, 1998.
37. N. Dyn, D. Levin, and S. Rippa, "Data dependent triangulations for piecewise linear interpolation," IMA J. Numer. Anal., vol. 10, no. 1, pp. 137-154, Jan. 1990.
38. A. A. Efros and T. K. Leung, "Texture synthesis by non-parametric sampling," in Proc. ICCV '99: Proc. Int. Conf. Comput. Vis.-Vol. 2, 1999, p. 1033, IEEE Comput. Soc.
39. A. A. Efros and W. T. Freeman, "Image quilting for texture synthesis and transfer," in Proc. Siggraph'01, Aug. 2001, pp. 341-346. (Pubitemid 33047318)
40. M. Elad and M. Aharon, "Image denoising via sparse and redundant representations over learned dictionaries," IEEE Trans. Image Process., vol. 15, no. 12, pp. 3736-3745, Dec. 2006. (Pubitemid 44811686)
41. M. Elad, M. A. T. Figueiredo, and Y. Ma, "On the role of sparse and redundant representations in image processing," Proc. IEEE, vol. 98, no. 6, pp. 972-982, 2010.
42. A. Elmoataz, O. Lezoray, and S. Bougleux, "Nonlocal discrete regularization on weighted graphs: A framework for image and manifold processing," IEEE Trans. Image Process., vol. 17, no. 7, pp. 1047-1060, Jul. 2008.
43. K. Engan, S. O. Aase, and J. H. Husoy, "Method of optimal directions for frame design," in Proc. ICASSP'99, Washington, DC, 1999, pp. 2443-2446, IEEE Comput. Soc.
44. G. Facciolo, P. Arias, V. Caselles, and G. Sapiro, "Exemplar-based interpolation of sparsely sampled images," IMA Preprint Series # 2264, 2009.
45. J. C. Feauveau, "Analyze multirésolution avec un facteur de résolution ," J. Traitement du Signal, vol. 7, no. 2, pp. 117-128, 1990.
46. R. M. Figueras i Ventura, P. Vandergheynst, and P. Frossard, "Lowrate and flexible image coding with redundant representations," IEEE Trans. Image Process., vol. 15, no. 3, pp. 726-739, Mar. 2006.
47. F. Friedrich, L. Demaret, H. Fuhr, and K. Wicker, "Efficient moment computation over polygonal domains with an application to rapid wedgelet approximation," SIAM J. Sci. Comput., vol. 29, no. 2, pp. 842-863, 2007. (Pubitemid 351456417)
48. H. Fuhr, L. Demaret, and F. Friedrich, "Beyond wavelets: New image representation paradigms," Survey article, in Document and Image Compression, 2006
49. P. L. George, H. Borouchaki, P. J. Frey, P. Laug, and E. Saltel, "Mesh generation and mesh adaptivity: Theory, techniques," in Encyclopedia of ComputationalMechanics, E. Stein, R. deBorst, andT. J.R.Hughes, Eds. New York: Wiley, 2004.
50. O. N. Gerek and A. E. Cetin, "Adaptive polyphase subband decomposition structures for image compression," IEEE Trans. Image Process., vol. 9, no. 10, pp. 1649-1660, Oct. 2000.
51. G.Gilboa, J.Darbon, S.Osher, and T. F. Chan, "Nonlocal convex functionals for image regularization," UCLA CAM Rep. 06-57, 2006.
52. R. Gribonval and E. Bacry, "Harmonic decomposition of audio signals with matching pursuit," IEEE Trans. Signal Process., vol. 51, no. 1, pp. 101-111, Jan. 2003.
53. G. Yu, G. Sapiro, and S.Mallat, "Solving inverse problems with piecewise linear estimators: From Gaussian mixture models to structured sparsity," 2011, preprint: arxiv.org/abs/1006.3056, to be published.
54. H. J. Heijmans, B. Pesquet-Popescu, and G. Piella, "Building nonredundant adaptive wavelets by update lifting," J. Appl. Comput. Harmon. Anal., vol. 18, no. 3, pp. 252-281, May 2005. (Pubitemid 40467200)
55. R. Jenatton, J. Mairal, G. Obozinski, and F. Bach, "Proximal methods for hierarchical sparse coding," Preprint HAL inria-00516723, 2010.
56. S. Kindermann, S. Osher, and P. W. Jones, "Deblurring and denoising of images by nonlocal functionals," SIAM Mult. Model. Simul., vol. 4, no. 4, pp. 1091-1115, 2005. (Pubitemid 44932284)
57. H. Krim, D. Tuckier, S. Mallat, and D. Donoho, "Near-optimal risk for best basis search," IEEE Trans. Inf. Theory, vol. 45, no. 7, pp. 2225-2238, 1999.
58. E. Le Pennec and S. Mallat, "Bandelet image approximation and compression," SIAM Multiscale Model. Simul., vol. 4, no. 3, pp. 992-1039, 2005. (Pubitemid 44340296)
59. E. Le Pennec and S. Mallat, "Sparse geometric image representations with bandelets," IEEE Trans. Image Process., vol. 14, no. 4, pp. 423-438, Apr. 2005. (Pubitemid 40552380)
60. S. Lesage, R.Gribonval, F. Bimbot, and L. Benaroya, "Learning unions of orthonormal bases with thresholded singular value decomposition," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2005, vol. 5, pp. v293-v296. (Pubitemid 43762401)
61. M. Lounsbery, T. D. DeRose, and J.Warren, "Multiresolution analysis for surfaces of arbitrary topological type," ACM Trans. Graphics, vol. 16, no. 1, pp. 34-73, 1997.
62. J. Mairal, F. Bach, J. Ponce, G. Sapiro, and A. Zisserman, "Supervised dictionary learning," in Proc. Adv. Neural Inf. Process. Syst., 2008, pp. 1033-1040.
63. J. Mairal, M. Elad, and G. Sapiro, "Sparse representation for color image restoration," IEEE Trans. Image Process., vol. 17, no. 1, pp. 53-69, Jan. 2008.
64. S. Mallat, "Geometrical grouplets," J. Appl. Comput. Harmon. Anal., vol. 26, no. 2, pp. 161-180, 2009.
65. S. Mallat, A Wavelet Tour of Signal Processing, 3rd ed. Amsterdam, The Netherlands: Elsevier, 2009.
66. S. Mallat and G. Peyré, "Orthogonal bandlets bases for geometric image approximation," Commun. Pure Appl. Math., vol. 61, no. 9, pp. 1173-1212, 2008.
67. S. Mallat and G. Yu, "Super-resolution with sparse mixing estimators," IEEE Trans. Image Process., vol. 19, no. 11, pp. 2889-2900, 2010.
68. S. Mallat and Z. Zhang, "Matching pursuitswith time-frequency dictionaries," IEEE Trans. Signal Process., vol. 41, no. 12, pp. 3397-3415, Dec. 1993.
69. S. Masnou, "Disocclusion: A variational approach using level lines," IEEE Trans. Image Process., vol. 11, no. 2, pp. 68-76, Feb. 2002. (Pubitemid 34278444)
70. B. Matei and A. Cohen, Nonlinear Subdivison Schemes : Applications to Image processing, in Tutorials on Multiresolution in Geometric Modelling, A. Iske, E. Quak, and M. S. Floater, Eds. New York: Springer Verlag, 2002, pp. 93-97.
71. P. Maurel, J. F. Aujol, and G. Peyré, "Locally parallel texture modeling," SIAM J. Imaging Sci., vol. 4, no. 1, pp. 413-447, 2010.
72. Y. Meyer, Oscillating Patterns in Image Processing and Nonlinear Evolution Equations. Boston, MA: American Mathematical Society, 2001.
73. M. Mignotte, "A non-local regularization strategy for image deconvolution," Pattern Recogn. Lett., vol. 29, no. 16, pp. 2206-2212, Dec. 2008.
74. J.-M. Mirebeau and A. Cohen, "Greedy bisection generates optimally adapted triangulations," Laboratoire Jacques-Louis Lions, 2008, Tech. Rep.
75. B. A. Olshausen and D. J. Field, "Emergence of simple-cell receptivefield properties by learning a sparse code for natural images," Nature, vol. 381, no. 6583, pp. 607-609, Jun. 1996. (Pubitemid 26177476)
76. N. Ouarti and G. Peyré, "Best basis search in a non-stationary wavelet packets dictionary," in Proc. ICIP 2009, 2009.
77. G. Peyré, "Image processing with non-local spectral bases," SIAMMultiscale Model. Simul., vol. 7, no. 2, pp. 703-730, 2008.
78. G. Peyré, "Manifold models for signals and images," Comput. Vis. Image Understand., vol. 113, no. 2, pp. 249-260, Feb. 2009.
79. G. Peyré, "Sparse modeling of textures," J. Math. Imaging Vis., vol. 34, no. 1, pp. 17-31, 2009.
80. G. Peyré, "Best basis compressed sensing," IEEE Trans. Signal Process., vol. 28, no. 5, 2010.
81. G. Peyré, "Texture synthesis with grouplets," IEEE Trans. Patt. Anal. Mach. Intell., vol. 32, no. 4, pp. 733-746, Apr. 2010.
82. G. Peyré, S. Bougleux, and L. D. Cohen, "Non-local regularization of inverse problems," Inverse Problems Imag., 2011, to be published.
83. G. Peyré, J. Fadili, and J.-L. Starck, "Learning the morphological diversity," SIAM J. Imag. Sci., vol. 3, no. 3, pp. 646-669, 2010.
84. G. Peyré and S. Mallat, "Surface compression with geometric bandelets," ACM Trans. Graphics, (SIGGRAPH'05), vol. 24, no. 3, pp. 601-608, Aug. 2005.
85. G. Peyré, E. Le Pennec, C. Dossal, and S. Mallat, "Geometric estimation with orthogonal bandlet bases," in SPIE Wavelet XII, 2007.
86. G. Plonka, "The easy path wavelet transform: A new adaptive wavelet transform for sparse representation of two-dimensional data," SIAM Multiscale Model. Simul., vol. 7, no. 3, pp. 1474-1496, 2009.
87. J. Portilla and E. P. Simoncelli, "A parametric texture model based on joint statistics of complex wavelet coefficients," Int. J. Comput. Vis., vol. 40, no. 1, pp. 49-70, 2000.
88. J. Portilla, V. Strela, M. Wainwright, and E. P. Simoncelli, "Image denoising using a scale mixture of Gaussians in the wavelet domain," IEEE Trans. Image Process., vol. 12, no. 11, pp. 1338-1351, Nov. 2003.
89. L. I. Rudin, S. Osher, and E. Fatemi, "Nonlinear total variation based noise removal algorithms," Phys. D, vol. 60, no. 1-4, pp. 259-268, 1992.
90. J. Ruppert, "A Delaunay refinement algorithm for quality 2-dimensional mesh generation," J. Algorithms, vol. 18, no. 3, pp. 548-585, 1995.
91. P. Schröder and W. Sweldens, "Spherical wavelets: Efficiently representing functions on the sphere," in Proc. SIGGRAPH 95, 1995, pp. 161-172.
92. A. Secker and D. Taubman, "Lifting-based invertible motion adaptive transform (LIMAT) framework for highly scalable video compression," IEEE Trans. Image Process., vol. 12, no. 12, pp. 1530-1542, Dec. 2003. (Pubitemid 40005922)
93. O. G. Sezer, O. Harmanci, and O. G. Guleryuz, "Sparse orthonormal transforms for image compression," in Proc. IEEE Int Conf. Image Process. (ICIP), 2008, pp. 149-152.
94. R. Shukla, P. L. Dragotti, M. Do, and M. Vetterli, "Rate distortion optimized tree structured compression algorithms for piecewise smooth images," IEEE Trans. Image Process., vol. 14, no. 3, pp. 343-359, Mar. 2005. (Pubitemid 40356098)
95. K. Skretting and J. H. Husoy, "Texture classification using sparse frame based representations," EURASIP J. Appl. Signal Process., vol. 2006, no. 1, p. 102, 2006.
96. W. Sweldens, "The lifting scheme: A custom-design construction of biorthogonal wavelets," J. Appl. Comput. Harmon. Anal., vol. 3, no. 2, pp. 186-200, 1996. (Pubitemid 126375198)
97. A. D. Szlam, M. Maggioni, and R. R. Coifman, "Regularization on graphs with function-adapted diffusion processes," J. Mach. Learn. Res., vol. 9, pp. 1711-1739, 2008.
98. J. A. Tropp, "Just relax: Convex programming methods for identifying sparse signals in noise," IEEE Trans. Inf. Theory, vol. 52, no. 3, pp. 1030-1051, Mar. 2006. (Pubitemid 46444890)
99. M. Wakin, J. Romberg, H. Choi, and R. Baraniuk, "Wavelet-domain approximation and compression of piecewise smooth images," IEEE Trans. Image Process., vol. 15, no. 5, pp. 1071-1087, May 2006.
100. D. M. Wang, L. Zhang, A. Vincent, and F. Speranza, "Curved wavelet transform for image coding," IEEE Trans. Image Process., vol. 15, no. 8, pp. 2413-2421, Aug. 2006. (Pubitemid 44089112)
101. L.-Y. Wei and M. Levoy, "Fast texture synthesis using tree-structured vector quantization," in Proc. 27th Annu. Conf. Comput. Graphics Interact. Tech. SIGGRAPH'00: , 2000, pp. 479-488, ACM Press/Addison-Wesley. (Pubitemid 32394012)
102. J. Wright, Y. Ma, J. Mairal, G. Sapiro, T. S. Huang, and S. Yan, "Sparse representation for computer vision and pattern recognition," Proc. IEEE, vol. 98, no. 6, pp. 1031-1044, Jun. 2010.