Ways to sparse representation: An overview

Science in China, Series F: Information Sciences

Volumn 52, Issue 4, 2009, Pages 695-703

  Yang, Jingyu ^a   Peng, Yigang ^a   Xu, Wenli ^a   Dai, Qionghai ^a  

^a TSINGHUA UNIVERSITY   (China)

Author keywords

Basis pursuit; Iterative shrinkage; Matching pursuit; Nonlinear approximation; Redundant dictionary; Redundant transform; Sparse representation

Indexed keywords

EID: 64249139684     PISSN: 10092757     EISSN: 18622836     Source Type: Journal    
DOI: 10.1007/s11432-009-0045-5     Document Type: Article

References (51)

1. Mallat S. A Wavelet Tour of Signal Processing. San Diego: Academic Press, 1998
2. S. Mallat Z. Zhang 1993 Matching pursuits with time-frequency dictionaries IEEE Trans Signal Process 41 3 3397 3415
3. G. Davis S. Mallat Z. Zhang 1994 Adaptive time-frequency decompositions Opt Engin 33 7 2183 2191
4. S. Chen D. Donoho M. Saunders 1999 Atomic decomposition by basis pursuit SIAM J Sci Comput 20 33 61
5. M. Elad 2006 Why simple shrinkage is still relevant for redundant representations? IEEE Trans Inf Theory 5212 5559 5569
6. R. Tibshirani 1996 Regression shrinkage and selection via the lasso J Royal Statist Soc Ser B (Methodological) 58 1 267 288
7. M. R. Osborne B. Presnell B. A. Turlach 2000 A new approach to variable selection in least squares problems IMA J Num Anal 20 3 389 403
8. B. Efron T. Hastie I. Johnstone 2004 Least angle regression Annals Statist 32 407 499
9. J. L. Starck M. K. Nguyen F. Murtagh 2003 Wavelets and curvelets for image deconvolution: A combined approach Signal Process 83 2279 2283
10. M. A. T. Figueiredo R. D. Nowak 2003 An EM algorithm for waveletbased image restoration IEEE Trans Image Process 12 8 906 916
11. S. Fischer G. Crist'obal R. Redondo 2006 Sparse overcomplete Gabor wavelet representation based on local competitions IEEE Trans Signal Process 15 2 265 272
12. Wang B, Wang Y, Selesnick I, et al. Video coding using 3-D dual-tree wavelet transform. EURASIP J Image Video Process, Special issue on "Wavelets in Source Coding, Communications, and Networks", Volume 2007 (2007), Article ID. 42761, 15 pages, doi: 10.1155/2007/42761
13. Yang J Y, Xu W L, Dai Q H, et al. Image compression using 2-D dual-tree discrete wavelet transform (DDWT). In: Proc. IEEE International Symposium on Circuits and Systems, New Orleans, 2007. 297-300
14. Figueiredo M A T, Nowak R D, Wright S J. Gradient projection for sparse reconstruction: Application to compressed sensing and other inverse Problems. Technical Report, University of Wisconsin, 2007
15. DeVore R A. Nonlinear Approximation, Acta Numerica. Cambridge: Cambridge Univ. Press, 1998. 51-150
16. Pati Y C, Rezaiifar R, Krishnaprasad P S. Orthogonal matching pursuit: Recursive function approximation with applications to wavelet decomposition. In: Proc. 27th Annu. Asilomar Conference on Signals, Systems and Computers, Pacific Grove, CA, USA, 1993. 40-44
17. Cotter S, Rao B. Application of tree-based searches to matching pursuit. In: Proc. International Conference on Acoustics, Speech, and Signal Processing, Salt Lake City, UT, USA, 2001. 3933-3936
18. P. Jost P. Vandergheynst P. Frossard 2006 Tree-based pursuit: Algorithm and properties IEEE Trans Signal Process 54 12 4685 4697
19. I. F. Gorodnitsky B. D. Rao 1997 Sparse signal reconstructions from limited data using FOCUSS: A re-weighted minimum norm algorithm IEEE Trans Signal Process 45 3 600 616
20. B. D. Rao K. Kreutz-Delgado 1999 An affine scaling methodology for best basis selection IEEE Trans Signal Process 47 1 187 200
21. P. S. Huggins S. W. Zucker 2007 Greedy basis pursuit IEEE Trans Signal Process 55 7 3760 3772
22. Reeves T H, Kingsbury N G. Overcomplete image coding using iterative projection-based noise shaping. In: Proc. International Conference on Image Processing, Rochester, NY, 2002. 597-600
23. Fischer S, Cristóbal G. Minimum entropy transform using Gabor wavelets for image compression. In: Proc. International Conference on Image Analysis and Processing, Palermo, Italy, 2001. 428-433
24. Fadili M J, Starck J L, Murtagh F. Inpainting and zooming using sparse representations. Computer J, 2007, doi:10.1093/comjnl/bxm055
25. A. E. C. Pece 2002 The problem of sparse coding J Math Imag Vision 17 89 108
26. C. Zhang Z. Yin X. Chen 2005 Signal overcomplete representation and sparse decomposition based on redundant dictionaries Chin Sci Bull 50 23 2672 2677
27. D. Donoho X. Huo 2001 Uncertainty principles and ideal atomic decompositions IEEE Trans Information Theory 47 7 2845 2862
28. Donoho D, Tsaig Y, Drori I, et al. Sparse solution of underdetermined linear equations of stagewise orthogonal matching pursuit. Technical Report, Department of Statistics, Stanford University, 2006
29. R. Neff A. Zakhor 2002 Matching pursuit video coding: I dictionary approximation. IEEE Trans Circuits Syst Video Tech 12 1 13 26
30. R. F. Ventura P. Vandergheynst P. Frossard 2006 Low-rate and flexible image coding with redundant representations IEEE Trans Image Process 15 3 726 739
31. R. Gribonval 2001 Fast matching pursuit with a multiscale dictionary of Gaussian chirps IEEE Trans Signal Process 49 5 994 1001
32. D. L. Donoho 2006 For most large underdetermined systems of linear equations, the minimal ell-1 norm solution is also the sparsest solution Commun Pure Appl Math 59 7 797 829
33. R. Chartrand 2007 Exact reconstruction of sparse signals via nonconvex minimization IEEE Signal Process Lett 14 1 707 710
34. D. Donoho 1995 De-noising by soft-thresholding IEEE Trans Inf Theory 41 3 613 627
35. I. Daubechies M. Defrise C. De Mol 2004 An iterative thresholding algorithm for linear inverse problems with a sparsity constraint Commun Pure Appl Math 57 11 1413 1457
36. I. Daubechies G. Teschke L. Vese 2007 Iteratively solving linear inverse problems under general convex constraints Inverse Problem Imag 1 1 29 46
37. Yang J Y, Peng Y G, Xu W L, et al.Way to sparse representation: a comparative study. Tsinghua Sci Tech, 2009 14(4): in press
38. 1-norm minimization problems when the solution may be sparse. Technical Report, Stanford University, 2006
39. Blumensath T, Davies M E. Iterative thresholding for sparse approximations. Technical Report, The University of Edinburgh, 2004
40. B. A. Olshausen D. J. Field 1996 Emergence of simple-cell receptive field properties by learning a sparse code for natural images Nature 381 607 609
41. Candes E J, Donoho D. Curvelets-a surprisingly effective nonadaptive representation for objects with edges. In: Laurent P J, Le Mehaute A, Schumaker L L, eds. Curves and Surfaces. Nashville: Vanderbilt University Press, TN, 2000. 105-120
42. E. L. Pennec S. Mallat 2005 Sparse geometric image representations with bandelets IEEE Trans Image Process 14 423 438
43. M. N. Do M. Vetterli 2005 The contourlet transform: an efficient directional multiresolution image representation IEEE Trans Image Process 14 12 2091 2106
44. R. Gribonval R. Nielsen 2003 Sparse decompositions in unions of bases IEEE Trans Inf Theory 49 3320 3325
45. J. Tropp 2004 Greed is good: Algorithmic results for sparse approximation IEEE Trans Inf Theory 50 10 2231 2242
46. 1 minimization In: Proc. the National Academy of Sciences 100 2197 2202
47. M. Elad A. M. Bruckstein 2002 A generalized uncertainty principle and sparse representation in pairs of bases IEEE Trans Inf Theory 48 2558 2567
48. K. K. Herrity A. C. Gilbert J. A. Tropp 2006 Sparse approximation via iterative thresholding Proc. International Conference on Acoustics, Speech and Signal Processing 3 624 627
49. Sharon Y, Wright J, Ma Y. Computation and relaxation of conditions for equivalence between l1 and l0 minimization. Technical Report, University of Illinois, 2007
50. D. Donoho M. Elad V. Temlyakov 2006 Stable recovery of sparse overcomplete representations in the presence of noise IEEE Trans Inf Theory 52 6 18
51. Fadili M J, Starck J L. Sparse representation-based image deconvolution by iterative thresholding. Astronomical Data Analysis, France: Marseille, 2006