Sparse components of images and optimal atomic decompositions

Constructive Approximation

Volumn 17, Issue 3, 2001, Pages 353-382

  Donoho, D L ^a  

^a STANFORD UNIVERSITY   (United States)

Author keywords

Computational harmonic analysis; Edgelets; Independent components analysis; Sparse components analysis; Synthetic image models; Wedgelets

Indexed keywords

EID: 0035533162     PISSN: 01764276     EISSN: None     Source Type: Journal    
DOI: 10.1007/s003650010032     Document Type: Article

References (35)

1. A. J. BELL, T. J. SEJNOWSKI (1995): An information-maximization approach to blind separation and blind deconvolution. Neural Comput., 7:1129-1159.
2. T. BERGER (1971): Rate-Distortion Theory: A Mathematical Basis for Data Compression. Englewood Cliffs, NJ: Prentice-Hall.
3. J. BERGH, J. LÖFSTRM (1976): Interpolation Spaces. An Introduction. Grundlehren der Mathematischen Wissenschaften, No. 223. Berlin: Springer-Verlag.
4. G. DAVID, S. SEMMES (1993): Analysis of and on Uniformly Rectifiable Sets. Mathematical Surveys and Monographs, 38. Providence, RI: American Mathematical Society.
5. S. CHEN, D. L. DONOHO, M. A. SAUNDERS (1999): Atomic decomposition by basis pursuit. SIAM J. Sci. Comput., 20:33-61.
6. R. R. COIFMAN, M. V. WICKERHAUSER (1992): Entropy-based algorithms for best-basis selection. IEEE Trans. Inform. Theory, 38:713-718.
7. J. G. DAUGMAN (1990): Self-similar oriented wavelet pyramids: Conjectures about neural nonorthogonality. Image Pyramids and Neural Networks. Proc. ECVP-90 Symposium.
8. G. DAVID, S. SEMMES (1993): Analysis of and on Uniformly Rectifiable Sets. Mathematical Surveys and Monographs, 38. Providence, RI: American Mathematical Society.
9. R. A. DEVORE, G. G. LORENTZ (1993): Constructive Approximation. Grundlehren der Mathematischen Wissenschaften, No. 303. Berlin: Springer-Verlag.
10. D. L. DONOHO (1993): Unconditional bases are optimal bases for data compression and statistical estimation. Appl. Comput. Harmonic Anal., 1:100-115.
11. D. L. DONOHO (1996): Unconditional bases and bit-level compression. Appl. Computat. Harmonic Anal., 3:388-392.
12. D. L. DONOHO (1997): CART and best-ortho-basis: A connection. Ann. Statist., 25:1870-1911.
13. D. L. DONOHO (1999): Wedgelets: Nearly-minimax estimation of edges. Ann. Statist., 27:859-897.
14. D. L. DONOHO (1998): Independent Components Analysis and Computational Harmonic Analysis. Technical Report, Department of Statistics, Stanford University.
15. D. L. DONOHO, I. M. JOHNSTONE (1995): Empirical Atomic Decomposition. Unpublished manuscript.
16. D. J. FIELD (1993): Scale-invariance and self-similar "wavelet" transforms: An analysis of natural scenes and mammalian visual systems. In: Wavelets, Fractals and Fourier Transforms (M. Farge, J. Hunt, and J. C. Vassilicos, eds.). Oxford: Oxford University Press.
17. D. J. FIELD (1995): Visual coding, redundancy, and "feature detection." In: The Handbook of Brain Theory and Neural Networks (M. A. Arbib, ed.). Cambridge, MA: MIT Press, pp. 1012-1016.
18. P. FOLDIAK (1995): Sparse coding in the primate cortex. In: The Handbook of Brain Theory and Neural Networks (M. A. Arbib, ed.). Cambridge, MA: MIT Press, pp. 895-899.
19. C. FYFE, R. BADDELEY (1995): Finding compact and sparse distributed representations of visual images. Network, 6:333-344.
20. G. H. HARPUR, R. W. PRAGER (1996): Development of low entropy coding in a recurrent network. Network, 7:277-284.
21. J. H. VAN HATEREN, D. L. RUDERMAN (1998): Independent component analysis of natural image sequences yields spatiotemporal filters similar to simple cells in primary visual cortex. Proc. Roy. Soc. London Ser. B, 265.
22. J. H. VAN HATEREN, A. VAN DER SCHAAF (1998): Independent component filters of natural images compared with simple cells in the primary visual cortex. Proc. Roy. Soc. London Ser. B, 265:359-366.
23. P. W. JONES (1990): Rectifiable sets and the travelling salesman problem. Invent. Math., 102:1-15.
24. J. KARHUNEN, A. HYVARINEN, R. VIGARIO, J. HURRI, E. OJA (1997): Applications of neural blind separation to signal and image processing. Proc. ICASSP '97, pp. 131-134.
25. B. S. KASHIN (1985): On approximation properties of complete orthonormal systems. Trudy Math. Inst. Steklov, 172 (in Russian), Proc. Steklov Inst. Math., 1987, 207-211.
26. 1. Mat. Zametki, 56:57-86 (in Russian); Math. Notes, 56:1137-1157 (in English).
27. 1. Mat. Zametki, 56:57-86 (in Russian); Math. Notes, 56:1137-1157 (in English).
28. R. Z. KHAS'MINSKII, V. S. LEBEDEV (1990): On the properties of parametric estimators for areas of a discontinuous image. Problems Control Inform. Theory, pp. 375-385.
29. A. P. KOROSTELEV, A. B. TSYBAKOV (1993): Minimax Theory of Image Reconstruction. Lecture Notes in Statistics, Vol. 82. New York: Springer-Verlag.
30. M. LEWICKI, B. OLSHAUSEN (1997): Inferring sparse, overcomplete image codes using an efficient coding framework. Proc. NIPS*97, pp. 815-821.
31. M. LEWICKI, T. SEJNOWKSI (2000): Learning overcomplete representations. Neural Comput., 12:337-365.
32. S. MALLAT, Z. ZHANG (1993): Matching pursuit in a time-frequency dictionary. IEEE Trans. Signal Proc., 41:3397-3415.
33. B. A. OLSHAUSEN, D. J. FIELD (1996): Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature, 381:607-609.
34. B. A. OLSHAUSEN, D. J. FIELD (1997): Sparse coding with an overcomplete basis set: A strategy employed by V1? Vision Res., 37:3311-3325.
35. M. V. WICKERHAUSER (1993): Adapted Wavelet Analysis: Theory and Algorithms. New York: A. K. Peters.