A geometrical study of matching pursuit parametrization

IEEE Transactions on Signal Processing

Volumn 56, Issue 7 I, 2008, Pages 2835-2848

  Jacques, Laurent ^a   De Vleeschouwer, Christophe ^a  

^a UNIVERSITÉ CATHOLIQUE DE LOUVAIN   (Belgium)

Author keywords

Convergence; Dictionary; Matching pursuit (MP); Optimization; Parametrization; Riemannian geometry

Indexed keywords

DECOMPOSITION; GEOMETRY; OPTIMIZATION;

(N-1) CRITERION; APPLIED (CO); CONVERGENCE (MATHEMATICS); DISCRETIZATIONS; GRADIENT ASCENT; MATCHING PURSUIT (MP); NUMERICAL EXPERIMENTS; PARAMETRIZATION; PARAMETRIZATIONS; SIGNAL SPACES;

SIGNAL PROCESSING;

EID: 46749142219     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2008.917379     Document Type: Article

References (48)

1. S. Chen, D. Donoho, and M. Saunders, "Atomic decomposition by basis pursuit," SIAM J. Sci. Comput., vol. 20, no. 1, pp. 33-61, Aug. 1998.
2. S. Mallat and Z. Zhang, "Matching pursuit with time-frequency dictionaries," IEEE Trans. Signal. Process., vol. 41, no. 12, pp. 3397-3415, Dec. 1993.
3. J. Tropp, "Greed is good: Algorithmic results for sparse approximation," IEEE Trans. Inf. Theory, vol. 50, no. 10, pp. 2231-2242, Oct. 2004.
4. E. Le Pennec and S. Mallat, "Sparse geometric image representations with bandelets," IEEE Trans. Image Process., vol. 14, no. 4, pp. 423-438, Apr. 2005.
5. D. Donoho and X. Huo, "Uncertainty principles and ideal atom decomposition," IEEE Trans. Inf. Theory, vol. 47, no. 7, pp. 2845-2862, Nov. 2001.
6. R. Neff and A. Zakhor, "Very low bit rate video coding based on matching pursuits," IEEE Trans. Circuits Syst. Video Technol., vol. 7, no. 1, pp. 158-171, Feb. 1997.
7. M. Goodwin and M. Vetterli, "Matching pursuit and atomic signal models based on recursive filterbanks," IEEE Trans. Signal Process., vol. 47, no. 7, pp. 1890-1902, Jul. 1999.
8. P. Durka, D. Ircha, and K. Blinowska, "Stochastic time-frequency dictionaries for matching pursuit," IEEE Trans. Signal Process., vol. 49, no. 3, pp. 507-510, Mar. 2001.
9. R. Gribonval and E. Bacry, "Harmonic decomposition of audio signals with matching pursuit," IEEE Trans. Signal Process., vol. 51, no. 1, pp. 101-111, Jan. 2003.
10. R. Gribonval and P. Vandergheynst, "On the exponential convergence of matching pursuits in quasi-incoherent dictionaries," IEEE Trans. Inf. Theory, vol. 52, no. 1, pp. 255-261, Jan. 2006.
11. O. D. Escoda, L. Granai, and P. Vandergheynst, "On the use of a priori information for sparse signal approximations," IEEE Trans. Signal Process., vol. 54, no. 9, pp. 3468-3482, Sep. 2006.
12. A. Rahmoune, P. Vandergheynst, and P. Frossard, "Flexible motion-adaptive video coding with redundant expansions," IEEE Trans. Circuits Syst. Video Technol., vol. 16, no. 2, pp. 178-190, Feb. 2006.
13. C. De Vleeschouwer and A. Zakhor, "In-loop atom modulus quantization for matching pursuit and its application to video coding," IEEE Trans. Image. Process., vol. 12, no. 10, pp. 1226-1242, Oct. 2003.
14. R. Gribonval, "Fast matching pursuit with a multiscale dictionary of Gaussianchirps," IEEE Trans. Signal Process., vol. 49, no. 5, pp. 994-1001, May 2001.
15. R. Figueras i Ventura, P. Vandergheynst, and P. Frossard, "Low-rate and flexible image coding with redundant representations," IEEE Trans. Image Process., vol. 15, no. 3, pp. 726-739, Mar. 2006.
16. C. De Vleeschouwer and B. Macq, "Subband dictionaries for low-cost matching pursuits of video residues," IEEE Trans. Circuits Syst. Video Technol., vol. 9, no. 7, pp. 984-983, Oct. 1999.
17. P. Czerepinski, C. Davies, N. Canagarajah, and D. Bull, "Matching pursuits video coding: Dictionaries and fast implementation," IEEE Trans. Circuits Syst. Video Technol., vol. 10, no. 7, pp. 1103-1115, Jul. 2000.
18. R. Neff and A. Zakhor, "Matching pursuit video coding. Part I: Dictionary approximation," IEEE Trans. Circuits Syst. Video Technol. vol. 12, no. 1, pp. 13-26, Jan. 2002.
19. Y.-T. Chau, W.-L. Hwang, and C.-L. Huang, "Gain-shape optimized dictionary for matching pursuit video coding," Signal Process., vol. 83, pp. 1937-1943, Sep. 2003.
20. P. Schmid-Saugeon and A. Zakhor, "Dictionary design for matching pursuit and application to motion compensated video coding," IEEE Trans. Circuits Syst. Video Technol., vol. 14, no. 6, pp. 880-886, Jun. 2004.
21. M. Wakin, D. Donoho, H. Choi, and R. Baraniuk, "The multiscale structure of non-differentiable image manifolds," in Proc. SPIE Wavelets XL, San Diego, CA, Aug. 2005, vol. 5914, pp. 413-429.
22. D. Donoho and C. Grimes, "Image manifolds which are isometric to Euclidean space," J. Math. Imag. Vision, vol. 23, no. 1, pp. 5-24, 2005.
23. S. Amari, "Differential geometry of curved exponential families-curvatures and information loss," Annals Statistics, vol. 10, no. 2, pp. 357-385, Jun. 1982.
24. G. Watson and K. Gilholm, "Signal and image feature extraction from local maxima of generalised correlation," Pattern Recog., vol. 31, no. 11, pp. 1733-1745, Nov. 1998.
25. I. Tosic, P. Frossard, and P. Vandergheynst, "Progressive coding of 3-D objects based on overcomplete decompositions," IEEE Trans. Circuits Syst. Video Technol., vol. 16, no. 11, pp. 1338-1349, Nov. 2006.
26. I. Bogdanova, P. Vandergheynst, and J.-P. Gazeau, "Continuous wavelet transform on the hyperboloid," Appl. Comput. Harmon. Anal., vol. 23, no. 3, pp. 286-306, 2007.
27. S. Lang, Differential Manifolds. Reading, MA: Addison-Wesley, 1972.
28. M. Carmo, Riemannian Geometry. Boston, MA: Birkhauser, 1992.
29. R. Gribonval and P. Vandergheynst, "On the exponential convergence of matching pursuits in quasi-incoherent dictionaries," IEEE Trans. Inf. Theory, vol. 52, no. 1, pp. 255-261, Jan. 2006.
30. S. Mallat, A Wavelet Tour of Signal Processing. New York: Academic Press, 1998.
31. L. Jacques and C. De Vleeschouwer, "Discretization effects of continuous dictionary in matching pursuits: Density, convergence and optimization," UCL, Tech. Rep. TR-LJ-2007.01, 2007.
32. P. Niyogi, S. Smale, and S. Weinberger, "Finding the homology of sub-manifolds with high confidence from random samples," Toyota Technological Institute, Chicago, IL, 2004.
33. M. Davenport, M. Duarte, M. Wakin, J. Laska, D. Takhar, K. Kelly, and R. Baraniuk, "The smashed filter for compressive classification and target recognition," presented at the Comput. Imag. V SPIE Electron. Imag., San Jose, California, Jan. 2007.
34. M. B. Wakin, "The geometry of low-dimensional signal manifolds," Ph.D. dissertation, ECE Dept., Rice Univ., Houston, TX, 2006.
35. I. Daubechies, Ten Lectures on Wavelets. Warrendale, PA: SIAM, 1992.
36. S. T. Ali, J.-P. Antoine, and J.-P. Gazeau, Coherent States, Wavelets, and Their Generalizations. New York: Springer-Verlag, 2000.
37. O. Ferreira and P. Oliveira, "Subgradient algorithm on Riemannian manifolds," J. Opt. Theory Appl., vol. 97, no. 1, pp. 93-104, Apr. 1998.
38. D. Gabay, "Minimizing a differentiable function over a differential manifold," J. Opt. Theory Appl., vol. 37, no. 2, pp. 177-219, Jun. 1982.
39. S. Boyd and L. Vandenberghe, Convex Optimization. Cambridge, U.K.: Cambridge Univ. Press, 2004.
40. R. Mahony and J. Manton, "The geometry of the Newton method on non-compact Lie groups," J. Global Opt., vol. 23, no. 3, pp. 309-327, Aug. 2002.
41. R. Figueras i Ventura, O. D. Escoda, and P. Vandergheynst, "A matching pursuit full search algorithm for image approximations," EPFL, Tech. Rep. 1015 Ecublens, 2004.
42. R. M. F. i Ventura, "Sparse image approximation with application to flexible image coding," Ph.D. dissertation, Inst. Electr. Eng., Swiss Federal Inst. Technol., Lausanne, Switzerland, 2005.
43. J.-P. Antoine, R. Murenzi, P. Vandergheynst, and S. Ali, Two-Dimensional Wavelets and Their Relatives. Cambridge, U.K.: Cambridge Univ. Press, 2004.
44. Y. C. Pati, R. Rezaiifar, and P. S. Krishnaprasad, "Orthogonal matching pursuit: Recursive function approximation with applications to wavelet decomposition," in Proc. 27th Ann. Asilomar Conf. Signals, Syst. Comput., Nov. 1993, pp. 40-44.
45. E. Candes, J. Romberg, and T. Tao, "Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information," IEEE Trans. Inf. Theory, vol. 52, no. 2, pp. 489-509, Feb. 2006.
46. Duarte, M. Davenport, M. Wakin, and R. Baraniuk, "Sparse signal detection from incoherent projections," in Proc. IEEE Int. Conf. Acoust., Speech Signal Process. (ICASSP), May 2006, vol. 3, pp. 14-19.
47. H. Rauhut, K. Schnass, and P. Vandergheynst, "Compressed sensing and redundant dictionaries," IEEE Trans. Inf. Theory, accepted for publication.
48. R. Baraniuk and M. Wakin, "Random projections of smooth manifolds," Foundations Comput. Math., to be published.