Learning parametric dictionaries for signals on graphs

IEEE Transactions on Signal Processing

Volumn 62, Issue 15, 2014, Pages 3849-3862

  Thanou, Dorina ^a   Shuman, David I ^b   Frossard, Pascal ^a  

^a EPFL   (Switzerland)

^b MACALESTER COLLEGE   (United States)

Author keywords

Dictionary learning; graph Laplacian; graph signal processing; sparse approximation

Indexed keywords

APPROXIMATION ALGORITHMS; DATA PROCESSING; LEARNING ALGORITHMS; MATRIX ALGEBRA; SIGNAL PROCESSING;

COMPUTATIONALLY EFFICIENT; DICTIONARY LEARNING; DICTIONARY LEARNING ALGORITHMS; GEOMETRIC STRUCTURE; GRAPH LAPLACIAN; SPARSE APPROXIMATIONS; SPARSE SIGNAL REPRESENTATION; STRUCTURED DICTIONARY;

GRAPH THEORY;

EID: 84904640248     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2014.2332441     Document Type: Article

References (39)

1. D. I. Shuman, S. K. Narang, P. Frossard, A. Ortega, and P. Vandergheynst, "The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains," IEEE Signal Process. Mag., vol. 30, no. 3, pp. 83-98, May 2013.
2. R. Rubinstein, A. M. Bruckstein, and M. Elad, "Dictionaries for sparse representation modeling," Proc. IEEE, vol. 98, no. 6, pp. 1045-1057, Apr. 2010.
3. M. Aharon, M. Elad, and A. Bruckstein, "K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation," IEEE Trans. Signal Process., vol. 54, no. 11, pp. 4311-4322, Nov. 2006. (Pubitemid 44637761)
4. K. Engan, S. O. Aase, and J. H. Husoy, "Method of optimal directions for frame design," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Phoenix, AZ, USA, Mar. 1999, vol. 5, pp. 2443-2446.
5. S. Mallat, A Wavelet Tour of Signal Processing: The Sparse Way, 3rd ed. New York, NY, USA: Academic, 2008.
6. P. Jost, P. Vandergheynst, S. Lesage, and R.Gribonval, "Motif: An efficient algorithm for learning translation invariant dictionaries," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Toulouse, France, May 2006, vol. 5, pp. 857-860.
7. M. Yaghoobi, L. Daudet, and M. E. Davies, "Parametric dictionary design for sparse coding," IEEE Trans. Signal Process., vol. 57, no. 12, pp. 4800-4810, Dec. 2009.
8. R. Rubinstein, M. Zibulevsky, and M. Elad, "Double sparsity: Learning sparse dictionaries for sparse signal approximation," IEEE Trans. Signal Process., vol. 58, no. 3, pp. 1553-1564, Mar. 2010.
9. D. Thanou, D. I Shuman, and P. Frossard, "Parametric dictionary learning for graph signals," presented at the IEEE Glob. Conf. Signal Inf. Process., Austin, TX, USA, Dec. 2013.
10. D. Hammond, P. Vandergheynst, and R. Gribonval, "Wavelets on graphs via spectral graph theory," Appl. Comput. Harmon. Anal., vol. 30, no. 2, pp. 129-150, Mar. 2010.
11. X. Zhu and M. Rabbat, "Approximating signals supported on graphs," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Kyoto, Japan, Mar. 2012, pp. 3921-3924.
12. R. R. Coifman and M. Maggioni, "Diffusion wavelets," Appl. Comput. Harmon. Anal., vol. 21, pp. 53-94, Mar. 2006. (Pubitemid 43947621)
13. S. K. Narang and A. Ortega, "Perfect reconstruction two-channel wavelet filter banks for graph structured data," IEEE Trans. Signal Process., vol. 60, no. 6, pp. 2786-2799, Jun. 2012.
14. M. Gavish, B. Nadler, and R. R. Coifman, "Multiscale wavelets on trees, graphs and high dimensional data: Theory and applications to semi supervised learning," presented at the Int. Conf. Mach. Learn., Haifa, Israel, Jun. 2010.
15. I. Ram, M. Elad, and I. Cohen, "Generalized tree-based wavelet transform," IEEE Trans. Signal Process., vol. 59, no. 9, pp. 4199-4209, Sep. 2011.
16. I. Ram, M. Elad, and I. Cohen, "Redundant wavelets on graphs and high dimensional data clouds," IEEE Signal Process. Lett., vol. 19, no. 5, pp. 291-294, May 2012.
17. D. I. Shuman, B. Ricaud, and P. Vandergheynst, "A windowed graph Fourier transform," presented at the IEEE Statist. Signal Process. Workshop, Ann Arbor, MI, USA, Aug. 2012.
18. D. I. Shuman, B. Ricaud, and P. Vandergheynst, "Vertex-frequency analysis on graphs," Appl. Comput. Harmon. Anal., Jul. 2013, submitted for publication.
19. D. I. Shuman, C. Wiesmeyr, N. Holighaus, and P. Vandergheynst, "Spectrum-adapted tight graph wavelet and vertex-frequency frames," IEEE Trans. Signal Process., Nov. 2013, submitted for publication.
20. J. C. Bremer, R. R. Coifman, M. Maggioni, and A. D. Szlam, "Diffusion wavelet packets," Appl. Comput. Harmon. Anal., vol. 21, no. 1, pp. 95-112, Jun. 2006. (Pubitemid 43947620)
21. R. M. Rustamov and L. Guibas, "Wavelets on graphs via deep learning," in Adv. Neural Inf. Process. Syst. (NIPS), Dec. 2013.
22. X. Zhang, X. Dong, and P. Frossard, "Learning of structured graph dictionaries," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Kyoto, Japan, Mar. 2012, pp. 3373-3376.
23. N. J. Higham, Functions of Matrices. Philadelphia, PA, USA: SIAM, 2008.
24. M. Zheng, J. Bu, C. Chen, C. Wang, L. Zhang, G. Qiu, and D. Cai, "Graph regularized sparse coding for image representation," IEEE Trans. Image Process., vol. 20, no. 5, pp. 1327-1336, May 2011.
25. F. Chung, Spectral Graph Theory. Providence, RI, USA: Amer, Math. Soc., 1997.
26. J. A. Tropp, "Greed is good: Algorithmic results for sparse approximation," IEEE Trans. Inf. Theory, vol. 50, no. 10, pp. 2231-2242, Oct. 2004.
27. M. Bruckstein, D. Donoho, and M. Elad, "From sparse solutions of systems of equations to sparse modeling of signals and images," SIAM Rev., vol. 51, no. 1, pp. 34-81, Feb. 2009.
28. M. Elad, Sparse and Redundant Representations-From Theory to Applications in Signal and Image Processing. NewYork,NY,USA: Springer, 2010.
29. S. Boyd and L. Vandenberghe, Convex Optimization. NewYork,NY, USA: Cambridge Univ. Press, 2004.
30. S. Boyd,N. Parikh, E. Chu, B. Peleato, and J. Eckstein, "Distributed optimization and statistical learning via the alternating direction method of multipliers," Found. Trends Mach. Learn., vol. 3, no. 1, pp. 1-122, 2011.
31. K. C. Toh, M. J. Todd, and R. H. Tutuncu, "SDPT3-A MATLAB software package for semidefinite programming," in Optim. Methods Softw., 1999, vol. 11, pp. 545-581.
32. J. Lofberg, "YALMIP: A toolbox for modeling and optimization in MATLAB," presented at the CACSD Conf., Taipei, Taiwan, Sep. 2004.
33. X. Dong, A. Ortega, P. Frossard, and P. Vandergheynst, "Inference of mobility patterns via spectral graph wavelets," presented at the Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Vancouver, Canada, May 2013.
34. T. Choe, A. Skabardonis, and P. P. Varaiya, "Freeway performance measurement system (PeMS): An operational analysis tool," presented at the Annu. Meet. of Transportat. Res. Board,Washington, DC, USA, Jan. 2002.
35. H. Eryilmaz, D. Van De Ville, S. Schwartz, and P. Vuilleumier, "Impact of transient emotions on functional connectivity during subsequent resting state: A wavelet correlation approach," NeuroImage, vol. 54, no. 3, pp. 2481-2491, Feb. 2011.
36. J. Richiardi, H. Eryilmaz, S. Schwartz, P. Vuilleumier, and D. Van De Ville, "Decoding brain states from fMRI connectivity graphs," NeuroImage, vol. 56, no. 2, pp. 616-626, May 2011.
37. I. Daubechies, M. Defrise, and C. De Mol, "An iterative thresholding algorithm for linear inverse problems with a sparsity constraint," Commun. Pure Appl. Math., vol. 57, no. 11, pp. 1413-1457, Nov. 2004. (Pubitemid 39427442)
38. R. Tibshirani, "Regression shrinkage and selection via the lasso," J. R. Statist. Soc. Ser. B, vol. 58, pp. 267-288, 1994.
39. D. I Shuman, P. Vandergheynst, and P. Frossard, "Chebyshev polynomial approximation for distributed signal processing," presented at the Int. Conf. Distrib. Comput. Sensor Sys., Barcelona, Spain, Jun. 2011.