The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains

IEEE Signal Processing Magazine

Volumn 30, Issue 3, 2013, Pages 83-98

  Shuman, David I ^a   Narang, Sunil K ^b   Frossard, Pascal ^c   Ortega, Antonio ^b   Vandergheynst, Pierre ^a  

^a EPFL   (Switzerland)

^b UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^c Signal Processing Laboratory   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

CLUSTERING ALGORITHMS; DATA HANDLING; DATA MINING; FREQUENCY DOMAIN ANALYSIS; GRAPH THEORY; GRAPHIC METHODS; INFORMATION FILTERING; MODULATION; NEURONS;

EXTRACT INFORMATIONS; FUNDAMENTAL OPERATIONS; HIGH DIMENSIONAL DATA; HIGH-DIMENSIONAL DATA ANALYSIS; IRREGULAR DOMAINS; IRREGULAR STRUCTURES; MULTI-SCALE TRANSFORMS; SIGNAL PROCESSING ON GRAPHS;

SIGNAL PROCESSING;

EID: 85032751310     PISSN: 10535888     EISSN: None     Source Type: Journal    
DOI: 10.1109/MSP.2012.2235192     Document Type: Article

References (67)

1. P. Hagmann, L. Cammoun, X. Gigandet, R. Meuli, C. Honey, V. Wedeen, and O. Sporns, "Mapping the structural core of human cerebral cortex," PLoS Biol., vol. 6, no. 7, pp. 1479-1493, 2008.
2. D. Lowe, "Object recognition from local scale-invariant features," in Proc. IEEE Int. Conf. Comput. Vis., 1999, vol. 2, pp. 1150-1157. (Pubitemid 32079997)
3. C. Apté, F. Damerau, and S. Weiss, "Automated learning of decision rules for text categorization," ACM Trans. Inf. Syst., vol. 12, no. 3, pp. 233-251, 1994.
4. A. J. Smola and R. Kondor, "Kernels and regularization on graphs," in Proc. Ann. Conf. Comp. Learn. Theory, 2003, LNCS, pp. 144-158. (Pubitemid 37053201)
5. X. Zhu and Z. Ghahramani, "Semi-supervised learning using Gaussian fields and harmonic functions," in Proc. Int. Conf. Mach. Learn., Washington, DC, Aug. 2003, pp. 912-919.
6. D. Zhou and B. Schölkopf, "A regularization framework for learning from graph data," in Proc. ICML Workshop Stat. Relat. Learn. and Its Connections to Other Fields, July 2004, pp. 132-137.
7. D. Zhou and B. Schölkopf, "Regularization on discrete spaces," in Pattern Recogn. (Lect. Notes Comp. Sci., vol. 3663), W. G. Kropatsch, R. Sablatnig, and A. Hanbury, Eds. Berlin, Germany: Springer, 2005, pp. 361-368. (Pubitemid 41520675)
8. M. Belkin, I. Matveeva, and P. Niyogi, "Regularization and semi-supervised learning on large graphs," in Learn. Theory (Lect. Notes Comp. Sci.). Berlin, Germany: Springer, 2004, pp. 624-638. (Pubitemid 38940364)
9. D. Zhou, O. Bousquet, T. N. Lal, J. Weston, and B. Schölkopf, "Learning with local and global consistency," in Adv. Neural Inf. Process. Syst., vol. 16, S. Thrun, L. Saul, and B. Schölkopf, Eds. Cambridge, MA: MIT Press, 2004, pp. 321-328.
10. G. Peyré, S. Bougleux, and L. Cohen, "Non-local regularization of inverse problems," in Proc. ECCV'08, 2008, Lect. Notes Comp. Sci., pp. 57-68.
11. F. Zhang and E. R. Hancock, "Graph spectral image smoothing using the heat kernel," Pattern Recognit., vol. 41, pp. 3328-3342, Nov. 2008.
12. S. K. Narang, Y. H. Chao, and A. Ortega, "Graph-wavelet filterbanks for edge-aware image processing," in Proc. IEEE Stat. Signal Process. Workshop, Ann Arbor, MI, Aug. 2012, pp. 141-144.
13. R. Rubinstein, A. M. Bruckstein, and M. Elad, "Dictionaries for sparse representation modeling," Proc. IEEE, vol. 98, no. 6, pp. 1045-1057, June 2010.
14. L. J. Grady and J. R. Polimeni, Discrete Calculus. Berlin, Germany: Springer, 2010.
15. C. Godsil and G. F. Royle, Algebraic Graph Theory. Berlin, Germany: Springer, 2001.
16. F. K. Chung, Spectral Graph Theory (CBMS Regional Conference Series in Mathematics, vol. 92). Providence, RI: AMS Bookstore, 1997.
17. D. Spielman, "Spectral graph theory," in Combinatorial Scientific Computing. Chapman and Hall/CRC Press, 2012.
18. G. Taubin, "Geometric signal processing on polygonal meshes," in Eurographics State of the Art Report. Aug. 2000.
19. Z. Karni and C. Gotsman, "Spectral compression of mesh geometry," in Proc. ACM SIG-GRAPH Conf., New Orleans, LA, July 2000, pp. 279-286. (Pubitemid 32393991)
20. I. Guskov, W. Sweldens, and P. Schroder, "Multiresolution signal processing for meshes," in Proc. ACM SIG-GRAPH Conf., Los Angeles, CA, Aug. 1999, pp. 325-334.
21. S. Hoory, N. Linial, and A. Wigderson, "Expander graphs and their applications," Bull. Amer. Math. Soc., vol. 43, pp. 439-561, Oct. 2006. (Pubitemid 44448254)
22. U. von Luxburg, "A tutorial on spectral clustering," Stat. Comput., vol. 17, no. 4, pp. 395-416, 2007.
23. D. Cvetković and I. Gutman, "Applications of graph spectra: An introduction to the literature," Zbornik radova, vol. 14, no. 22, pp. 9-34, 2011.
24. R. R. Coifman and M. Maggioni, "Diffusion wavelets," Appl. Comput. Harmon. Anal., vol. 21, no. 1, pp. 53-94, 2006. (Pubitemid 43947621)
25. X. Zhu and M. Rabbat, "Approximating signals supported on graphs," in Proc. IEEE Int. Conf. Acc., Speech, and Signal Process., Kyoto, Japan, Mar. 2012, pp. 3921-3924.
26. X. Zhu and M. Rabbat, "Graph spectral compressed sensing for sensor networks," in Proc. IEEE Int. Conf. Acc., Speech, and Signal Process., Kyoto, Japan, Mar. 2012, pp. 2865-2868.
27. D. Gleich. The MatlabBGL Matlab Library [Online]. Available: http://www.cs.purdue.edu/homes/dgleich/packages/matlab-bgl/index.html
28. S. Bougleux, A. Elmoataz, and M. Melkemi, "Discrete regularization on weighted graphs for image and mesh filtering," in Scale Space Var. Methods Comp. Vision (Lect. Notes Comp. Sci., vol. 4485), F. Sgallari, A. Murli, and N. Paragios, Eds. Berlin, Germany: Springer, 2007, pp. 128-139. (Pubitemid 350269790)
29. A. Elmoataz, O. Lezoray, and S. Bougleux, "Nonlocal discrete regularization on weighted graphs: A framework for image and manifold processing," IEEE Trans. Image Process., vol. 17, pp. 1047-1060, July 2008.
30. S. Osher and J. Shen, "Digitized PDE method for data restoration," in Handbook of Analytic-Computational Methods in Applied Mathematics, G. Anastas-siou, Ed. Boca Raton, FL: Chapman and Hall/CRC Press, 2000, pp. 751-771.
31. M. Belkin and P. Niyogi, "Towards a theoretical foundation for Laplacian-based manifold methods," J. Comp. Syst. Sci., vol. 74, no. 8, pp. 1289-1308, 2008.
32. M. Hein, J.-Y. Audibert, and U. von Luxburg, "From graphs to manifolds: Weak and strong pointwise consistency of graph Laplacians," in Learning Theory (Lect. Notes Comp. Sci., vol. 3559), P. Auer and R. Meir, Eds. Berlin/Heidelberg, Germany: Springer, 2005, pp. 470-485.
33. A. Singer, "From graph to manifold Laplacian: The convergence rate," Appl. Comput. Harmon. Anal., vol. 21, no. 1, pp. 128-134, July 2006. (Pubitemid 43947616)
34. D. Ting, L. Huang, and M. I. Jordan, "An analysis of the convergence of graph Laplacians," in Proc. Int. Conf. Mach. Learn., Haifa, Israel, June 2010, pp. 1079-1086.
35. R. A. Horn and C. R. Johnson, Matrix Analysis. Cambridge, MA: Cambridge Univ. Press, 1990.
36. T. Biyikoǧlu, J. Leydold, and P. F. Stadler, "Chapter 1: Introduction," Laplacian Eigenvectors of Graphs (Lect. Notes in Math., vol. 1915). Berlin, Germany: Springer, 2007.
37. S. K. Narang and A. Ortega, "Perfect reconstruction two-channel wavelet filter-banks for graph structured data," IEEE. Trans. Signal Process., vol. 60, pp. 2786-2799, June 2012.
38. N. J. Higham, "Chapter 1: Theory of Matrix Functions," Functions of Matrices. Soc. for Industrial and Appl. Mathematics, 2008, pp. 1-29.
39. A. Buades, B. Coll, and J. Morel, "A review of image denoising algorithms, with a new one," SIAM J. Multiscale Model. Simul., vol. 4, no. 2, pp. 490-530, 2005. (Pubitemid 43890582)
40. D. I Shuman, P. Vandergheynst, and P. Frossard, "Chebyshev polynomial approximation for distributed signal processing," in Proc. Int. Conf. Distr. Comput. Sensor Syst., Barcelona, Spain, June 2011, pp. 1-8.
41. D. K. Hammond, P. Vandergheynst, and R. Gribonval, "Wavelets on graphs via spectral graph theory," Appl. Comput. Harmon. Anal., vol. 30, no. 2, pp. 129-150, Mar. 2011.
42. D. I Shuman, B. Ricaud, and P. Vandergheynst, "A windowed graph Fourier transform," in Proc. IEEE Stat. Signal Process. Workshop, Ann Arbor, MI, Aug. 2012, pp. 133-136.
43. R. R. Coifman, S. Lafon, A. B. Lee, M. Maggioni, B. Nadler, F. Warner, and S. W. Zucker, "Geometric diffusions as a tool for harmonic analysis and structure definition of data: Diffusion maps," Proc. Natl. Acad. Sci., vol. 102, no. 21, pp. 7426-7431, May 2005. (Pubitemid 40740988)
44. M. Maggioni, J. C. Bremer, R. R. Coifman, and A. D. Szlam, "Biorthogonal diffusion wavelets for multiscale representations on manifolds and graphs," in Proc. SPIE Wavelet XI, Sep. 2005, vol. 5914, pp. 59141M1-59141M13.
45. J. C. Bremer, R. R. Coifman, M. Maggioni, and A. D. Szlam, "Diffusion wavelet packets," Appl. Comput. Harmon. Anal., vol. 21, no. 1, pp. 95-112, 2006. (Pubitemid 43947620)
46. S. Lafon and A. B. Lee, "Diffusion maps and coarse-graining: A unified framework for dimensionality reduction, graph partitioning, and data set parameterization," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 9, pp. 1393-1403, Sept. 2006. (Pubitemid 44132647)
47. D. Ron, I. Safro, and A. Brandt, "Relaxation-based coarsening and multiscale graph organization," Multiscale Model. Simul., vol. 9, no. 1, pp. 407-423, Sept. 2011.
48. S. T. Barnard and H. D. Simon, "Fast multilevel implementation of recursive spectral bisection for partitioning unstructured problems," Concurrency: Practice Experience, vol. 6, no. 2, pp. 101-117, Apr. 1994.
49. S. K. Narang and A. Ortega, "Lifting based wavelet transforms on graphs," in Proc. APSIPA ASC, Sapporo, Japan, Oct. 2009, pp. 441-444.
50. C. Walshaw. The Graph Partitioning Archive [Online]. Available: http://staffweb.cms.gre.ac.uk/~wc06/partition/
51. B. Aspvall and J. R. Gilbert, "Graph coloring using eigenvalue decomposition," SIAM J. Alg. Disc. Meth., vol. 5, no. 4, pp. 526-538, 1984.
52. I. Pesenson, "Sampling in Paley-Wiener spaces on combinatorial graphs," Trans. Amer. Math. Soc, vol. 360, no. 10, pp. 5603-5627, 2008.
53. M. Crovella and E. Kolaczyk, "Graph wavelets for spatial traffic analysis," in Proc. IEEE INFOCOM, Mar. 2003, vol. 3, pp. 1848-1857.
54. A. D. Szlam, M. Maggioni, R. R. Coifman, and J. C. Bremer, Jr., "Diffusion-driven multiscale analysis on manifolds and graphs: Top-down and bottom-up constructions," in Proc. SPIE Wavelets, Aug. 2005, vol. 5914, pp. 445-455.
55. W. Wang and K. Ramchandran, "Random multiresolution representations for arbitrary sensor network graphs," in Proc. IEEE Int. Conf. Acc., Speech, and Signal Process., May 2006, vol. 4, pp. 161-164.
56. M. Jansen, G. P. Nason, and B. W. Silverman, "Multiscale methods for data on graphs and irregular multidimensional situations," J. R. Stat. Soc. Ser. B Stat. Methodol., vol. 71, no. 1, pp. 97-125, 2009.
57. M. Gavish, B. Nadler, and R. R. Coifman, "Multiscale wavelets on trees, graphs and high dimensional data: Theory and applications to semi supervised learning," in Proc. Int. Conf. Mach. Learn., Haifa, Israel, June 2010, pp. 367-374.
58. S. K. Narang and A. Ortega, "Local two-channel critically sampled filter-banks on graphs," in Proc. Int. Conf. Image Process., Hong Kong, Sept. 2010, pp. 333-336.
59. M. Vetterli and J. Kovačević, Wavelets and Subband Coding. Englewood Cliffs, NJ: Prentice Hall, 1995.
60. A. Agaskar and Y. M. Lu, "Uncertainty principles for signals defined on graphs: Bounds and characterizations," in Proc. IEEE Int. Conf. Acc., Speech, and Signal Process., Kyoto, Japan, Mar. 2012, pp. 3493-3496.
61. R. Wagner, V. Delouille, and R. Baraniuk, "Distributed wavelet de-noising for sensor networks," in Proc. IEEE Int. Conf. Dec. and Contr., San Diego, CA, Dec. 2006, pp. 373-379. (Pubitemid 351283874)
62. G. Shen and A. Ortega, "Transform-based distributed data gathering," IEEE. Trans. Signal Process., vol. 58, no. 7, pp. 3802-3815, July 2010.
63. W. Sweldens, "The lifting scheme: A construction of second generation wavelets," SIAM J. Math. Anal., vol. 29, no. 2, pp. 511-546, 1998.
64. D. J. Klein and M. Randić, "Resistance distance," J. Math. Chem., vol. 12, no. 1, pp. 81-95, 1993.
65. D. L. Donoho, "Unconditional bases are optimal bases for data compression and for statistical estimation," Appl. Comput. Harmon. Anal., vol. 1, no. 1, pp. 100-115, Dec. 1993.
66. F. Chung, "Laplacians and the Cheeger inequality for directed graphs," Ann. Combinatorics, vol. 9, no. 1, pp. 1-19, 2005. (Pubitemid 40550406)
67. J. D. Lee and M. Maggioni, "Multiscale analysis of time series of graphs," in Proc. Int. Conf. Samp. Theory and Appl., Singapore, May 2011.