Convolutional neural networks on graphs with fast localized spectral filtering

Advances in Neural Information Processing Systems

Volumn , Issue , 2016, Pages 3844-3852

  Defferrard, Michaël ^a   Bresson, Xavier ^a   Vandergheynst, Pierre ^a  

^a EPFL   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

CONVOLUTION; GRAPH THEORY; GRAPHIC METHODS; NEURAL NETWORKS;

COMPOSITIONAL FEATURES; CONVOLUTIONAL NEURAL NETWORK; EFFICIENT NUMERICAL SCHEMES; HIGH-DIMENSIONAL; IRREGULAR DOMAINS; LEARNING COMPLEXITY; SPECTRAL FILTERING; SPECTRAL GRAPH THEORY;

COMPLEX NETWORKS;

EID: 85019257780     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (34)

1. Martín Abadi et al. TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems. 2016.
2. M. Bawa, T. Condie, and P. Ganesan. LSH Forest: Self-Tuning Indexes for Similarity Search. In International Conference on World Wide Web, pages 651-660, 2005.
3. M. Belkin and P. Niyogi. Towards a Theoretical Foundation for Laplacian-based Manifold Methods. Journal of Computer and System Sciences, 74(8): 1289-1308, 2008.
4. J. Bruna, W. Zaremba, A. Szlam, and Y. LeCun. Spectral Networks and Deep Locally Connected Networks on Graphs. arXiv: 1312.6203, 2013.
5. T.N. Bui and C. Jones. Finding Good Approximate Vertex and Edge Partitions is NP-hard. Information Processing Letters, 42(3): 153-159, 1992.
6. F. R. K. Chung. Spectral Graph Theory, Volume 92. American Mathematical Society, 1997.
7. A. Coates and A.Y. Ng. Selecting Receptive Fields in Deep Networks. In Neural Information Processing Systems (NIPS), pages 2528-2536, 2011.
8. R.R. Coifman and S. Lafon. Diffusion Maps. Applied and Computational Harmonic Analysis, 21(1): 5-30, 2006.
9. I. Dhillon, Y. Guan, and B. Kulis. Weighted Graph Cuts Without Eigenvectors: A Multilevel Approach. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 29(11): 1944-1957, 2007.
10. M. Gavish, B. Nadler, and R. Coifman. Multiscale Wavelets on Trees, Graphs and High Dimensional Data: Theory and Applications to Semi Supervised Learning. In International Conference on Machine Learning (ICML), pages 367-374, 2010.
11. K. Gregor and Y. LeCun. Emergence of Complex-like Cells in a Temporal Product Network with Local Receptive Fields. In arXiv: 1006.0448, 2010.
12. D. Hammond, P. Vandergheynst, and R. Gribonval. Wavelets on Graphs via Spectral Graph Theory. Applied and Computational Harmonic Analysis, 30(2): 129-150, 2011.
13. M. Henaff, J. Bruna, and Y. LeCun. Deep Convolutional Networks on Graph-Structured Data. arXiv: 1506.05163, 2015.
14. Max Jaderberg, Karen Simonyan, Andrew Zisserman, et al. Spatial transformer networks. In Advances in Neural Information Processing Systems, pages 2017-2025, 2015.
15. T. Joachims. A Probabilistic Analysis of the Rocchio Algorithm with TFIDF for Text Categorization. Carnegie Mellon University, Computer Science Technical Report, CMU-CS-96-118, 1996.
16. G. Karypis and V. Kumar. A Fast and High Quality Multilevel Scheme for Partitioning Irregular Graphs. SIAM Journal on Scientific Computing (SISC), 20(1): 359-392, 1998.
17. D. Kingma and J. Ba. Adam: A Method for Stochastic Optimization. arXiv: 1412.6980, 2014.
18. Y. LeCun, Y. Bengio, and G. Hinton. Deep Learning. Nature, 521(7553): 436-444, 2015.
19. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradient-Based Learning Applied to Document Recognition. In Proceedings of the IEEE, 86(11), pages 2278-2324, 1998.
20. Yujia Li, Daniel Tarlow, Marc Brockschmidt, and Richard Zemel. Gated Graph Sequence Neural Networks.
21. U. Von Luxburg. A Tutorial on Spectral Clustering. Statistics and Computing, 17(4): 395-416, 2007.
22. S. Mallat. A Wavelet Tour of Signal Processing. Academic press, 1999.
23. Jonathan Masci, Davide Boscaini, Michael Bronstein, and Pierre Vandergheynst. Geodesic convolutional neural networks on riemannian manifolds. In Proceedings of the IEEE International Conference on Computer Vision Workshops, pages 37-45, 2015.
24. T. Mikolov, K. Chen, G. Corrado, and J. Dean. Estimation of Word Representations in Vector Space. In International Conference on Learning Representations, 2013.
25. B. Pasdeloup, R. Alami, V. Gripon, and M. Rabbat. Toward an Uncertainty Principle for Weighted Graphs. In Signal Processing Conference (EUSIPCO), pages 1496-1500, 2015.
26. N. Perraudin, B. Ricaud, D. Shuman, and P. Vandergheynst. Global and Local Uncertainty Principles for Signals on Graphs. arXiv: 1603.03030, 2016.
27. I. Ram, M. Elad, and I. Cohen. Generalized Tree-based Wavelet Transform. IEEE Transactions on Signal Processing, 59(9): 4199-4209, 2011.
28. D. Ron, I. Safro, and A. Brandt. Relaxation-based Coarsening and Multiscale Graph Organization. SIAM Iournal on Multiscale Modeling and Simulation, 9: 407-423, 2011.
29. F. Scarselli, M. Gori, A. C. Tsoi, M. Hagenbuchner, and G. Monfardini. The Graph Neural Network Model. 20(1): 61-80.
30. J. Shi and J. Malik. Normalized Cuts and Image Segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 22(8): 888-905, 2000.
31. D. Shuman, S. Narang, P. Frossard, A. Ortega, and P. Vandergheynst. The Emerging Field of Signal Processing on Graphs: Extending High-Dimensional Data Analysis to Networks and other Irregular Domains. IEEE Signal Processing Magazine, 30(3): 83-98, 2013.
32. D.I. Shuman, M.J. Faraji, and P. Vandergheynst. A Multiscale Pyramid Transform for Graph Signals. IEEE Transactions on Signal Processing, 64(8): 2119-2134, 2016.
33. A. Susnjara, N. Perraudin, D. Kressner, and P. Vandergheynst. Accelerated Filtering on Graphs using Lanczos Method. preprint arXiv: 1509.04537, 2015.
34. M. Tsitsvero and S. Barbarossa. On the Degrees of Freedom of Signals on Graphs. In Signal Processing Conference (EUSIPCO), pages 1506-1510, 2015.