Geometric Deep Learning: Going beyond Euclidean data

IEEE Signal Processing Magazine

Volumn 34, Issue 4, 2017, Pages 18-42

  Bronstein, Michael M ^a   Bruna, Joan ^b   Lecun, Yann ^c   Szlam, Arthur ^d   Vandergheynst, Pierre ^e  

^a UNIVERSITY OF LUGANO   (Switzerland)

^b NEW YORK UNIVERSITY   (United States)

^c FACEBOOK AI RESEARCH   (United States)

^d EPFL   (Switzerland)

^e UNIVERSITÉ CATHOLIQUE DE LOUVAIN   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

BRAIN MAPPING; COMPLEX NETWORKS; COMPUTER GRAPHICS; COMPUTER NETWORKS; DEEP LEARNING; EDUCATION; LEARNING SYSTEMS; NEUROIMAGING; SENSOR NETWORKS; SOCIAL NETWORKING (ONLINE); STRUCTURES (BUILT OBJECTS);

AUDIO ANALYSIS; COMPUTATIONAL SOCIAL SCIENCE; FUNCTIONAL NETWORK; GEOMETRIC DATA; MACHINE LEARNING TECHNIQUES; NATURAL TARGETS; REGULATORY NETWORK; SCIENTIFIC FIELDS;

DEEP NEURAL NETWORKS;

EID: 85032751403     PISSN: 10535888     EISSN: None     Source Type: Journal    
DOI: 10.1109/MSP.2017.2693418     Document Type: Review

References (122)

1. Y. LeCun, Y. Bengio, G. Hinton, "Deep learning," Nature, vol. 521, no. 7553, pp. 436-444, 2015.
2. T. Mikolov, A. Deoras, D. Povey, L. Burget, J. C ernockỳ, "Strategies for training large scale neural network language models," in Proc. 2011 IEEE Workshop Automatic Speech Recognition and Understanding, pp. 196-201.
3. G. Hinton, L. Deng, D. Yu, G. E. Dahl, A. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T. N. Sainath, "Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups," IEEE Signal Process. Mag., vol. 29, no. 6, pp. 82-97, 2012.
4. I. Sutskever, O. Vinyals, Q. V. Le, "Sequence to sequence learning with neural networks," in Proc. Int. Conf. Neural Information Processing Systems (NIPS), 2014, pp. 3104-3112.
5. Y. LeCun, K. Kavukcuoglu, C. Farabet, "Convolutional networks and applications in vision," in Proc. IEEE Int. Symp. Circuits and Systems, 2010, pp. 253-256.
6. D. Ciresan, U. Meier, J. Masci, J. Schmidhuber, "A committee of neural networks for traffic sign classification," in Proc. Int. Joint Conf. Neural Networks (IJCNN), 2011, pp. 253-256.
7. A. Krizhevsky, I. Sutskever, G. Hinton, "Imagenet classification with deep convolutional neural networks," in Proc. Int. Conf. Neural Information Processing Systems (NIPS), 2012, pp. 1097-1105.
8. C. Farabet, C. Couprie, L. Najman, Y. LeCun, "Learning hierarchical features for scene labeling," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 8, pp. 1915-1929, 2013.
9. Y. Taigman, M. Yang, M. Ranzato, L. Wolf, "Deepface: Closing the gap to human-level performance in face verification," in Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2014, pp. 1701-1708.
10. K. Simonyan and A. Zisserman. (2014). Very deep convolutional networks for large-scale image recognition. [Online]. Available: Https://arXiv:1409.1556
11. K. He, X. Zhang, S. Ren, J. Sun. (2015). Deep residual learning for image recognition. [Online]. Available: Https://arXiv:1512.03385
12. L. Deng and D. Yu, "Deep learning: Methods and applications," Foundations and Trends in Signal Processing, vol. 7, no. 3-4, pp. 197-387, 2014.
13. I. Goodfellow, Y. Bengio, A. Courville, Deep Learning. Cambridge, MA: MIT Press, 2016.
14. E. P. Simoncelli and B. A. Olshausen, "Natural image statistics and neural representation," Ann. Rev. Neuroscience, vol. 24, no. 1, pp. 1193-1216, 2001.
15. D. J. Field, "What the statistics of natural images tell us about visual coding," in Proc. SPIE-Int. Society for Optical Engineering, vol. 1077, p. 269, 1989.
16. P. Mehta and D. J. Schwab. (2014). An exact mapping between the variational renormalization group and deep learning. [Online]. Available: Https://arXiv:1410.3831
17. S. Mallat, "Group invariant scattering," Commun. Pure and Appl. Math., vol. 65, no. 10, pp. 1331-1398, 2012.
18. J. Bruna and S. Mallat, "Invariant scattering convolution networks," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 8, pp. 1872-1886, 2013.
19. M. Tygert, J. Bruna, S. Chintala, Y. LeCun, S. Piantino, A. Szlam, "A mathematical motivation for complex-valued convolutional networks," Neural Computation, vol. 28, no. 5, pp. 815-825, 2016.
20. Y. LeCun, B. Boser, J. S. Denker, D. Henderson, R. E. Howard, W. Hubbard, L. D. Jackel, "Backpropagation applied to handwritten ZIP code recognition," Neural Computation, vol. 1, no. 4, pp. 541-551, 1989.
21. I. J. Goodfellow, D. Warde-Farley, M. Mirza, A. Courville, Y. Bengio. (2013). Maxout networks. [Online]. Available: Https://arXiv:1302.4389
22. D. Lazer, A. Pentland, L. Adamic, S. Aral, A. L. Barabasi, D. Brewer, N. Christakis, N. Contractor, J. Fowler, M. Gutmann, T. Jebara, G. King, M. Macy, D. Roy, M. Van Alstyne, "Life in the network: The coming age of computational social science," Science, vol. 323, no. 5915, pp. 721-723, 2009.
23. E. H. Davidson, J. P. Rast, P. Oliveri, A. Ransick, C. Calestani, C. H. Yuh, T. Minokawa, G. Amore, V. Hinman, C. Arenas-Mena, O. Otim, C. T. Brown, C. B. Livi, P. Y. Lee, R. Revilla, A. G. Rust, Z. Pan, M. J. Schilstra, P. J. Clarke, M. I. Arnone, L. Rowen, R. A. Cameron, D. R. McClay, L. Hood, H. Bolouri, "A genomic regulatory network for development," Science, vol. 295, no. 5560, pp. 1669-1678, 2002.
24. M. B. Wakin, D. L. Donoho, H. Choi, R. G. Baraniuk, "The multiscale structure of non-differentiable image manifolds," in Proc. SPIE-Int. Society for Optical Engineering, vol. 5914, p. 59141B, 2005.
25. N. Verma, S. Kpotufe, S. Dasgupta, "Which spatial partition trees are adaptive to intrinsic dimension" in Proc. Uncertainty in Artificial Intelligence, 2009, pp. 565-574.
26. J. B. Tenenbaum, V. De Silva, J. C. Langford, "A global geometric framework for nonlinear dimensionality reduction," Science, vol. 290, no. 5500, pp. 2319-2323, 2000.
27. S. T. Roweis and L. K. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol. 290, no. 5500, pp. 2323-2326, 2000.
28. L. Maaten and G. Hinton, "Visualizing data using t-SNE," JMLR, vol. 9, pp. 2579-2605, 2008.
29. M. Belkin and P. Niyogi, "Laplacian eigenmaps for dimensionality reduction and data representation," Neural Computation, vol. 15, no. 6, pp. 1373-1396, 2003.
30. R. R. Coifman and S. Lafon, "Diffusion maps," Appl. Comput. Harmon. Anal., vol. 21, no. 1, pp. 5-30, 2006.
31. R. Hadsell, S. Chopra, Y. LeCun, "Dimensionality reduction by learning an invariant mapping," in Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2006, pp. 1735-1742.
32. B. Perozzi, R. Al-Rfou, S. Skiena, "DeepWalk: Online learning of social representations," in Proc. Int. Conf. Knowledge Discovery and Data Mining (KDD), 2014, pp. 701-710.
33. J. Tang, M. Qu, M. Wang, M. Zhang, J. Yan, Q. Mei, "LINE: Large-scale information network embedding," in Proc. Int. World Wide Web Conf. (WWW), 2015, pp. 1067-1077.
34. S. Cao, W. Lu, Q. Xu, "GraRep: Learning graph representations with global structural information," in Proc. Int. Conf. Information and Knowledge Management (CIKM), 2015, pp. 891-900.
35. T. Mikolov, K. Chen, G. Corrado, J. Dean. (2013). Efficient estimation of word representations in vector space. [Online]. Available: Https://arXiv:1301.3781
36. R. Milo, S. Shen-Orr, S. Itzkovitz, N. Kashtan, D. Chklovskii, U. Alon, "Network motifs: Simple building blocks of complex networks," Science, vol. 298, no. 5594, pp. 824-827, 2002.
37. N. Pržulj, "Biological network comparison using graphlet degree distribution," Bioinformatics, vol. 23, no. 2, pp. 177-183, 2007.
38. J. Sun, M. Ovsjanikov, L. J. Guibas, "A concise and provably informative multi-scale signature based on heat diffusion," Comput. Graph. Forum, vol. 28, no. 5, pp. 1383-1392, 2009.
39. R. Litman and A. M. Bronstein, "Learning spectral descriptors for deformable shape correspondence," IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 1, pp. 171-180, 2014.
40. S. Fortunato, "Community detection in graphs," Phys. Rep., vol. 486, no. 3, pp. 75-174, 2010.
41. T. Mikolov and J. Dean, "Distributed representations of words and phrases and their compositionality," in Proc. Int. Conf. Neural Information Processing Systems (NIPS), 2013, pp. 3111-3119.
42. E. Cho, S. A. Myers, J. Leskovec, "Friendship and mobility: User movement in location-based social networks," in Proc. Int. Conf. Knowledge Discovery and Data Mining (KDD), 2011, pp.1082-1090.
43. D. I. Shuman, S. K. Narang, P. Frossard, A. Ortega, P. Vandergheynst, "The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains," IEEE Signal Process. Mag., vol. 30, no. 3, pp. 83-98, 2013.
44. M. Henaff, J. Bruna, Y. LeCun. (2015). Deep convolutional networks on graph-structured data. [Online]. Available: Https://arXiv:1506.05163
45. M. Defferrard, X. Bresson, P. Vandergheynst, "Convolutional neural networks on graphs with fast localized spectral filtering," in Proc. Int. Conf. Neural Information Processing Systems (NIPS), 2016, pp. 3844-3852.
46. J. Atwood and D. Towsley. (2016). Diffusion-convolutional neural networks. [Online]. Available: Https://arXiv:1511.02136v2
47. J. Masci, D. Boscaini, M. M. Bronstein, P. Vandergheynst, "Geodesic convolutional neural networks on Riemannian manifolds," in Proc. Int. IEEE Workshop 3-D Representation and Recognition (3DRR), 2015, pp. 832-840.
48. D. Boscaini, J. Masci, E. Rodol and M. M. Bronstein, "Learning shape correspondence with anisotropic convolutional neural networks," in Proc. Int. Conf. Neural Information Processing Systems (NIPS), 2016, pp. 3189-3197.
49. M. Gori, G. Monfardini, F. Scarselli, "A new model for learning in graph domains," in Proc. Int. Joint Conf. Neural Networks (IJCNN), 2005, pp. 729-734.
50. Y. Li, D. Tarlow, M. Brockschmidt, R. Zemel. (2015). Gated graph sequence neural networks. [Online]. Available: Https://arXiv:1511.05493
51. S. Sukhbaatar, A. Szlam, R. Fergus. (2016). Learning multiagent communication with backpropagation. [Online]. Available: Https://arXiv:1605.07736
52. J. Bruna, W. Zaremba, A. Szlam, Y. LeCun. (2013). Spectral networks and locally connected networks on graphs. [Online.] Available: Https://arXiv.1312.6203
53. D. Boscaini, J. Masci, E. Rodol M. M. Bronstein, D. Cremers, "Anisotropic diffusion descriptors," Comput. Graph. Forum, vol. 35, no. 2, pp. 431-441, 2016.
54. F. Monti, D. Boscaini, J. Masci, E. Rodol J. Svoboda, M. M. Bronstein, (2017). Geometric deep learning on graphs and manifolds using mixture model CNNs. [Online.] Available: Https://arXiv.1611.08402
55. D. K. Duvenaud, D. Maclaurin, J. Iparraguirre, R. Bombarell, T. Hirzel, A. Aspuru-Guzik, R. P. Adams, "Convolutional networks on graphs for learning molecular fingerprints," in Proc. Int. Conf. Neural Information Processing Systems (NIPS), 2015, pp. 2224-2232.
56. F. Monti, X. Bresson, M. M. Bronstein. (2017). Geometric matrix completion with recurrent multi-graph neural networks. [Online]. Available: Https://arXiv.1704.06803
57. S. Mallat, "Understanding deep convolutional networks," Philos. Trans. R. Soc. London A, Math. Phys. Sci., vol. 374, no. 2065, 2016. doi: 10.1098/rsta.2015.0207.
58. P. F. Felzenszwalb, R. B. Girshick, D. McAllester, D. Ramanan, "Object detection with discriminatively trained part-based models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 9, pp. 1627-1645, 2010.
59. A. Dosovitskiy, P. Fischery, E. Ilg, P. Hausser, C. Hazirbas, V. Golkov, P. van der Smagt, D. Cremers, T. Brox "Flownet: Learning optical flow with convolutional networks," in Proc. 2015 Int. Conf. Computer Vision, 2015, pp. 2758-2766.
60. J. T. Springenberg, A. Dosovitskiy, T. Brox, M. Riedmiller. (2014). Striving for simplicity: The all convolutional net. [Online]. Available: Https://arXiv:1412.6806
61. S. Mallat, A Wavelet Tour of Signal Processing. New York: Academic, 1999.
62. A. Choromanska, M. Henaff, M. Mathieu, G. B. Arous, Y. LeCun, "The loss surfaces of multilayer networks," in Proc. 18th Int. Conf. Artificial Intelligence and Statistics (AISTATS), 2015, pp. 192-204.
63. I. Safran and O. Shamir. (2015). On the quality of the initial basin in overspecified neural networks. [Online]. Available: Https://arXiv:1511.04210
64. K. Kawaguchi, "Deep learning without poor local minima," in Proc. Int. Conf. Neural Information Processing Systems (NIPS), 2016, pp. 586-594.
65. T. Chen, I. Goodfellow, J. Shlens. (2015). Net2net: Accelerating learning via knowledge transfer. [Online]. Available: Https://arXiv:1511.05641
66. C. D. Freeman and J. Bruna. (2017). Topology and geometry of half-rectified network optimization. [Online]. Available: Https://arXiv.1611.01540
67. J. Nash, "The imbedding problem for Riemannian manifolds," Ann. Math., vol. 63, no. 1, pp. 20-63, 1956.
68. M. Wardetzky, S. Mathur, F. Kberer, E. Grinspun, "Discrete Laplace operators: No free lunch," in Proc. 5th Eurographics Symp. Geometry Processing (SGP), 2007, pp. 33-37.
69. M. Wardetzky, "Convergence of the cotangent formula: An overview," in Discrete Differential Geometry. Cambridge, MA: Birkhser, 2008, pp. 275-286.
70. U. Pinkall and K. Polthier, "Computing discrete minimal surfaces and their conjugates," Exp. Mathematics, vol. 2, no. 1, pp. 15-36, 1993.
71. S. Rosenberg, The Laplacian on a Riemannian Manifold: An Introduction to Analysis on Manifolds. Cambridge, U.K.: Cambridge Univ. Press, 1997.
72. L.-H. Lim. (2015). Hodge Laplacians on graphs. [Online]. Available: Https://arXiv:1507.05379
73. U. Von Luxburg, "A tutorial on spectral clustering," Statistics and Computing, vol. 17, no. 4, pp. 395-416, 2007.
74. A. Kovnatsky, M. M. Bronstein, A. M. Bronstein, K. Glashoff, R. Kimmel, "Coupled quasi-harmonic bases," Comput. Graph. Forum, vol. 32, no. 2, pp. 439-448, 2013.
75. D. Eynard, A. Kovnatsky, M. M. Bronstein, K. Glashoff, A. M. Bronstein, "Multimodal manifold analysis by simultaneous diagonalization of Laplacians," IEEE Trans. Pattern Anal. Mach. Intell., vol. 37, no. 12, pp. 2505-2517, 2015.
76. N. L. Roux, Y. Bengio, P. Lamblin, M. Joliveau, B. Kl, "Learning the 2-d topology of images," in Proc. Int. Conf. Neural Information Processing Systems (NIPS), 2008, pp. 841-848.
77. T. N. Kipf and M. Welling. (2016). Semi-supervised classification with graph convolutional networks. [Online]. Available: Https://arXiv:1609.02907
78. F. Scarselli, M. Gori, A. C. Tsoi, M. Hagenbuchner, G. Monfardini, "The graph neural network model," IEEE Trans. Neural Netw., vol. 20, no. 1, pp. 61-80, 2009.
79. M. B. Chang, T. Ullman, A. Torralba, J. B. Tenenbaum. (2016). A compositional object-based approach to learning physical dynamics. [Online]. Available: Https://arXiv:1612.00341
80. P. Battaglia, R. Pascanu, M. Lai, D. Jimenez Rezende, K. Kavukcuoglu, "Interaction networks for learning about objects, relations and physics," in Proc. Int. Conf. Neural Information Processing Systems (NIPS), 2016, pp. 4502-4510.
81. A. Coates and A. Y. Ng, "Selecting receptive fields in deep networks," in Proc. Int. Conf. Neural Information Processing Systems (NIPS), 2011, pp. 2528-2536.
82. M. Andreux, E. Rodol M. Aubry, D. Cremers, "Anisotropic Laplace-Beltrami operators for shape analysis," in Proc. 6th Workshop Non-Rigid Shape Analysis and Deformable Image Alignment (NORDIA), 2014, pp. 299-312.
83. D. I. Shuman, B. Ricaud, P. Vandergheynst, "Vertex-frequency analysis on graphs," Appl. Comput. Harmon. Anal., vol. 40, no. 2, pp. 260-291, 2016.
84. R. R. Coifman and M. Maggioni, "Diffusion wavelets," Appl. Comput. Harmonic Anal., vol. 21, no. 1, pp. 53-94, 2006.
85. A. D. Szlam, M. Maggioni, R. R. Coifman, J. C. Bremer, Jr., "Diffusiondriven multiscale analysis on manifolds and graphs: Top-down and bottom-up constructions," Proc. SPIE-Int. Society for Optical Engineering, vol. 5914, p. 59141D, 2005.
86. M. Gavish, B. Nadler, R. R. Coifman, "Multiscale wavelets on trees, graphs and high dimensional data: Theory and applications to semi supervised learning," in Proc. 27th Int. Conf. Machine Learning (ICML-10), 2010, pp. 367-374.
87. R. Rustamov and L. J. Guibas, "Wavelets on graphs via deep learning," in Proc. Int. Conf. Neural Information Processing Systems (NIPS), 2013, pp. 998-1006.
88. X. Cheng, X. Chen, S. Mallat, "Deep Haar scattering networks," Information and Inference, vol. 5, pp. 105-133, 2016.
89. D. Boscaini, J. Masci, S. Melzi, M. M. Bronstein, U. Castellani, P. Vandergheynst, "Learning class-specific descriptors for deformable shapes using localized spectral convolutional networks," Comput. Graph. Forum, vol. 34, no. 5, pp. 13-23, 2015.
90. P. Sen, G. Namata, M. Bilgic, L. Getoor, B. Galligher, T. Eliassi-Rad, "Collective classification in network data," AI Mag., vol. 29, no. 3, p. 93, 2008.
91. K. Gregor and Y. LeCun, "Learning fast approximations of sparse coding," in Proc. 27th Int. Conf. Machine Learning (ICML-10), 2010, pp. 399-406.
92. E. Cand and B. Recht, "Exact matrix completion via convex optimization," Commun. ACM, vol. 55, no. 6, pp. 111-119, 2012.
93. Y. Koren, R. Bell, C. Volinsky, "Matrix factorization techniques for recommender systems," Computer, vol. 42, no. 8, pp. 30-37, 2009.
94. H. Ma, D. Zhou, C. Liu, M. Lyu, I. King, "Recommender systems with social regularization," in Proc. Web Search and Data Mining, 2011, pp. 287-296.
95. V. Kalofolias, X. Bresson, M. Bronstein, P. Vandergheynst. (2014). Matrix completion on graphs. [Online]. Available: Https://arXiv:1408.1717
96. N. Rao, H.-F. Yu, P. K. Ravikumar, I. S. Dhillon, "Collaborative filtering with graph information: Consistency and scalable methods," in Proc. Int. Conf. Neural Information Processing Systems (NIPS), 2015, pp. 2107-2115.
97. D. Kuang, Z. Shi, S. Osher, A. Bertozzi. (2016). A harmonic extension approach for collaborative ranking. [Online]. Available: Https://arXiv:1602.05127
98. H. Su, S. Maji, E. Kalogerakis, E. Learned-Miller, "Multi-view convolutional neural networks for 3D shape recognition," in Proc. Int. Conf. Computer Vision (ICCV), 2015, pp. 945-953.
99. L. Wei, Q. Huang, D. Ceylan, E. Vouga, H. Li, "Dense human body correspondences using convolutional networks," in Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2016, pp. 1544-1553.
100. Z. Wu, S. Song, A. Khosla, F. Yu, L. Zhang, X. Tang, J. Xiao, "3D shapenets: A deep representation for volumetric shapes," in Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2015, pp. 1912-1920.
101. C. R. Qi, H. Su, M. Niessner, A. Dai, M. Yan, L. J. Guibas, "Volumetric and multi-view CNNs for object classification on 3D data," in Proc. 2016 IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2016, pp. 5648-5656.
102. A. M. Bronstein, M. M. Bronstein, R. Kimmel, "Generalized multidimensional scaling: A framework for isometry-invariant partial surface matching," Proc. Natl. Acad. Sci. U.S.A., vol. 103, no. 5, pp. 1168-1172, 2006.
103. M. M. Bronstein and I. Kokkinos, "Scale-invariant heat kernel signatures for non-rigid shape recognition," in Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2010, pp. 1704-1711.
104. V. Kim, Y. Lipman, T. Funkhouser, "Blended intrinsic maps," ACM Trans. Graph., vol. 30, no. 4, p. 79, 2011.
105. A. M. Bronstein, M. M. Bronstein, L. J. Guibas, M. Ovsjanikov, "ShapeGoogle: Geometric words and expressions for invariant shape retrieval," ACM Trans. Graph., vol. 30, no. 1, p. 1, 2011.
106. M. Ovsjanikov, M. Ben-Chen, J. Solomon, A. Butscher, L. J. Guibas, "Functional maps: A flexible representation of maps between shapes," ACM Trans. Graph., vol. 31, no. 4, p. 30, 2012.
107. S. Biasotti, A. Cerri, A. M. Bronstein, M. M. Bronstein, "Recent trends, applications, perspectives in 3D shape similarity assessment," Comput. Graph. Forum, vol. 35, no. 6, pp. 87-119, 2016.
108. E. Rodol S. Rota Bulo, T. Windheuser, M. Vestner, D. Cremers, "Dense non-rigid shape correspondence using random forests," in Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2014, pp. 4177-4184.
109. O. Litany, E. Rodol, A. M. Bronstein, M. M. Bronstein. (2017). Deep functional maps: Structured prediction for dense shape correspondence. [Online]. Available: Https://arXiv.1704.08686
110. F. Tombari, S. Salti, L. D Stefano, "Unique signatures of histograms for local surface description," in Proc. European Conf. Computer Vision (ECCV), 2010, pp. 356-369.
111. P. W. Battaglia, R. Pascanu, M. Lai, D. J. Rezende, K. Kavukcuoglu, "Interaction networks for learning about objects, relations and physics," in Proc. Advances in Neural Information Processing Systems (NIPS), 2016, pp. 4502-4510.
112. M. B. Chang, T. Ullman, A. Torralba, J. B. Tenenbaum. (2016). A compositional object-based approach to learning physical dynamics. [Online]. Available: Https://arXiv.1612.00341
113. H. L. Morgan, "The generation of a unique machine description for chemical structure," J. Chem. Documentation, vol. 5, no. 2, pp. 107-113, 1965.
114. R. C. Glem, A. Bender, C. H. Arnby, L. Carlsson, S. Boyer, J. Smith, "The generation of a unique machine description for chemical structure," Investigational Drugs, vol. 9, no. 3, pp. 199-204, 2006.
115. D. Rogers and M. Hahn, "Extended-connectivity fingerprints," J. Chem. Inform., Modeling, vol. 50, no. 5, pp. 742-754, 2010.
116. M. G. Preti, T. A. Bolton, D. Van De Ville. (2016). The dynamic functional connectome: State-of-the-art and perspectives,. Science. [Online] http://www .sciencedirect.com/science/article/pii/S1053811916307881
117. S. I. Ktena, S. Parisot, E. Ferrante, M. Rajchl, M. Lee, B. Glocker, D. Rueckert. (2017). Distance metric learning using graph convolutional networks: Application to functional brain networks. [Online]. Available: Https://arXiv:1703.02161
118. L. Yi, H. Su, X. Guo, L. J. Guibas. (2017). SyncSpecCNN: Synchronized spectral CNN for 3D shape segmentation. [Online]. Available: Https://arXiv.1612.00606
119. M. Jaderberg, K. Simonyan, A. Zisserman, K. Kavukcuoglu, "Spatial transformer networks," in Proc. Int. Conf. Neural Information Processing Systems (NIPS), 2015, pp. 2017-2025.
120. A. Dosovitskiy, J. Springenberg, M. Tatarchenko, T. Brox, "Learning to generate chairs, tables and cars with convolutional networks," in Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2015, pp. 1538-1546.
121. S. Dieleman, H. Zen, K. Simonyan, O. Vinyals, A. Graves, N. Kalchbrenner, A. Senior, K. Kavukcuoglu. (2016). Wavenet: A generative model for raw audio. [Online]. Available: Https://arXiv:1609.03499
122. D. Boscaini, D. Eynard, D. Kourounis, M. M. Bronstein, "Shape-fromoperator: Recovering shapes from intrinsic operators," Comput. Graph. Forum, vol. 34, no. 2, pp. 265-274, 2015.