Multimodal Manifold Analysis by Simultaneous Diagonalization of Laplacians

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 37, Issue 12, 2015, Pages 2505-2517

  Eynard, Davide ^a   Kovnatsky, Artiom ^a   Bronstein, Michael M ^a,b   Glashoff, Klaus ^a   Bronstein, Alexander M ^b,c  

^a UNIVERSITY OF LUGANO   (Switzerland)

^b INTEL CORPORATION   (Israel)

^c TEL AVIV UNIVERSITY   (Israel)

Author keywords

diffusion distances; dimensionality reduction; Joint diagonalization; Laplace Beltrami operator; manifold alignment; manifold learning; multimodal clustering; multimodal data

Indexed keywords

CLUSTERING ALGORITHMS; DIFFUSION; GEOMETRY; LAPLACE TRANSFORMS;

DIFFUSION DISTANCE; DIMENSIONALITY REDUCTION; JOINT DIAGONALIZATION; LAPLACE-BELTRAMI OPERATOR; MANIFOLD ALIGNMENTS; MANIFOLD LEARNING; MULTI-MODAL; MULTI-MODAL DATA;

MODAL ANALYSIS;

EID: 84939541806     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2015.2408348     Document Type: Article

References (52)

1. A. Y. Ng, M. I. Jordan, and Y. Weiss, "On spectral clustering: Analysis and an algorithm," in Proc. Neural Inf. Process. Syst.s, 2001.
2. M. Belkin and P. Niyogi, "Laplacian eigenmaps for dimensionality reduction and data representation," Neural Comput., vol. 15, pp. 1373-1396, 2002.
3. R. Coifman and S. Lafon, "Diffusion maps," Appl. Comput. Harmonic Anal., vol. 21, pp. 5-30, 2006.
4. R. R. Coifman, S. Lafon, A. B. Lee, M. Maggioni, B. Nadler, F. Warner, and S. W. Zucker, "Geometric diffusions as a tool for harmonic analysis and structure definition of data: Diffusion maps," PNAS, vol. 102, no. 21, pp. 7426-7431, 2005.
5. C. Ding, X. He, H. Zha, M. Gu, and H. Simon, "A min-max cut algorithm for graph partitioning and data clustering," in Proc. Conf. Data Mining, 2001.
6. Y. Weiss, A. Torralba, and R. Fergus, "Spectral hashing," in Proc. Neural Inf. Process. Syst., 2008.
7. J. Shi and J. Malik, "Normalized cuts and image segmentation," IEEE Trans. Pattern Anal. Mach. Intel., vol. 22, no. 8, pp. 888-905, Aug. 2000.
8. B. Levy, "Laplace-Beltrami eigenfunctions towards an algorithm that "understands" geometry," in Proc. Shape Model. Int., 2006.
9. G. Rong, Y. Cao, and X. Guo, "Spectral mesh deformation," Vis. Comput., vol. 24, no. 7, pp. 787-796, 2008.
10. M. Ovsjanikov, M. Ben-Chen, J. Solomon, A. Butscher, and L. Guibas, "Functional maps: A flexible representation of maps between shapes," ACM Trans. Graphics, vol. 31, no. 4, 2012.
11. A. Kovnatsky, M. M. Bronstein, A. M. Bronstein, K. Glashoff, and R. Kimmel, "Coupled quasi-harmonic bases," Comput. Graph. Forum, vol. 32, no. 2, pp. 439-448, 2013.
12. B. Nadler, S. Lafon, R. R. Coifman, and I. G. Kevrekidis, "Diffusion maps, spectral clustering and eigenfunctions of Fokker-Planck operators," in Proc. Neural Inf. Process. Syst., 2005.
13. J. Weston, S. Bengio, and N. Usunier, "Large scale image annotation: Learning to rank with joint word-image embeddings," Mach. Learn., vol. 81, no. 1, pp. 21-35, 2010.
14. N. Rasiwasia, J. Costa Pereira, E. Coviello, G. Doyle, G. Lanckriet, R. Levy, and N. Vasconcelos, "A new approach to cross-modal multimedia retrieval," in Proc. Int. Congr. Math., 2010.
15. B. McFee and G. R. G. Lanckriet, "Learning multi-modal similarity," J. Mach. Learn. Res., vol. 12, pp. 491-523, 2011.
16. E. Kidron, Y. Y. Schechner, and M. Elad, "Pixels that sound," in Proc. Comput. Vis. Pattern Recognit., 2005.
17. X. Alameda-Pineda, V. Khalidov, R. Horaud, and F. Forbes, "Finding audio-visual events in informal social gatherings," in Proc. Int. Conf. on Multimodal Interaction, 2011.
18. M. M. Bronstein, A. M. Bronstein, F. Michel, and N. Paragios, "Data fusion through cross-modality metric learning using similarity-sensitive hashing," in Proc. Comput. Vis. Pattern Recognit., 2010.
19. A. Bunse-Gerstner, R. Byers, and V. Mehrmann, "Numerical methods for simultaneous diagonalization," SIAM J. Matrix Anal. Appl., vol. 14, no. 4, pp. 927-949, 1993.
20. J.-F. Cardoso and A. Souloumiac, "Blind beamforming for non-Gaussian signals," Radar Signal Process., vol. 140, no. 6, pp. 362-370, 1993.
21. J. F. Cardoso and A. Souloumiac, "Jacobi angles for simultaneous diagonalization," SIAM J. Matrix Anal. Appl, vol. 17, pp. 161-164, 1996.
22. A. Yeredor, "Non-orthogonal joint diagonalization in the leastsquares sense with application in blind source separation," Trans. Signal Proc., vol. 50, no. 7, pp. 1545-1553, 2002.
23. A. Ziehe, Blind Source Separation Based on Joint Diagonalization of Matrices with Applications in Biomedical Signal Processing, U. o. L. Dissertation, Ed. Dissertation, Univ. Potsdam, Potsdam, Germany, 2005.
24. D. Eynard, K. Glashoff, M. Bronstein, and A. Bronstein, "Multimodal diffusion geometry by joint diagonalization of Laplacians," arXiv:1209.2295, 2012.
25. V. de Sa, "Spectral clustering with two views," in Proc. ICML Workshop Learning Multiple Views, 2005.
26. C. Ma and C.-H. Lee, "Unsupervised anchor shot detection using multi-modal spectral clustering," in Proc. ICASSP, 2008.
27. W. Tang, Z. Lu, and I. Dhillon, "Clustering with multiple graphs," in Proc. Data Mining, 2009.
28. X. Cai, F. Nie, H. Huang, and F. Kamangar, "Heterogeneous image feature integration via multi-modal spectral clustering," in Proc. Comput. Vis. Pattern Recognit., 2011.
29. A. Kumar, P. Rai, and H. Daumé III, "Co-regularized multi-view spectral clustering," in Proc. Neural Inf. Process. Syst., 2011.
30. J. Ham, D. Lee, and L. Saul, "Semisupervised alignment of manifolds," in Proc. Annu. Conf. Uncertain. Artif. Intell., 2005.
31. C. Wang and S. Mahadevan, "Manifold alignment using procrustes analysis," in Proc. 25th Int. Conf. Mach. Learning, ser. ICML '08. New York, NY, USA: ACM, 2008, pp. 1120-1127.
32. U. von Luxburg, "A tutorial on spectral clustering," Statistics Comput., vol. 17, no. 4, pp. 395-416, Dec. 2007.
33. M. Wardetzky, "Convergence of the cotangent formula: An overview," in Discrete Differential Geometry, ser. Oberwolfach Seminars, A. I. Bobenko, J. M. Sullivan, P. Schröder, and G. M. Ziegler, Eds. Birkhäuser Basel, 2008, vol. 38, pp. 275-286.
34. C. Jacobi, " Über ein leichtes Verfahren, die in der Theorie der Säkularstörungen vorkommenden Gleichungen numerisch aufzulösen," J. für reine und Angew. Math., vol. 30, pp. 51-95, 1846.
35. J.-F. Cardoso, "Perturbation of joint diagonalizers," Signal Dept., Telecom Paris, Tech. Rep. 94D023, 1994.
36. K. Rahbar and J. P. Reilly, "Geometric optimization methods for blind source separation of signals," in Proc. ICA, 2000.
37. Z. Wen and W. Yin, "A feasible method for optimization with orthogonality constraints," Math. Prog., vol. 142, no. 1-2, pp. 397-434, 2013.
38. M. M. Bronstein and K. Glashoff, "Heat kernel coupling for multiple graph analysis," arXiv:1312.3035, 2013.
39. X. Dong, P. Frossard, P. Vandergheynst, and N. Nefedov, "Clustering on multi-layer graphs via subspace analysis on Grassmann manifolds," arXiv:1303.2221, 2013.
40. H. Lin, "Almost commuting selfadjoint matrices and applications." vol. 13, pp. 193-233, 1997.
41. K. Glashoff and M. M. Bronstein, "Matrix commutators: Their asymptotic metric properties and relation to approximate joint diagonalization," Linear Algebra Appl., vol. 439, no. 8, pp. 2503-2513, 2013.
42. M. M. Bronstein, K. Glashoff, and T. A. Loring, "Making Laplacians commute," arXiv:1307.6549, 2013.
43. P. Schönemann, "A generalized solution of the orthogonal procrustes problem," Psychometrika, vol. 31, no. 1, pp. 1-10, 1966.
44. D. S. Hochbaum and D. B. Shmoys, "A best possible heuristic for the k-center problem," Math. Oper. Res., pp. 180-184, 1985.
45. T.-S. Chua, J. Tang, R. Hong, H. Li, Z. Luo, and Y.-T. Zheng, "Nus-wide: A real-world web image database from National University of Singapore," in Proc. CIVR, 2009.
46. E. Alpaydin and C. Kaynak, "Cascading classifiers," Kybernetika, vol. 34, no. 4, pp. 369-374, 1998.
47. J. Liu, C. Wang, J. Gao, and J. Han, "Multi-view clustering via joint nonnegative matrix factorization," in Proc. SDM, 2013.
48. M. R. Amini, N. Usunier, and C. Goutte, "Learning from multiple partially observed views-an application to multilingual text categorization," in Proc. Neural Inf. Process. Syst., 2009.
49. R. Bekkerman and J. Jeon, "Multi-modal clustering for multimedia collections," in Proc. Comput. Vis. Pattern Recognit., 2007.
50. N. Pinto. (2009). UCSD-MIT Caltech-101-MKL Dataset. [Online]. Available: http://mkl.ucsd.edu/dataset/ucsd-mit-caltech-101-mkl-dataset
51. P. Perona and L. Zelnik-Manor, "Self-tuning spectral clustering," in Proc. Neural Inf. Process. Syst., 2004.
52. C. D. Manning, P. Raghavan, and H. Schütze, Introduction to Information Retrieval. Cambridge University Press, 2008.