Data Visualization with Structural Control of Global Cohort and Local Data Neighborhoods

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 40, Issue 6, 2018, Pages 1323-1327

  Mu, Tingting ^a   Goulermas, John Yannis ^b   Ananiadou, Sophia ^a  

^a UNIVERSITY OF MANCHESTER   (United Kingdom)

^b UNIVERSITY OF LIVERPOOL   (United Kingdom)

Author keywords

cohort separability; Cohort visualization; dimensionality reduction; embedding generation; manifold optimization

Indexed keywords

AUTOMOBILE ENGINE MANIFOLDS; COMPLEX NETWORKS; GENETIC ALGORITHMS; MATRIX ALGEBRA; NEURAL NETWORKS; OPTIMIZATION; STRUCTURAL DYNAMICS; VISUALIZATION;

COHORT SEPARABILITY; COMPUTATIONAL MODEL; DIMENSIONALITY REDUCTION; EMBEDDING GENERATION; LEARNING (ARTIFICIAL INTELLIGENCE); PROTOTYPES;

DATA VISUALIZATION;

EID: 85021843518     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2017.2715806     Document Type: Article

References (53)

1. E. Bertini, A. Tatu, and D. Keim, "Quality metrics in high-dimensional data visualization: An overview and systematization, " IEEE Trans. Vis. Comput. Graph., vol. 17, no. 12, pp. 2203-2212, Dec. 2011.
2. A. Bordes, X. Glorot, J. Weston, and Y. Bengio, "A semantic matching energy function for learning with multi-relational data, " Mach. Learn., vol. 94, no. 2, pp. 233-259, 2014.
3. S. Kaski and J. Peltonen, "Dimensionality reduction for data visualization, " IEEE Signal Process. Mag., vol. 28, no. 2, pp. 100-104, Mar. 2011.
4. R. Etemadpour, R. Motta, J. Paiva, M. O. R. Minghim, and L. Linsen, "Perception-based evaluation of projection methods for multidimensional data visualization, " IEEE Trans. Vis. Comput. Graph., vol. 21, no. 1, pp. 81-94, Jan. 2015.
5. I. T. Jolliffe, Principal Component Analysis. New York, NY, USA: Springer-Verlag, 1986.
6. P. Comon, "Independent component analysis: A new concept?" Signal Process., vol. 36, no. 3, pp. 187-134, 1994.
7. H. Hotelling, "Relations between two sets of variates, " Biometrika, vol. 28, no. 3/4, pp. 321-377, 1936.
8. P. Dhillon, D. Foster, and L. Ungar, "Eigenwords: Spectral word embeddings, " J. Mach. Learn. Res., vol. 16, pp. 3035-3078, 2015.
9. S. T. Roweis and L. K. Saul, "Nonlinear dimensionality reduction by locally linear embedding, " Sci., vol. 290, no. 5500, pp. 2323-2326, 2000.
10. J. B. Tenenbaum, V. de Silva, and J. C. Langford, "A global geometric framework for nonlinear dimensionality reduction, " Sci., vol. 290, no. 5500, pp. 2319-2323, 2000.
11. M. Belkin and P. Niyogi, "Laplacian eigenmaps for dimensionality reduction and data representation, " Neural Comput., vol. 15, no. 6, pp. 1373-1396, 2003.
12. T. Lin and H. Zha, "Riemannian manifold learning, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 5, pp. 796-809, May 2008.
13. Z. Zhang, J. Wang, and H. Zha, "Adaptive manifold learning, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 2, pp. 253-265, Feb. 2012.
14. M. Sugiyama, "Dimensionality reduction of multimodal labeled data by local fisher discriminant analysis, " J. Mach. Learn. Res., vol. 8, pp. 1027-1061, 2007.
15. Y. Yang, F. Nie, D. Xu, J. Luo, Y. Zhuang, and Y. Pan, "A multimedia retrieval framework based on semi-supervised ranking and relevance feedback, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 4, pp. 723-742, Apr. 2012.
16. Y. Yang, D. Xu, F. Nie, S. Yan, and Y. Zhuang, "Image clustering using local discriminant models and global integration, " IEEE Trans. Image Process., vol. 19, no. 10, pp. 2761-2773, Oct. 2010.
17. T. Mu, J. Y. Goulermas, J. Tsujii, and S. Ananiadou, "Proximitybased frameworks for generating embeddings from multi-output data, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 11, pp. 2216-2232, Nov. 2012.
18. G. E. Hinton and S. T. Roweis, "Stochastic neighbor embedding, " in Proc. Advances Neural Inf. Process. Syst., 2002, pp. 833-840.
19. J. Venna, J. Peltonen, K. Nybo, H. Aidos, and S. Kaski, "Information retrieval perspective to nonlinear dimensionality reduction for data visualization, " J. Mach. Learn. Res., vol. 11, pp. 451-490, 2010.
20. L. J. P. van der Maaten and G. E. Hinton, "Visualizing data using t-SNE, " J. Mach. Learn. Res., vol. 9, pp. 2579-2605, 2008.
21. J. Goldberger, S. T. Roweis, G. E. Hinton, and R. Salakhutdinov, "Neighbourhood components analysis, " in Proc. Advances Neural Inf. Process. Syst., 2005, pp. 513-520.
22. A. Globerson and S. T. Roweis, "Metric learning by collapsing classes, " in Proc. Int. Conf. Neural Inf. Process. Syst., 2005, pp. 451-458.
23. H. Kim, J. Choo, C. K. Reddy, and H. Park, "Doubly supervised embedding based on class labels and intrinsic clusters for highdimensional data visualization, " Neurocomput., vol. 150, pp. 2399-2434, 2015.
24. K. Q. Weinberger, F. Sha, and L. K. Saul, "Learning a kernel matrix for nonlinear dimensionality reduction, " in Proc. 21st Int. Conf. Mach. Learn., 2004, Art. no. 106.
25. K. Q. Weinberger, F. Sha, Q. Zhu, and L. K. Saul, "Graph laplacian regularization for large-scale semidefinite programming, " in Proc. Advances Neural Inf. Process. Syst., 2007, Art. no. 1489.
26. L. Song, A. Smola, K. Borgwardt, and A. Gretton, "Colored maximum variance unfolding, " in Proc. Advances Neural Inf. Process. Syst., 2008, pp. 1385-1392.
27. N. Quadrianto and C. Lampert, "Learning multi-view neighborhood preserving projections, " in Proc. Int. Conf. Mach. Learn., 2011, pp. 425-432.
28. M. Kan, S. Shan, H. Zhang, S. Lao, and X. Chen, "Multi-view discriminant analysis, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 38, no. 1, pp. 188-194, Jan. 2016.
29. D. Eynard, A. Kovnatsky, M. M. Bronstein, K. Glashoff, and A. M. Bronstein, "Multimodal manifold analysis using simultaneous diagonalization of Laplacians, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 37, no. 12, pp. 2505-2517, Dec. 2015.
30. G. E. Hinton and R. R. Salakhutdinov, "Reducing the dimensionality of data with neural networks, " Sci., vol. 313, no. 5786, pp. 504-507, 2006.
31. Y. Bengio, A. Courville, and P. Vincent, "Representation learning: A review and new perspectives, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 8, pp. 1798-1828, Aug. 2013.
32. J. Weston, F. Ratle, and R. Collobert, "Deep learning via semisupervised embedding, " in Proc. Int. Conf. Mach. Learn., 2008, pp. 1168-1175.
33. R. Min, L. Maaten, Z. Yuan, A. Bonner, and Z. Zhang, "Deep supervised t-distributed embedding, " in Proc. Int. Conf. Mach. Learn., 2010, pp. 791-798.
34. A. Bordes, N. Usunier, A. Garcia-Duran, J. Weston, and O. Yakhnenko, "Translating embeddings for modeling multirelational data, " in Proc. Advances Neural Inf. Process. Syst., 2013, pp. 2787-2795.
35. P. Sen, G. M. Namata, M. Bilgic, L. Getoor, B. Gallagher, and T. Eliassi-Rad, "Collective classification in network data, " AI Mag., vol. 29, no. 3, pp. 93-106, 2008.
36. A. Ng, M. Jordan, and Y. Weiss, "On spectral clustering: Analysis and algorithm, " in Proc. 14th Int. Conf. Neural Inf. Process. Syst., 2001, pp. 849-856.
37. U. Luxburg, "A tutorial on spectral clustering, " Statist. Comput., vol. 17, no. 4, pp. 395-416, 2007.
38. R. Xu, "Survey of clustering algorithms, " IEEE Trans. Neural Netw., vol. 16, no. 3, pp. 645-678, May 2005.
39. E. Romero, T. Mu, and P. J. G. Lisboa, "Cohort-based kernel visualisation with scatter matrices, " Pattern Recognit., vol. 45, no. 4, pp. 1436-1454, 2008.
40. I. S. Dhillona, D. S. Modhab, and W. S. Spanglerb, "Class visualization of high-dimensional data with applications, " Comput. Statist. Data Anal., vol. 41, pp. 59-90, 2002.
41. W. S. Torgerson, "Multidimensional scaling: I theory and method, " J. Psychometrika, vol. 17, no. 4, pp. 401-419, 1952.
42. E. Pekalska, P. Paclik, and R. P. W. Duin, "A generalized kernel approach to dissimilarity-based classification, " J. Mach. Learn. Res., vol. 2, pp. 175-211, 2002.
43. P. A. Absil, R. Mahony, and R. Sepulchre, Optimization Algorithms on Matrix Manifolds. Princeton, NJ, USA: Princeton Univ. Press, 2008.
44. B. Vandereycken, "Low-rank matrix completion by Riemannian optimization, " SIAM J. Optimization, vol. 23, no. 2, pp. 1214-1236, 2013.
45. N. Boumal, B. Mishra, P. A. Absil, and R. Sepulchre, "Manopt, a Matlab toolbox for optimization on manifolds, " J. Mach. Learn. Res., vol. 15, pp. 1455-1459, 2014.
46. J. Shi and J. Malik, "Normalized cuts and image segmentation, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 888-905, Aug. 2000.
47. A. Edelman, T. A. Arias, and S. T. Smith, "The geometry of algorithms with orthogonality constraints, " SIAM J. Matrix Anal. Appl., vol. 29, no. 3, pp. 93-106, 2008.
48. H. Friedman and J. Tukey, "A projection pursuit algorithm for exploratory data analysis, " IEEE Trans. Comput., vol. C-23, no. 9, pp. 881-890, Sep. 1974.
49. E. Kokiopoulou and Y. Saad, "Orthogonal neighborhood preserving projections, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 12, pp. 2143-2156, Dec. 2007.
50. E. Rodriguez-Martinez, J. Y. Goulermas, T. Mu, and J. F. Ralph, "Automatic induction of projection pursuit indices, " IEEE Trans. Neural Netw., vol. 21, no. 8, pp. 1281-1295, Aug. 2010.
51. Y. Teh and S. Roweis, "Automatic alignment of hidden representations, " in Proc. Advances Neural Inf. Process. Syst., 2003, pp. 841-848.
52. R. A. Fisher, "The use of multiple measurements in taxonomic problems, " Ann. Eugenics, vol. 7, no. 2, pp. 179-188, 1936.
53. B. Zhou, A. Khosla, A. Lapedriza, A. Torralba, and A. Oliva, "Places: An image database for deep scene understanding, " arXiv: 1610. 02055, 2016, http://places2. csail. mit. edu