Scale-independent quality criteria for dimensionality reduction

Pattern Recognition Letters

Volumn 31, Issue 14, 2010, Pages 2248-2257

  Lee, John A ^a   Verleysen, Michel ^b,c  

^a Molecular Imaging and Experimental Radiotherapy Department   (Belgium)

^b UNIVERSITÉ CATHOLIQUE DE LOUVAIN   (Belgium)

^c University Paris I Sorbonne Panthéon   (France)

Author keywords

Dimensionality reduction; Embedding; Manifold learning; Quality assessment

Indexed keywords

DIMENSIONALITY REDUCTION; DIMENSIONALITY REDUCTION TECHNIQUES; EMBEDDING; HIGH DIMENSIONAL DATA; LINEAR PROJECTIONS; LOCAL AND GLOBAL DATA; LOW-DIMENSIONAL SPACES; MANIFOLD LEARNING; NON-LINEAR TRANSFORMATIONS; QUALITY ASSESSMENT; QUALITY CRITERIA; SCALE DEPENDENCY; SCALE PARAMETER; VISUAL INTERPRETATION;

LINEAR TRANSFORMATIONS;

EID: 77957908161     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2010.04.013     Document Type: Article

References (46)

1. H.-U. Bauer, and K. Pawelzik Quantifying the neighborhood preservation of self-organizing maps IEEE Trans. Neural Networks 3 1992 570 579
2. M. Belkin, and P. Niyogi Laplacian eigenmaps for dimensionality reduction and data representation Neural Comput. 15 6 2003 1373 1396
3. Bengio, Y., Vincent, P., Paiement, J.-F., Delalleau, O., Ouimet, M., Le Roux, N., 2003. Spectral clustering and kernel PCA are learning eigenfunctions. Tech. rep. 1239, Département d'Informatique et Recherche Opérationnelle, Université de Montréal, Montréal.
4. Bernstein, M., de Silva, V., Langford, J., Tenenbaum, J., 2000. Graph approximations to geodesics on embedded manifolds. Tech. rep., Stanford University, Palo Alto, CA.
5. Brand, M., Huang, K., 2003. A unifying theorem for spectral embedding and clustering. In: Bishop, C., Frey, B. (Eds.), Proc. Internat. Workshop on Artificial Intelligence and Statistics (AISTATS'03).
6. Chen, L., 2006. Local multidimensional scaling for nonlinear dimensionality reduction, graph layout, and proximity analysis. Ph.D. Thesis, University of Pennsylviana.
7. L. Chen, and A. Buja Local multidimensional scaling for nonlinear dimension reduction, graph drawing, and proximity analysis J. Amer. Statist. Assoc. 101 485 2009 209 219
8. P. Demartines, and J. Hérault Vector Quantization and Projection Neural Network Lecture Notes in Computer Science vol. 686 1993 Springer-Verlag New York pp. 328-333
9. P. Demartines, and J. Hérault Curvilinear component analysis: a self-organizing neural network for nonlinear mapping of data sets IEEE Trans. Neural Networks 8 1 1997 148 154
10. G. Di Battista, P. Eades, R. Tamassia, and I. Tollis Graph Drawing: Algorithms for the Visualization of Graphs 1999 Prentice-Hall
11. Donoho, D., Grimes, C., 2003. Hessian eigenmaps: locally linear embedding techniques for high-dimensional data. In: Proc. National Academy of Arts and Sciences, vol. 100. pp. 5591-5596.
12. J. Hérault, C. Jaussions-Picaud, and A. Guérin-Dugué Curvilinear component analysis for high dimensional data representation: I. Theoretical aspects and practical use in the presence of noise J. Mira, J. Sánchez, Proc. IWANN'99 vol. II 1999 Springer Alicante, Spain 635 644
13. G. Hinton, and S. Roweis Stochastic neighbor embedding S. Becker, S. Thrun, K. Obermayer, Advances in Neural Information Processing Systems (NIPS 2002) vol. 15 2003 MIT Press 833 840
14. I. Jolliffe Principal Component Analysis 1986 Springer-Verlag New York, NY
15. T. Kohonen Self-organization of topologically correct feature maps Biological Cybernet. 43 1982 59 69
16. M. Kramer Nonlinear principal component analysis using autoassociative neural networks AIChE J. 37 2 1991 233 243
17. J. Kruskal Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis Psychometrika 29 1964 1 28
18. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner Gradient-based learning applied to document recognition Proc. IEEE 86 11 1998 2278 2324
19. J. Lee, and M. Verleysen Curvilinear distance analysis versus isomap Neurocomputing 57 2004 49 76
20. J. Lee, and M. Verleysen Nonlinear Dimensionality Reduction 2007 Springer
21. Lee, J., Verleysen, M., 2008a. Quality assessment of nonlinear dimensionality reduction based on K-ary neighborhoods. In: Saeys, Y., Liu, H., Inza, I., Wehenkel, L., Van de Peer, Y. (Eds.), JMLR Workshop and Conf. Proc. (New Challenges for Feature Selection in Data Mining and Knowledge Discovery), vol. 4. pp. 21-35.
22. Lee, J., Verleysen, M., 2008b. Rank-based quality assessment of nonlinear dimensionality reduction. In: Verleysen, M. (Ed.), Proc. ESANN 2008, 16th European Symposium on Artificial Neural Networks. d-side, Bruges, pp. 49-54.
23. J. Lee, and M. Verleysen Quality assessment of dimensionality reduction: rank-based criteria Neurocomputing 72 7-9 2009 1431 1443
24. Lee, J., Lendasse, A., Donckers, N., Verleysen, M., 2000. A robust nonlinear projection method. In: Verleysen, M. (Ed.), Proc. ESANN 2000, 8th European Symposium on Artificial Neural Networks. D-Facto public., Bruges, Belgium, pp. 13-20.
25. J. Mao, and A. Jain Artificial neural networks for feature extraction and multivariate data projection IEEE Trans. Neural Networks 6 2 1995 296 317
26. B. Nadler, S. Lafon, R. Coifman, and I. Kevrekidis Diffusion maps, spectral clustering and eigenfunction of Fokker-Planck operators Y. Weiss, B. Schölkopf, J. Platt, Advances in Neural Information Processing Systems (NIPS 2005) vol. 18 2006 MIT Press Cambridge, MA
27. E. Oja Data compression, feature extraction, and autoassociation in feedforward neural networks T. Kohonen, K. Mäkisara, O. Simula, J. Kangas, Artificial Neural Networks vol. 1 1991 Elsevier Science Publishers, B.V. North-Holland 737 745
28. S. Roweis, and L. Saul Nonlinear dimensionality reduction by locally linear embedding Science 290 5500 2000 2323 2326
29. S. Roweis, L. Saul, and G. Hinton Global coordination of local linear models T. Dietterich, S. Becker, Z. Ghahramani, Advances in Neural Information Processing Systems (NIPS 2001) vol. 14 2002 MIT Press Cambridge, MA
30. Saerens, M., Fouss, F., Yen, L., Dupont, P., 2004. The principal components analysis of a graph, and its relationships to spectral clustering. In: Proc. 15th European Conf. on Machine Learning (ECML 2004), pp. 371-383.
31. J. Sammon A nonlinear mapping algorithm for data structure analysis IEEE Trans. Comput. CC-18 5 1969 401 409
32. L. Saul, and S. Roweis Think globally, fit locally: unsupervised learning of nonlinear manifolds J. Machine Learn. Res. 4 2003 119 155
33. B. Schölkopf, A. Smola, and K.-R. Müller Nonlinear component analysis as a kernel eigenvalue problem Neural Comput. 10 1998 1299 1319
34. R. Shepard The analysis of proximities: multidimensional scaling with an unknown distance function (parts 1 and 2) Psychometrika 27 1962 pp. 125-140, 219-249
35. Y. Takane, F. Young, and J. de Leeuw Nonmetric individual differences multidimensional scaling: an alternating least squares method with optimal scaling features Psychometrika 42 1977 7 67
36. J. Tenenbaum Mapping a manifold of perceptual observations M. Jordan, M. Kearns, S. Solla, Advances in Neural Information Processing Systems (NIPS 1997) vol. 10 1998 MIT Press Cambridge, MA 682 688
37. J. Tenenbaum, V. de Silva, and J. Langford A global geometric framework for nonlinear dimensionality reduction Science 290 5500 2000 2319 2323
38. W. Torgerson Multidimensional scaling, I: Theory and method Psychometrika 17 1952 401 419
39. L. van der Maaten, and G. Hinton Visualizing data using t-SNE J. Machine Learn. Res. 9 2008 2579 2605
40. Venna, J., 2007. Dimensionality reduction for visual exploration of similarity structures. Ph.D. Thesis, Helsinki University of Technology, Espoo, Finland.
41. Venna, J., Kaski, S., 2001. Neighborhood preservation in nonlinear projection methods: an experimental study. In: Dorffner, G., Bischof, H., Hornik, K. (Eds.), Proc. ICANN 2001, Springer, Berlin, pp. 485-491.
42. J. Venna, and S. Kaski Local multidimensional scaling Neural Networks 19 2006 889 899
43. T. Villmann, R. Der, M. Herrmann, and T. Martinetz Topology preservation in self-organizing feature maps: exact definition and measurement IEEE Trans. Neural Networks 8 2 1997 256 266
44. K. Weinberger, and L. Saul Unsupervised learning of image manifolds by semidefinite programming Internat. J. Comput. Vision 70 1 2006 77 90
45. Weinberger, K., Sha, F., Saul, L., 2004. Learning a kernel matrix for nonlinear dimensionality reduction. In: Proc. 21st Internat. Conf. on Machine Learning (ICML-04). Banff, Canada, pp. 839-846.
46. G. Young, and A. Householder Discussion of a set of points in terms of their mutual distances Psychometrika 3 1938 19 22