Quality assessment of dimensionality reduction: Rank-based criteria

Neurocomputing

Volumn 72, Issue 7-9, 2009, Pages 1431-1443

  Lee, John A ^a   Verleysen, Michel ^a  

^a UNIVERSITÉ CATHOLIQUE DE LOUVAIN   (Belgium)

Author keywords

Co ranking matrix; Dimensionality reduction; Embedding; Intrusion and extrusion fractions; Quality assessment; Trustworthiness and continuity

Indexed keywords

CO-RANKING MATRIX; DIMENSIONALITY REDUCTION; EMBEDDING; INTRUSION AND EXTRUSION FRACTIONS; QUALITY ASSESSMENT; TRUSTWORTHINESS AND CONTINUITY;

EXTRUSION;

ARTICLE; AUTOMATED PATTERN RECOGNITION; CLASSIFICATION; CONTROLLED STUDY; DATA BASE; DIMENSIONALITY REDUCTION; INFORMATION PROCESSING; INFORMATION RETRIEVAL; MACHINE LEARNING; NONLINEAR SYSTEM; PRIORITY JOURNAL; QUALITY CONTROL; SYSTEMATIC ERROR;

EID: 61849137245     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2008.12.017     Document Type: Article

References (44)

1. Bauer H.-U., and Pawelzik K. Quantifying the neighborhood preservation of self-organizing maps. IEEE Transactions on Neural Networks 3 (1992) 570-579
2. Belkin M., and Niyogi P. Laplacian eigenmaps and spectral techniques for embedding and clustering. In: Dietterich T., Becker S., and Ghahramani Z. (Eds). Advances in Neural Information Processing Systems (NIPS 2001) vol. 14 (2002), MIT Press, Cambridge, MA
3. Belkin M., and Niyogi P. Laplacian eigenmaps for dimensionality reduction and data representation. Neural Computation 15 6 (2003) 1373-1396
4. Y. Bengio, P. Vincent, J.-F. Paiement, O. Delalleau, M. Ouimet, N. Le Roux, Spectral clustering and kernel PCA are learning eigenfunctions, Technical Report 1239, Département d'Informatique et Recherche Opérationnelle, Université de Montréal, Montréal, July 2003.
5. M. Brand, K. Huang, A unifying theorem for spectral embedding and clustering, in: C. Bishop, B. Frey (Eds.), Proceedings of International Workshop on Artificial Intelligence and Statistics (AISTATS'03), Key West, FL, 2003, also presented at NIPS 2002 Workshop on Spectral Methods, Available as Technical Report TR2002-042.
6. L. Chen, Local multidimensional scaling for nonlinear dimensionality reduction, graph layout, and proximity analysis, Ph.D. Thesis, University of Pennsylvania, July 2006.
7. P. Demartines, J. Hérault, Vector quantization and projection neural network, in: Lecture Notes in Computer Science, vol. 686, Springer, New York, 1993, pp. 328-333.
8. Demartines P., and Hérault J. Curvilinear component analysis: a self-organizing neural network for nonlinear mapping of data sets. IEEE Transactions on Neural Networks 8 1 (1997) 148-154
9. Di Battista G., Eades P., Tamassia R., and Tollis I. Graph Drawing: Algorithms for the Visualization of Graphs (1999), Prentice-Hall, Englewood-Cliffs, NJ
10. Donoho D., and Grimes C. Hessian eigenmaps: locally linear embedding techniques for high-dimensional data. Proceedings of the National Academy of Arts and Sciences vol. 100 (2003)
11. Fukunaga K. Intrinsic dimensionality extraction. In: Krishnaiah P., and Kanal L. (Eds). Classification, Pattern Recognition and Reduction of Dimensionality, Handbook of Statistics vol. 2 (1982), Elsevier, Amsterdam 347-360
12. Hérault J., Jaussions-Picaud C., and Guérin-Dugué A. Curvilinear component analysis for high dimensional data representation: I. Theoretical aspects and practical use in the presence of noise. In: Mira J., and Sánchez J. (Eds). Proceedings of IWANN'99 vol. II (1999), Springer, Alicante, Spain 635-644
13. Jolliffe I. Principal Component Analysis (1986), Springer, New York, NY
14. Kohonen T. Self-organization of topologically correct feature maps. Biological Cybernetics 43 (1982) 59-69
15. Kohonen T. Self-Organizing Maps. second ed. (1995), Springer, Heidelberg
16. Kramer M. Nonlinear principal component analysis using autoassociative neural networks. AIChE Journal 37 2 (1991) 233-243
17. Kruskal J. Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis. Psychometrika 29 (1964) 1-28
18. J. Lee, C. Archambeau, M. Verleysen, Locally linear embedding versus isotop, in: M. Verleysen (Ed.), Proceedings of 11th European Symposium on Artificial Neural Networks, ESANN 2003, d-side, Bruges, Belgium, 2003, pp. 527-534.
19. J. Lee, A. Lendasse, M. Verleysen, Curvilinear distances analysis versus isomap, in: M. Verleysen (Ed.), Proceedings of 10th European Symposium on Artificial Neural Networks, ESANN 2002, d-side, Bruges, Belgium, 2002, pp. 185-192.
20. Lee J., and Verleysen M. Curvilinear distance analysis versus isomap. Neurocomputing 57 (2004) 49-76
21. Lee J., and Verleysen M. Nonlinear dimensionality reduction of data manifolds with essential loops. Neurocomputing 67 (2005) 29-53
22. Lee J., and Verleysen M. Nonlinear Dimensionality Reduction (2007), Springer, Berlin
23. J. Lee, M. Verleysen, Rank-based quality assessment of nonlinear dimensionality reduction, in: M. Verleysen (Ed.), Proceedings of 16th European Symposium on Artificial Neural Networks, ESANN 2008, d-side, Bruges, 2008, pp. 49-54.
24. Mao J., and Jain A. Artificial neural networks for feature extraction and multivariate data projection. IEEE Transactions on Neural Networks 6 2 (1995) 296-317
25. Nadler B., Lafon S., Coifman R., and Kevrekidis I. Diffusion maps, spectral clustering and eigenfunction of Fokker-Planck operators. In: Weiss Y., Schölkopf B., and Platt J. (Eds). Advances in Neural Information Processing Systems (NIPS 2005) vol. 18 (2006), MIT Press, Cambridge, MA
26. Oja E. Data compression, feature extraction, and autoassociation in feedforward neural networks. In: Kohonen T., Mäkisara K., Simula O., and Kangas J. (Eds). Artificial Neural Networks vol. 1 (1991), Elsevier Science Publishers, B.V., North-Holland 737-745
27. Roweis S., and Saul L. Nonlinear dimensionality reduction by locally linear embedding. Science 290 5500 (2000) 2323-2326
28. M. Saerens, F. Fouss, L. Yen, P. Dupont, The principal components analysis of a graph, and its relationships to spectral clustering, in: Proceedings of the 15th European Conference on Machine Learning (ECML 2004), Lecture Notes in Artificial Intelligence, vol. 3201, Pisa, Italy, 2004.
29. Sammon J. A nonlinear mapping algorithm for data structure analysis. IEEE Transactions on Computers CC-18 5 (1969) 401-409
30. Saul L., and Roweis S. Think globally, fit locally: unsupervised learning of nonlinear manifolds. Journal of Machine Learning Research 4 (2003) 119-155
31. Schölkopf B., Smola A., and Müller K.-R. Nonlinear component analysis as a kernel eigenvalue problem. Neural Computation 10 (1998) 1299-1319
32. Shepard R. The analysis of proximities: multidimensional scaling with an unknown distance function (parts 1 and 2). Psychometrika 27 (1962) 125-140 219-249
33. Takane Y., Young F., and de Leeuw J. Nonmetric individual differences multidimensional scaling: an alternating least squares method with optimal scaling features. Psychometrika 42 (1977) 7-67
34. Tenenbaum J., de Silva V., and Langford J. A global geometric framework for nonlinear dimensionality reduction. Science 290 5500 (2000) 2319-2323
35. Torgerson W. Multidimensional scaling, I: theory and method. Psychometrika 17 (1952) 401-419
36. J. Venna, Dimensionality reduction for visual exploration of similarity structures, Ph.D. Thesis, Helsinki University of Technology, Espoo, Finland, June 2007.
37. Venna J., and Kaski S. Neighborhood preservation in nonlinear projection methods: an experimental study. In: Dorffner G., Bischof H., and Hornik K. (Eds). Proceedings of ICANN 2001 (2001), Springer, Berlin 485-491
38. Venna J., and Kaski S. Local multidimensional scaling. Neural Networks 19 (2006) 889-899
39. J. Venna, S. Kaski, Nonlinear dimensionality reduction as information retrieval, in: M. Meila, X. Shen (Eds.), Proceedings of the 11th International Conference on Artificial Intelligence and Statistics (AISTATS 2007), San Juan, Puerto Rico, 2007, pp. 568-575.
40. Villmann T., Der R., Herrmann M., and Martinetz T. Topology preservation in self-organizing feature maps: exact definition and measurement. IEEE Transactions on Neural Networks 8 2 (1997) 256-266
41. K. Weinberger, L. Saul, Unsupervised learning of image manifolds by semidefinite programming, International Journal of Computer Vision 70 (1) (2006) 77-90, in: A. Bobick, R. Chellappa, L. Davis (Guest Eds.), Special Issue: Computer Vision and Pattern Recognition-CVPR 2004.
42. K. Weinberger, F. Sha, L. Saul, Learning a kernel matrix for nonlinear dimensionality reduction, in: Proceedings of the 21st International Conference on Machine Learning (ICML-04), Banff, Canada, 2004.
43. Whitney H. Differentiable manifolds. Annals of Mathematics 37 3 (1936) 645-680
44. Young G., and Householder A. Discussion of a set of points in terms of their mutual distances. Psychometrika 3 (1938) 19-22