DD-HDS: A method for visualization and exploration of high-dimensional data

IEEE Transactions on Neural Networks

Volumn 18, Issue 5, 2007, Pages 1265-1279

  Lespinats, Sylvian ^a   Verleysen, Michel ^b,c   Giron, Alain ^a   Fertil, Bernard ^a  

^a INSERM   (France)

^b UNIVERSITÉ CATHOLIQUE DE LOUVAIN   (Belgium)

^c University Paris I Sorbonne Panthéon   (France)

Author keywords

High dimensional data; Multidimensional scaling (MDS); Neighborhood visualization; Nonlinear mapping

Indexed keywords

ALGORITHMS; DATA HANDLING; MAPPING; OPTIMIZATION; VISUALIZATION;

HIGH-DIMENSIONAL DATA; MULTIDIMENSIONAL SCALING; NEIGHBORHOOD VISUALIZATION; NONLINEAR MAPPING;

DATA REDUCTION;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; COMPUTER GRAPHICS; COMPUTER SIMULATION; INFORMATION PROCESSING; INFORMATION RETRIEVAL; METHODOLOGY; THEORETICAL MODEL; THREE DIMENSIONAL IMAGING;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER GRAPHICS; COMPUTER SIMULATION; DATA DISPLAY; IMAGING, THREE-DIMENSIONAL; INFORMATION STORAGE AND RETRIEVAL; MODELS, THEORETICAL;

EID: 34548644125     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2007.891682     Document Type: Article

References (66)

1. D. L. Donoho, "High-dimensional data analysis: The curses and blessings of dimensionality," Los Angeles, CA, 2000, Amer. Math. Soc. Lecture: "Math challenges of the 21st century" [Online]. Available: http://www-stat.stanford.edu/~donoho/
2. T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning. Data Mining, Inference, and Prediction. New York: Springer-Verlag, 2001, p. 470.
3. W. Basalaj, "Proximity visualization of abstract data," Ph.D. dissertation, Comput. Lab., Univ. Cambridge, Cambridge, U.K., 2000.
4. W. S. Torgerson, "Multidimensional scaling: 1. Theory and method," Psychometrika, vol. 17, pp. 401-419, 1952.
5. J. W. Sammon, "A nonlinear mapping for data structure analysis," IEEE Trans. Comput., vol. C-18, no. 5, pp. 401-409, May 1969.
6. P. Demartines and J. Hérault, "Curvilinear component analysis: A self-organizing neural network for nonlinear mapping of data sets," IEEE Trans. Neural Netw., vol. 8, no. 1, pp. 148-154, Jan. 1997.
7. J. Hérault, A. Guérin-Dugué, and P. Villemain, "Searching for the embedded manifolds in high-dimensional data, problems and unsolved questions," in Proc. Euro. Symp. Artif. Neural Netw. (ESANN), Bruges, Belgium, 2002, pp. 173-184.
8. C. C. Aggarwal, A. Hinneburg, and D. A. Keim, "On the surprising behavior of distance metrics in high dimensional space," in Lecture Notes in Computer Science, ser. 1973, J. V. Bussche and V. Vianu, Eds. Berlin, Germany: Springer-Verlag, 2001, pp. 420-434.
9. D. Lowe and M. E. Tipping, "Feed-forward neural networks and topographic mappings for exploratory data analysis," Neural Comput. Appl., vol. 4, pp. 83-95, 1996.
10. B. Schölkopf and A. J. Smola, Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. Cambridge, MA: MIT Press, 2002.
11. B. Schölkopf, A. J. Smola, and K. R. Müller, "Nonlinear component analysis as a kernel eigenvalue problem," Neural Comput., vol. 10, pp. 1299-1319, 1998.
12. J. Shawe-Taylor and N. Cristianini, Kernel Methods for Pattern Analysis. Cambridge, U.K.: Cambridge Univ. Press, 2004.
13. W. Wu, D. L. Massarat, and S. de Jong, "The kernel PCA algorithm for wide data. Part II: Fast cross-validation and application in classification of NIR Data," Chemometrics Intell. Lab. Syst., vol. 37, pp. 271-280, 1997.
14. C. K. I. Williams and M. Seeger, "Using the Nyström method to speed up kernel machines," in Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 2001, pp. 682-688.
15. K. Q. Weinberger, F. Sha, and L. K. Saul, "Learning a kernel matrix for nonlinear dimensionality reduction," in Proc. 21st Int. Conf. Mach. Learn. (ICML), Banff, AB, Canada, 2004, pp. 839-846.
16. K. Q. Weinberger, B. D. Packer, and L. K. Saul, "Nonlinear dimensionality reduction by semidefinite programming and kernel matrix factorization," in Proc. 30th Int. Workshop Artif. Intell. Statist. Z. Ghahramani and R. Cowell, Eds., Barbados, 2005, pp. 381-388.
17. J. Sun, S. Boyd, L. Xiao, and P. Diaconisem, "The fastest mixing Markov process on a graph and a connection to a maximum variance unfolding problem," SIAM Rev., vol. 48, no. 4, pp. 681-699, 2006.
18. J. B. Tenenbaum, V. de Silva, and J. C. Langford, "A global geometric framework for nonlinear dimensionality reduction," Science, vol. 290, pp. 2319-2323, 2000.
19. J. A. Lee, A. Lendasse, and M. Verleysen, "Nonlinear projection with curvilinear distances: Isomap versus curvilinear distance analysis," in Neurocomputing. New York: Elsevier, 2004, vol. 57, pp. 49-76.
20. E. W. Dijkstra, "A note on two problems in connection with graphs," Numerisch Mathematik, vol. 1, pp. 269-271, 1959.
21. S. Skiena, Implementing Discrete Mathematics: Combinatorics and Graph Theory with Mathematica. Reading, MA: Addison-Wesley, 1990.
22. J. A. Lee, N. Lendasse, N. Donckers, and M. Verleysen, "A robust non-linear projection method," in Proc. Euro. Symp. Artif. Neural Netw. (ESANN), 2000, pp. 13-20.
23. J. A. Lee and M. Verleysen, "Nonlinear dimensionality reduction of data manifolds with essential loops," Neurocomput., vol. 67, pp. 29-53, 2005.
24. P. J. Deschavanne, A. Giron, J. Vilain, G. Fagot, and B. Fertil, "Genomic signature: Characterization and classification of species assessed by chaos game representation of sequences," Mol. Biol. Evol., vol. 16, pp. 1391-1399, 1999.
25. C. Dufraigne, B. Fertil, S. Lespinats, A. Giron, and P. Deschavanne, "Detection and characterization of horizontal transfers in prokaryotes using genomic signature," Nucleic Acids Res. vol. 33, p. e6, 2005 [Online]. Available: http://nar.oxfordjournals.org/cgi/content/abstract/33/1/e6
26. J. B. Kruskal, "Non-metric multidimensional scaling: A numerical method," Psychometrika, vol. 29, pp. 115-129, 1964.
27. J. B. Kruskal, "Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis," Psychometrika, vol. 29, pp. 1-27, 1964.
28. I. Borg and P. Groenen, Modern Multidimensional Scaling. New York: Springer-Verlag, 1997.
29. T. Cox and M. Cox, Multidimensional Scaling. London, U.K.: Chapman & Hall, 1994.
30. S. T. Roweis and L. K. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol. 290, pp. 2323-2326, 2000.
31. M. Belkin and P. Niyogi, "Laplacian eigenmaps for dimensionality reduction and data representation," Neural Comput., vol. 15, pp. 1373-1396, 2003.
32. D. L. Donoho and C. Grimes, "Hessian eigenmaps: Locally linear embedding techniques for high-dimensional data," Proc. Nat. Acad. Sci., vol. 100, pp. 5591-5596, 2003.
33. S. T. Roweis, L. K. Saul, and G. Hinton, "Global coordination of local linear models," in Advances in Neural Information Processing Systems Cambridge, MA: MIT Press, 2001, vol. 14, pp. 889-896.
34. S. Wold, A. Ruhe, H. Wold, and W. J. Dunn, "The collinearity problem in linear regression. The partial least squares (PLS) approach to generalized inverses," SIAM J. Sci. Statist. Comput., vol. 5, pp. 735-743, 1984.
35. T. Kohonen, "Self-organized formation of topologically correct feature maps," Biol. Cybern., vol. 43, pp. 59-69, 1982.
36. T. Kohonen, Self-Organizing Maps., H. K. V. Lotsch, Ed. Heidelberg, Germany: Springer-Verlag, 1997.
37. S. Wu and T. W. S. Chow, "PRSOM: A new visualization method by hybridizing multidimensional scaling and self-organizing map," IEEE Trans. Neural Netw., vol. 16, no. 6, pp. 1362-1380, Nov. 2005.
38. H. Yin, "ViSOM: A novel method for multivariate data projection and structure visualization," IEEE Trans. Neural Netw., vol. 13, no. 1, pp. 237-243, Jan. 2002.
39. H. Yin, "Data visualization and manifold mapping using the ViSOM," Neural Netw., vol. 15, pp. 1005-1016, 2002.
40. C. M. Bishop, M. Svensén, and C. K. I. Williams, "GTM: The generative topographic mapping," Neural Comput., vol. 10, pp. 215-234, 1998.
41. A. Kaban and M. Girolami, "A combined latent class and trait model for the analysis and visualization of discrete data," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 8, pp. 859-872, Aug. 2001.
42. N. D. Lawrence, "Probabilistic non-linear principal component analysis with Gaussian process latent variable models," J. Mach. Learn. Res. vol. 6, pp. 1783-1816, 2005.
43. K. V. Mardia, J. T. Kent, and J. M. Bibby, Multivariate Analysis. London, UK.: Academic Press, 1979.
44. J. Hérault, A. Oliva, and A. Guérin-Dugué, "Scene categorization by curvilinear component analysis of low frequency spectra," in Proc. Euro. Symp. Artif. Neural Netw. (ESANN), Bruges, Belgium, 1997, pp. 91-96.
45. J. A. Lee and M. Verleysen, "Nonlinear projection with the isotop method," in Lecture Notes in Computer Science, ser. 2415, J. R. Dorronsoro, Ed. Berlin, Germany: Springer-Verlag, 2002, pp. 933-938.
46. J. A. Lee, C. Archambeau, and M. Verleysen, "Locally linear embedding versus isotop," in Proc. Euro. Symp. Artif. Neural Netw. (ESANN), Bruges, Belgium, 2003, pp. 527-534.
47. N. D. Lawrence and J. Quiñonero-Candela, "Local distance preservation in the GP-LVM through back constraints," in Proc. 23rd Int. Conf. Mach. Learn. (ICML), W. Cohen and A. Moore, Eds., Pittsburgh, PA, 2006, pp. 513-520.
48. D. Francois, V. Wertz, and M. Verleysen, "About the locality of kernels in high-dimensional spaces," in Proc. Int. Symp. Appl. Stochastic Models Data Anal. (ASMDA), Brest, France, 2005, pp. 238-245.
49. G. Hinton and S. T. Roweis, "Stochastic neighbor embedding," in Proc. Neural Inf. Process. Syst. (NIPS), Vancouver, BC, Canada, 2002, pp. 833-840.
50. W. H. Press, S. A. Teukolsky, W. T. Vetterling, and B. P. Flannery, Numerical Recipes in C: The Art of Scientific Computing. Cambridge, UK.: Cambridge Univ. Press, 1992.
51. F. Glover and M. Laguna, C. R. Reeves, Ed., Tabu Search. New York: McGraw-Hill, 1995.
52. D. E. Goldberg, Genetic algorithms in Search, Optimization, and Machine Learning. Reading, MA: Addison-Wesley, 1989.
53. C. R. Reeves, C. R. Reeves, Ed., Genetic Algorithms. New York: McGraw-Hill, 1995.
54. K. A. Dowsland, Simulated Annealing, C. R. Reeves, Ed. New York: McGraw-Hill, 1995.
55. P. Eades, "A heuristic for graph drawing," in Proc. 13th Manitoba Conf. Numer. Math. Comput. (Congressus Numerantium), D. S. Meek and G. H. J. V. Rees, Eds., Winnipeg, MB, Canada, 1984, vol. 42, pp. 149-160.
56. T. Fruchterman and E. Reingold, "Graph drawing by force-directed placement," Software-Practice Exp., vol. 21, pp. 1129-1164, 1991.
57. G. D. Di Battista, P. Eades, R. Tamassia, and I. G. Tollis, Graph Drawing: Algorithms for the Visualization of Graphs. Englewood Cliffs, NJ: Prentice-Hall, 1999.
58. M. Chalmers, "A linear iteration time layout algorithm for visualizing high-dimensional data," in Proc. 7th Conf. Visualization, R. Yagel and G. M. Nielson, Eds., San Francisco/Los Alamitos, CA, 1996, pp. 127-132.
59. A. Morrison, G. Ross, and M. Chalmers, "Fast Multidimensional Scaling through Sampling, Springs and Interpolation," Inf. Visualization, vol. 2, pp. 68-77, 2003.
60. J. X. Li, "Visualization of high-dimensional data with relational perspective map," Inf. Visualization, vol. 3, pp. 49-59, 2004.
61. A. Frick, A. Ludwig, and H. Mehldau, "A fast adaptive layout algorithm for undirected graphs," in Proc. Int. Workshop Graph Drawing, R. Tamassia and I. G. Tollis, Eds., Berlin, Germany, 1994, pp. 388-403.
62. N. Quinn and M. Breuer, "A force-directed component placement procedure for printed circuit boards," IEEE Trans. Circuits Syst., vol. CAS-26, no. 6, pp. 377-388, Jun. 1979.
63. P. Demartines, "Mesures d'organisation du réseau de Kohonen," presented at the Congrés Satellite du Congrés Européen de Mathématiques: Aspects Théoriques des Réseaux de Neurones, Paris, France, 1992, unpublished.
64. S. V. Edwards, B. Fertil, A. Giron, and P. J. Deschavanne, "A genomic schism in birds revealed by phylogenetic analysis of DNA strings," Syst. Biol., vol. 51, pp. 599-613, 2002.
65. C. Chapus, C. Dufraigne, S. Edwards, A. Giron, B. Fertil, and P. J. Deschavanne, "Exploration of phylogenetic data using a global sequence analysis method," BMC Evol. Biol. vol. 5, no. 63, 2005 [Online]. Available: http://www.biomedcentral.com/1471-2148/5/63
66. Y. L. Yap, X. W. Zhang, and A. Danchin, "Relationship of SARS-CoV to other pathogenic RNA viruses explored by tetranucleotide usage profiling," BMC Bioinf. vol. 4, no. 43, 2003 [Online]. Available: http://www.biomedcentral.com/1471-2105/4/43