PARAMAP vs. isomap: A comparison of two nonlinear mapping algorithms

Journal of Classification

Volumn 23, Issue 2, 2006, Pages 221-254

  Akkucuk, Ulas ^a   Carroll, J Douglas ^b,c  

^a BOGAZICI UNIVERSITY   (Turkey)

^b RUTGERS BUSINESS SCHOOL   (United States)

^c RUTGERS UNIVERSITY   (United States)

Author keywords

Dimensionality reduction; Isomap; Measures of agreement; Nonlinear mapping; PARAMAP; Parametric mapping

Indexed keywords

EID: 33750723835     PISSN: 01764268     EISSN: 14321343     Source Type: Journal    
DOI: 10.1007/s00357-006-0014-2     Document Type: Article

References (52)

1. AKKUCUK, U. (2004), Nonlinear Mapping: Approaches Based on Optimizing an Index of Continuity and Applying Classical Metric MDS to Revised Distances, Doctoral Dissertation, Newark, NJ: Rutgers University. (University Microfilms No. AAT 3148774)
2. AKKUCUK, U., and CARROLL, J.D. (2003), Nonlinear Mapping: Approaches Based on Optimizing an Index of Continuity and Applying Classical Metric MDS to Revised Distances, Paper presented at 2003 DIMACS Working Group Meeting, Tallahassee, FL.
3. AKKUCUK, U., and CARROLL, J.D. (2004), "Mapping of Nonlinear Manifolds: ISOMAP and a Version of PARAMAP" (Abstract), in Classification, Clustering and Data Mining Applications, Eds., D. Banks, L. House, F.R. McMorris, P. Arabie, and W. Gaul, Proceedings of the meeting of IFCS/CSNA, July 15-18, 2004, Illinois Institute of Technology, Chicago, IL, Berlin: Springer.
4. BALASUBRAMANIAN, M., SCHWARTZ, E.L., TENENBAUM, J.B., DE SILVA, V., and LANGFORD, J.C. (2002), "The Isomap Algorithm and Topological Stability," Science, 295, 7a.
5. BALDI, B., and HORNIK, K. (1989), "Neural Networks and Principal Component Analysis: Learning from Examples without Local Minima," Neural Networks, 2, 53-58.
6. BELKIN, M., and NYOGI, P. (2003), "Laplacian Eigenmaps for Dimensionality Reduction," Neural Computation, 15, 1373-1396.
7. BERNSTEIN, M., DE SILVA, V., LANGFORD, J.C., and TENENBAUM, J.B. (2000), Graph Approximations to Geodesics on Embedded Manifolds, Unpublished Manuscript, Stanford, CA: Stanford University.
8. BERTSEKAS, D.P. (1999), Nonlinear Programming, Belmont, MA: Athena Scientific.
9. BUJA, A., and SWAYNE, D.F. (2002), "Visualization Methodology for Multidimensional Dealing," Journal of Classification, 19, 7-43.
10. CARROLL, J.D. (1968), Parametric Mapping of Similarity Data as a Scaling Method, Unpublished Manuscript, Murray Hill, NJ: Bell Laboratories.
11. CARROLL, J.D. (1969). "Polynomial Factor Analysis," Proceedings of the 77th Annual Convention of the American Psychological Association, 4,103-104.
12. CARROLL, J.D., and CHANG, J.J. (1968), PARAMAP, A Computer Program Which Performs Parametric Mapping, Unpublished manuscript, Murray Hill, NJ: Bell Laboratories.
13. DE BACKER, S., NAUD, A., and SCHEUNDERS P. (1998), "Non-linear Dimensionality Reduction Techniques for Unsupervised Feature Extraction," Pattern Recognition Letters, 19, 711-720.
14. DE SILVA, V., and TENENBAUM, J.B. (2002), "Global Versus Local Methods in Nonlinear Dimensionality Reduction", in Advances in Neural Information Processing Systems 15 (pp. 705-712), Eds., M.S. Becker, S. Thrun, and K. Obermayer, Cambridge, MA: MIT Press.
15. DEETZ, C.H., and ADAMS, O.S. (1945), Elements of Map Projection, U.S. Department of Commerce Special Publication No. 68, Washington, DC: U.S. Government Printing Office.
16. DIJKSTRA, E.W. (1959), "A Note on Two Problems in Connection with Graphs" Numerische Mathematik, 1, 269-271.
17. DONOHO, D.L., and GRIMES, C. (2002), Image Manifolds Which are Isometric to Euclidean Space, Unpublished Manuscript, Stanford, CA: Stanford University.
18. FLETCHER, R. (1987), Practical Methods of Optimization. Chichester, U.K.: Wiley.
19. FLETCHER, R., and REEVES, C.M. (1964), "Function Minimization by Conjugate Fradients," Computer Journal, 7, 149-154.
20. FLOYD, R.W. (1962), "Algorithm 97: Shortest Path," Communications of the ACM, 5, 345.
21. FOSTER, I. (1995), Designing and Building Parallel Programs: Concepts and Tools for Parallel Software Engineering. Reading: MA: Addison-Wesley.
22. HU, T.C. (1967), "Revised Matrix Algorithms for Shortest Paths," SIAM Journal on Applied Mathematics, 15, 207-218.
23. HUBERT, L., and ARABIE, P. (1985), "Comparing Partitions," Journal of Classification, 2, 193-218.
24. KOHONEN, T. (1990), "The Self-organizing Map," Proceedings of the IEEE, 78, 1464-1480.
25. KOHONEN, T. (1995), Self-Organizing Maps. Berlin: Springer-Verlag.
26. KRAMER, M.A. (1991), "Nonlinear Principal Components Analysis Using Auto-associative Neural Networks," AIChE Journal, 37, 233-243.
27. KRUMHANSL, C.L., and KESSLER, E.J. (1982), "Tracing the Dynamic Changes in Perceived Tonal Organization in Spatial Representation of Musical Keys," Psychological Review, 89, 334-368.
28. \KRUSKAL, J.B. (1964a), "Multidimensional Scaling by Optimizing a Goodness of Fit to a Nonmetric Hypothesis," Psychometrika, 29, 1-27.
29. KRUSKAL, J.B. (1964b), "Nonmetric Multidimensional Scaling: A Numerical Method," Psychometrika, 29, 115-129.
30. KRUSKAL, J.B. (1971), "Comments on "A Nonlinear Mapping for Data Structure Analysis," IEEE Transactions on Computers, 20, 1614.
31. KRUSKAL, J.B. (1975), "Locally Linear and Locally Isometric Mapping", in, Theory, Methods and Applications of Multidimensional Scaling and Related Techniques, Proceedings of a meeting sponsored by National Science Foundation and the Japan Society for the Promotion of Science, (pp. 27-33).
32. KRUSKAL, J.B., and CARROLL, J.D. (1969), "Geometric Models and Badness of Fit Function", in Multivariate Analysis (pp. 639-671), Ed., P.R. Krishnaiah, New York, NY: Academic Press.
33. KRUSKAL, J.B., and SHEPARD, R.N. (1974), "A Nonmetric Variety of Linear Factor Analysis," Psychometrika, 39, 123-157.
34. KRUSKAL, J.B., YOUNG, F.W., and SEERY, J.B. (1977), How to Use KYST2, A Very Flexible Program to Do Multidimensional Scaling and Unfolding. Murray Hill, NJ: AT and T Bell Laboratories.
35. KUMAR, V., GRAMA, A., GUPTA, A., and KARYPIS, G. (1994), Introduction to Parallel Computing: Design and Analysis of Algorithms. Redwood City, CA: Benjamin/Cummings.
36. LEE, J.A., LANDASSE, A., and VERLEYSEN, M. (2002), "Curvilinear Distance Analysis versus Isomap", in ESANN'2002 Proceedings - European Symposium on Artificial Neural Networks (pp. 185-192), Ed., M. Verleysen, Bruges, Belgium: D-Side Publications.
37. LEE, J.A., LANDASSE, A., and VERLEYSEN, M. (2004), "Nonlinear Projection With Curvilinear Distances: Isomap Versus Curvilinear Distance Analysis," Neuro-computing, 57, 49-76.
38. MARDIA, K.V., KENT, J.T., and BIBBY, J.M. (1979), Multivariate Analysis, London, England: Academic Press.
39. MCDONALD, R.P. (1963), "A General Approach to Nonlinear Factor Analysis," Psychometrika, 27, 397-415.
40. MCDONALD, R.P. (1965), "Difficulty Factors and Nonlinear Factor Analysis," British Journal of Mathematical and Statistical Psychology, 18, 11-23.
41. MCDONALD, R.P. (1967a), "Factor Interaction in Nonlinear Factor Analysis," British Journal of Mathematical and Statistical Psychology, 20, 205-215.
42. MCDONALD, R.P. (1967b), "Nonlinear Factor Analysis," Psychometric Monographs, 15, 167.
43. POWELL, M.J.D. (1977), "Restart Procedures for the Conjugate Gradient Method," Mathematical Programming, 12, 241-254.
44. RAND, W.M. (1971), "Objective Criteria for the Evaluation of Clustering Methods," Journal of the American Statistical Association, 66, 846-850.
45. ROWEIS, S.T., and SAUL, L.K. (2000), "Nonlinear Dimensionality Reduction by Locally Linear Embedding," Science, 290, 2323-2326.
46. SAMMON, J.W. (1969), "A Nonlinear Mapping for Data Structure Analysis," IEEE Transactions on Computers, 18, 401-409.
47. SHEPARD, R.N., and CARROLL, J.D. (1966), "Parametric Representation of Nonlinear Data Structures", in Multivariate Analysis (pp. 561-592), Ed. P.R. Krishnaiah, New York, NY: Academic Press.
48. TENENBAUM, J.B., DE SILVA, V., and LANGFORD, J.C. (2000), "A Global Geometric Framework for Nonlinear Dimensionality Reduction," Science, 290, 2319-2323.
49. TORGERSON, W.S. (1958), Theory and Methods of Scaling, New York, NY: Wiley.
50. VON NEUMAN, J. (1941), "Distribution of the Ratio of the Mean Square Successive Difference to the Variance," The Annals of Mathematical Statistics, 12, 367-395.
51. VON NEUMAN, J., KENT, R.H., BELLINSON, H.R., and HART, B.I. (1941), "The Mean Square Successive Difference," The Annals of Mathematical Statistics, 12, 153-162.
52. WEBB, A.R. (1995), "Multidimensional Scaling by Iterative Majorization Using Radial Basis Functions," Pattern Recognition, 28, 753-759.