Quantitative analysis of nonlinear embedding

IEEE Transactions on Neural Networks

Volumn 22, Issue 12 PART 1, 2011, Pages 1987-1998

  Zhang, Junping ^a   Wang, Qi ^a   He, Li ^b   Zhou, Zhi Hua ^c  

^a FUDAN UNIVERSITY   (China)

^b Yahoo Labs China   (China)

^c NANJING UNIVERSITY   (China)

Author keywords

Dimensionality reduction; manifold learning; nonlinear embedding

Indexed keywords

COMPUTATIONAL COSTS; DIMENSIONALITY REDUCTION; EVALUATION METHOD; GEOMETRICAL PROPERTY; HIGH DIMENSIONAL SPACES; INTRINSIC LOW-DIMENSIONAL MANIFOLDS; MANIFOLD LEARNING; NONLINEAR EMBEDDING; QUANTITATIVE EVALUATION;

ALGORITHMS; VISUALIZATION;

QUALITY CONTROL;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; NONLINEAR SYSTEM;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; NONLINEAR DYNAMICS;

EID: 83855163511     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2011.2171991     Document Type: Article

References (37)

1. G. Polzlbauer, T. Lidy, and A. Rauber, "Decision manifolds-a supervised learning algorithm based on self-organization," IEEE Trans. Neural Netw., vol. 19, no. 9, pp. 1518-1530, Sep. 2008.
2. S. W. Park and M. Savvides, "An extension of multifactor analysis for face recognition based on submanifold learning," in Proc. 23rd IEEE Conf. Comput. Vision Pattern Recognit., San Francisco, CA, 2010, pp. 2645-2652.
3. Y. M. Lui, J. R. Beveridge, and M. Kirby, "Action classification on product manifolds," in Proc. 23rd IEEE Conf. Comput. Vision Pattern Recognit., San Francisco, CA, 2010, pp. 833-839.
4. Z. Xu, I. King, M. Lyu, and R. Jin, "Discriminative semi-supervised feature selection via manifold regularization," IEEE Trans. Neural Netw., vol. 21, no. 7, pp. 1033-1047, Jul. 2010.
5. M. Torki and A. Elgammal, "Putting local features on a manifold," in Proc. 23rd IEEE Conf. Comput. Vision Pattern Recognit., San Francisco, CA, Jun. 2010, pp. 1743-1750.
6. G. G. Yen and Z. Wu, "Ranked centroid projection: A data visualization approach with self-organizing maps," IEEE Trans. Neural Netw., vol. 19, no. 2, pp. 245-259, Feb. 2008. (Pubitemid 351359290)
7. J. A. K. Suykens, "Data visualization and dimensionality reduction using kernel maps with a reference point," IEEE Trans. Neural Netw., vol. 19, no. 9, pp. 1501-1517, Sep. 2008.
8. X. Wang and R. Yang, "Learning 3D shape from a single facial image via non-linear manifold embedding and alignment," in Proc. 23rd IEEE Conf. Comput. Vision Pattern Recognit., 2010, pp. 1-8.
9. J. Tenenbaum, V. Silva, and J. Langford, "A global geometric framework for nonlinear dimensionality reduction," Science, vol. 290, no. 5500, pp. 2319-2323, Dec. 2000. (Pubitemid 32041577)
10. K. Q. Weinberger, F. Sha, and L. K. Saul, "Learning a kernel matrix for nonlinear dimensionality reduction," in Proc. Int. Conf. Mach. Learn., 2004, pp. 1-8.
11. P. Niyogi, "Laplacian eigenmaps for dimensionality reduction and data representation," Neural Comp., vol. 15, no. 6, pp. 1373-1396, Jun. 2003. (Pubitemid 37049796)
12. S. Roweis and L. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol. 290, no. 5500, pp. 2323-2326, Dec. 2000. (Pubitemid 32041578)
13. Y. Hou, P. Zhang, X. Xu, X. Zhang, and W. Li, "Nonlinear dimensionality reduction by locally linear inlaying," IEEE Trans. Neural Netw., vol. 20, no. 2, pp. 300-315, Feb. 2009.
14. G. E. Hinton and S. Roweis, "Stochastic neighbor embedding," in Neural Information Processing Systems. Cambridge, MA: MIT Press, 2003, pp. 857-864.
15. L. J. P. Maaten and G. E. Hinton, "Visualizing data using t-SNE," J. Mach. Learn. Res., vol. 9, pp. 2579-2605, Nov. 2008.
16. J. Venna and S. Kaski, "Visualizing gene interaction graphs with local multidimensional scaling," in Proc. Eur. Symp. Art. Neural Netw., 2006, pp. 557-562.
17. Y. Goldberg, A. Zakai, D. Kushnir, and Y. Ritov, "Manifold learning: The price of normalization," J. Mach. Learn. Res., vol. 9, pp. 1909-1939, Aug. 2008.
18. J. Zhang, L. He, and Z.-H. Zhou, "Analyzing magnification factors and principal spread directions in manifold learning," in Soft Computing Technologies: The Challenge of Complexity (Advances in Soft Computing). New York: Springer-Verlag, 2006, pp. 651-664. (Pubitemid 44896254)
19. D. L. Donoho and C. Grimes, "Hessian eigenmaps: Locally linear embedding techniques for high-dimensional data," Proc. Nat. Academy Sci., vol. 100, no. 10, pp. 5591-5596, 2003. (Pubitemid 36576852)
20. Z. Zhang and H. Zha, "Principal manifolds and nonlinear dimension reduction via local tangent space alignment," SIAM J. Scientific Comp., vol. 26, no. 1, pp. 313-338, 2005. (Pubitemid 40297703)
21. R. R. Coifman, S. Lafon, A. B. Lee, M. Maggioni, B. Nadler, F. Warner, and S. W. Zucker, "Geometric diffusions as a tool for harmonic analysis and structure definition of data: Diffusion maps," Proc. Nat. Academy Sci., vol. 102, no. 21, pp. 7426-7431, 2005. (Pubitemid 40740988)
22. P. Dollár, V. Rabaud, and S. Belongie, "Non-isometric manifold learning: Analysis and an algorithm," in Proc. Int. Conf. Mach. Learn., 2007, pp. 241-248.
23. R. Urtasun, D. J. Fleet, A. Geiger, J. Popovic, T. J. Darrell, and N. D. Lawrence, "Topologically-constrained latent variable models," in Proc. Int. Conf. Mach. Learn., 2008, pp. 1-8.
24. T. Lin, H. Zha, and S. Lee, "Riemannian manifold learning," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 5, pp. 796-809, May 2008. (Pubitemid 351486749)
25. B. Shaw and T. Jebara, "Structure preserving embedding," in Proc. Int. Conf. Mach. Learn., 2009, pp. 1-8.
26. K. Zhang and J. T. Kwok, "Clustered Nyström method for large scale manifold learning and dimension reduction," IEEE Trans. Neural Netw., vol. 21, no. 10, pp. 1576-1587, Oct. 2010.
27. Y. Liu, Y. Liu, and K. C. Chan, "Tensor distance based multilinear locality-preserved maximum information embedding," IEEE Trans. Neural Netw., vol. 21, no. 11, pp. 1848-1854, Nov. 2010.
28. H. Wang, S. Chen, Z. Hu, and W. Zheng, "Locality-preserved maximum information projection," IEEE Trans. Neural Netw., vol. 19, no. 4, pp. 571-585, Apr. 2008. (Pubitemid 351583575)
29. A. Gashler, D. Ventura, and T. Martinez, "Iterative non-linear dimensionality reduction with manifold sculpting," in Neural Information Processing Systems. Cambridge, MA: MIT Press, 2008.
30. C. M. Bishop, M. Sevensen, and C. K. I. Williams, "Magnification factors for the GTM algorithm," in Proc. Art. Neural Netw. Int. Conf., Cambridge, MA, 1997, pp. 64-69.
31. M. Svensén and C. K. I. Williams, "GTM: The generative topographic mapping," Neural Comp., vol. 10, no. 1, pp. 215-234, Jan. 1998. (Pubitemid 128463659)
32. J. Park and I. W. Sandberg, "Universal approximation using radial-basisfunction networks," Neural Comp., vol. 3, no. 2, pp. 246-257, Mar. 2008.
33. K. Q. Weinberger, B. D. Packer, and L. K. Saul, "Nonlinear dimensionality reduction by semidefinite programming and kernel matrix factorization," Soc. Art. Intell. Statist., vol. 6, no. 1, pp. 381-388, 2005.
34. J. W. Sammon, "A nonlinear mapping for data structure analysis," IEEE Trans. Comput., vol. 18, no. 5, pp. 401-409, May 1969.
35. F. Sha and L. K. Saul, "Analysis and extension of spectral methods for nonlinear dimensionality reduction," in Proc. Int. Conf. Mach. Learn., 2005, pp. 784-791.
36. T. Wittman. Manifold Learning MATLAB Demo [Online]. Available: http://www.math.ucla.edu/wittman/mani/index.html.com
37. Y. Bengio, J.-F. Paiement, P. Vincent, O. Delalleau, N. Le Roux, and M. Ouimet, "Out-of-sample extensions for LLE, isomap, MDS, eigenmaps, and spectral clustering," in Neural Information Processing Systems. Cambridge, MA: MIT Press, 2004.