Manifold learning by graduated optimization

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 41, Issue 6, 2011, Pages 1458-1470

  Gashler, Michael ^a   Ventura, Dan ^a   Martinez, Tony ^a  

^a 3361 TMCB   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EMPIRICAL ANALYSIS; LOCALLY LINEAR EMBEDDING; MANIFOLD LEARNING; MAXIMUM VARIANCE; PRIOR KNOWLEDGE;

ALGORITHMS;

OPTIMIZATION;

EID: 81955160857     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2011.2151187     Document Type: Article

References (32)

1. R. Bellman, Adaptive Control Processes: A Guided Tour. Princeton, NJ: Princeton Univ. Press, 1961.
2. T. C. E. Cheng andM. Y. Kovalyov, "An unconstrained optimization problem is NP-hard given an oracle representation of its objective function: A technical note," Comput. Oper. Res., vol. 29, no. 14, pp. 2087-2091, Dec. 2002. (Pubitemid 34961693)
3. J. B. Tenenbaum, V. de Silva, and J. C. Langford, "A global geometric framework for nonlinear dimensionality reduction," Science, vol. 290, no. 5500, pp. 2319-2323, Dec. 2000. (Pubitemid 32041577)
4. S. T. Roweis and L. K. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol. 290, no. 5500, pp. 2323-2326, Dec. 2000. (Pubitemid 32041578)
5. K. Q. Weinberger, F. Sha. K. Saul "Learning a kernel matrix for nonlineardimensionality reduction," in Proc. 21st ICML, 2004, pp. 839- 846. (Pubitemid 40290888)
6. P. Burt, "Fast filter transforms for image processing," Comput. Vis. Graph. Image Process., vol. 16, pp. 20-51, 1981. (Pubitemid 11516675)
7. Z. Wu, "The effective energy transformation scheme as a special continuation approach to global optimization with application to molecular conformation," SIAM J. Optim., vol. 6, no. 3, pp. 748-768, 1996.
8. H. Hotelling, "Analysis of a complex of statistical variables into principal components," J. Educ. Psychol., vol. 24, no. 6, pp. 417-441, Sep. 1933.
9. R. N. Shepard and J. D. Carroll, "Parametric representation of nonlinear data structures," in Proc. Int. Symp. Multivariate Anal., vol. 2. New York: Academic, 1965, pp. 561-592.
10. J. W. Sammon, "A nonlinear mapping for data structure analysis," IEEE Trans. Comput., vol. C-18, no. 5, pp. 401-409, May 1969.
11. P. Demartines and J. Hérault. (1997, Jan.). Curvilinear component analysis: A self-organizing neural network for nonlinear mapping of data sets. IEEE Trans. Neural Netw. [Online]. 8(1), pp. 148-154. Available: citeseer.ist.psu.edu/demartines96curvilinear.html (Pubitemid 127767788)
12. J. Lee, A. Lendasse, N. Donckers, and M. Verleysen, "A robust non-linear projection method," in Proc. ESANN, Bruges, Belgium, 2000, pp. 13-20.
13. V. de Silva and J. B. Tenenbaum, "Global versus local methods in nonlinear dimensionality reduction," in Proc. Adv. Neural Inf. Process. Syst., 2002, pp. 705-712.
14. B. Schölkopf, A. J. Smola, and K.-R. Müller, "Kernel principal component analysis," in Advances in Kernel Methods: Support Vector Learning. Cambridge, MA: MIT Press, 1999, pp. 327-352.
15. M. Belkin and P. Niyogi, "Laplacian eigenmaps and spectral techniques for embedding and clustering," in Advances in Neural Information Processing Systems, 14. Cambridge, MA: MIT Press, 2001, pp. 585-591.
16. M. Brand, "Charting a manifold," in Advances in Neural Information Processing Systems, 15, S. T. S. Becker and K. Obermayer, Eds. Cambridge, MA: MIT Press, 2003, pp. 961-968.
17. P. Vincent and Y. Bengio, "Manifold Parzen windows," in Advances in Neural Information Processing Systems 15. Cambridge, MA: MIT Press, 2003, pp. 825-832.
18. D. Donoho and C. Grimes, "Hessian eigenmaps: Locally linear embedding techniques for high dimensional data," Proc. Nat. Acad. Sci., vol. 100, no. 10, pp. 5591-5596, May 2003. (Pubitemid 36576852)
19. Y. Bengio and M. Monperrus, "Non-local manifold tangent learning," in Advances in Neural Information Processing Systems 17, L. K. Saul, Y. Weiss, and L. Bottou, Eds. Cambridge, MA: MIT Press, 2005, pp. 129-136.
20. E. Levina and P. J. Bickel, "Maximum likelihood estimation of intrinsic dimension," in Advances in Neural Information Processing Systems 17, L. K. Saul, Y. Weiss, and L. Bottou, Eds. Cambridge, MA: MIT Press, 2005, pp. 777-784.
21. Z. Zhang and H. Zha, "A domain decomposition method for fast manifold learning," in Advances in Neural Information Processing Systems 18, Y. Weiss, B. Schölkopf, and J. Platt, Eds. Cambridge, MA: MIT Press, 2006.
22. K. Q. Weinberger, B. D. Packer, and L. K. Saul, "Nonlinear dimensionality reduction by semidefinite programming and kernel matrix factorization," in Proc. 10th Int. Workshop Artif. Intell. Statist., 2005, pp. 381-388.
23. D. Huang, Z. Yi, and X. Pu, "Manifold-based learning and synthesis," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 39, no. 3, pp. 592-606, Jun. 2009.
24. X. Geng, D.-C. Zhan, and Z.-H. Zhou, "Supervised nonlinear dimensionality reduction for visualization and classification," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 35, no. 6, pp. 1098-1107, Dec. 2005. (Pubitemid 41800411)
25. C. Chen, J. Zhang, and R. Fleischer, "Distance approximating dimension reduction of Riemannian manifolds," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 1, pp. 208-217, Feb. 2010.
26. D. Meng, Y. Leung, T. Fung, and Z. Xu, "Nonlinear dimensionality reduction of data lying on the multicluster manifold," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 38, no. 4, pp. 1111-1122, Aug. 2008.
27. M. Gashler, D. Ventura, and T. Martinez, "Iterative non-linear dimensionality reduction with manifold sculpting," in Advances in Neural Information Processing Systems 20, J. Platt, D. Koller, Y. Singer, and S. Roweis, Eds. Cambridge, MA: MIT Press, 2008.
28. V. V. Raghavan and S. K. M. Wong, "A critical analysis of vector space model for information retrieval," J. Amer. Soc. Inf. Sci., vol. 37, no. 5, pp. 279-287, Sep. 1986.
29. M. Porter, "An algorithm for suffix stripping," Program, vol. 14, no. 3, pp. 130-137, 1980.
30. M. Breitenbach and G. Z. Grudic, "Clustering through ranking on manifolds," in Proc. 22nd ICML, 2005, pp. 73-80. (Pubitemid 43183318)
31. A. Demiriz, K. Bennett, and M. Embrechts, "Semi-supervised clustering using genetic algorithms," in Proc. Artif. Neural Netw. Eng., 1999, pp. 809-814. (Pubitemid 30523784)
32. M. H. C. Law, N. Zhang, and A. K. Jain, "Nonlinear manifold learning for data stream," Dept. Comput. Sci. Eng., Michigan State Univ., East Lansing, MI, Tech. Rep. MSU-CSE-03-5. [Online]. Available: citeseer.ist.psu.edu/ 691968.html