Incremental manifold learning by spectral embedding methods

Pattern Recognition Letters

Volumn 32, Issue 10, 2011, Pages 1447-1455

  Li, Housen ^a   Jiang, Hao ^a   Barrio, Roberto ^b   Liao, Xiangke ^a   Cheng, Lizhi ^a   Su, Fang ^a  

^a NATIONAL UNIVERSITY OF DEFENSE TECHNOLOGY   (China)

^b UNIVERSITY OF ZARAGOZA   (Spain)

Author keywords

Dimensionality reduction; Hessian eigenmaps; Incremental learning; Manifold learning; Spectral embedding methods

Indexed keywords

DIMENSIONALITY REDUCTION; EMBEDDING METHOD; HESSIAN EIGENMAPS; INCREMENTAL LEARNING; MANIFOLD LEARNING;

ALGORITHMS;

EID: 79956353630     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2011.04.004     Document Type: Article

References (37)

1. Abdel-Mannan, O., Ben Hamza, A., Youssef, A., 2007. Incremental Hessian locally linear embedding algorithm. In: Internat. Symp. Signal Processing and its Applications, vol. 1-3, pp. 484-487.
2. M. Belkin, and P. Niyogi Laplacian eigenmaps for dimensionality reduction and data representation Neural Comput. 15 6 2003 1373 1396 (Pubitemid 37049796)
3. R.E. Bellman Adaptive Control Processes: A Guided Tour 1961 Princeton University Press New Jersey
4. Bengio, Y., Paiement, J.F.O., Vincent, P., Delalleau, O., Le Roux, N., Ouimet, M., 2004. Out-of-sample extensions for LLE, Isomap, MDS, eigenmaps and spectral clustering. In: Advances in Neural Information Processing Systems, vol. 16, pp. 177-184.
5. Beygelzimer, A., Kakade, S., Langford, J., 2006. Cover trees for nearest neighbor. In: Proc. 23rd Internat. Conf. Machine Learning, pp. 97-104.
6. C.M. Bishop, M. Svensén, and C.K.I. Williams GTM: The generative topographic mapping Neural Comput. 10 1998 215 234 (Pubitemid 128463659)
7. Y. Chen, T.A. Davis, W.W. Hager, and S. Rajamanickam Algorithm 887: CHOLMOD, supernodal sparse Cholesky factorization and update/downdate ACM Trans. Math. Software 35 3 2008 1 14
8. T.J. Chin, and D. Suter Out-of-sample extrapolation of learned manifolds IEEE Trans. Pattern Anal. Machine Intell. 30 9 2008 1547 1556
9. T.F. Cox, and M.A.A. Cox Multidimensional Scaling second ed. 2001 Chapman and Hall London
10. D.L. Donoho, and C. Grimes Hessian eigenmaps: Locally linear embedding techniques for high-dimensional data Proc. Natl. Acad. Sci. USA 100 10 2003 5591 5596 (Pubitemid 36576852)
11. R.O. Duda, P.E. Hart, and D.G. Stork Pattern Classification second ed. 2000 Wiley-Interscience Hoboken, NJ
12. R.A. Fisher The use of multiple measurements in taxonomic problems Ann. Eugenics 7 1936 179 188
13. G.H. Golub, and C.F. Van Loan Matrix Computations third ed. 1996 Johns Hopkins University Press Baltimore, MD
14. R.A. Horn, and C.R. Johnson Matrix Analysis 1986 Cambridge University Press Cambridge
15. P. Jia, J. Yin, X. Huang, and D. Hu Incremental Laplacian eigenmaps by preserving adjacent information between data points Pattern Recognition Lett. 30 16 2009 1457 1463
16. I. Jolliffe Principal Component Analysis second ed. 2002 Springer New York
17. T. Kohonen Self-Organizing Maps third ed. 2001 Springer New York
18. O. Kouropteva, O. Okun, and M. Pietikänen Incremental locally linear embedding Pattern Recognition 38 10 2005 1764 1767 (Pubitemid 41037108)
19. S. Kumar, J. Guivant, B. Upcroft, and H.F. Durrant-Whyte Sequential nonlinear manifold learning Intell. Data Anal. 11 2 2007 203 222
20. M.H.C. Law, and A.K. Jain Incremental nonlinear dimensionality reduction by manifold learning IEEE Trans. Pattern Anal. Machine Intell. 28 3 2006 377 391 (Pubitemid 43159634)
21. T. Lin, and H. Zha Riemannian manifold learning IEEE Trans. Pattern Anal. Machine Intell. 30 5 2008 796 809 (Pubitemid 351486749)
22. Liu, X., Yin, J., Feng, Z., Dong. J., 2006. Incremental manifold learning via tangent space alignment. In: Proc. Artificial Neural Networks in Pattern Recognition, vol. 4087, pp. 107-121. (Pubitemid 44502875)
23. K. Pearson On lines and planes of closest fit to systems of points in space Philos. Mag. 2 6 1901 559 572
24. S.T. Roweis, and L.K. Saul Nonlinear dimensionality reduction by locally linear embedding Science 290 2000 2323 2326 (Pubitemid 32041578)
25. L.K. Saul, and S.T. Roweis Think globally, fit locally: Unsupervised learning of low dimensional manifold J. Machine Learn. Res. 4 2 2003 119 155
26. Silva, V. de, Tenenbaum, J.B., 2003. Global versus local approaches to nonlinear dimensionality reduction. In: Advances in Neural Information Processing Systems, vol. 15, pp. 705-712.
27. Smith, A.K., Huo, X., 2006. Perturbation analysis of a manifold learning algorithm - Hessian locally linear embedding. Technical Report, Georgia Institute of Technology, Atlanta, GA.
28. G.W. Stewart Accelerating the orthogonal iteration for the eigenvectors of a Hermitian matrix Numer. Math. 13 4 1969 362 376
29. J.B. Tenenbaum, V. de Silva, and J.C. Langford A global geometric framework for nonlinear dimensionality reduction Science 290 2000 2319 2323 (Pubitemid 32041577)
30. Weinberger, K., Saul, L.K., 2004. Unsupervised learning of image manifolds by semidefinite programming. In: IEEE Internat. Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 988-995.
31. S. Xiang, F. Nie, Y. Song, C. Zhang, and C. Zhang Embedding new data points for manifold learning via coordinate propagation Knowl. Inf. Systems 19 2 2009 159 184
32. S. Xiang, F. Nie, C. Zhang, and C. Zhang Nonlinear dimensionality reduction with local spline embedding IEEE Trans. Knowl. Data Eng. 21 9 2009 1285 1298
33. S. Yan, D. Xu, B. Zhang, H. Zhang, Q. Yang, and S. Lin Graph embedding and extensions: A general framework for dimensionality reduction IEEE Trans. Pattern Anal. Machine Intell. 29 1 2007 40 51 (Pubitemid 46415944)
34. Yang, Y., Nie, F., Xiang, S., Zhuang, Y., Wang, W., 2010. Local and global regressive mapping for manifold learning with out-of-sample extrapolation. In: Proc. 24th AAAI Conf. Artificial Intelligence, pp. 649-654.
35. H. Yin ViSOM - A novel method for multivariate data projection and structure visualisation IEEE Trans. Neural Networks 13 1 2002 237 243 (Pubitemid 34236851)
36. H. Yin On multidimensional scaling and the embedding of self-organising maps Neural Networks 21 2-3 2008 160 169
37. Z. Zhang, and H. Zha Principal manifolds and nonlinear dimension reduction via local tangent space alignment SIAM J. Sci. Comput. 26 1 2004 313 338