Robust Positive semidefinite L-Isomap Ensemble

Pattern Recognition Letters

Volumn 32, Issue 4, 2011, Pages 640-649

  Shang, Fanhua ^a   Jiao, L C ^a   Shi, Jiarong ^a   Chai, Jing ^b  

^a XIDIAN UNIVERSITY   (China)

^b Duke University   (United States)

Author keywords

Dimensionality reduction; Ensemble learning; High dimensional affine transformation; Isomap; Manifold learning; Nystr m approximation

Indexed keywords

DIMENSIONALITY REDUCTION; ENSEMBLE LEARNING; HIGH-DIMENSIONAL; ISOMAP; MANIFOLD LEARNING;

TOPOLOGY;

EID: 78650766293     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2010.12.005     Document Type: Article

References (46)

1. M. Balasubramanian, E.L. Schwartz, J.B. Tenenbaum, V. de Silva, and J.C. Langford The Isomap algorithm and topological stability Science 295 5552 2002 7
2. M.-A. Belabbas, and P.J. Wolfe Spectral methods in machine learning: New strategies for very large datasets Proc. Natl. Acad. Sci. USA 106 2009 369 374
3. M. Belkin, and P. Niyogi Laplacian eigenmaps and spectral techniques for embedding and clustering Advances in Neural Information Processing Systems vol. 14 2002 The MIT Press Cambridge, MA, USA 585 591
4. F. Cailliez The analytical solution of the additive constant problem Psychometrika 48 2 1983 305 308
5. Chi, Yu-Tseh, Nejhum, Shahed S.M., Ho, Jeffrey, Yang, Ming-Hsuan, 2008. Higher dimensional affine registration and vision applications. In: Proc. 10th European Conf. on Computer Vision: Part IV, ECCV (4), pp. 256-269.
6. H. Choi, and S. Choi Robust kernel Isomap Pattern Recognition 40 2007 853 862
7. de Silva, V., Tenenbaum, Joshua B., 2003. Global versus local methods in nonlinear dimensionality reduction. In: Advances in Neural Information Processing Systems (NIPS), vol. 15, pp. 705-712.
8. Dietterich, T.G., 2000. Ensemble methods in machine learning. In: Proc. 1st Internat. Workshop on Multiple Classifier Systems, Cagliari, Italy, pp. 1-15.
9. D.L. Donoho, and C. Grimes Hessian eigenmaps: New locally linear embedding techniques for high-dimensional data Proc. Natl. Acad. Sci. USA 102 21 2003 7426 7431
10. P. Drineas, and M.W. Mahoney On the Nyström method for approximating a Gram matrix for improved kernel-based learning J. Machine Learn. Res. 6 2005 2153 2175
11. C. Fowlkes, S. Belongie, F. Chung, and J. Malik Spectral grouping using the Nyström method IEEE Trans. Pattern Anal. Machine Intell. 26 2 2004 214 225
12. G.H. Golub, and C.F.V. Loan Matrix Computations second ed. 1983 Johns Hopkins University Press Baltimore
13. Gorrell, G., 2006. Generalized Hebbian algorithm for incremental singular value decomposition in natural language processing. In: EACL.
14. Ham, J., Lee, D.D., Mika, S., Schökopf, B., 2004. A kernel view of the dimensionality reduction of manifolds. In: Proc. Internat. Conf. on Machine Learning (ICML), Banff, Canada, pp. 369-376.
15. V. Hernandez, J. Roman, and V. Vidal SLEPc: A scalable and flexible toolkit for the solution of eigenvalue problems ACM Trans. Math. Software 31 2005 351 362
16. L.O. Jimenez, and D.A. Landgrebe Supervised classification in high-dimensional space: Geometrical, statistical, and asymptotical properties of multivariate data IEEE Trans. Systems Man Cybernet. 28 1 1997 39 54
17. W. Johnson, and J. Lindenstrauss Extensions of lipschitz maps into a hilbert space Contemp. Math. 26 1984 189 206
18. B. Kulis, S. Basu, I. Dhillon, and R. Mooney Semi-supervised graph clustering: A kernel approach Machine Learn. 74 1 2009 1 22
19. Kumar, S., Mohri, M., Talwalkar, A., 2010. Ensemble Nyström method. In: Neural Information Processing Systems (NIPS).
20. S. Lafon, and A.B. Lee Diffusion maps and coarse-graining: A unified framework for dimensionality reduction graph partitioning, and data set parameterization IEEE Trans. Pattern Anal. Machine Intell. 28 9 2006 1393 1403
21. S. Lee, and S. Choi Landmark MDS ensemble Pattern Recognition 42 9 2009 2045 2053
22. J.A. Lee, and M. Verleysen Nonlinear dimensionality reduction of data manifolds with essential loops Neurocomputing 67 2005 29 53
23. K.C. Lee, J. Ho, M.H. Yang, and D. Kriegman Visual tracking and recognition using probabilistic appearance manifolds Comput. Vision Image Understanding 99 2005 303 331
24. Lim, I.S., Ciechomski, P.H., Sarni, S., Thalmann, D., 2003. Planar arrangement of high-dimensional biomedical data sets by Isomap coordinates. In: Proc. 16th IEEE Symp. on Computer-based Medical Systems, pp. 50-55.
25. T. Lin, and H. Zha Riemannian manifold learning IEEE Trans. Pattern Anal. Machine Intell. 30 2008 796 809
26. Liu, T., Moore, A.W., Gray, A.G., Yang, K., 2005. An investigation of practical approximate nearest neighbor algorithms. In: Advances in Neural Information Processing Systems (NIPS), vol. 17, pp. 825-832.
27. M. Niskanen, and O. Silvén Comparison of dimensionality reduction methods for wood surface inspection Proc. 6th Internat. Conf. on Quality Control by Artificial Vision, Gatlinburg, TN, USA 2003 International Society for Optical Engineering 178 188
28. K. Pearson On lines and planes of closest fit to systems of points in space Philios. Mag. 2 1901 559 572
29. J. Platt Fastmap, metricmap, and landmark MDS are all Nyström algorithms Proc. 10th Internat. Workshop on Artificial Intelligence and Statistics 2005 Omni Press Madison, WI 261 268
30. R. Polikar Ensemble based systems in decision making IEEE Circuits Systems Mag. 6 3 2006 21 45
31. B. Raytchev, I. Yoda, and K. Sakaue Head pose estimation by nonlinear manifold learning Proc. 17th Internat. Conf. on Pattern Recognition (ICPR'04) 2004 IEEE Computer Society Washington, DC, USA 462 466
32. S.T. Roweis, and L.K. Saul Nonlinear dimensionality reduction by locally linear embedding Science 290 5500 2000 2323 2326
33. Shang, F., Jiao, L.C., Shi, J., Gong, M., Shang, R., 2010. Fast density-weighted low-rank approximation spectral clustering. Data Min. Knowl. Disc. doi: 10.1007/s10618-010-0207-5.
34. A. Strehl, and J. Ghosh Cluster ensembles - A knowledge reuse framework for combining multiple partitions J. Machine Learn. Res. 3 2002 583 617
35. Talwalkar, A., Kumar, S., Rowley, H., 2008. Large-scale manifold learning. In: IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), vol. 2, pp. 1-8.
36. J.B. Tenenbaum, V. de Silva, and J.C. Langford A global geometric framework for nonlinear dimensionality reduction Science 290 5500 2000 2319 2323
37. W.S. Torgerson Multidimensional scaling I: Theory and method Psychometrika 17 1952 401 419
38. van der Maaten, L.J.P., 2007. Matlab toolbox for dimensionality reduction. In: Proc. Belgian-Dutch Artificial Intelligence Conf. 2007, Utecht, The Netherlands, pp. 439-440.
39. F. Wang, and C. Zhang Label propagation through linear neighborhoods IEEE Trans. Knowl. Data Eng. 20 1 2008 55 67
40. Weinberger, K.Q., Sha, F., Saul, L.K., 2004. Learning a kernel matrix for nonlinear dimensionality reduction. In: Proc. 21st Internat. Conf. on Machine Learning (ICML), pp. 839-846.
41. Williams, C., Seeger, M., 2001. Using the Nyström method to speed up kernel machines. In: Advances in Neural Information Processing Systems (NIPS), vol. 13, pp 682-688.
42. Wu, M., Schölkopf, B., 2007. A local learning approach for clustering. In: Advances in Neural Information Processing Systems (NIPS), vol. 19, pp. 1529-1536.
43. S. Yan, Y. Hu, D. Xu, H. Zhang, B. Zhang, and Q. Cheng Nonlinear discriminant analysis on embedded manifold IEEE Trans. Circuits Systems Video Technol. 17 4 2007 468 477
44. Yann, L., Corinna, C., 2009. The MNIST Database of Handwritten Digits. < http://yann.lecun.com/exdb/mnist/ >.
45. Z. Zhang, and H. Zha Principal manifolds and nonlinear dimensionality reduction via local tangent space alignment SIAM J. Sci. Comput. 26 1 2004 313 338
46. Zhang, K., Tsang, I., Kwok, J., 2008. Improved Nyström low-rank approximation and error analysis. In: Proc. 25th Internat. Conf. on Machine Learning (ICML), pp. 273-297.