Sample-dependent graph construction with application to dimensionality reduction

Neurocomputing

Volumn 74, Issue 1-3, 2010, Pages 301-314

  Yang, Bo ^a,b   Chen, Songcan ^a  

^a NANJING UNIVERSITY OF AERONAUTICS AND ASTRONAUTICS   (China)

^b TONGHUA NORMAL UNIVERSITY   (China)

Author keywords

Dimensionality reduction (DR); Graph construction; Graph embedding; Graph Laplacian; Local neighbor; Similarity neighborhood

Indexed keywords

DIMENSIONALITY REDUCTION; GRAPH CONSTRUCTION; GRAPH EMBEDDING; GRAPH LAPLACIAN; LOCAL NEIGHBOR; SIMILARITY NEIGHBORHOOD;

CHARACTER RECOGNITION; LAPLACE TRANSFORMS; LEARNING ALGORITHMS;

FACE RECOGNITION;

ARTICLE; AUTOMATED PATTERN RECOGNITION; K NEAREST NEIGHBOR; LEARNING ALGORITHM; PRIORITY JOURNAL; QUALITY CONTROL; SAMPLE;

EID: 78649463393     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2010.03.019     Document Type: Article

References (53)

1. X. He, P. Niyogi, Locality preserving projections, in: Advances in Neural Information Processing Systems, 2003.
2. Yan S., Xu D., Zhang B., Zhang H., Yang Q., Lin S. Graph embedding and extension: a general framework for dimensionality reduction. IEEE Trans. Pattern Anal. Mach. Intell. 2007, 29:40-51.
3. He X., Yan S., Hu Y., Niyogi P., Zhang H.-J. Face recognition using laplacian faces. IEEE Trans. Pattern Anal. Mach. Intell. 2005, 27:328-340.
4. Belkin M., Niyogi P. Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput. 2003, 15:1373-1396.
5. Tenenbaum J., de Silva V., Langford J. A global geometric framework for nonlinear dimensionality reduction. Science 2000, 290:2319-2323.
6. Roweis S., Saul L. Nonlinear dimensionality reduction by locally linear embedding. Science 2000, 290:2323-2326.
7. D. Cai, X. He, K. Zhou, J. Han, and H. Bao, Locality sensitive discriminant analysis, in: International Joint Conference on Artificial Intelligence, 2007.
8. Yang J., Zhang D., Yang J.Y., Niu B. Globally maximizing, locally minimizing: unsupervised discriminant projection with applications to face and palm biometrics. IEEE Trans. Pattern Anal. Mach. Intell. 2007, 29:650-664.
9. Deng W., Hu J., Guo J., Zhang H., Zhang C. Comments on globally maximizing, locally minimizing: unsupervised discriminant projection with applications to face and palm biometrics. IEEE Trans. Pattern Anal. Mach. Intell. 2008, 30:1503-1504.
10. Y. Fu, T.S. Huang, Locally linear embedded eigenspace analysis, IFP-TR, UIUC, 〈〉, January 1, 2005. http://www.ifp.uiuc.edu/~yunfu2/papers/LEAYun05.pdf.
11. D. Cai, X. He, J. Han, Semi-supervised discriminant analysis, in: IEEE International Conference on Computer Vision, Rio de Janeiro, Brazil, October 2007.
12. X. Yang, H. Fu, H. Zha, J.L. Barlow, Semi-supervised nonlinear dimensionality reduction, in: International Conference on Machine Learning, Pittsburgh, PA, 2006.
13. X. Zhu, Semi-supervised learning literature survey, Computer Sciences Technical Report 1530, University of Wisconsin-Madison, July, 2008.
14. D. Zhou, O. Bousquet, T.N. Lal, J..Weston, B. Schölkopf, Learning with local and global consistency, in: Advances in Neural Information Processing Systems 16, 2004.
15. W. Tong, R. Jin, Semi-supervised learning by mixed label propagation, in: The Twenty-Second AAAI Conference on Artificial Intelligence, 2007.
16. Y. Zhang, Z. Zhou, Non-metric label propagation, in: International Joint Conference on Artificial Intelligence, 2009.
17. F. Wang, C. Zhang, Label propagation through linear neighborhoods, in: International Conference on Machine Learning, Pittsburgh, USA, 2006.
18. X. Zhu, Z. Ghahramani, J. Lafferty, Semi-supervised learning using Gaussian fields and harmonic functions, in: International Conference on Machine Learning, 2003.
19. M. Belkin, P. Niyogi, Laplacian eigenmaps and spectral techniques for embedding and clustering, in: Advances in Neural Information Processing Systems 14, Vancouver, British Columbia, Canada, 2001.
20. D. Zhou, C. Burges, Spectral clustering and transductive learning with multiple views, in: International Conference on Machine Learning, 2007.
21. Y. Bengio, J. Paiement, P. Vincent, Out-of-sample extensions for LLE, Isomap, MDS, eigenmaps, and spectral clustering, in: Advances in Neural Information Processing Systems 16, 2004.
22. Y. Fu, T.S. Huang, Unsupervised locally embedded clustering for automatic high-dimensional data labeling, in: IEEE International Conference on Acoustics, Speech, and Signal Processing, 2007.
23. Fu Y., Li Z., Huang T.S., Katsaggelos A.K. Locally adaptive subspace and similarity metric learning for visual data clustering and retrieval. Comput. Vis. Image Understand. 2008, 110:390-402.
24. C. Schellewald, C. Schnorr, Probabilistic subgraph matching approach based on convex relaxation, in: Energy Minimization Methods in Computer Vision and Pattern Recognition, 2005.
25. M. Maier, U. Luxburg, Influence of graph construction on graph-based clustering measures, in: Advances in The Neural Information Processing Systems 21, 2008.
26. T. Jebara, J. Wang, S. Chang, Graph construction and b-matching for semi-supervised learning, in: International Conference on Machine Learning, Montreal, Canada, 2009.
27. S. Daitch, J. Kelner, D. Spielman, Fitting a graph to vector data, in: International Conference on Machine Learning, Montreal, Canada, 2009.
28. A. Argyriou, M. Herbster, M. Pontil, Combining graph Laplacians for semi-supervised learning, in: Advances in Neural Information Processing Systems 18, 2005.
29. Hein M., Audibert J., Luxburg U. Graph laplacians and their convergence on random neighborhood graphs. J. Mach. Learn. Res. 2007, 8:1325-1368.
30. Tan X., Chen S., Zhou Z., Zhang F. Face recognition from a single image per person: A survey. Pattern Recog. 2006, 39:1725-1745.
31. Cai D., He X., Han J., Zhang H. Orthogonal Laplacian faces for face recognition. IEEE Trans. Image Process. 2006, 15:3608-3614.
32. F. Wang, C. Zhang, Feature extraction by maximizing the average neighborhood margin, in: IEEE Conference on Computer Vision and Pattern Recognition, 2007.
33. X. He, D. Cai, S. Yan, H. Zhang, Neighborhood preserving embedding, in: International Conference on Computer Vision, 2005.
34. H.T. Chen, H.W. Chang, T.L. Liu, Local discriminant embedding and its variants, in: IEEE Conference on Computer Vision and Pattern Recognition, 2005.
35. Tao D., Li X., Wu X., Maybank S.J. Geometric mean for subspace selection. IEEE Trans. Pattern Anal. Mach. Intell. 2009, 31:260-274.
36. Zhang T., Tao D., Li X., Yang J. Patch alignment for dimensionality reduction. IEEE Trans. Knowl. Data Eng. 2009, 21:1299-1313.
37. T. Zhang, D. Tao, X. Li, T. Yang, A unifying framework for spectral analysis based dimensionality reduction, in: IEEE International Joint Conference on Neural Networks, 2008.
38. D. Tao, J. Sun, J. Shen, X. Wu, X. Li, S. Maybank, C. Faloutsos, Bayesian tensor analysis, in: IEEE International Joint Conference on Neural Networks, 2008.
39. Tao D., Song M., Li X., Shen J., Sun J., Wu X., Faloutsos C., Maybank S. Bayesian tensor approach for 3-d face modeling. IEEE Trans. Circuits Syst. Video Technol. 2008, 18:1397-1410.
40. Zhang T., Li X., Tao D., Yang J. Local coordinates alignment (lca): a novel manifold learning approach. Int. J. Pattern Recogn. Artif. Intell. 2008, 22:667-690.
41. D. Cai, X. He, J. Han, Spectral regression for efficient regularized subspace learning, in: International Conference on Computer Vision, 2007.
42. D. Cai, X. He, Y. Hu, J. Han, T. Huang, Learning a spatially smooth subspace for face recognition, in: IEEE Conference on Computer Vision and Pattern Recognition, 2007.
43. D. Cai, X. He, W. Zhang, J. Han, Regularized locality preserving indexing via spectral regression, in: ACM International Conference on Information and Knowledge Management, 2007.
44. D. Cai, X. He, J. Han. Spectral regression: A unified approach for sparse subspace learning, in: International Conference on Data Mining, 2007.
45. Golub G.H., Van Loan C.F. Matrix Computations 1996, The Johns Hopkins University Press, Baltimore, MD, USA. third edition.
46. Y. Moses, Y. Adini, S. Ullman, Face recognition: the problem of compensating for changes in illumination direction, in: European Conference on Computer Vision, 1994.
47. C.L. Blake, C.J. Merz, UCI Repository of Machine Learning Databases, Department of Information and Computer Sciences,University of California, Irvine,1998.
48. M. Belkin, P. Niyogi, V. Sindhwani, Manifold regularization: a geometric framework for learning from examples, Technical Report TR-2004-06, Department of Computer Science, University of Chicago, 2004.
49. Jolliffe I.T. Principal Component Analysis 1986, Springer Verlag, New York.
50. Duda R.O., Hart P.E., Stork D.G. Pattern Classification 2001, John Wiley Sons, New York. second ed.
51. A.M. Martinez and R. Benavente, The AR face database, CVC Technical Report #24, June 1998.
52. Schölkopf B., Smola A.J. Learning with Kernels 2002, MIT Press.
53. A. Yang, J. Wright, Y. Ma, S. Sastry, Feature selection in face recognition: A sparse representation perspective, UC Berkeley Technical Report UCB/EECS-2007-99, 2007.