Weighted locally linear embedding for dimension reduction

Pattern Recognition

Volumn 42, Issue 5, 2009, Pages 798-811

  Pan, Yaozhang ^a   Ge, Shuzhi Sam ^a   Al Mamun, Abdullah ^a  

^a Interactive Digital Media Institute   (Singapore)

Author keywords

Feature extraction; Locally linear embedding; Manifold learning; Nonlinear dimensionality reduction

Indexed keywords

CAMS; CLUSTERING ALGORITHMS; DATA REDUCTION; DATA STRUCTURES; DISCRIMINANT ANALYSIS; EDUCATION; FACE RECOGNITION; LEARNING ALGORITHMS; LEARNING SYSTEMS;

CAM CONTOURS; CENTRAL PROBLEMS; DATA ANALYSIS; DATA SETS; DIMENSION REDUCTIONS; DIMENSIONAL DATUMS; DIMENSIONAL REPRESENTATIONS; DISTANCE MEASURES; FACE IMAGES; FACE RECOGNITION METHODS; FEATURE EXTRACTION ALGORITHMS; GLOBAL DISTRIBUTIONS; INPUT DATUMS; INTRINSIC STRUCTURES; KERNEL DIRECT DISCRIMINANT ANALYSES; LINEAR EMBEDDING; LOCALLY LINEAR EMBEDDING; MANIFOLD LEARNING; NEIGHBOR SEARCHING; NONLINEAR DIMENSIONALITY REDUCTION; PARAMETER CHANGES; REAL WORLDS; SIMULATION STUDIES; UNSUPERVISED LEARNING ALGORITHMS; WEIGHTED DISTANCES;

FEATURE EXTRACTION;

EID: 58249094366     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2008.08.024     Document Type: Article

References (42)

1. S.M. Omohundro, Bumptrees for efficient function, constraint and classification learning., in: conf/nips/1990, Morgan Kaufmann, 1991, pp. 693-699.
2. Lu J., Plataniotis K.N., and Venetsanopoulos A.N. Face recognition using kernel direct discriminant analysis algorithms. IEEE Trans. Neural Networks 14 1 (2003) 117-126
3. Rousseeuw P.J., and Leroy A.M. Robust Regression and Outlier Detection (1987), Wiley, New York
4. Roweis S.T., and Saul L.K. Nonlinear dimensionality reduction by locally linear embedding. Science 290 (2000) 2323-2326
5. Saul L.K., and Roweis S.T. Think globally, fit locally: unsupervised learning of low dimensional manifolds. J. Mach. Learn. Res. 4 (2003) 119-155
6. Jolliffe I. Principal Component Analysis. second ed. (2002), Springer, New York
7. Cox T.F., and Cox M.A.A. Multidimensional Scaling (1994), Chapman & Hall, London
8. Tenenbaum J., de Silva V., and Langford J.C. A global geometric framework for nonlinear dimensionality reduction. Science 290 (2000) 2319-2323
9. Scholkopf B., Smola A., and Müller K.-R. Nonlinear component analysis as a kernel eigenvalue problem. Neural Comput. 10 5 (1998) 1299-1319
10. Belkin M., and Niyogi P. Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput. 15 6 (2003) 1373-1396
11. Ge S.S., Lee T.H., and Harris C.J. Adaptive Neural Network Control of Robotic Manipulators (1992), World Scientific, Singapore
12. Li X., and Roeder N. Face contour extraction from front-view images. Pattern Recognition 28 8 (1995) 1167-1179
13. Yang G., and Huang T.S. Human face detection in a complex background. Pattern Recognition 27 1 (1994) 53-63
14. Short R.D., and Fukunaga K. The optimal distance measure for nearest neighbor classification. IEEE Trans. Inf. Theory 27 5 (1981) 622-627
15. Fukunaga K., and Hostetler L. Optimization of k-nearest neighbor density estimates. IEEE Trans. Inf. Theory 19 3 (1973) 320-326
16. Muezzinoglu M., and Zurada J. Rbf-based neurodynamic nearest neighbor classification in real pattern space. Pattern Recognition 39 5 (2006) 747-760
17. Y. Pan, S.S. Ge, F.R. Tang, A.A. Mamun, Detection of epileptic spike-wave discharges using SVM, in: Proceedings of the 2007 IEEE International Conference on Control Applications, Suntec City, Singapore, 2007, pp. 467-472.
18. Su M., and Chou C. A modified version of the k-means algorithm with a distance based on cluster symmetry. IEEE Trans. Pattern Anal. Mach. Intell. 23 6 (2001) 674-680
19. Likas A., Vlassis N., and Verbeek J. The global k-means clustering algorithm. Pattern Recognition 36 2 (2003) 451-461
20. Fukunaga K., and Flick T.E. An optimal global nearest neighbor metric. IEEE Trans. Pattern Anal. Mach. Intell. 6 3 (1984) 314-318
21. J.H. Friedman, Flexible metric nearest neighbor classification, Technical Report, Department of Statistics Stanford University, Stanford, CA, USA, 1994.
22. Hastie T., and Tibshirani R. Discriminant adaptive nearest neighbor classification. IEEE Trans. Pattern Anal. Mach. Intell. 18 6 (1996) 607-616
23. Lowe D.G. Similarity metric learning for a variable-kernel classifier. Neural Comput. 7 1 (1995) 72-85
24. Domeniconi C., Peng J., and Gunopulos D. Locally adaptive metric nearest-neighbor classification. IEEE Trans. Pattern Anal. Mach. Intell. 24 9 (2002) 1281-1285
25. Zhang Y.G., Zhang C.S., and Zhang D. Distance metric learning by knowledge embedding. Pattern Recognition 37 1 (2004) 161-163
26. Yu J., Amores J., Sebe N., Radeva P., and Tian Q. Distance learning for similarity estimation. IEEE Trans. Pattern Anal. Mach. Intell. 30 3 (2008) 451-462
27. N. Mekuz, C. Bauckhage, J.K. Tsotsos, Face recognition with weighted locally linear embedding, in: Proceedings of the Second Canadian Conference on Computer and Robot Vision, 2005, pp. 290-296.
28. Zhou C.Y., and Chen Y.Q. Improving nearest neighbor classification with cam weighted distance. Pattern Recognition 39 (2006) 1-11
29. S.S. Ge, F. Guan, A.P. Loh, C.H. Fua, Feature representation based on intrinsic structure discovery in high dimensional space, in: Proceedings of the 2006 IEEE International Conference on Robotics and Automation, Orlando, FL, USA, 2006, pp. 3399-3404.
30. S.S. Ge, F. Guan, Y. Pan, A.P. Loh, Neighborhood linear embedding for intrinsic structure discovery, Mach. Vision Appl. J., accepted for publication.
31. S.S. Ge, Y. Yang, T. Lee, Hand gesture recognition and tracking based on distributed locally linear embedding, in: Proceedings of IEEE International Conference on Robotics, Automation and Mechatronics, Bangkok, Thailand, 2006, pp. 567-572.
32. E. Pekalska, A. Harol, R. Duin, B. Spillmann, H. Bunke, Non-euclidean or non-metric measures can be informative, in: Structural, Syntactic, and Statistical Pattern Recognition, 2006, pp. 871-880.
33. D.B. Graham, N.M. Allinson, Characterizing virtual eigensignatures for general purpose face recognition, in: H. Wechsler, P.J. Phillips, V. Bruce, F. Fogelman-Soulie, T.S. Huang (Eds.), Face Recognition: From Theory to Applications, NATO ASI Series F, Computer and Systems Sciences, vol. 163, 1998, pp. 446-456.
34. D.B. Graham, N. Allinson, URL: 〈http://images.ee.umist.ac.uk/danny/database.html〉, 1998.
35. Zhang C.S., Wang J., Zhao N.Y., and Zhang D. Reconstruction and analysis of multi-pose face images based on nonlinear dimensionality reduction. Pattern Recognition 37 2 (2004) 325-336
36. LEE C.H., Kim J.S., and Park K.H. Automatic human face location in a complex background using motion and color information. Pattern Recognition 29 11 (1996) 1877-1889
37. Dai Y., and Nakano Y. Face-texture model based on sgld and its application in face detection in a color scene. Pattern Recognition 29 6 (1996) 1007-1017
38. Yang J., Frangi A.F., and Yang Zhong Jin J.yu. KPCA plus LDA: a complete kernel fisher discriminant framework for feature extraction and recognition. IEEE Trans. Pattern Anal. Mach. Intell. 27 2 (2005) 230-244
39. A.G. Gray, A.W. Moore, N-Body problems in statistical learning, in: conf/nips/2000, 2001, pp. 521-527.
40. Fokkema D.R., Speijpen G.L.G., and Vandervorst H.A. Jacobi-Davidson style QR and QZ algorithms for the reduction of matrix pencils. SIAM J. Sci. Comput. 20 1 (1998) 94-125
41. Press W., Teukolsky S.A., Vetterling W.T., and Flannery B. Numerical Recipes in C: The Art of Scientific Computing. second ed. (1993), Cambridge University Press, New York, NY, USA
42. LeCun Y., Orr G.B., and Müller K.-R. Efficient backprop. In: Orr G.B., and Muller K.-R. (Eds). Neural Networks: Tricks of the Trade (1998), Springer, Berlin