Semisupervised metric learning by maximizing constraint margin

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 41, Issue 4, 2011, Pages 931-939

  Wang, Fei ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

Constraint margin; distance metric learning; semisupervised

Indexed keywords

CONSTRAINT MARGIN; DATA OBJECTS; DATA POINTS; DISTANCE METRIC LEARNING; DISTANCE METRICS; HIGHER-ORDER TENSOR; METRIC LEARNING; NONLINEAR PROBLEMS; PAIRWISE CONSTRAINTS; SEMISUPERVISED;

TENSORS;

ALGORITHMS;

EID: 79960697096     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2010.2101593     Document Type: Article

References (38)

1. A. Bar-Hillel, T. Hertz, N. Shental, and D. Weinshall, "Learning a Mahalanobis metric from equivalence constraints," J. Mach. Learn. Res., vol. 6, pp. 937-965, 2005.
2. S. Basu, A. Banerjee, and R. J. Mooney, "Semi-supervised clustering by seeding," in Proc. 19th Int. Conf. Mach. Learn., 2002, pp. 19-26.
3. P. N. Belhumeur, J. Hespanda, and D. Kiregeman, "Eigenfaces vs. fisherfaces: Recognition using class specific linear projection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 711-720, Jul. 1997. (Pubitemid 127762263)
4. M. Belkin, P. Niyogi, and V. Sindhwani, "Manifold regularization: A geometric framework for learning from labeled and unlabeled examples," J. Mach. Learn. Res., vol. 7, pp. 2399-2434, 2006. (Pubitemid 44708005)
5. P. O. Boykin and V. P. Roychowdhury, "Leveraging social networks to fight spam," Computer, vol. 38, no. 4, pp. 61-68, Apr. 2005. (Pubitemid 40625786)
6. E. K. C. Blake and C. J. Merz, "UCI repository of machine learning databases," Dept. Inf. Comput. Sci., Univ. California, Irvine, CA, 1998.
7. D. Cai, X. He, and J. Han, "Subspace learning based on tensor analysis," Dept. Comput. Sci., Univ. Illinois Urbana-Champaign (UIUCDCS-R-2005-2572), Champaign, IL, Tech. Rep. 2572, 2005.
8. T. F. Cox and M. A. A. Cox, Multimensional Scaling. London, U.K.: Chapman & Hall, 2001.
9. I. Davidson, K. L.Wagstaff, and S. Basu, "Measuring constraint-set utility for partitional clustering algorithms," in Proc. 10th Eur. Conf. Principles Practice Knowl. Discovery Databases, 2006, pp. 115-126. (Pubitemid 44617717)
10. R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification, 2nd ed. New York: Wiley, 2001.
11. K. Fukunaga and T. Flick, "An optimal global nearest neighbor metric," IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-6, no. 3, pp. 314-318, May 1984. (Pubitemid 14563808)
12. A. S. Georghiades, P. N. Belhumeur, and D. J. Kriegman, "From few to many: Illumination none models for face recognition under variable lighting and pose," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 6, pp. 643-660, Jun. 2001. (Pubitemid 32585276)
13. J. He, M. Li, H.-J. Zhang, H. Tong, and C. Zhang, "Manifold ranking based image retrieval," in Proc. ACM Multimedia Conf., 2004, pp. 9-16. (Pubitemid 40211712)
14. X. He, W.-Y. Ma, and H.-J. Zhang, "Learning an image manifold for retrieval," in Proc. ACM Multimedia Conf., 2004, pp. 17-23. (Pubitemid 40211713)
15. G. Hinton and S. Roweis, "Stochastic neighbor embedding," in Advances in Neural Information Processing Systems 15. Cambridge, MA: MIT Press, 2002, pp. 833-840.
16. I. T. Jolliffe, Principal Component Analysis. New York: Springer-Verlag, 1986.
17. B. Larsen and C. Aone, "Fast and effective text mining using lineartime document clustering," in Proc. 5th ACM SIGKDD Int. Conf. Knowl. Discuss. Data Mining, 1999, pp. 16-22.
18. n) approximation of higher-order tensors," SIAM J. Matrix Anal. Appl., vol. 21, no. 4, pp. 1324-1342, 2000. (Pubitemid 33217072)
19. B. Liu, M. Wang, R. Hong, Z. Zha, and X.-S. Hua, "Joint learning of labels and distance metric," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 3, pp. 973-978, Jun. 2010.
20. W. Liu, S. Ma, D. Tao, J. Liu, and P. Liu, "Semi-supervised sparse metric learning using alternating linearization optimization," in Proc. 16th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining (KDD), 2010, pp. 1139-1148.
21. W. Liu, X. Tian, D. Tao, and J. Liu, "Constrained metric learning via distance gap maximization," in Proc. Nat. Conf. Artif. Intell. (AAAI), 2010, pp. 518-524.
22. B. Schölkopf and A. Smola, Learning With Kernels. Cambridge, MA: MIT Press, 2002.
23. H. S. Seung and D. D. Lee, "The manifold ways of perception," Science, vol. 290, no. 5500, pp. 2268-2269, Dec. 2000. (Pubitemid 32041555)
24. Y. Song, C. Zhang, J. Lee, and F. Wang, "A discriminative method for semi-automated tumorous tissues segmentation of MR brain images," in Proc. IEEE Comput. Soc. Workshop Math. Methods Biomed. Image Anal., 2006, p. 79.
25. J. Tang, X.-S. Hua, M. Wang, Z. Gu, G.-J. Qi, and X. Wu, "Correlative linear neighborhood propagation for video annotation," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 39, no. 2, pp. 409-416, Apr. 2009.
26. D. Tao, X. Li, X. Wu, W. Hu, and S. J. Maybank, "Supervised tensor learning," Knowl. Inf. Syst., vol. 13, no. 1, pp. 1-42, Sep. 2007.
27. D. Tao, X. Li, X. Wu, and S. J. Maybank, "General tensor discriminant analysis and Gabor features for gait recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 10, pp. 1700-1715, Oct. 2007.
28. M. A. Turk and A. P. Pentland, "Eigenfaces for recognition," J. Cogn. Neurosci., vol. 3, no. 1, pp. 71-96, 1991.
29. K.Wagstaff, C. Cardie, S. Rogers, and S. Schroedl, "Constrained k-means clustering with background knowledge," in Proc. 18th Int. Conf. Mach. Learn., 2001, pp. 577-584.
30. F. Wang, S. Chen, T. Li, and C. Zhang, "Semi-supervised metric learning by maximizing constraint margin," in Proc. ACM 17th Conf. Inf. Knowl. Manage., 2008, pp. 1457-1458.
31. F. Wang and C. Zhang, "Feature extraction by maximizing the average neighborhood margin," in Proc. IEEE Comput. Soc. Conf. CVPR, 2007, pp. 1-8.
32. H. Wang, Q. Wu, L. Shi, Y. Yu, and N. Ahuja, "Out-of-core tensor approximation of multi-dimensional matrices of visual data," ACM Trans. Graph., vol. 24, no. 3, pp. 527-535, Jul. 2005.
33. K. Q. Weinberger, J. Blitzer, and L. K. Saul, "Distance metric learning for large margin nearest neighbor classification," in Proc. Adv. Neural Inf. Process. Syst., 2006, pp. 1473-1480.
34. K. Q. Weinberger and L. K. Saul, "An introduction to nonlinear dimensionality reduction by maximum variance unfolding," in Proc. Nat. Conf. Artif. Intell., 2006, pp. 1683-1686. (Pubitemid 44705525)
35. E. P. Xing, A. Y. Ng, M. I. Jordan, and S. Russell, "Distance metric learning with application to clustering with side-information," in Proc. Adv. Neural Inf. Process. Syst., 2002, vol. 15, pp. 505-512.
36. L. Yang, "Distance metric learning: A comprehensive survey," Dept. Comput. Sci. Eng., Michigan State Univ., East Lansing, MI, 2006.
37. M. H. Yang, "Kernel eigenfaces vs. kernel fisherfaces: Face recognition using kernel methods," in Proc. 5th IEEE Int. Conf. Autom. Face Gesture Recog., 2002, pp. 215-220.
38. W. Zuo, D. Zhang, and K. Wang, "Bidirectional PCA with assembled matrix distance metric for image recognition," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 36, no. 4, pp. 863-872, Aug. 2006. (Pubitemid 44178155)