Semi-supervised sparse metric learning using alternating linearization optimization

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2010, Pages 1139-1147

  Liu, Wei ^a   Ma, Shiqian ^a   Tao, Dacheng ^b   Liu, Jianzhuang ^c   Liu, Peng ^d  

^a Och Spine at New York Presbyterian Hospitals   (United States)

^b NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^c CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

^d Federal Service for Surveillance on Consumer Rights Protection and Human Well Being   (United States)

Author keywords

Alternating linearization; Metric learning; Semi supervised sparse metric learning; Sparse inverse covariance estimation

Indexed keywords

ALTERNATING LINEARIZATION; CONVENTIONAL METHODS; DATA MINING APPLICATIONS; DATA RELATIONSHIPS; DATA SETS; DISTANCE MEASURE; DISTANCE METRICS; EUCLIDEAN SPACES; EXISTING METHOD; INPUT DATAS; INVERSE COVARIANCE; LABELED DATA; LINEARIZATION METHODS; MACHINE-LEARNING; METRIC LEARNING; PERFORMANCE GAIN; PROXIMITY MEASURE; SEMI-SUPERVISED; UNLABELED DATA;

DATA MINING; LEARNING SYSTEMS; OPTIMIZATION; VECTOR SPACES;

LINEARIZATION;

EID: 77956207894     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1835804.1835947     Document Type: Conference Paper

References (31)

1. O. Banerjee, L. E. Ghaoui, and A. d'Aspremont. Model selection through sparse maximum likelihood estimation for multivariate gaussian or binary data. Journal of Machine Learning Research, 9:485-516, 2008.
2. A. Bar-Hillel, T. Hertz, N. Shental, and D. Weinshall. Learning a mahalanobis metric from equivalence constraints. JMLR, 6:937-965, 2005.
3. S. Basu, M. Bilenko, and R. Mooney. A probabilistic framework for semi-supervised clustering. In Proc. KDD, 2004.
4. M. Bilenko, S. Basu, and R. Mooney. Integrating constraints and metric learning in semi-supervised clustering. In Proc. ICML, 2004.
5. S. Boyd and L. Vandenberge. Convex Optimization. Cambridge University Press, Cambridge, UK, 2003.
6. T.-S. Chua, J. Tang, R. Hong, H. Li, Z. Luo, and Y. Zheng. Nus-wide: A real-world web image database from national university of singapore. In Proc. CIVR, 2009.
7. J. V. Davis and I. S. Dhillon. Structured metric learning for high dimensional problems. In Proc. KDD, 2008.
8. J. V. Davis, B. Kulis, P. Jain, S. Sra, and I. S. Dhillon. Information-theoretic metric learning. In Proc. ICML, 2007.
9. J. Friedman, T. Hastie, and R. Tibshirani. Sparse inverse covariance estimation with the graphical lasso. Biostatistics, 8(1):1-10, 2007.
10. A. Globerson and S. Roweis. Metric learning by collapsing classes. In NIPS 18, 2006.
11. J. Goldberger, S. Roweis, and R. Salakhutdinov. Neighbourhood components analysis. In NIPS 17, 2005.
12. D. Goldfarb and S. Ma. Fast alternating linearization methods for minimizing the sum of two convex functions. Technical report, Department of IEOR, Columbia University, 2009. Preprint available at http://arxiv.org/abs/ 0912.4571.
13. J.-B. Hiriart-Urruty and C. Lemaréchal. Convex Analysis and Minimization Algorithms II: Advanced Theory and Bundle Methods. Springer-Verlag, New York, 1993.
14. S. C. Hoi, W. Liu, and S.-F. Chang. Semi-supervised distance metric learning for collaborative image retrieval. In Proc. CVPR, 2008.
15. B. Kulis, S. Basu, I. Dhillon, and R. Mooney. Semi-supervised graph clustering: A kernel approach. Machine Learning, 74(1):1-22, 2009.
16. W. Liu, B. Qian, J. Cui, and J. Liu. Spectral kernel learning for semi-supervised classification. In Proc. IJCAI, 2009.
17. W. Liu, D. Tao, and J. Liu. Transductive component analysis. In Proc. IEEE ICDM, 2008.
18. W. Liu, X. Tian, D. Tao, and J. Liu. Constrained metric learning via distance gap maximization. In Proc. AAAI, 2010.
19. Z. Lu. Smooth optimization approach for sparse covariance selection. SIAM J. Optim., 19(4):1807-1827, 2009.
20. Y. E. Nesterov. Smooth minimization for non-smooth functions. Math. Program. Ser. A, 103:127-152, 2005.
21. 1-penalized log-determinant regularization. In Proc. ICML, 2009.
22. R. Rosales and G. Fung. Learning sparse metrics via linear programming. In Proc. KDD, 2006.
23. Y. Rui, T. S. Huang, M. Ortega, and S. Mehrotra. Relevance feedback: A powerful tool in interactive content-based image retrieval. IEEE Trans. on Circuits and Systems for Video Technology, 8(5):644-655, 1998.
24. A. W. M. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain. Content-based image retrieval at the end of the early years. IEEE Trans. PAMI, 22(12):1349-1380, 2000.
25. W. Tang, H. Xiong, S. Zhong, and J. Wu. Enhancing semi-supervised clustering: A feature projection perspective. In Proc. KDD, 2007.
26. K. Wagstaff, C. Cardie, S. Rogers, and S. Schroedl. Constrained k-means clustering with background knowledge. In Proc. ICML, 2001.
27. M. Wang, L. Yang, and X.-S. Hua. Msra-mm: Bridging research and industrial societies for multimedia information retrieval. Technical report, Miscosoft Research Asia, 2009. No. MSR-TR-2009-30.
28. K. Q. Weinberger and L. K. Saul. Distance metric learning for large margin nearest neighbor classification. Journal of Machine Learning Research, 10:207-244, 2009.
29. E. P. Xing, A. Y. Ng, M. I. Jordan, and S. Russell. Distance metric learning with application to clustering with side-information. In NIPS 15, 2003.
30. Y. Ying, K. Huang, and C. Campbell. Sparse metric learning via smooth optimization. In NIPS 22, 2010.
31. X. Zhu. Semi-supervied learning literature survey. Technical report, University of Wisconsin Madison, 2008.