Transfer metric learning with semi-supervised extension

ACM Transactions on Intelligent Systems and Technology

Volumn 3, Issue 3, 2012, Pages

  Zhang, Yu ^a   Yeung, Dit Yan ^a  

^a HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

Author keywords

Metric learning; Multitask learning; Semi supervised learning; Transfer learning

Indexed keywords

ALTERNATING METHOD; CONVEX OPTIMIZATION PROBLEMS; DATA MINING ALGORITHM; DISTANCE METRIC LEARNING; GENERALIZATION PERFORMANCE; LABELED DATA; METRIC LEARNING; MULTITASK LEARNING; SEMI-SUPERVISED; SEMI-SUPERVISED LEARNING; TRANSFER LEARNING; UNLABELED DATA;

ALGORITHMS; CONVEX OPTIMIZATION; COVARIANCE MATRIX; SUPERVISED LEARNING;

DATA MINING;

EID: 84863633782     PISSN: 21576904     EISSN: 21576912     Source Type: Journal    
DOI: 10.1145/2168752.2168768     Document Type: Conference Paper

References (42)

1. ARGYRIOU, A., EVGENIOU, T., AND PONTIL, M. 2008. Convex multi-task feature learn. Machine Learn. 73, 3, 243-272.
2. BELKIN, M., NIYOGI, P., AND SINDHWANI, V. 2006. Manifold regularization: A geometric framework for learning from labeled and unlabeled examples. J. Machine Learn. Res. 7, 2399-2434. (Pubitemid 44708005)
3. BERTSEKAS, D. P. 1999. Nonlinear Programming. Athena Scientific.
4. BOYD, S. AND VANDENBERGHE, L. 2004. Convex Optimization. Cambridge University Press, Cambridge, UK.
5. CARUANA, R. 1997. Multitask learn. Machine Learn. 28, 1, 41-75.
6. CAWLEY, G. C., TALBOT, N. L. C., AND GIROLAMI, M. 2006. Sparse multinomial logistic regression via bayesian l1 regularisation. In Advances in Neural Information Processing Systems 19, B. Schölkopf, J. C. Platt, and T. Hoffman Eds., 209-216.
7. CHANG, H. AND YEUNG, D.-Y. 2004. Locally linear metric adaptation for semi-supervised clustering. In Proceedings of the 21st International Conference on Machine Learning.
8. CHAPELLE, O., ZIEN, A., AND SCHÖLKOPF, B., Eds. 2006. Semi-Supervised Learning. MIT Press, Cambridge, UK.
9. CHEN, J., ZHAO, Z., YE, J., AND LIU, H. 2007. Nonlinear adaptive distance metric learning for clustering. In Proceedings of the 13th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 123-132. (Pubitemid 350229199)
10. CHUNG, F. R. K. 1997. Spectral Graph Theory. American Mathematical Society.
11. DAVIS, J. V. AND DHILLON, I. S. 2008. Structured metric learning for high dimensional problems. In Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 195-203.
12. DAVIS, J. V., KULIS, B., JAIN, P., SRA, S., AND DHILLON, I. S. 2007. Information-theoretic metric learning. In Proceedings of the 24th International Conference on Machine Learning. 209-216.
13. DEMPSTER, A. P., LAIRD, N. M., AND RUBIN, D. B. 1977. Maximum likelihood from incomplete data via the EM algorithm. J. Royal Stat. Soc., B 39, 1, 1-38.
14. EVGENIOU, T. AND PONTIL, M. 2004. Regularized multi-task learning. In Proceedings of the 10th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 109-117. (Pubitemid 40114921)
15. FOO, C.-S., DO, C. B., AND NG, A. Y. 2009. A majorization-minimization algorithm for (multiple) hyperparameter learning. In Proceedings of the 26th International Conference on Machine Learning. 321-328.
16. GRANT, M. AND BOYD, S. 2009. CVX: Matlab software for disciplined convex programming.
17. GUPTA, A. K. AND NAGAR, D. K. 2000. Matrix Variate Distributions. Chapman & Hall.
18. HASTIE, T. AND TIBSHIRANI, R. 1996. Discriminant adaptive nearest neighbor classification. IEEE Trans. Pattern Anal. Mach. Intell. 18, 6, 607-616. (Pubitemid 126773896)
19. HOI, S. C. H., LIU, W., AND CHANG, S.-F. 2008. Semi-supervised distance metric learning for collaborative image retrieval. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition.
20. HOI, S. C. H., LIU, W., AND CHANG, S.-F. 2010. Semi-supervised distance metric learning for collaborative image retrieval and clustering. ACM Trans. Multimedia Comput. Comm. App. 6, 3.
21. JIN, R., WANG, S., AND ZHOU, Y. 2009. Regularized distance metric learning: Theory and algorithm. In Advances in Neural Information Processing Systems 22, Y. Bengio, D. Schuurmans, J. Lafferty, C. K. I. Williams, and A. Culotta Eds., 862-870.
22. KIENZLE, W. AND CHELLAPILLA, K. 2006. Personalized handwriting recognition via biased regularization. In Proceedings of the 23rd International Conference on Machine Learning. 457-464.
23. LANGE, K., HUNTER, D. R., AND YANG, I. 2000. Optimization transfer using surrogate objective functions. J. Computat. Graph. Stat. 9, 1, 1-59.
24. LOBO, M. S., VANDENBERGHE, L., BOYD, S., AND LEBRET, H. 1998. Applications of second-order cone programming. Linear Algebra Appl. 284, 193-228.
25. PAN, S. AND YANG, Q. 2010. A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 22, 10, 1345-1359.
26. PAN, S. J., KWOK, J. T., AND YANG, Q. 2008. Transfer learning via dimensionality reduction. In Proceedings of the 23rd AAAI Conference on Artificial Intelligence. 677-682.
27. PAN, S. J., TSANG, I. W., KWOK, J. T., AND YANG, Q. 2009. Domain adaptation via transfer component analysis. In Proceedings of the 21st International Joint Conference on Artificial Intelligence. 1187-1192.
28. ROSENSTEIN, M. T., MARX, Z., AND KAELBLING, L. P. 2005. To transfer or not to transfer. In Proceedings of the NIPS-05 Workshop on Inductive Transfer: 10 Years Later.
29. THRUN, S. 1996. Is learning the n-th thing any easier than learning the first? In Advances in Neural Information Processing Systems 8, D. S. Touretzky, M. Mozer, and M. E. Hasselmo Eds., 640-646.
30. WANG, Z., SONG, Y., AND ZHANG, C. 2008. Transferred dimensionality reduction. In Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases. 550-565.
31. WEINBERGER, K. Q. AND SAUL, L. K. 2008. Fast solvers and efficient implementations for distance metric learning. In Proceedings of the 25th International Conference on Machine Learning. 1160-1167.
32. WEINBERGER, K. Q., BLITZER, J., AND SAUL, L. K. 2005. Distance metric learning for large margin nearest neighbor classification. In Advances in Neural Information Processing Systems 18, Y. Weiss, B. Schölkopf, and J. Platt Eds., 1473-1480.
33. WILLIAMS, P. M. 1995. Bayesian regularization and pruning using a laplace prior. Neural Comput. 7, 1, 117-143.
34. XIAO, B., YANG, X., XU, Y., AND ZHA, H. 2009. Learning distance metric for regression by semidefinite programming with application to human age estimation. In Proceedings of the 17th ACM International Conference on Multimedia. 451-460.
35. XING, E. P., NG, A. Y., JORDAN, M. I., AND RUSSELL, S. J. 2002. Distance metric learning with application to clustering with side-information. In Advances in Neural Information Processing Systems 15, S. Becker, S. Thrun, and K. Obermayer Eds., 505-512.
36. YEUNG, D.-Y. AND CHANG, H. 2007. A kernel approach for semisupervised metric learning. IEEE Trans. Neural Netw. 18, 1, 141-149. (Pubitemid 46062923)
37. YEUNG, D.-Y., CHANG, H., AND DAI, G. 2008. A scalable kernel-based semi-supervised metric learning algorithm with out-of-sample generalization ability. Neural Comput. 20, 11, 2839-2861.
38. ZELNIK-MANOR, L. AND PERONA, P. 2004. Self-tuning spectral clustering. In Advances in Neural Information Processing Systems 17. 1601-1608.
39. ZHA, Z.-J., MEI, T., WANG, M., WANG, Z., AND HUA, X.-S. 2009. Robust distance metric learning with auxiliary knowledge. In Proceedings of the 21st International Joint Conference on Artificial Intelligence. 1327-1332.
40. ZHAN, D.-C., LI, M., LI, Y.-F., AND ZHOU, Z.-H. 2009. Learning instance specific distances using metric propagation. In Proceedings of the 26th International Conference on Machine Learning. 1225-1232.
41. ZHANG, Y. AND YEUNG, D.-Y. 2010a. A convex formulation for learning task relationships in multi-task learning. In Proceedings of the 26th Conference on Uncertainty in Artificial Intelligence. 733-742.
42. ZHANG, Y. AND YEUNG, D.-Y. 2010b. Transfer metric learning by learning task relationships. In Proceedings of the 16th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 1199-1208.