Decomposition-based transfer distance metric learning for image classification

IEEE Transactions on Image Processing

Volumn 23, Issue 9, 2014, Pages 3789-3801

  Luo, Yong ^a   Liu, Tongliang ^b   Tao, Dacheng ^b   Xu, Chao ^a  

^a BEIJING UNIVERSITY OF POSTS AND TELECOMMUNICATIONS   (China)

^b UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

Author keywords

base metric; decomposition; Distance metric learning; image classification; transfer learning

Indexed keywords

DECOMPOSITION; IMAGE ANALYSIS; PATTERN RECOGNITION;

BASE METRIC; CRITICAL FACTORS; DATA DISTRIBUTION; DISTANCE METRIC LEARNING; HANDWRITTEN IMAGES; PAIRWISE CONSTRAINTS; SIDE INFORMATION; TRANSFER LEARNING;

IMAGE CLASSIFICATION;

EID: 84905040895     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2014.2332398     Document Type: Article

References (46)

1. K. Q. Weinberger, J. Blitzer, and L. K. Saul, "Distance metric learning for large margin nearest neighbor classification," in Proc. Adv. Neural Inform. Process. Syst., 2005, pp. 1473-1480.
2. M. Guillaumin, T. Mensink, J. Verbeek, and C. Schmid, "Tagprop: Discriminative metric learning in nearest neighbor models for image auto-annotation," in Proc. IEEE 12th Int. Conf. Comput. Vis., Sep./Oct. 2009, pp. 309-316.
3. E. P. Xing, M. I. Jordan, S. Russell, and A. Y. Ng, "Distance metric learning with application to clustering with side-information," in Proc. Adv. Neural Inform. Process. Syst., 2002, pp. 505-512.
4. Y. Aytar and A. Zisserman, "Tabula rasa: Model transfer for object category detection," in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Nov. 2011, pp. 2252-2259.
5. Y. Luo, D. Tao, B. Geng, C. Xu, and S. J. Maybank, "Manifold regularized multitask learning for semi-supervised multilabel image classification," IEEE Trans. Image Process., vol. 22, no. 2, pp. 523-536, Feb. 2013.
6. N. Sawant, J. Z. Wang, and L. Jia, "Enhancing training collections for image annotation: An instance-weighted mixture modeling approach," IEEE Trans. Image Process., vol. 22, no. 9, pp. 3562-3577, Sep. 2013.
7. Y. Luo, D. Tao, C. Xu, C. Xu, H. Liu, and Y. Wen, "Multiview vectorvalued manifold regularization for multilabel image classification," IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 5, pp. 709-722, May 2013.
8. J. Gui, D. Tao, Z. Sun, Y. Luo, X. You, and Y. Tang, "Group sparse multiview patch alignment framework with view consistency for image classification," IEEE Trans. Image Process., vol. 23, no. 7, pp. 3126-3137, Jul. 2014.
9. J. Goldberger, S. Roweis, G. Hinton, and R. Salakhutdinov, "Neighbourhood components analysis," in Proc. Adv. Neural Inform. Process. Syst., Dec. 2004, pp. 513-520.
10. J. V. Davis, B. Kulis, P. Jain, S. Sra, and I. S. Dhillon, "Informationtheoretic metric learning," in Proc. 24th Int. Conf. Mach. Learn. (ICML), 2007, pp. 209-216.
11. K. Q. Weinberger and L. K. Saul, "Fast solvers and efficient implementations for distance metric learning," in Proc. 25th Int. Conf. Mach. Learn. (ICML), 2008, pp. 1160-1167.
12. R. Jin, S. Wang, and Y. Zhou, "Regularized distance metric learning: Theory and algorithm," in Proc. Adv. Neural Inform. Process. Syst., 2009, pp. 862-870.
13. Z.-J. Zha, T. Mei, M. Wang, Z. Wang, and X.-S. Hua, "Robust distance metric learning with auxiliary knowledge," in Proc. Int. Joint Conf. Artif. Intell., 2009, pp. 1327-1332.
14. Y. Zhang and D.-Y. Yeung, "Transfer metric learning with semisupervised extension," ACM Trans. Intell. Syst. Technol., vol. 3, no. 3, pp. 54:1-54:28, May 2012.
15. Y. Nesterov, "Smooth minimization of non-smooth functions," Math. Program., vol. 103, no. 1, pp. 127-152, May 2005. (Pubitemid 40537674)
16. T.-S. Chua, J. Tang, R. Hong, H. Li, Z. Luo, and Y. Zheng, "NUS-WIDE: A real-world web image database from national university of singapore," in Proc. ACM Int. Conf. Image Video Retr., 2009, pp. 48:1-48:9.
17. L. Yang and R. Jin, "Distance metric learning: A comprehensive survey," Dept. Comput. Sci. Eng., Michigan State Univ., Tech. Rep., Lansing, MI, USA, May 2006.
18. M. Schultz and T. Joachims, "Learning a distance metric from relative comparisons," in Proc. Adv. Neural Inform. Process. Syst., 2003, pp. 41-48.
19. S. T. Roweis and L. K. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol. 290, no. 5500, pp. 2323-2326, Dec. 2000. (Pubitemid 32041578)
20. M. Belkin and P. Niyogi, "Laplacian eigenmaps and spectral techniques for embedding and clustering," in Proc. Adv. Neural Inform. Process. Syst., 2001, pp. 585-591.
21. S. C. H. Hoi, W. Liu, M. R. Lyu, and W.-Y. Ma, "Learning distance metrics with contextual constraints for image retrieval," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Jun. 2006, pp. 2072-2078. (Pubitemid 44931570)
22. M. S. Baghshah and S. B. Shouraki, "Semi-supervised metric learning using pairwise constraints," in Proc. Int. Joint Conf. Artif. Intell., 2009, pp. 1217-1222.
23. N. Shental, T. Hertz, D. Weinshall, and M. Pavel, "Adjustment learning and relevant component analysis," in Proc. 7th Eur. Conf. Comput. Vis., May 2002, pp. 776-790.
24. J. Quionero-Candela, M. Sugiyama, A. Schwaighofer, and N. D. Lawrence, Dataset Shift in Machine Learning. Cambridge, MA, USA: MIT Press, 2009.
25. T. Evgeniou and M. Pontil, "Regularized multi-task learning," in Proc. ACM Int. Conf. Knowl. Discovery Data Mining, 2004, pp. 109-117. (Pubitemid 40114921)
26. J. Huang, A. Gretton, K. M. Borgwardt, B. Schölkopf, and A. J. Smola, "Correcting sample selection bias by unlabeled data," in Proc. Adv. Neural Inform. Process. Syst., 2007, pp. 601-608.
27. A. Argyriou, T. Evgeniou, and M. Pontil, "Convex multi-task feature learning," Mach. Learn., vol. 73, no. 3, pp. 243-272, Dec. 2008.
28. B. Geng, D. Tao, and C. Xu, "DAML: Domain adaptation metric learning," IEEE Trans. Image Process., vol. 20, no. 10, pp. 2980-2989, Oct. 2011.
29. J. Blitzer, R. McDonald, and F. Pereira, "Domain adaptation with structural correspondence learning," in Proc. Conf. Empirical Methods Natural Lang. Process., 2006, pp. 120-128.
30. A. Argyriou, T. Evgeniou, and M. Pontil, "Multi-task feature learning," in Proc. Adv. Neural Inform. Process. Syst., 2007, pp. 41-48.
31. R. Gupta and L.-A. Ratinov, "Text categorization with knowledge transfer from heterogeneous data sources," in Proc. 23rd Nat. Conf. Artif. Intell., 2008, pp. 842-847.
32. S. J. Pan and Q. Yang, "A survey on transfer learning," IEEE Trans. Knowl. Data Eng., vol. 22, no. 10, pp. 1345-1359, Oct. 2010.
33. W. Dai, Q. Yang, G.-R. Xue, and Y. Yu, "Boosting for transfer learning," in Proc. Int. Conf. Mach. Learn., Jun. 2007, pp. 193-200.
34. R. Raina, A. Battle, H. Lee, B. Packer, and A. Y. Ng, "Self-taught learning: Transfer learning from unlabeled data," in Proc. 24th Int. Conf. Mach. Learn., 2007, pp. 759-766.
35. L. Mihalkova, T. Huynh, and R. J. Mooney, "Mapping and revising Markov logic networks for transfer learning," in Proc. 22nd Nat. Conf. Artif. Intell., 2007, pp. 608-614. (Pubitemid 350149637)
36. H. Van Nguyen, V. Patel, N. M. Nasrabad, and R. Chellappa, "Design of non-linear Kernel dictionaries for object recognition," IEEE Trans. Image Process., vol. 22, no. 12, pp. 5123-5135, Dec. 2013.
37. A. Rodriguez, V. N. Boddeti, B. Vijaya Kumar, and A. Mahalanobis, "Maximum margin correlation filter: A new approach for localization and classification," IEEE Trans. Image Process., vol. 22, no. 2, pp. 631-643, Feb. 2013.
38. T. Zhou, D. Tao, and X. Wu, "NESVM: A fast gradient method for support vector machines," in Proc. Int. Conf. Data Mining, 2010, pp. 679-688.
39. S. Oraintara, W. C. Karl, D. A. Castanon, and T. Q. Nguyen, "A method for choosing the regularization parameter in generalized Tikhonov regularized linear inverse problems," in Proc. Int. Conf. Image Process., 2000, pp. 93-96. (Pubitemid 32465810)
40. A. Mirzal, "A converged algorithm for Tikhonov regularized nonnegative matrix factorization with automatic regularization parameters determination," 2012.
41. O. Bousquet and A. Elisseeff, "Stability and generalization," J. Mach. Learn. Res., vol. 2, pp. 499-526, Mar. 2002. (Pubitemid 135712570)
42. M. Mohri, A. Rostamizadeh, and A. Talwalkar, Foundations of Machine Learning. Cambridge, MA, USA: MIT Press, 2012.
43. G. A. Watson, "Characterization of the subdifferential of some matrix norms," Linear Algebra Appl., vol. 170, pp. 33-45, Jun. 1992.
44. C. McDiarmid, "On the method of bounded differences," in Proc. Surv. Combinat., 1989, pp. 148-188.
45. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, Nov. 2004.
46. J. Gui, Z. Sun, J. Cheng, S. Ji, and X. Wu, "How to estimate the regularization parameter for spectral regression discriminant analysis and its kernel version?" IEEE Trans. Circuits Syst. Video Technol., vol. 24, no. 2, pp. 211-223, 2014.