Semantic preserving distance metric learning and applications

Information Sciences

Volumn 281, Issue , 2014, Pages 674-686

  Yu, Jun ^a   Tao, Dapeng ^b   Li, Jonathan ^c   Cheng, Jun ^d,e  

^a HANGZHOU DIANZI UNIVERSITY   (China)

^b SOUTH CHINA UNIVERSITY OF TECHNOLOGY   (China)

^c XIAMEN UNIVERSITY   (China)

^d SHENZHEN INSTITUTES OF ADVANCED TECHNOLOGY   (China)

^e CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Clustering; Manifold structure; Pairwise constraints; Semantic distance metric

Indexed keywords

CONTENT BASED RETRIEVAL; GRAPHIC METHODS;

CLUSTERING; COMPLEMENTARY CHARACTERISTICS; CONTENT BASED IMAGE RETRIEVAL; DISTANCE METRIC LEARNING; EDGE DIRECTION HISTOGRAMS; MANIFOLD STRUCTURES; PAIRWISE CONSTRAINTS; SEMANTIC DISTANCE;

SEMANTICS;

EID: 84904725481     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2014.01.025     Document Type: Article

References (82)

1. P. Belhumeur, J. Hepanha, and D. Kriegman Eigenfaces vs. fisherfaces: recognition using class specific linear projection IEEE Trans. Pattern Anal. Mach. Intell. 19 7 1997 711 720
2. M. Belkin, and P. Niyogi Laplacian eigenmaps for dimensionality reduction and data representation Neural Comput. 15 6 2003 1373 1396
3. S. Belongie, J. Malik, and J. Puzicha Shape matching and object recognition using shape contexts IEEE Trans. Pattern Anal. Mach. Intell. 24 4 2002 509 522
4. Cedar CDROM, 1: USPS Office of Advanced Technology Database of Handwritten, Cities, 1992.
5. G. Chechik, V. Sharma, U. Shalit, and S. Bengio Large scale online learning of image similarity through ranking J. Mach. Learn. Res. 11 3 2010 1109 1135
6. H. Chen, L. Li, and J. Peng Error bounds of multi-graph regularized semi-supervised classification Inform. Sci. 179 12 2009 1960 1969
7. R. Datta, D. Joshi, J. Li, and J.Z. Wang Image retrieval: ideas, influences, and trends of the new age ACM Comput. Surv. 40 2 2008 1 60
8. J. Davis, B. Kulis, P. Jain, S. Sra, I. Dhillon, Information-theoretic metric learning, in: Proc. of the International Conference on Machine Learning, Corvallis, Oregon, USA, 2007, pp. 209-216.
9. Y. Du, J.Z. Wang, A scalable integrated region-based image retrieval system, in: Proc. IEEE Int. Conf. on Image Processing, Thessaloniki, Greece, 2001, pp. 22-25.
10. S. France, J. Carroll, and H. Xiong Distance metrics for high dimensional nearest neighborhood recovery: compression and normalization Inform. Sci. 184 1 2012 92 110
11. A. Georghiades, P. Belhumeur, and D. Kriegman From few to many: illumination cone models for face recognition under variable lighting and pose IEEE Trans. Pattern Anal. Mach. Intell. 23 6 2001 643 660
12. S. Gordon, H. Greenspan, J. Goldberger, Applying the information bottleneck principle to unsupervised clustering of discrete and continuous image representations, in: Proc. IEEE Int. Conf. on Computer Vision, Nice, France, 2003, pp. 370-377.
13. D. Graham, N. Allinson, Web site of UMIST Multi-View Face Database, Image Engineering and Neural Computing Lab, University of Manchester Institute of Science and Technology, UK. < http://www.images.ee.umist.ac.uk/danny/ database.html >
14. Y. Han, Z. Xu, Z. Ma, and Z. Huang Image classification with manifold learning for out-of-sample data Signal Process. 93 8 2013 2169 2177
15. H. Hayashi, Q. Zhao, Induction of compact neural network trees through centroid based dimensionality reduction, in: Proc. of IEEE International Conference on Systems, Man and Cybernetics, Texas, 2009, pp. 974-979.
16. H. Hayashi, Q. Zhao, Model reduction of neural network trees based on dimensionality reduction, in: Proc. of International Joint Conference on Neural Networks, Atlanta, 2009, pp. 1171-1176.
17. X. He, P. Niyogi, Locality preserving projections, in: Proc. of Neural Information Processing Systems, Whistler, BC, Canada, 2003.
18. A. Hillel, T. Hertz, N. Shental, D. Weinshall, Learning distance functions using equivalence relations, in: Proc. Int. Conf. on Machine Learning, Washington, DC, USA, 2003, pp. 11-18.
19. C. Hoi, W. Liu, M. Lyu, W. Ma, Learning distance metrics with contextual constraints for image retrieval, in: Proc. Int. Conf. on Computer Vision and Pattern Recognition, New York, USA, 2006, pp. 2072-2078.
20. C. Hsieh, F. Chang, Q. Zhao, Content aware image retrieval with partition-based color feature, in: Proc. of International Joint Conference on Neural Networks, Barcelona, 2010, pp. 1392-1398.
21. K. Huang, Y. Ying, C. Campbell, GSML: a unified framework for sparse metric learning, in: Proc. Int. Conf. on Data Mining, Miami, USA, 2009, pp. 189-198.
22. K. Huang, Y. Ying, and C. Campbell Generalized sparse metric learning with relative comparisons Knowl. Inform. Syst. 2010 10.1007/s10115-010-0313-0
23. K. Huang, D. Tao, Y. Tang, X. Li, and T. Tan Biologically inspired features for scene classification in video surveillance IEEE Trans. Syst. Man Cybern. Part B 41 1 2011 307 313
24. M. Huiskes, M. Lew, The MIRFLICKR retrieval evaluation, in: Proc. ACM Int. Conf on Multimedia Information Retrieval, Vancouver, Canada, 2008, pp. 39-43.
25. A. Jain, and A. Vailaya Image retrieval using color and shape Pattern Recogn. 29 8 1996 1233 1244
26. P. Jain, B. Kulis, J. Davis, I. Dhillon, Metric and Kernel Learning using a Linear Transformation, 30 October 2009. arXiv: 0910.5932v1.
27. P. Jain, Brian Kulis, Inductive regularized learning of kernel functions, in: Proc. of Neural Information Processing Systems, Vancouver, Canada, 2010, pp. 946-954.
28. P. Ji, N. Zhao, S. Hao, and J. Jiang Automatic image annotation by semi-supervised manifold kernel density estimation Inform. Sci. 281 2013 648 660
29. I. Jolliffe Principal Component Analysis second en. 2002 Springer-Verlag
30. M. Kostinger, M. Hirzer, P. Wohlhart, M. Roth, H. Bischof, Large scale metric learning from equivalence constraints, in: IEEE Conference on Computer Vision and Pattern Recognition, 2012, pp. 2288-2295.
31. F. Li, J. Yang, J. Wang, A transductive framework of distance metric learning by spectral dimensionality reduction, in: Proc. Int. Conf. on Machine Learning, Corvallis, USA, 2007, pp. 513-520.
32. J. Li, J. Z. Wang, Real-time computerized annotation of pictures, in: Proc. ACM Int. Conf. on Multimedia, Santa Barbara, USA, 2006, pp. 911-920.
33. P. Li, H. Li, and M. Wu Multi-label ensemble based on variable pairwise constraint projection Inform. Sci. 222 2013 269 281
34. B. Liu, M. Wang, R. Hong, Z. Zha, and X. Hua Joint learning of labels and distance metric IEEE. Trans. Syst. Man Cybern. Part B 40 3 2010 973 978
35. D. Lowe Distinctive image features from scale-invariant keypoints Int. J. Comput. Vision 60 2 2004 91 110
36. J. Lu, J. Hu, X. Zhou, Y. Shang, Y. Tan, G. Wang, Neighborhood repulsed metric learning for kinship verification, in: IEEE Conference on Computer Vision and Pattern Recognition, 2012, pp. 2594-2601.
37. B. Manjunath, and W.Y. Ma Texture features for browsing and retrieval of image data IEEE Trans. Pattern Anal. Mach. Intell. 18 8 1996 837 842
38. J. Mao, and A.K. Jain Texture classification and segmentation using multiresolution simultaneous autoregressive models Pattern Recogn. 25 2 1992 173 188
39. A. Martinez, and J. Vitria Clustering in image space for place recognition and visual annotations for human-robot interaction IEEE. Trans. Syst. Man Cybern. Part B 31 5 2001 669 682
40. S. Nene, S. Nayar, H. Murase, Columbia Object Image Library (COIL-20), Technical Report, Report No. CUCS-005-96, February 1996.
41. A. Oliva, and A. Torralba Modeling the shape of the scene: a holistic representation of the spatial envelope Int. J. Comput. Vision 42 3 2001 145 175
42. Z. Pan, X. You, H. Chen, D. Tao, and B. Pang Generalization performance of magnitude-preserving semi-supervised ranking with graph-based regularization Inform. Sci. 221 2013 284 296
43. G. Pass, R. Zabih, J. Miller, Comparing images using color coherence vectors, in: Proc. ACM Int. Conf. on Multimedia, Santa Barbara, USA, 2006, pp. 65-73.
44. C. Papadimitriou, and K. Steiglitz Combinatorial Optimization: Algorithms and Complexity 1998 Dover New York
45. L. Saul, and S. Roweis Think globally, fit locally: unsupervised learning of low dimensional manifolds J. Mach. Learn. Res. 4 2003 119 155
46. D. Pedronette, and R. Torres Exploiting pairwise recommendation and clustering strategies for image re-ranking Inform. Sci. 207 2012 19 34
47. Shape Data for the MPEG-7 Core Experiment CE-Shape-1. < http://www.cis.temple.edu/~latecki/TestData/mpeg7shapeB.tar.gz >.
48. J. Shi, and J. Malik Normalized cuts and image segmentation IEEE Trans. Pattern Anal. Mach. Intell. 22 8 2000 888 905
49. M. Swain, and D. Ballard Color indexing Int. J. Comput. Vision 7 1 1991 11 32
50. J. Tenenbaum, V. Silva, and J. Langford A global geometric framework for nonlinear dimensionality reduction Science 290 22 2000 2319 2323
51. M. Wang, X. Hua, J. Tang, and R. Hong Beyond distance measurement: constructing neighborhood similarity for video annotation IEEE Trans. Multimedia 11 3 2009 465 476
52. J. Wang, F. Wang, C. Zhang, H. Shen, and L. Quan Linear neighborhood propagation and its applications IEEE Trans. Pattern Anal. Mach. Intell. 31 9 2009 1600 1615
53. J. Wang, Y. Zhao, X. Wu, and X. Hua A transductive multi-label learning approach for video concept detection Pattern Recogn. 44 10-11 2011 2274 2286
54. M. Wang, H. Li, D. Tao, K. Lu, and X. Wu Multimodal graph-based reranking for web image search IEEE Trans. Image Process. 21 11 2012 4649 4661
55. M. Wang, B. Ni, X. Hua, and T. Chua Assistive tagging: a survey of multimedia tagging with human-computer joint exploration ACM Comput. Surv. 44 4 2012
56. W. Wang, S. Li, J. Li, W. Li, and F. Wei Exploring hypergraph-based semi-supervised ranking for query-oriented summarization Inform. Sci. 237 2013 271 286
57. K. Weinberger, and L. Saul Distance metric learning for large margin nearest neighbor classification J. Mach. Learn. Res. 10 12 2009 207 244
58. J. Weston, S. Bengio, and P. Hamel Large-scale music annotation and retrieval: learning to rank in joint semantic spaces J. New Music Res. 2011
59. J. Weston, S. Bengio, N. Usunier, WSABIE: Scaling Up to Large Vocabulary Image Annotation, IJCAI, 2011, pp. 2764-2770.
60. A. Woznica, A. Kalousis, A new framework for dissimilarity and similarity learning, in: Proc. of Pacific-Asia Conf. Knowledge Discovery and Data Mining, Hyderabad, India, 2010, pp. 386-397.
61. S. Xiang, F. Nie, and C. Zhang Learning a Mahalanobis distance metric for data clustering and classification Pattern Recogn. 41 12 2008 3600 3612
62. E. Xing, A. Ng, M. Jordan, S. Russell, Distance metric learning, with application to clustering with side-information, in: Proc. of Neural Information Processing Systems, Vancouver, Canada, 2003, pp. 177-184.
63. L. Yang, R. Jin, Distance Metric Learning: A Comprehensive Survey, Technical Report, Report No. UCB/CSD-02-1206, 2006.
64. Y. Yang, D. Xu, F. Nie, J. Luo, Y. Zhuang, Ranking with local regression and global alignment for cross media retrieval, in: ACM Multimedia, 2009, pp. 175-184.
65. Y. Yang, H. Shen, Z. Ma, Z. Huang, X. Zhou, L21-Norm Regularized Discriminative Feature Selection for Unsupervised Learning, IJCAI, 2011, pp. 1589-1594.
66. Y. Yang, F. Nie, D. Xu, J. Luo, Y. Zhuang, and Y. Pan A multimedia retrieval framework based on semi-supervised ranking and relevance feedback IEEE Trans. Pattern Anal. Mach. Intell. 34 4 2012 723 742
67. Y. Yang, J. Song, Z. Huang, Z. Ma, N. Sebe, and A. Hauptmann Multi-feature fusion via hierarchical regression for multimedia analysis IEEE Trans. Multimedia 15 3 2013 572 581
68. Y. Ying, K. Huang, C. Campbell, Sparse metric learning via smooth optimization, in: Proc. of Neural Information Processing Systems, Vancouver, Canada, 2009.
69. Z. Yu, H. Wong, J. You, and G. Han Visual query processing for efficient image retrieval using a SOM-based filter-refinement scheme Inform. Sci. 203 2012 83 101
70. J. Yu, D. Liu, D. Tao, and H. Seah Complex object correspondence construction in two-dimensional animation IEEE Trans. Image Process. 20 11 2011 3257 3269
71. J. Yu, D. Liu, D. Tao, and H. Seah On combining multiple features for cartoon character retrieval and clip synthesis IEEE Trans. Syst. Man Cybern. Part B 42 5 2012 1413 1427
72. J. Yu, D. Tao, and M. Wang Adaptive hypergraph learning and its application in image classification IEEE Trans. Image Process. 21 7 2012 3262 3272
73. J. Yu, M. Wang, and D. Tao Semi supervised multiview distance metric learning for cartoon synthesis IEEE Trans. Image Process. 21 11 2012 4636 4648
74. J. Yu, and D. Tao Modern Machine Learning Techniques and Their Applications in Cartoon Animation Research 2013 Wiley-IEEE Press
75. J. Yu, D. Tao, Y. Rui, and J. Cheng Pairwise constraints based multiview features fusion for scene classification Pattern Recogn. 46 2 2013 483 496
76. J. Yu, Y. Rui, and B. Chen Exploiting click constraints and multiview features for image reranking IEEE Trans. Multimedia 2013 10.1109/TMM.2013. 2284755
77. Z. Zhang, and H. Zha Principal manifolds and nonlinear dimension reduction via local tangent space alignment SIAM J. Sci. Comput. 26 1 2005 313 338
78. T. Zhang, D. Tao, J. Yang, Discriminative locality alignment, in: Proc. Euro. Conf. on Computer Vision, 2008, pp. 725-738.
79. T. Zhang, K. Huang, X. Li, J. Yang, and D. Tao Discriminative orthogonal neighborhood-preserving projections for classification IEEE Trans. Syst. Man Cybern. Part B 40 1 2010 253 263
80. T. Zhang, D. Tao, X. Li, and J. Yang Patch alignment for dimensionality reduction IEEE Trans. Knowl. Data Eng. 21 9 2009 1299 1313
81. Y. Zhang, J. Schneider, Maximum Margin Output Coding, ICML, 2012.
82. K. Zhao, W. Liu, J. Liu, Optimal semi-supervised metric learning for image retrieval, in: ACM Multimedia, 2012.