SLED: Semantic label embedding dictionary representation for multilabel image annotation

IEEE Transactions on Image Processing

Volumn 24, Issue 9, 2015, Pages 2746-2759

  Cao, Xiaochun ^a,b   Zhang, Hua ^a,b   Guo, Xiaojie ^a   Liu, Si ^a   Meng, Dan ^a  

^a University of Chinese Academy of Sciences   (China)

^b TIANJIN UNIVERSITY   (China)

Author keywords

Group sparse reconstruction; Multilabel image annotation; Weakly supervised dictionary learning

Indexed keywords

IMAGE ANALYSIS; IMAGE PROCESSING; SEMANTICS;

DICTIONARY LEARNING; DISCRIMINATIVE DICTIONARIES; DISCRIMINATIVE FEATURES; FEATURE REPRESENTATION; FISHER DISCRIMINATION CRITERIONS; GROUP SPARSE; IMAGE ANNOTATION; SEMANTIC RELATIONSHIPS;

IMAGE RECONSTRUCTION;

EID: 84930507299     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2015.2428055     Document Type: Article

References (56)

1. X. Chen, Y. Mu, S. Yan, and T.-S. Chua, "Efficient large-scale image annotation by probabilistic collaborative multi-label propagation", in Proc. Int. Conf. Multimedia, 2010, pp. 35-44.
2. M. Guillaumin, T. Mensink, J. Verbeek, and C. Schmid, "TagProp: Discriminative metric learning in nearest neighbor models for image auto-annotation", in Proc. IEEE 12th Int. Conf. Comput. Vis., Sep./Oct. 2009, pp. 309-316.
3. C. Wang, S. Yan, L. Zhang, and H.-J. Zhang, "Multi-label sparse coding for automatic image annotation", in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2009, pp. 1643-1650.
4. G. Carneiro, A. B. Chan, P. J. Moreno, and N. Vasconcelos, "Supervised learning of semantic classes for image annotation and retrieval", IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 3, pp. 394-410, Mar. 2007.
5. C. Cusano, G. Ciocca, and R. Schettini, "Image annotation using SVM", Proc. SPIE, vol. 5304, pp. 330-338, 2004.
6. X. Chen, X.-T. Yuan, Q. Chen, S. Yan, and T.-S. Chua, "Multilabel visual classification with label exclusive context", in Proc. ICCV, Nov. 2011, pp. 834-841.
7. Y.-G. Jiang, Q. Dai, J. Wang, C.-W. Ngo, X. Xue, and S.-F. Chang, "Fast semantic diffusion for large-scale context-based image and video annotation", IEEE Trans. Image Process., vol. 21, no. 6, pp. 3080-3091, Jun. 2012.
8. L. Wu, S. C. H. Hoi, and N. Yu, "Semantics-preserving bag-of-words models and applications", IEEE Trans. Image Process., vol. 19, no. 7, pp. 1908-1920, Jul. 2010.
9. N. Zhou, Y. Shen, J. Peng, and J. Fan, "Learning inter-related visual dictionary for object recognition", in Proc. IEEE Conf. CVPR, Jun. 2012, pp. 3490-3497.
10. Z. Jiang, Z. Lin, and L. S. Davis, "Learning a discriminative dictionary for sparse coding via label consistent K-SVD", in Proc. IEEE Conf. CVPR, Jun. 2011, pp. 1697-1704.
11. Z. Jiang, Z. Lin, and L. S. Davis, "Label consistent K-SVD: Learning a discriminative dictionary for recognition", IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 11, pp. 2651-2664, Nov. 2013.
12. P. Duygulu, K. Barnard, J. F. de Freitas, and D. A. Forsyth, "Object recognition as machine translation: Learning a lexicon for a fixed image vocabulary", in Proc. ECCV, 2002, pp. 97-112.
13. A. Subramanya and J. A. Bilmes, "Entropic graph regularization in non-parametric semi-supervised classification", in Proc. NIPS, 2009, pp. 1803-1811.
14. N. Ueda and K. Saito, "Parametric mixture models for multi-labeled text", in Proc. NIPS, 2002, pp. 721-728.
15. S. Liu et al., "Hi, magic closet, tell me what to wear!" in Proc. ACM MM, 2012, pp. 619-628.
16. S. Liu, Z. Song, G. Liu, C. Xu, H. Lu, and S. Yan, "Street-to-shop: Cross-scenario clothing retrieval via parts alignment and auxiliary set", in Proc. IEEE Conf. CVPR, Jun. 2012, pp. 3330-3337.
17. F. Perronnin, J. Sánchez, and T. Mensink, "Improving the Fisher kernel for large-scale image classification", in Proc. ECCV, 2010, pp. 143-156.
18. L. Fei-Fei and P. Perona, "A Bayesian hierarchical model for learning natural scene categories", in Proc. IEEE Conf. CVPR, Jun. 2005, pp. 524-531.
19. D. G. Lowe, "Distinctive image features from scale-invariant keypoints", Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, Nov. 2004.
20. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection", in Proc. IEEE Conf. CVPR, Jun. 2005, pp. 886-893.
21. M. Zheng et al., "Graph regularized sparse coding for image representation", IEEE Trans. Image Process., vol. 20, no. 5, pp. 1327-1336, May 2011.
22. C.-C. Chang and C.-J. Lin, "LIBSVM: A library for support vector machines", ACM Trans. Intell. Syst. Technol., vol. 2, no. 3, p. 27, Apr. 2011.
23. M. Yang, L. Zhang, X. Feng, and D. Zhang, "Sparse Representation Based Fisher Discrimination Dictionary Learning for Image Classification", Int. J. Comput. Vis., vol. 109, no. 3, pp. 209-232, 2014.
24. Y. Yang, F. Wu, F. Nie, H. T. Shen, Y. Zhuang, and A. G. Hauptmann, "Web and personal image annotation by mining label correlation with relaxed visual graph embedding", IEEE Trans. Image Process., vol. 21, no. 3, pp. 1339-1351, Mar. 2012.
25. I. Tsochantaridis, T. Hofmann, T. Joachims, and Y. Altun, "Support vector machine learning for interdependent and structured output spaces", in Proc. ICML, 2004, p. 104.
26. T.-S. Chua, J. Tang, R. Hong, H. Li, Z. Luo, and Y. Zheng, "NUS-WIDE: A real-world Web image database from National University of Singapore", in Proc. ACM CIVR, 2009, p. 48.
27. T. Griffiths and Z. Ghahramani, "Infinite latent feature models and the Indian buffet process", in Proc. NIPS, 2005, pp. 475-482.
28. M. Aharon, M. Elad, and A. Bruckstein, "K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation", IEEE Trans. Signal Process., vol. 54, no. 11, pp. 4311-4322, Nov. 2006.
29. H. Lee, A. Battle, R. Raina, and A. Y. Ng, "Efficient sparse coding algorithms", in Proc. NIPS, 2006, pp. 801-808.
30. J. Wright, A. Y. Yang, A. Ganesh, S. S. Sastry, and Y. Ma, "Robust face recognition via sparse representation", IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 210-227, Feb. 2009.
31. J. Mairal, F. Bach, J. Ponce, G. Sapiro, and A. Zisserman, "Discriminative learned dictionaries for local image analysis", in Proc. IEEE Conf. CVPR, Jun. 2008, pp. 1-8.
32. L. Yang, R. Jin, R. Sukthankar, and F. Jurie, "Unifying discriminative visual codebook generation with classifier training for object category recognition", in Proc. IEEE Conf. CVPR, Jun. 2008, pp. 1-8.
33. W. Zhang, A. Surve, X. Fern, and T. Dietterich, "Learning non-redundant codebooks for classifying complex objects", in Proc. ICML, 2009, pp. 1241-1248.
34. J. Winn, A. Criminisi, and T. Minka, "Object categorization by learned universal visual dictionary", in Proc. ICCV, Oct. 2005, pp. 1800-1807.
35. J. Liu and M. Shah, "Learning human actions via information maximization", in Proc. IEEE Conf. CVPR, Jun. 2008, pp. 1-8.
36. S. Lazebnik and M. Raginsky, "Supervised learning of quantizer codebooks by information loss minimization", IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 7, pp. 1294-1309, Jul. 2009.
37. Q. Qiu, Z. Jiang, and R. Chellappa, "Sparse dictionary-based representation and recognition of action attributes", in Proc. ICCV, Nov. 2011, pp. 707-714.
38. H. Liu and S. Yan, "Robust graph mode seeking by graph shift", in Proc. ICML, 2010, pp. 671-678.
39. H. Cheng, X. Yan, J. Han, and C.-W. Hsu, "Discriminative frequent pattern analysis for effective classification", in Proc. ICDE, Apr. 2007, pp. 716-725.
40. S. Ji and J. Ye, "An accelerated gradient method for trace norm minimization", in Proc. ICNL, 2009, pp. 457-464.
41. J. M. Bioucas-Dias and M. A. T. Figueiredo, "A new TwIST: Two-step iterative shrinkage/thresholding algorithms for image restoration", IEEE Trans. Image Process., vol. 16, no. 12, pp. 2992-3004, Dec. 2007.
42. S. Zhang, J. Huang, Y. Huang, Y. Yu, H. Li, and D. N. Metaxas, "Automatic image annotation using group sparsity", in Proc. IEEE Conf. CVPR, Jun. 2010, pp. 3312-3319.
43. L. Yuan, J. Liu, and J. Ye, "Efficient methods for overlapping group lasso", in Proc. NIPS, 2011, pp. 352-360.
44. N. S. Altman, "An introduction to kernel and nearest-neighbor nonparametric regression", Amer. Statist., vol. 46, no. 3, pp. 175-185, 1992.
45. V. Lavrenko, R. Manmatha, and J. Jeon, "A model for learning the semantics of pictures", in Proc. NIPS, 2003, pp. 553-560.
46. D. Metzler and R. Manmatha, "An inference network approach to image retrieval", in Proc. CIVR, 2004, pp. 42-50.
47. A. Yavlinsky, E. Schofield, and S. Rüger, "Automated image annotation using global features and robust nonparametric density estimation", in Proc. CIVR, 2005, pp. 507-517.
48. J. Liu, M. Li, Q. Liu, H. Lu, and S. Ma, "Image annotation via graph learning", Pattern Recognit., vol. 42, no. 2, pp. 218-228, Feb. 2009.
49. A. Makadia, V. Pavlovic, and S. Kumar, "A new baseline for image annotation", in Proc. ECCV, 2008, pp. 316-329.
50. Z. Lin, G. Ding, M. Hu, J. Wang, and X. Ye, "Image tag completion via image-specific and tag-specific linear sparse reconstructions", in Proc. IEEE Conf. CVPR, Jun. 2013, pp. 1618-1625.
51. B. Hariharan, L. Zelnik-Manor, M. Varma, and S. Vishwanathan, "Large scale max-margin multi-label classification with priors", in Proc. ICML, 2010, pp. 423-430.
52. X. Li, C. G. M. Snoek, and M. Worring, "Learning social tag relevance by neighbor voting", IEEE Trans. Multimedia, vol. 11, no. 7, pp. 1310-1322, Nov. 2009.
53. S. L. Feng, R. Manmatha, and V. Lavrenko, "Multiple Bernoulli relevance models for image and video annotation", in Proc. IEEE Conf. CVPR, Jun./Jul. 2004, pp. II-1002-II-1009.
54. M. Chen, A. Zheng, and K. Weinberger, "Fast image tagging", in Proc. ICML, 2013, pp. 1274-1282.
55. L. Wu, R. Jin, and A. K. Jain, "Tag completion for image retrieval", IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 3, pp. 716-727, Mar. 2013.
56. M. Yang, L. Zhang, X. Feng, and D. Zhang, "Sparse representation based Fisher discrimination dictionary learning for image classification", Int. J. Comput. Vis., vol. 109, no. 3, pp. 209-232, Sep. 2014.