Optimized graph learning using partial tags and multiple features for image and video annotation

IEEE Transactions on Image Processing

Volumn 25, Issue 11, 2016, Pages 4999-5011

  Song, Jingkuan ^a   Gao, Lianli ^b   Nie, Feiping ^c   Shen, Heng Tao ^d   Yan, Yan ^a   Sebe, Nicu ^a  

^a UNIVERSITY OF TRENTO   (Italy)

^b UNIVERSITY OF ELECTRONIC SCIENCE AND TECHNOLOGY OF CHINA   (China)

^c University of Texas at Arlington   (United States)

^d UNIVERSITY OF QUEENSLAND   (Australia)

Author keywords

Graph learning; image and video annotation; semi supervised learning

Indexed keywords

GRAPHIC METHODS; SUPERVISED LEARNING;

GEOMETRICAL RELATIONSHIP; GRAPH LEARNING; GRAPH-BASED LEARNING; MULTIMEDIA ANNOTATIONS; REGULARIZATION TERMS; SEMI- SUPERVISED LEARNING; STATE-OF-THE-ART METHODS; VIDEO ANNOTATIONS;

LEARNING ALGORITHMS;

EID: 84991618952     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2016.2601260     Document Type: Article

References (59)

1. A. Tariq and H. Foroosh, "Feature-independent context estimation for automatic image annotation," in Proc. CVPR, 2015, pp. 1958-1965.
2. M. Chen, A. Zheng, and K. Q. Weinberger, "Fast image tagging," in Proc. ICML, 2013, pp. 1274-1282.
3. M. Guillaumin, T. Mensink, J. Verbeek, and C. Schmid, "TagProp: Discriminative metric learning in nearest neighbor models for image auto-annotation," in Proc. ICCV, 2009, pp. 309-316.
4. L. Gao, J. Song, F. Nie, Y. Yan, N. Sebe, and H. T. Shen, "Optimal graph learning with partial tags and multiple features for image and video annotation," in Proc. CVPR, Jun. 2015, pp. 4371-4379.
5. B. Cheng, J. Yang, S. Yan, Y. Fu, and T. S. Huang, "Learning with l1- graph for image analysis," IEEE Trans. Image Process., vol. 19, no. 4, pp. 858-866, Apr. 2010.
6. J. Wang, T. Jebara, and S.-F. Chang, "Graph transduction via alternating minimization," in Proc. ICML, 2008, pp. 1144-1151.
7. W. Liu, J. Wang, and S. F. Chang, "Robust and scalable graph-based semisupervised learning," Proc. IEEE, vol. 100, no. 9, pp. 2624-2638, Sep. 2012.
8. Y. Yang, Z. Wang, J. Yang, J. Wang, S. Chang, and T. S. Huang, "Data clustering by Laplacian regularized -1-graph," in Proc. AAAI, 2014, pp. 3148-3149.
9. C. Deng, R. Ji, D. Tao, X. Gao, and X. Li, "Weakly supervised multigraph learning for robust image reranking," IEEE Trans. Multimedia, vol. 16, no. 3, pp. 785-795, Apr. 2014.
10. J. Tang, R. Hong, S. Yan, T.-S. Chua, G.-J. Qi, and R. Jain, "Image annotation by kNN-sparse graph-based label propagation over noisily tagged Web images," ACM Trans. Intell. Syst. Technol., vol. 1, no. 1, pp. 111-126, 2011.
11. X. Zhu, Z. Ghahramani, and J. D. Lafferty, "Semi-supervised learning using gaussian fields and harmonic functions," in Proc. ICML, 2003, pp. 912-919.
12. D. Zhou, O. Bousquet, T. N. Lal, J. Weston, and B. Schölkopf, "Learning with local and global consistency," in Proc. NIPS, 2003, pp. 1-8.
13. M. Belkin, P. Niyogi, and V. Sindhwani, "Manifold regularization: A geometric framework for learning from labeled and unlabeled examples," J. Mach. Learn. Res., vol. 7, pp. 2399-2434, Nov. 2006.
14. V. Sindhwani, P. Niyogi, and M. Belkin, "Beyond the point cloud: From transductive to semi-supervised learning," in Proc. ICML, 2005, pp. 824-831.
15. F. Nie, D. Xu, I. W. Tsang, and C. Zhang, "Flexible manifold embedding: A framework for semi-supervised and unsupervised dimension reduction," IEEE Trans. Image Process., vol. 19, no. 7, pp. 1921-1932, Jul. 2010.
16. Y. Zhang and D.-Y. Yeung, "Semisupervised generalized discriminant analysis," IEEE Trans. Neural Netw., vol. 22, no. 8, pp. 1207-1217, Aug. 2011.
17. J. Song, Y. Yang, Y. Yang, Z. Huang, and H. T. Shen, "Inter-media hashing for large-scale retrieval from heterogeneous data sources," in Proc. SIGMOD, 2013, pp. 785-796.
18. F. Wang and C. Zhang, "Label propagation through linear neighborhoods," IEEE Trans. Knowl. Data Eng., vol. 20, no. 1, pp. 55-67, Jan. 2008.
19. X. Peng, Z. Yu, Z. Yi, and H. Tang, "Constructing the L2-graph for robust subspace learning and subspace clustering," IEEE Trans. Cybern., vol. PP, no. 99, pp. 1-14, 2012.
20. J. Song, Y. Yang, Z. Huang, H. T. Shen, and R. Hong, "Multiple feature hashing for real-time large scale near-duplicate video retrieval," in Proc. ACM Multimedia, 2011, pp. 423-432.
21. Y. Yan, E. Ricci, S. Ramanathan, O. Lanz, and N. Sebe, "No matter where you are: Flexible graph-guided multi-task learning for multi-view head pose classification under target motion," in Proc. ICCV, 2013, pp. 1177-1184.
22. J. Song, Y. Yang, X. Li, Z. Huang, and Y. Yang, "Robust hashing with local models for approximate similarity search," IEEE Trans. Cybern., vol. 44, no. 7, pp. 1225-1236, Jul. 2014.
23. L. Gao, J. Song, F. Nie, F. Zou, N. Sebe, and H. T. Shen, "Graphwithout- cut: An ideal graph learning for image segmentation," in Proc. AAAI, 2016, pp. 1188-1194.
24. J. Wang, T. Zhang, J. Song, N. Sebe, and H. T. Shen, "A survey on learning to hash," CoRR, 2016. Online. Available: http://arxiv.org/abs/1606.00185
25. J. Song, L. Gao, M. M. Puscas, F. Nie, F. Shen, and N. Sebe, "Joint graph learning and video segmentation via multiple cues and topology calibration," in Proc. ACM Multimedia, 2016.
26. A. Y. Ng, M. I. Jordan, and Y. Weiss, "On spectral clustering: Analysis and an algorithm," in Proc. NIPS, 2001, pp. 849-856.
27. A. Goh and R. Vidal, "Segmenting motions of different types by unsupervised manifold clustering," in Proc. CVPR, 2007, pp. 1-6.
28. S. Rao, R. Tron, R. Vidal, and Y. Ma, "Motion segmentation in the presence of outlying, incomplete, or corrupted trajectories," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 10, pp. 1832-1845, Oct. 2010.
29. E. Elhamifar and R. Vidal, "Sparse subspace clustering: Algorithm, theory, and applications," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 11, pp. 2765-2781, Nov. 2013.
30. S. Yan and H. Wang, "Semi-supervised learning by sparse representation," in Proc. ICDM, 2009, pp. 792-801.
31. G. Liu, Z. Lin, and Y. Yu, "Robust subspace segmentation by low-rank representation," in Proc. ICML, 2010, pp. 663-670.
32. G. Liu, Z. Lin, S. Yan, J. Sun, Y. Yu, and Y. Ma, "Robust recovery of subspace structures by low-rank representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 1, pp. 171-184, Jan. 2013.
33. G. Liu and S. Yan, "Latent low-rank representation for subspace segmentation and feature extraction," in Proc. ICCV, 2011, pp. 1615-1622.
34. R. Liu, Z. Lin, F. De la Torre, and Z. Su, "Fixed-rank representation for unsupervised visual learning," in Proc. CVPR, 2012, pp. 598-605.
35. E. Elhamifar and R. Vidal, "Sparse manifold clustering and embedding," in Proc. NIPS, 2011, pp. 55-63.
36. E. P. Xing, A. Y. Ng, M. I. Jordan, and S. J. Russell, "Distance metric learning with application to clustering with side-information," in Proc. NIPS, 2002, pp. 505-512.
37. R. Vidal, "Subspace clustering," IEEE Signal Process. Mag., vol. 28, no. 2, pp. 52-68, Mar. 2011.
38. J. Tang, R. Hong, S. Yan, T.-S. Chua, G.-J. Qi, and R. Jain, "Image annotation by kNN-sparse graph-based label propagation over noisily tagged Web images," ACM Trans. Intell. Syst. Technol., vol. 2, no. 2, p. 14, 2011.
39. X. Li, T. Uricchio, L. Ballan, M. Bertini, C. G. M. Snoek, and A. D. Bimbo, "Socializing the semantic gap: A comparative survey on image tag assignment, refinement and retrieval," CoRR, 2015.
40. X. Li, C. G. M. Snoek, and M. Worring, "Learning social tag relevance by neighbor voting," IEEE Trans. Multimedia, vol. 11, no. 7, pp. 1310-1322, Nov. 2009.
41. S. Lee, W. D. Neve, and Y. M. Ro, "Visually weighted neighbor voting for image tag relevance learning," Multimedia Tools Appl., vol. 72, no. 2, pp. 1363-1386, 2014.
42. X. Zhu, W. Nejdl, and M. Georgescu, "An adaptive teleportation random walk model for learning social tag relevance," in Proc. SIGIR, 2014, pp. 223-232.
43. L. Ballan, T. Uricchio, L. Seidenari, and A. D. Bimbo, "A cross-media model for automatic image annotation," in Proc. ICMR, 2014, p. 73.
44. J. Wang, J. Zhou, H. Xu, T. Mei, X. Hua, and S. Li, "Image tag refinement by regularized latent Dirichlet allocation," Comput. Vis. Image Understand., vol. 124, pp. 61-70, Jul. 2014.
45. L. Chen, D. Xu, I. W. Tsang, and J. Luo, "Tag-based image retrieval improved by augmented features and group-based refinement," IEEE Trans. Multimedia, vol. 14, no. 4, pp. 1057-1067, Aug. 2012.
46. J. Verbeek, M. Guillaumin, T. Mensink, and C. Schmid, "Image annotation with tagprop on the MIRFLICKR set," in Proc. ACM Multimedia, 2010, pp. 537-546.
47. B. Zhou, V. Jagadeesh, and R. Piramuthu, "ConceptLearner: Discovering visual concepts from weakly labeled image collections," CoRR, 2014.
48. J. Zheng and Z. Jiang, "Learning view-invariant sparse representations for cross-view action recognition," in Proc. ICCV, 2013, pp. 3176-3183.
49. X. Xu, A. Shimada, and R. Taniguchi, "Tag completion with defective tag assignments via image-tag re-weighting," in Proc. ICME, 2014, pp. 1-6.
50. Z. Feng, S. Feng, R. Jin, and A. K. Jain, "Image tag completion by noisy matrix recovery," in Proc. ECCV, 2014, pp. 424-438.
51. F. Richter, S. Romberg, E. Hörster, and R. Lienhart, "Leveraging community metadata for multimodal image ranking," Multimedia Tools Appl., vol. 56, no. 1, pp. 35-62, 2012.
52. S. T. Roweis and L. K. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol. 290, no. 5500, pp. 2323-2326, Dec. 2000.
53. W. Liu, J. Wang, S. Kumar, and S. Chang, "Hashing with graphs," in Proc. ICML, 2011, pp. 1-8.
54. Z. Feng, R. Jin, and A. Jain, "Large-scale image annotation by efficient and robust kernel metric learning," in Proc. ICCV, 2013, pp. 1609-1616.
55. Y.-G. Jiang, Q. Dai, J. Wang, C.-W. Ngo, X. Xue, and S.-F. Chang, "Fast semantic diffusion for large-scale context-based image and video annotation," IEEE Trans. Image Process., vol. 21, no. 6, pp. 3080-3091, Jun. 2012.
56. C. H. Lampert, H. Nickisch, and S. Harmeling, "Attribute-based classification for zero-shot visual object categorization," IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 3, pp. 453-465, Mar. 2014.
57. A. Farhadi, I. Endres, D. Hoiem, and D. A. Forsyth, "Describing objects by their attributes," in Proc. CVPR, 2009, pp. 1778-1785.
58. P. Kankuekul, A. Kawewong, S. Tangruamsub, and O. Hasegawa, "Online incremental attribute-based zero-shot learning," in Proc. CVPR, 2012, pp. 3657-3664.
59. F. X. Yu, L. Cao, R. S. Feris, J. R. Smith, and S.-F. Chang, "Designing category-level attributes for discriminative visual recognition," in Proc. CVPR, 2013, pp. 771-778.