Image Annotation by Latent Community Detection and Multikernel Learning

IEEE Transactions on Image Processing

Volumn 24, Issue 11, 2015, Pages 3450-3463

  Gu, Yun ^a,b   Qian, Xueming ^a   Li, Qing ^a,c   Wang, Meng ^d   Hong, Richang ^d   Tian, Qi ^e  

^a XI'AN JIAOTONG UNIVERSITY   (China)

^b SHANGHAI JIAO TONG UNIVERSITY   (China)

^c UNIVERSITY OF WISCONSIN MADISON   (United States)

^d HEFEI UNIVERSITY OF TECHNOLOGY   (China)

^e UNIVERSITY OF TEXAS AT SAN ANTONIO   (United States)

Author keywords

community detection; concept graph; Image annotation; multiple kernel learning

Indexed keywords

IMAGE ANALYSIS; POPULATION DYNAMICS; SEMANTICS; SUPPORT VECTOR MACHINES;

AUTOMATIC IMAGE ANNOTATION; COMMUNITY DETECTION; CONCEPT GRAPH; IMAGE ANNOTATION; MULTI-KERNEL LEARNING; MULTIPLE KERNEL LEARNING; ONLINE PHOTO SHARING; STATE-OF-THE-ART APPROACH;

IMAGE RETRIEVAL;

EID: 84959457076     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2015.2443501     Document Type: Article

References (59)

1. A. Makadia, V. Pavlovic, and S. Kumar, "Baselines for image annotation," Int. J. Comput. Vis., vol. 90, no. 1, pp. 88-105, 2010.
2. D. Zhang, M. M. Islam, and G. Lu, "A review on automatic image annotation techniques," Pattern Recognit., vol. 45, no. 1, pp. 346-362, 2012.
3. Y. Yang, F. Wu, F. Nie, H. T. Shen, Y. Zhuang, and A. G. Hauptmann, "Web and personal image annotation by mining label correlation with relaxed visual graph embedding," IEEE Trans. Image Process., vol. 21, no. 3, pp. 1339-1351, Mar. 2012.
4. J. Tang, Z.-J. Zha, D. Tao, and T.-S. Chua, "Semantic-gap-oriented active learning for multilabel image annotation," IEEE Trans. Image Process., vol. 21, no. 4, pp. 2354-2360, Apr. 2012.
5. J. Tang, S. Yan, C. Zhao, T.-S. Chua, and R. Jain, "Label-specific training set construction from Web resource for image annotation," Signal Process., vol. 93, no. 8, pp. 2199-2204, 2013.
6. J. Tang, R. Hong, S. Yan, T.-S. Chua, G.-J. Qi, and R. Jain, "Image annotation by kNN-sparse graph-based label propagation over noisily tagged Web images," ACM Trans. Intell. Syst. Technol., vol. 2, no. 2, 2011, Art. ID 14.
7. P. T. M. Saito, P. J. de Rezende, A. X. Falcão, C. T. N. Suzuki, and J. F. Gomes, "A data reduction and organization approach for efficient image annotation," in Proc. 28th Annu. ACM Symp. Appl. Comput., 2013, pp. 53-57.
8. R. Yan, A. Natsev, and M. Campbell, "A learning-based hybrid tagging and browsing approach for efficient manual image annotation," in Proc. IEEE CVPR, Jun. 2008, pp. 1-8.
9. Z. Ma, F. Nie, Y. Yang, J. R. R. Uijlings, and N. Sebe, "Web image annotation via subspace-sparsity collaborated feature selection," IEEE Trans. Multimedia, vol. 14, no. 4, pp. 1021-1030, Aug. 2012.
10. X. Liu, R. Liu, F. Li, and Q. Cao, "Graph-based dimensionality reduction for KNN-based image annotation," in Proc. 21st ICPR, Nov. 2012, pp. 1253-1256.
11. Y. Han, F. Wu, Q. Tian, and Y. Zhuang, "Image annotation by input-output structural grouping sparsity," IEEE Trans. Image Process., vol. 21, no. 6, pp. 3066-3079, Jun. 2012.
12. M.-L. Zhang and Z.-H. Zhou, "ML-KNN: A lazy learning approach to multi-label learning," Pattern Recognit., vol. 40, no. 7, pp. 2038-2048, 2007.
13. X. Qian, X. Liu, C. Zheng, Y. Du, and X. Hou, "Tagging photos using users' vocabularies," Neurocomputing, vol. 111, pp. 144-153, Jul. 2013.
14. J. Fan, Y. Gao, and H. Luo, "Hierarchical classification for automatic image annotation," in Proc. 30th ACM SIGIR, 2007, pp. 111-118.
15. X. Zhou, M. Wang, Q. Zhang, J. Zhang, and B. Shi, "Automatic image annotation by an iterative approach: Incorporating keyword correlations and region matching," in Proc. 6th ACM CIVR, 2007, pp. 25-32.
16. L. Wu, X.-S. Hua, N. Yu, W.-Y. Ma, and S. Li, "Flickr distance," in Proc. ACM Multimedia, 2008, pp. 31-40.
17. J. Liu, M. Li, W.-Y. Ma, Q. Liu, and H. Lu, "An adaptive graph model for automatic image annotation," in Proc. 8th ACM Int. Workshop Multimedia Inf. Retr., 2006, pp. 61-70.
18. Y. Gao, J. Fan, X. Xue, and R. Jain, "Automatic image annotation by incorporating feature hierarchy and boosting to scale up SVM classifiers," in Proc. ACM Multimedia, 2006, pp. 901-910.
19. C. Cusano, G. Ciocca, and R. Schettini, "Image annotation using SVM," in Proc. Int. Soc. Opt. Photon. Electron. Imag., vol. 5304. Dec. 2003, pp. 330-338.
20. O. Chapelle, P. Haffner, and V. N. Vapnik, "Support vector machines for histogram-based image classification," IEEE Trans. Neural Netw., vol. 10, no. 5, pp. 1055-1064, Sep. 1999.
21. K.-S. Goh, E. Y. Chang, and B. Li, "Using one-class and two-class SVMs for multiclass image annotation," IEEE Trans. Knowl. Data Eng., vol. 17, no. 10, pp. 1333-1346, Oct. 2005.
22. X. Qi and Y. Han, "Incorporating multiple SVMs for automatic image annotation," Pattern Recognit., vol. 40, no. 2, pp. 728-741, 2007.
23. S. Fortunato, "Community detection in graphs," Phys. Rep., vol. 486, nos. 3-5, pp. 75-174, 2010.
24. M. E. J. Newman, "Modularity and community structure in networks," Proc. Nat. Acad. Sci. USA, vol. 103, no. 23, pp. 8577-8582, 2006.
25. N. Du, B. Wu, X. Pei, B. Wang, and L. Xu, "Community detection in large-scale social networks," in Proc. 9th WebKDD, 1st SNA-KDD Workshop Web Mining Soc. Netw. Anal., 2007, pp. 16-25.
26. S. Papadopoulos et al., "Image clustering through community detection on hybrid image similarity graphs," in Proc. 17th IEEE Int. Conf. Image Process. (ICIP), Sep. 2010, pp. 2353-2356.
27. D. M. Blei, A. Y. Ng, and M. I. Jordan, "Latent Dirichlet allocation," J. Mach. Learn. Res., vol. 3, pp. 993-1022, Jan. 2003.
28. K. Barnard, P. Duygulu, D. Forsyth, N. de Freitas, D. M. Blei, and M. I. Jordan, "Matching words and pictures," J. Mach. Learn. Res., vol. 3, pp. 1107-1135, Mar. 2003.
29. S. Sonnenburg, G. Rätsch, C. Schäfer, and B. Schölkopf, "Large scale multiple kernel learning," J. Mach. Learn. Res., vol. 7, pp. 1531-1565, Jul. 2006.
30. Q. Li, Y. Gu, and X. Qian, "LCMKL: Latent-community and multikernel learning based image annotation," in Proc. 22nd ACM CIKM, 2013, pp. 1469-1472.
31. Z. Younes, F. Abdallah, and T. Denoeux, "Multi-label classification algorithm derived from K-nearest neighbor rule with label dependencies," in Proc. 16th Eur. Signal Process. Conf., Aug. 2008, pp. 1-5.
32. M. Wang, X. Zhou, and T.-S. Chua, "Automatic image annotation via local multi-label classification," in Proc. Int. Conf. Content-Based Image Video Retr., 2008, pp. 17-26.
33. Y. Yu, W. Pedrycz, and D. Miao, "Neighborhood rough sets based multi-label classification for automatic image annotation," Int. J. Approx. Reason., vol. 54, no. 9, pp. 1373-1387, 2013.
34. M. Kutas and S. A. Hillyard, "Brain potentials during reading reflect word expectancy and semantic association," Nature, vol. 307, no. 5947, pp. 161-163, 1984.
35. A. E. Elisseeff and J. Weston, "A kernel method for multilabelled classification," in Proc. Adv. Neural Inf. Process. Syst., 2001, pp. 681-687.
36. M.-L. Zhang, J. M. Peña, and V. Robles, "Feature selection for multi-label naive Bayes classification," Inf. Sci., vol. 179, no. 19, pp. 3218-3229, 2009.
37. F. A. Thabtah, P. Cowling, and Y. Peng, "MMAC: A new multiclass, multi-label associative classification approach," in Proc. 4th IEEE ICDM, Nov. 2004, pp. 217-224.
38. M.-L. Zhang, "Lift: Multi-label learning with label-specific features," in Proc. IJCAI, 2011, pp. 1609-1614.
39. X. Xue, W. Zhang, J. Zhang, B. Wu, J. Fan, and Y. Lu, "Correlative multi-label multi-instance image annotation," in Proc. IEEE ICCV, Nov. 2011, pp. 651-658.
40. W. Zhang, X. Xue, J. Fan, X. Huang, B. Wu, and M. Liu, "Multi-kernel multi-label learning with max-margin concept network," in Proc. 22nd Int. Joint Conf. Artif. Intell. (IJCAI), vol. 22. 2011, pp. 1615-1620.
41. C.-T. Nguyen, D.-C. Zhan, and Z.-H. Zhou, "Multi-modal image annotation with multi-instance multi-label LDA," in Proc. IJCAI, 2013, pp. 1558-1564.
42. X. Li and C. G. M. Snoek, "Classifying tag relevance with relevant positive and negative examples," in Proc. 21st ACM Multimedia, 2013, pp. 485-488.
43. X. Qian, X.-S. Hua, Y. Y. Tang, and T. Mei, "Social image tagging with diverse semantics," IEEE Trans. Cybern., vol. 44, no. 12, pp. 2493-2508, Dec. 2014.
44. T.-S. Chua, J. Tang, R. Hong, H. Li, Z. Luo, and Y. Zheng, "NUS-WIDE: A real-world Web image database from National University of Singapore," in Proc. ACM CIVR, 2009, Art. ID 48.
45. V. D. Blondel, J.-L. Guillaume, R. Lambiotte, and E. Lefebvre, "Fast unfolding of communities in large networks," J. Statist. Mech., Theory Experim., vol. 2008, no. 10, p. P10008, 2008.
46. A. Rakotomamonjy, F. Bach, S. Canu, and Y. Grandvalet, "Simple MKL," J. Mach. Learn. Res., vol. 9, pp. 2491-2521, Nov. 2008.
47. M. Grubinger, P. Clough, H. Müller, and T. Deselaers, "The IAPR TC-12 benchmark: A new evaluation resource for visual information systems," in Proc. Int. Workshop OntoImage, 2006, pp. 13-23.
48. D. Liu, X.-S. Hua, L. Yang, M. Wang, and H.-J. Zhang, "Tag ranking," in Proc. WWW, 2009, pp. 351-360.
49. M. Guillaumin, "Exploiting multimodal data for image understanding," Ph.D. dissertation, Inst. Nat. Polytechn. Grenoble, Grenoble, France, 2010.
50. X. Li, C. G. M. Snoek, and M. Worring, "Learning social tag relevance by neighbor voting," IEEE Trans. Multimedia, vol. 11, no. 7, pp. 1310-1322, Nov. 2009.
51. H. Jégou, M. Douze, C. Schmid, and P. Pérez, "Aggregating local descriptors into a compact image representation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2010, pp. 3304-3311.
52. A. S. Razavian, H. Azizpour, J. Sullivan, and S. Carlsson. (2014). "CNN features off-the-shelf: An astounding baseline for recognition." [Online]. Available: http://arxiv.org/abs/1403.6382
53. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "ImageNet classification with deep convolutional neural networks," in Advances in Neural Information Processing Systems 25. Red Hook, NY, USA: Curran Associates, Inc., 2012, pp. 1106-1114.
54. P. Ronhovde and Z. Nussinov, "Local resolution-limit-free Potts model for community detection," Phys. Rev. E, vol. 81, no. 4, p. 046114, 2010.
55. A. Arenas, A. Fernandez, and S. Gomez, "Analysis of the structure of complex networks at different resolution levels," New J. Phys., vol. 10, no. 5, p. 053039, 2008.
56. D. Ramage, D. Hall, R. Nallapati, and C. D. Manning, "Labeled LDA: A supervised topic model for credit attribution in multi-labeled corpora," in Proc. Conf. Empirical Methods Natural Lang. Process., vol. 1. 2009, pp. 248-256.
57. X. Xu, A. Shimada, and R.-I. Taniguchi, "Latent topic model for image annotation by modeling topic correlation," in Proc. IEEE ICME, Jul. 2013, pp. 1-6.
58. R.-E. Fan, K.-W. Chang, C.-J. Hsieh, X.-R. Wang, and C.-J. Lin, "LIBLINEAR: A library for large linear classification," J. Mach. Learn. Res., vol. 9, pp. 1871-1874, Jun. 2008.
59. T.-F. Wu, C.-J. Lin, and R. C. Weng, "Probability estimates for multiclass classification by pairwise coupling," J. Mach. Learn. Res., vol. 5, pp. 975-1005, Dec. 2004.