An efficient two-stage framework for image annotation

Pattern Recognition

Volumn 46, Issue 3, 2013, Pages 936-947

  Hu, Jiwei ^a   Lam, Kin Man ^a  

^a HONG KONG POLYTECHNIC UNIVERSITY   (Hong Kong)

Author keywords

Image annotation; Label filtering; Label specific classifiers; Multi labeling

Indexed keywords

COMPLEX MODEL; DISCRIMINATIVE MODELS; GENERATIVE MODEL; IMAGE ANNOTATION; IMAGE COLLECTIONS; IMAGE LABELING; LABEL-FILTERING; MULTI-CLASS; MULTI-LABEL; MULTI-LABELING; QUERY IMAGES; SMALL POPULATION; TWO-STAGE METHODS;

EFFICIENCY; IMAGE ANALYSIS; SEMANTICS;

IMAGE RETRIEVAL;

EID: 84870235246     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2012.09.010     Document Type: Article

References (40)

1. G. Carneiro, A.B. Chan, P.J. Moreno, and N. Vasconcelos Supervised learning of semantic classes for image annotation and retrieval IEEE Transactions on Pattern Analysis and Machine Intelligence 29 3 2007 394 410
2. G. Qiu Indexing chromatic and achromatic patterns for content-based colour image retrieval Pattern Recognition 35 2002 1675 1686
3. Yuchi, Huang Qingshan Liu, Shaoting Zhang, Metaxas, D. Netc, Image retrieval via probabilistic hypergraph ranking, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2010, pp. 3376-3383.
4. D. Zhang, Md. Monirul Islam, and G. Lu A review on automatic image annotation techniques Journal of Pattern Recognition 45 2012 346 362
5. G. Tsoumakas, and I. Katakis Multi-label classification: an overview International Journal of Data Warehousing and Mining 3 3 2007 1 13
6. I. Guyon, and A. Elisseeff An introduction to variable and feature selection Journal of Machine Learning Research 3 2003 1157 1182
7. R.E. Schapire, and Y. Singer BoosTexter: a boosting-based system for text categorization Machine Learning 39 2/3 2000 135 168
8. Yoav Freund, E. Robert, and Schapire A short introduction to boosting Journal of Japanese Society for Artificial Intelligence 14 5 1999 771 780
9. M.L. Zhang, Z.H. Zhou, A K-Nearest Neighbor based algorithm for multi-label classification, in: Proceedings of the 1st IEEE International Conference on Granular Computing (GrC'05), 2005.
10. Ameesh Makadia, Vladimir Pavlovic, Sanjiv Kumar, A new baseline for image annotation, in: Proceedings of the European Conference on Computer Vision, 2008, pp. 316-329.
11. C. Sun, J. Hu, K.M. Lam, Feature subset selection for efficient AdaBoost training, in: Proceedings of the IEEE International Conference on Multimedia and Expo, 2011, pp. 1-6.
12. Nikhil Naikal, Allen Y. Yang, S. Shankar Sastry, Informative feature selection for object recognition via Sparse PCA, in: Proceedings of the IEEE Conference on Computer Vision, 2011, pp. 818-825.
13. Z.-H. Zhou, M.-L. Zhang, S.-J. Huang, and Y.-F. Li Multi-instance multi-label learning Artificial Intelligence 176 1 2012 2291 2320
14. Adriana Kovashka, Sudheendra Vijayanarasimhan, Kristen Grauman. Actively selecting annotations among objects and attributes, in: Proceedings of the IEEE Conference on Computer Vision, 2011, pp. 1403-1410.
15. Florian Brucker, Fernando Benites, P. Elena, and Sapozhnikova Multi-label classification and extracting predicted class hierarchies Pattern Recognition 44 3 2011 724 738
16. F. Monay, and D. Gatica-Perez PLSA-based image auto-annotation: constraining the latent space ACM Multi-Media 2004 348 351
17. K. Barnard, P. Duygulu, D. Forsyth, N. de Freitas, D.M. Blei, and M.I. Jordanetc Matching words and pictures Journal of Machine Learning Research 3 2003 1107 1135
18. David Grangier, and A. Samy Bengio Discriminative kernel-based model to rank images from text queries IEEE Transactions on Pattern Analysis and Machine Intelligence 30 8 2008 1371 1384
19. M. Guillaumin, T. Mensink, J. Verbeek, C. Schmid, Tagprop: discriminative metric learning in nearest neighbor models for image auto-annotations, in: Proceedings of the International Conference on Computer Vision, 2009, pp. 309-316.
20. H. Zhang, A. Berg, M. Maire, J. Mailik, SVM-KNN: discriminative nearest neighbor classification for visual category recognition, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2006, pp. 2126-2136.
21. Freund Yoav, E. Robert, and Schapire A decision theoretic generalization of on-line learning and an application to boosting Journal of Computer and System Sciences 55 1997 119 139
22. J. Hu, K.M. Lam, G. Qiu, A hierarchical algorithm for image multi-labeling, in: Proceedings of the IEEE International Conference on Image Processing, ICIP'2010, 2010, pp. 2349-2352.
23. A. Yavlinsky, E. Schofield, S. Ruger, Automatic image annotation using global features and robust nonparametric density estimation, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2005, pp. 507-517.
24. F. Monay, and D. Gatica-Perez. PLSA-based image auto-annotation: constraining the latent space ACM Multi-Media 2004 348 351
25. J. Fan, Y. Gao, and H. Luo Integrating concept ontology and multitask learning to achieve more effective classifier training for multilevel image annotation IEEE Transactions on Image Processing 17 3 2008 407 426
26. Z. Liang, H. Fu, Z. Chi, D. Feng, Refining a region based attention model using eye tracking data, in: Proceedings of the IEEE International Conference on Image Processing, 2010, pp. 1105-1108.
27. J. Hu, C. Sun, K.M. Lam, Learning a discriminative model for image annotation, in: Proceedings of Asia Pacific Information and Signal Processing Association, ASC 2011.
28. S. Zhang, J. Huang, Y. Huang, Y. Yu, H. Li, D.N. Metaxasetc, Automatic image annotation using group sparisty, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2010, pp. 3312-3319.
29. D. Zhou, J. Huang, B. Scholkopf, Learning with hypergraphs: clustering, classification, and embedding, in: Proceedings of the Advances in Neural Information Processing Systems, 2006, pp. 1601-1608.
30. S. Andrews, I. Tsochantaridis, T. Hofmann. Support vector machines for multiple-instance learning, in: Proceedings of the Advances in Neural Information Processing Systems, 2003 pp. 561-568.
31. Q.V. Le, A. Smola, O. Chapelle, and C.H. Teo Optimization of ranking measures Journal of Machine Learning Research 1 2010 1 48
32. J. Zhu, S.C.H. Hoi, M.R. Lyu, and S. Yan Near-duplicate keyframe retrieval by nonrigid image matching ACM Multimedia 2008 41 50
33. D.G. Lowe, Object recognition from local scale-invariant features, in: Proceedings of the International Conference on Computer Vision, 1999, pp. 1150-1157.
34. V. Lavrenko, R. Manmatha, J. Jeon, A model for learning the semantic of pictures, in: Proceedings of the Advances in Neural Information Processing Systems, 2003.
35. D. Metzler, R. Manmatha, An inference network approach to image retrieval, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2004, pp. 42-50.
36. S.L. Feng, R. Manmatha, V. Lavrenko, Multiple Bernoulli relevance models for image and video annotation, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2004, pp. 1002-1009.
37. J. Liu, M. Li, Q. Liu, H. Lu, and S. Ma Image annotation via graph learning Pattern Recognition 42 2 2009 218 228
38. N. Zhou, W. Cheung, G. Qiu, and X. Xue A hybrid probabilistic model for unified collaborative and content based image tagging IEEE Transactions on Pattern Analysis and Machine Intelligence 33 7 2011 1281 1294
39. J.-H. Su, C.-L. Chou, and C.-Y. Lin Effective semantic annotation by image-to-concept distribution model IEEE Transactions on Multimedia 2011 530 538
40. J. Deng, A. Berg, K. Li, L. Fei-Fei, What does classifying more than 10,000 image categories tell us? in: Proceedings of the 12th European Conference of Computer Vision (ECCV), 2010, pp. 71-84.