Semantics-preserving bag-of-words models for efficient image annotation

1st ACM Workshop on Large-Scale Multimedia Retrieval and Mining, LS-MMRM 2009, Co-located with the 2009 ACM International Conference on Multimedia, MM'09

Volumn , Issue , 2009, Pages 19-26

  Wu, Lei ^a   Hoi, Steven C H ^b   Yu, Nenghai ^a  

^a UNIVERSITY OF SCIENCE AND TECHNOLOGY OF CHINA   (China)

^b NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

Bag of words model; Distance metric learning; Image annotation; Semantic gap

Indexed keywords

BAG OF WORDS; BAG-OF-WORDS MODEL; DISTANCE METRIC LEARNING; IMAGE ANNOTATION; SEMANTIC GAP;

EDUCATION; IMAGE ANALYSIS; METHOD OF MOMENTS; MULTIMEDIA SYSTEMS; OBJECT RECOGNITION;

SEMANTICS;

EID: 72449143610     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1631058.1631064     Document Type: Conference Paper

References (41)

1. A. Bar-Hillel, T. Hertz, N. Shental, and D. Weinshall. Learning distance functions using equivalence relations. In Proc. of ICML, pages 11-18, 2003.
2. K. Barnard, P. Duygulu, D. Forsyth, N. D. Freitas, D. M. Blei, J. K, T. Hofmann, T. Poggio, and J. Shawe-taylor. Matching words and pictures. Journal of Machine Learning Research, 3:1107-1135, 2003.
3. D. M. Blei, A. Y. Ng, M. I. Jordan, and J. Lafferty. Latent dirichlet allocation. Journal of Machine Learning Research, 3:2003, 2003.
4. L. Cao and L. Fei-Fei. Spatially coherent latent topic model for concurrent segmentation and classification of objects and scenes. In Proc. of ICCV, pages 1-8, 2007.
5. G. Carneiro and N. Vasconcelos. Formulating semantic image annotation as a supervised learning problem. In Proc. of CVPR, pages 163-168, 2005.
6. G. Csurka, C. R. Dance, L. Fan, J. Willamowski, and C. Bray. Visual categorization with bags of keypoints. In Workshop on Statistical Learning in Computer Vision, ECCV, pages 1-22, 2004.
7. C. Dance, J. Willamowski, L. Fan, C. Bray, and G. Csurka. Visual categorization with bags of keypoints. In Workshop on Statistical Learning in Computer Vision, ECCV, 2004.
8. J. V. Davis, B. Kulis, P. Jain, S. Sra, and I. S. Dhillon. Information-theoretic metric learning. In Proc. of ICML, pages 209-216, 2007.
9. P. Duygulu, K. Barnard, J. de Freitas, and D. A. Forsyth. Object recognition as machine translation: Learning a lexicon for a fixed image vocabulary. In Proc. of ECCV, pages 97-112, 2002.
10. J. Fan, Y. Gao, and H. Luo. Multi-level annotation of natural scenes using dominant image components and semantic concepts. In ACM Multimedia, pages 540-547, 2004.
11. A. Globerson and S. Roweis. Metric learning by collapsing classes. In Proc. of NIPS, 2005.
12. K.-S. Goh, B. Li, and E. Chang. Using one-class and two-class svms for multiclass image annotation. IEEE Trans. on Knowl. and Data Eng., 17(10):1333-1346, 2005.
13. J. Goldberger, S. Roweis, G. Hinton, and R. Salakhutdinov. Neighborhood component analysis. In Proc. of NIPS, 2004.
14. V. Hedau, H. Arora, and N. Ahuja. Matching images under unstable segmentations. In Proc. of CVPR, pages 1-8, 2008.
15. T. Hofmann. Probabilistic latent semantic indexing. In Proc. of SIGIR, pages 50-57, 1999.
16. C.-H. Hoi and M. R. Lyu. A novel log-based relevance feedback technique in content-based image retrieval. In Proc.ACM Multimedia Conference, New York, 2004.
17. S. C. H. Hoi, W. Liu, M. R. Lyu, and W.-Y. Ma. Learning distance metrics with contextual constraints for image retrieval. In Proc. of CVPR, 2006.
18. S.C.H. Hoi, W. Liu, and S.-F. Chang. Semi-Supervised Distance Metric Learning for Collaborative Image Retrieval. In Proc. of CVPR, 2008.
19. Y.-G. Jiang, C.-W. Ngo, and J. Yang. Towards optimal bag-of-features for object categorization and semantic video retrieval. In Proc. of CIVR, pages 494-501, 2007.
20. R. Jin, J. Y. Chai, and L. Si. Effective automatic image annotation via a coherent language model and active learning. In ACM Multimedia, pages 892-899, 2004.
21. C. H. Lampert, M. B. Blaschko, and T. Hofmann. Beyond sliding windows: object localization by efficient subwindow search. In Proc. of CVPR, 2008.
22. S. Lazebnik, C. Schmid, and J. Ponce. Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In Proc. of CVPR, 2006.
23. L. Fei-Fei, and P. Perona. A bayesian hierarchical model for learning natural scene categories. In Proc. of CVPR, pages 524-531, 2005.
24. J. Li and J. Z. Wang. Real-time computerized annotation of pictures. In ACM Multimedia, 2006.
25. J. Li, W. Wu, T. Wang, and Y. Zhang. One step beyond histograms: Image representation using markov stationary features. In Proc. of CVPR, pages 1-8, 2008.
26. D. G. Lowe. Object recognition from local scale-invariant features. In Proc. of ICCV, pages 1150-1157, 1999.
27. D. G. Lowe. Distinctive image features from scale-invariant keypoints. In Proc. of IJCV, 60:91-110, 2004.
28. R. Maree, P. Geurts, J. Piater, and L. Wehenkel. Random subwindows for robust image classification. In Proc. of CVPR, pages 34-40, 2005.
29. B. C. Russell, A. Torralba, K. P. Murphy, and W. T. Freeman. Labelme: A database and web-based tool for image annotation. Int. J. Comput. Vision, 77(1-3):157-173, 2008.
30. L. Si, R. Jin, S. C. H. Hoi, and M. R. Lyu. Collaborative image retrieval via regularized metric learning. ACM Multimedia Systems Journal, 12(1):34-44, 2006.
31. J. Sivic, B. C. Russell, A. A. Efros, A. Zisserman, and W. T. Freeman. Discovering object categories in image collections. In Proc. of ICCV, 2005.
32. P. Tirilly, V. Claveau, and P. Gros. Language modeling for bag-of-visual words image categorization. In Proc. of CIVR, pages 249-258, 2008.
33. E. Tola, V. Lepetit, and P. Fua. A fast local descriptor for dense matching. In Proc. of CVPR, pages 1-8, 2008.
34. X.-J. Wang, L. Zhang, F. Jing, and W.-Y. Ma. Annosearch: Image auto-annotation by search. In Proc. of CVPR, pages 1483-1490, 2006.
35. K. Weinberger, J. Blitzer, and L. Saul. Distance metric learning for large margin nearest neighbor classification. Advances in Neural Information Processing Systems, 18:1473-1480, 2006.
36. L. Wu, Y. Hu, M. Li, N. Yu, and X.-S. Hua. Scale-invariant visual language modeling for object categorization. Multimedia, IEEE Transactions on, 11(2):286-294, 2009.
37. L. Wu, X.-S. Hua, N. Yu, W.-Y. Ma, and S. Li. Flickr distance. In ACM Multimedia, pages 31-40, 2008.
38. L. Wu, M. Li, Z. Li, W.-Y. Ma, and N. Yu. Visual language modeling for image classification. In ACM Multimedia Workshop on multimedia information retrieval, pages 115-124, 2007.
39. E. P. Xing, A. Y. Ng, M. I. Jordan, and S. Russell. Distance metric learning with application to clustering with side-information. In Proc. of NIPS, 2002.
40. L. Yang, R. Jin, R. Sukthankar, and Y. Liu. An efficient algorithm for local distance metric learning. In Proc. of AAAI, 2006.
41. L. Yang, R. Jin, R. Sukthankar, and F. Jurie. Unifying discriminative visual codebook generation with classifier training for object category recognition. In Proc. of CVPR, pages 1-8, 2008.