Multimodal feature generation framework for semantic image classification

Proceedings of the 2nd ACM International Conference on Multimedia Retrieval, ICMR 2012

Volumn , Issue , 2012, Pages

  Znaidia, Amel ^a   Shabou, Aymen ^a   Popescu, Adrian ^a   Le Borgne, Hervé ^a   Hudelot, Céline ^b  

^a DIF   (France)

^b ECOLE CENTRALE PARIS   (France)

Author keywords

Bags of words; Classification; Image annotation; Multimedia fusion

Indexed keywords

BAGS OF WORDS; CLASSIFICATION FRAMEWORK; COMPUTER VISION TECHNIQUES; CONCEPTUAL HIERARCHY; DATA SETS; FEATURE GENERATION; IMAGE ANNOTATION; LABELED IMAGES; LATE FUSION; MULTIMODAL FEATURES; PHOTO SHARING; RESEARCH TOPICS; SEMANTIC IMAGE CLASSIFICATION; SEMANTIC LABELS; STATE-OF-THE-ART METHODS; TAG SIMILARITY; TEXTUAL INFORMATION; VISUAL CONTENT; VISUAL INFORMATION;

CLASSIFICATION (OF INFORMATION); COMPUTER VISION; CONTENT BASED RETRIEVAL; IMAGE ANALYSIS; SEMANTICS; TEXT PROCESSING;

IMAGE CLASSIFICATION;

EID: 84864135876     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2324796.2324842     Document Type: Conference Paper

References (28)

1. A. Binder, W. Samek, M. Kloft, C. Müller, K.-R. Müller, and M. Kawanabe. The Joint Submission of the TU Berlin and Fraunhofer FIRST (TUBFI) to the ImageCLEF2011 Photo Annotation Task. In CLEF (Notebook Papers/Labs/Workshop) , 2011.
2. Y.-L. Boureau, F. Bach, Y. LeCun, and J. Ponce. Learning mid-level features for recognition. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 2559-2566, 2010.
3. A. Coates and A. Ng. The Importance of Encoding Versus Training with Sparse Coding and Vector Quantization. In ACM International Conference on Machine Learning (ICML), pages 921-928, 2011.
4. G. Csurka, C. R. Dance, L. Fan, J. Willamowski, and C. Bray. Visual categorization with bags of keypoints. In Workshop on Statistical Learning in Computer Vision (ECCV), pages 1-22, 2004.
5. G. Dork and C. Schmid. Object class recognition using discriminative local features. Rapport de recherche RR-5497, INRIA, 2005.
6. R. P. W. Duin. The Combining Classifier: To Train or Not to Train? In International Conference on Pattern Recognition (ICPR), pages 765-770, 2002. (Pubitemid 44844850)
7. M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman. The PASCAL Visual Object Classes Challenge 2007 (VOC2007) Results.
8. C. Fellbaum, editor. WordNet: An Electronic Lexical Database (Language, Speech, and Communication). The MIT Press, 1998.
9. S. Gao, I. Tsang, L. Chia, and P. Zhao. Local features are not lonely - Laplacian sparse coding for image classification. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 3555-3561, 2011.
10. M. Guillaumin, J. Verbeek, and C. Schmid. Multimodal semi-supervised learning for image classification. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 902 - 909, 2010.
11. Y. Huang, K. Huang, Y. Yu, and T. Tan. Salient Coding for Image Classification. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1753 -1760, 2011.
12. M. J. Huiskes and M. S. Lew. The MIR ickr retrieval evaluation. In ACM international conference on Multimedia information retrieval (ICMR), pages 39-43, 2008.
13. M. Kawanabe, A. Binder, C. Muller, and W. Wojcikiewicz. Multi-modal visual concept classification of images via Markov random walk over tags. In IEEE Workshop on Applications of Computer Vision, pages 396-401, 2011.
14. S. Lazebnik, C. Schmid, and J. Ponce. Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 2169-2178, 2006. (Pubitemid 44931582)
15. L. Liu, L. Wang, and X. Liu. In Defense of Soft-assignment Coding. In IEEE International Conference on Computer Vision (ICCV), 2011.
16. D. G. Lowe. Distinctive image features from scale-invariant keypoints. International journal of computer vision (IJCV), 60(2):91-110, 2004.
17. A. Oliva and A. Torralba. Modeling the shape of the scene: A holistic representation of the spatial envelope. International Journal of Computer Vision (IJCV), 42(3):145-175, 2001. (Pubitemid 32680801)
18. A. Popescu and G. Grefenstette. Social media driven image retrieval. In ACM International Conference on Multimedia Retrieval (ICMR), pages 33:1-33:8, 2011.
19. G. Salton and M. J. McGill. Introduction to Modern Information Retrieval. McGraw-Hill, New York, 1983.
20. J. Sivic and A. Zisserman. Video Google: A Text Retrieval Approach to Object Matching in Videos. In IEEE International Conference on Computer Vision (ICCV), volume 2, pages 1470-1477, 2003.
21. A. W. M. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain. Content-based image retrieval at the end of the early years. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 22:1349-1380, 2000. (Pubitemid 32088465)
22. J. van Gemert, C. Veenman, A. Smeulders, and J. Geusebroek. Visual word ambiguity. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), pages 1271-1283, 2009.
23. G. Wang, D. Hoiem, and D. Forsyth. Building text features for object image classification. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1367-1374, 2009.
24. J. Wang, J. Yang, K. Yu, F. Lv, T. S. Huang, and Y. Gong. Locality-constrained linear coding for image classification. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 3360-3367, 2010.
25. D. H. Wolpert. Stacked generalization. Neural Networks, 5:241-259, 1992.
26. Z. Wu and M. Palmer. Verb semantics and lexical selection. In Annual Meeting of the Association for Computational Linguistics, pages 133 -138, 1994.
27. J. Yang, K. Yu, Y. Gong, and T. Huang. Linear spatial pyramid matching using sparse coding for image classification. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1794-1801, 2009.
28. K. Yu, T. Zhang, and Y. Gong. Nonlinear learning using local coordinate coding. Advances in Neural Information Processing Systems, 22:2223-2231, 2009.