Personalizing automated image annotation using cross-entropy

MM'11 - Proceedings of the 2011 ACM Multimedia Conference and Co-Located Workshops

Volumn , Issue , 2011, Pages 233-242

  Li, Xirong ^a   Gavves, Efstratios ^a   Snoek, Cees G M ^a   Worring, Marcel ^a   Smeulders, Arnold W M ^a  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

Automated image annotation; Cross entropy optimization; Personal multimedia tagging history; Personalization

Indexed keywords

ABSOLUTE PERFORMANCE; AUTOMATIC IMAGE ANNOTATION; CONTENT-BASED; CROSS ENTROPY; GENERIC IMAGES; IMAGE ANNOTATION; PERFORMANCE MEASUREMENTS; PERSONALIZATIONS;

AUTOMATION; CONTENT BASED RETRIEVAL; ENTROPY; LEARNING ALGORITHMS; USER INTERFACES;

IMAGE ANALYSIS;

EID: 84455173086     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2072298.2072330     Document Type: Conference Paper

References (29)

1. P. Atrey, M. Hossain, A. El Saddik, and M. Kankanhalli. Multimodal fusion for multimedia analysis: a survey. Multimedia Syst., 16(6):345-379, 2010.
2. T.-S. Chua, J. Tang, R. Hong, H. Li, Z. Luo, and Y.-T. Zheng. NUS-WIDE: A real-world web image database from National University of Singapore. In CIVR, 2009.
3. R. Datta, D. Joshi, J. Li, and J. Wang. Tagging over time: real-world image annotation by lightweight meta-learning. In ACM Multimedia, 2007.
4. M. Duan, A. Ulges, T. Breuel, and X.-Q. Wu. Style modeling for tagging personal photo collections. In CIVR, 2009.
5. A. Gallagher, C. Neustaedter, L. Cao, J. Luo, and T. Chen. Image annotation using personal calendars as context. In ACM Multimedia, 2008.
6. M. Guillaumin, T. Mensink, J. Verbeek, and C. Schmid. TagProp: Discriminative metric learning in nearest neighbor models for image auto-annotation. In ICCV, 2009.
7. M. Heikkilä, M. Pietikäinen, and C. Schmid. Description of interest regions with local binary patterns. Pattern Recogn., 42:425-436, 2009.
8. J. Huang, S. Kumar, M. Mitra, W. Zhu, and R. Zabih. Image indexing using color correlograms. In CVPR, 1997.
9. J. Li and J. Wang. Real-time computerized annotation of pictures. IEEE Trans. Pattern Anal. Mach. Intell., 30(6):985-1002, 2008.
10. X. Li, C. Snoek, and M. Worring. Learning social tag relevance by neighbor voting. IEEE Trans. Multimedia, 11(7):1310-1322, 2009.
11. X. Li, C. Snoek, and M. Worring. Unsupervised multi-feature tag relevance learning for social image retrieval. In CIVR, 2010.
12. D. Liu, X.-S. Hua, M. Wang, and H.-J. Zhang. Image retagging. In ACM Multimedia, 2010.
13. J. Liu, B. Wang, M. Li, Z. Li, W. Ma, H. Lu, and S. Ma. Dual cross-media relevance model for image annotation. In ACM Multimedia, 2007.
14. Y. Liu, D. Xu, I. Tsang, and J. Luo. Textual query of personal photos facilitated by large-scale web data. IEEE Trans. Pattern Anal. Mach. Intell., 33(5):1022-1036, 2011.
15. J. Luo, J. Yu, D. Joshi, and W. Hao. Event recognition: viewing the world with a third eye. In ACM Multimedia, 2008.
16. A. Makadia, V. Pavlovic, and S. Kumar. Baselines for image annotation. Int. J. Comput. Vision, 90(1):88-105, 2010.
17. G. Miller. WordNet: a lexical database for english. Commun. ACM, 38(11):39-41, 1995.
18. A. Oliva and A. Torralba. Modeling the shape of the scene: a holistic representation of the spatial envelope. Int. J. Comput. Vision, 42(3):145-175, 2001.
19. R. Rubinstein and D. Kroese. The Cross-Entropy Method: A Unified Approach to Combinatorial Optimization, Monte-Carlo Simulation, and Machine Learning. Springer-Verlag, New York, 2004.
20. P. Sandhaus and S. Boll. Semantic analysis and retrieval in personal and social photo collections. Multimedia Tools Appl., 51(1):5-33, 2011.
21. N. Sawant, R. Datta, J. Li, and J. Wang. Quest for relevant tags using local interaction networks and visual content. In ACM MIR, 2010.
22. Y. Shen and J. Fan. Leveraging loosely-tagged images and inter-object correlations for tag recommendation. In ACM Multimedia, 2010.
23. P. Sinha and R. Jain. Classification and annotation of digital photos using optical context data. In CIVR, 2008.
24. A. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain. Content-based image retrieval at the end of the early years. IEEE Trans. Pattern Anal. Mach. Intell., 22(12):1349-1380, 2000.
25. J. Tang, R. Hong, S. Yan, T.-S. Chua, G.-J. Qi, and R. Jain. Image annotation by knn-sparse graph-based label propagation over noisily tagged web images. ACM Trans. Intell. Syst. Technol., 2:14:1-14:15, 2011.
26. J. Weston, S. Bengio, and N. Usunier. Large scale image annotation: learning to rank with joint word-image embeddings. Mach. Learn., 81:21-35, 2010.
27. L. Wu, S. Hoi, R. Jin, J. Zhu, and N. Yu. Distance metric learning from uncertain side information with application to automated photo tagging. In ACM Multimedia, 2009.
28. H. Yu, M. Li, H.-J. Zhang, and J. Feng. Color texture moment for content-based image retrieval. In ICIP, 2002.
29. G. Zhu, S. Yan, and Y. Ma. Image tag refinement towards low-rank, content-tag prior and error sparsity. In ACM Multimedia, 2010.