Learning visual contexts for image annotation from flickr groups

IEEE Transactions on Multimedia

Volumn 13, Issue 2, 2011, Pages 330-341

  Ulges, Adrian ^a   Worring, Marcel ^b   Breuel, Thomas ^c  

^a GERMAN RESEARCH CENTER FOR ARTIFICIAL INTELLIGENCE DFKI   (Germany)

^b UNIVERSITY OF AMSTERDAM   (Netherlands)

^c Rheinland Pfälzische Technische Universität Kaiserslautern Landau   (Germany)

Author keywords

Content based image retrieval; context; image annotation

Indexed keywords

AUTOMATIC IMAGE ANNOTATION; CONTENT BASED IMAGE RETRIEVAL; CONTEXT; IMAGE ANNOTATION; LEARNING CONTEXT; QUANTITATIVE EXPERIMENTS; VISUAL CONTEXT;

CONTENT BASED RETRIEVAL;

IMAGE ANALYSIS;

EID: 79952947989     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2010.2101051     Document Type: Article

References (48)

1. K. Barnard, P. Duygulu, D. Forsyth, N. de Freitas, D. Blei, and M. Jordan, "Matching words and pictures," J. Mach. Learn. Res., vol. 3, pp. 1107-1135, 2003.
2. H. Bay, T. Tuytelaars, and L. van Gool, "SURF: Speeded up robust features," in Proc. ECCV, 2006, pp. 404-417. (Pubitemid 44029795)
3. D. Blei, A. Ng, and M. Jordan, "Latent Dirichlet allocation," J. Mach. Learn. Res., vol. 3, pp. 993-1022, 2003.
4. L. Cao, J. Luo, H. Kautz, and T. Huang, "Annotating collections of photos using hierarchical event and scene models," in Proc. CVPR, 2008, pp. 1-8.
5. G. Carneiro, A. Chan, P. Moreno, and N. Vasconcelos, "Supervised learning of semantic classes for image annotation and retrieval," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 3, pp. 394-410, Mar. 2007. (Pubitemid 46336416)
6. A. Llorente Coto and S. Rüger, "Can a probabilistic image annotation system be improved using a co-occurrence approach?," in Proc. SAMT Workshop Cross-Media Information Analysis and Retrieval, 2008.
7. M. Cristani, A. Perina, U. Castellani, and V. Murino, "Geo-located image analysis using latent representations," in Proc. CVPR, 2008.
8. M. Duan, A. Ulges, T. Breuel, and X.-Q.Wu, "Style modeling for tagging personal photo collections," in Proc. CIVR, 2009.
9. P. Duygulu, K. Barnard, J. de Freitas, and D. Forsyth, "Object recognition as machine translation: Learning a lexicon for a fixed image vocabulary," in Proc. ECCV, 2002, pp. 97-112.
10. C. Elkan, "Using the triangle inequality to accelerate KMeans," in Proc. ICML, 2003, pp. 147-153.
11. L. Fei-Fei and P. Perona, "A Bayesian hierarchical model for learning natural scene categories," in Proc. CVPR, 2005, pp. 524-531.
12. S. Feng and R. Manmatha, "A discrete direct retrieval model for image and video retrieval," in Proc. CIVR, 2008, pp. 427-436.
13. S. Feng, R. Manmatha, and V. Lavrenko, "Multiple Bernoulli relevance models for image and video annotation," in Proc. CVPR, 2004.
14. R. Fergus, L. Fei-Fei, P. Perona, and A. Zisserman, "Learning object categories from Google's image search," Comput. Vis., vol. 2, pp. 1816-1823, 2005. (Pubitemid 44042397)
15. A. Gallagher, C. Neustaedter, L. Cao, J. Luo, and T. Chen, "Image annotation using personal calendars as context," in Proc. ACM MM, 2008, pp. 681-684.
16. T. Hofmann, "Unsupervised learning by probabilistic latent semantic analysis," Mach. Learn., vol. 42, pp. 177-196, 2001. (Pubitemid 32872403)
17. A. Hrishikesh, G. Toderici, and J. Yagnik, "Video2Text: Learning to annotate video content," in Proc. Workshop Int. Multimedia Mining, 2009.
18. J. Jeon and R. Manmatha, "Using maximum entropy for automatic image tagging," in Proc. CIVR, Jul. 2004, pp. 24-32.
19. H. Kück, P. Carbonetto, and N. de Freitas, "A constrained semi-supervised learning approach to data association," in Proc. ECCV, 2004, pp. 1-12.
20. V. Lavrenko, R. Manmatha, and J. Jeon, "A model for learning the semantics of pictures," in Advances in Neural Information Processing Systems 16. Cambridge, MA: MIT Press, 2004.
21. J. Leon, V. Lavrenko, and R. Manmatha, "Automatic image annotation and retrieval using cross-media relevance models," in Proc. Int. Conf. Research and Development in Information Retrieval, 2003, pp. 119-126.
22. J. Li and J. Wang, "Real-time computerized annotation of pictures," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 6, pp. 985-1002, Jun. 2008. (Pubitemid 351650103)
23. L.-J. Li, G. Wang, and L. Fei-Fei, "OPTIMOL: Automatic object picture collection via incremental model learning," in Proc. CVPR, 2007.
24. X. Li, L. Chen, L. Zhang, F. Lin, and W.-Y. Ma, "Image annotation by large-scale content-based image retrieval," in Proc. ACM MM, 2006.
25. X. Li, C. Snoek, and M. Worring, "Annotating images by harnessing worldwide user-tagged photos," in Proc. ICASSP, 2009.
26. X. Li, C. Snoek, and M. Worring, "Learning social tag relevance by neighbor voting," IEEE Trans. Multimedia, vol. 11, no. 7, pp. 1310-1322, Nov. 2009.
27. A. Makadia, V. Pavlovic, and S. Kumar, "A new baseline for image annotation," in Proc. ECCV, 2008, pp. 316-329.
28. H. M. Castro, E. Sucar, and E. Morales, "Automatic image annotation using a semi-supervised ensemble of classifiers," in Proc. Iberoamerican Congr. Pattern Recognition, 2007, pp. 487-495.
29. D. Metzler and R. Manmatha, "An inference network approach to image retrieval," in Proc. CIVR, 2004, pp. 42-50.
30. F. Monay and D. Gatica-Perez, "PLSA-based image annotation: Constraining the latent space," in Proc. ACM MM, 2004, pp. 348-351. (Pubitemid 40211780)
31. Y. Mori, T. Takahashi, and R. Oka, "Image-to-word transformation based on dividing and vector quantizing images with words," in Proc. Workshop Multimedia Intelligence Storage and Retrieval Management, 1999.
32. H. Müller, S. Marchand-Maillet, and T. Pun, "The truth about Corel-evaluation in image retrieval," in Proc. CIVR, 2002, pp. 38-49.
33. M. Naaman, R. Yeh, H. Garcia-Molina, and A. Paepcke, "Leveraging context to resolve identity in photo albums," in Proc. Joint Conf. Digital Libraries, 2005, pp. 178-187. (Pubitemid 41543551)
34. R. Negoescu, B. Adams, D. Phung, S. Venkatesh, and D. Gatica-Perez, "Flickr hypergroups," in Proc. ACM MM, 2009.
35. R. Negoescu and D. Gatica-Perez, "Analyzing Flickr groups," in Proc. CIVR, Jul. 2008, pp. 417-426.
36. M. Renn, J. van Beusekom, D. Keysers, and T. Breuel, "Automatic image tagging using community-driven online image databases," in Proc. Int. Workshop Adaptive Multimedia Retrieval, 2008.
37. P. Sarkar and G. Nagy, "Style consistent classification of isogenous patterns," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 1, pp. 88-98, Jan. 2005. (Pubitemid 40195900)
38. A. Setz and C. Snoek, "Can social tagged images aid concept-based video search?," in Proc. ICME, 2009, pp. 1460-1463.
39. J. Sivic and A. Zisserman, "Video Google: Efficient visual search of videos," in Toward Category-Level Object Recognition. New York: Springer-Verlag, 2006, pp. 127-144.
40. J. Tang and P. Lewis, "A study of quality issues for image auto-annotation with the Corel dataset," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 3, pp. 384-389, Mar. 2007. (Pubitemid 46393337)
41. A. Ulges, C. Schulze, D. Keysers, and T. Breuel, "A system that learns to tag videos by watching Youtube," in Proc. ICVS, 2008.
42. A. Ulges, C. Schulze, M. Koch, and T. Breuel, "Learning automatic concept detectors from online video," Comp. Vis. Image Understand., vol. 114, pp. 429-438, 2010.
43. V. Viitaniemi and J. Laaksonen, "Empirical investigations on benchmark tasks for automatic image annotation," in Proc. VISUAL, 2007.
44. C. Wang, F. Jing, L. Zhang, and H. Zhang, "Image annotation refinement using random walk with restarts," in Proc. ACM MM, 2006.
45. X.-J. Wang, L. Zhang, X. Li, and W.-Y. Ma, "Annotating images by mining image search results," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 11, pp. 1919-1932, Nov. 2008.
46. C. Yang, M. Dong, and F. Fotouhi, "Region based image annotation through multiple-instance learning," in Proc. ACM MM, 2005.
47. Q. Yang, X. Chen, and G. Wang, "Web 2.0 dictionary," in Proc. Int. Conf. Image and Video Retrieval, 2008, pp. 591-600.
48. A.Yavlinsky, E. Schofield, and S. Rüger, "Automated image annotation using global features and robust nonparametric density estimation," in Proc. CIVR, Jul. 2005, pp. 507-517. (Pubitemid 41425589)