The accuracy and value of machine-generated image tags: Design and user evaluation of an end-to-end image tagging system

CIVR 2010 - 2010 ACM International Conference on Image and Video Retrieval

Volumn , Issue , 2010, Pages 58-65

  Xie, Lexing ^a   Natsev, Apostol ^a   Hill, Matthew ^a   Smith, John R ^a   Phillips, Alex ^b  

^a IBM T J WATSON RESEARCH CENTER   (United States)

^b IBM   (United Kingdom)

Author keywords

Image tagging; Social media; User value

Indexed keywords

AUTOMATIC CLASSIFIERS; BASE-LINE PERFORMANCE; END-TO-END SYSTEMS; ERROR TOLERANCE; IMAGE CONTENT; IMAGE TAGGING; IN-BUILDINGS; PHOTO SHARING; RELATIVE IMPORTANCE; SOCIAL MEDIA; TAGGING SYSTEMS; USER EVALUATIONS; USER INPUT; USER STUDY; USER VALUE;

CLASSIFIERS; TAXONOMIES;

MACHINE DESIGN;

EID: 77955890353     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1816041.1816052     Document Type: Conference Paper

References (35)

1. Flickr API. http://www.flickr.com/services/api/.
2. IBM Multimedia Analysis and Retrieval System. http://www.alphaworks.ibm. com/tech/imars.
3. The PASCAL visual object classes homepage. http://pascallin.ecs.soton.ac. uk/challenges/VOC/.
4. M. Ames and M. Naaman. Why we tag: Motivations for annotation in mobile and online media. In Proc. CHI, pages 971-980, 2007.
5. K. Barnard, P. Duygulu, D. Forsyth, N. de Freitas, D. M. Blei, and M. I. Jordan. Matching words and pictures. J. Mach. Learn. Res., 3:1107-1135, 2003.
6. K. Bischoff, C. S. Firan, W. Nejdl, and R. Paiu. Can all tags be used for search? In Proc. ACM CIKM, pages 193-202, 2008.
7. T. Coates. Two cultures of fauxonomies collide⋯ http://www.plasticbag.org/archives/2005/06/, 2005.
8. T. M. Cover and J. Thomas. Elements of information theory. Wiley, 1991.
9. J. Elson, J. R. Douceur, J. Howell, and J. Saul. Asirra: A captcha that exploits interest-aligned manual image categorization. In ACM CCS '07, 2007.
10. C. Fellbaum et al. WordNet: An electronic lexical database. MIT press Cambridge, MA, 1998.
11. P. Felzenszwalb, R. Girshick, D. McAllester, and D. Ramanan. Object Detection with Discriminatively Trained Part Based Models. Journal of Artificial Intelligence Research, 29, 2007.
12. N. Garg and I. Weber. Personalized tag suggestion for Flickr. In Proc. WWW, pages 1063-1064, 2008.
13. S. A. Golder and B. A. Huberman. Usage patterns of collaborative tagging systems. J. Inf. Sci., 32(2), 2006.
14. L. Kennedy, M. Slaney, and K. Weinberger. Reliable tags using image similarity: mining specificity and expertise from large-scale multimedia databases. In WSMC '09: Proc. of workshop on Web-scale multimedia corpus, pages 17-24, 2009.
15. J. Li and J. Z. Wang. Real-time computerized annotation of pictures. IEEE Trans. PAMI, 30(6):985-1002, 2008.
16. D. Liu, X.-S. Hua, L. Yang, M. Wang, and H.-J. Zhang. Tag ranking. In Proc. WWW, pages 351-360, 2009.
17. H. Liu and P. Singh. ConceptNet: a practical commonsense reasoning toolkit. BT Tech. Journal, 22(4):211-226, 2004.
18. M. Campbell et. al. IBM research TRECVID-2007 video retrieval system. TREC Video Retrieval Evaluation Online Proceeding, 2007.
19. M. Naphade et. al. Large-scale concept ontology for multimedia. IEEE Multimedia, 13(3):86-91, 2006.
20. C. Marlow, M. Naaman, D. Boyd, and M. Davis. HT06, tagging paper, taxonomy, Flickr, academic article, to read. In Proc. the 17th conference on Hypertext and hypermedia, page 40, 2006.
21. M. Marszalek and C. Schmid. Semantic hierarchies for visual object recognition. In Proc. CVPR, jun 2007.
22. P. Bolettieri et. al. CoPhIR: a test collection for content-based image retrieval. CoRR, 2009.
23. J. Platt. Probabilities for SV machines. Advances in Neural Information Processing Systems, pages 61-74, 1999.
24. T. Rattenbury, N. Good, and M. Naaman. Towards extracting Flickr tag semantics. In Proc. WWW '07, pages 1287-1288, 2007.
25. S. Reed and D. Lenat. Mapping ontologies into cyc. In Proc. AAAI Conference 2002 Workshop on Ontologies for the Semantic Web, pages 02-11, 2002.
26. R. Shi, C.-H. Lee, and T.-S. Chua. Enhancing image annotation by integrating concept ontology and text-based bayesian learning model. In Proc. ACM Multimedia, pages 341-344, New York, NY, USA, 2007.
27. B. Sigurbjornsson and R. van Zwol. Flickr tag recommendation based on collective knowledge. In Proc. WWW '08, pages 327-336, 2008.
28. A. Smeaton, P. Over, and W. Kraaij. Evaluation campaigns and TRECVid. In Proceedings of the 8th ACM international workshop on Multimedia information retrieval, page 330, 2006.
29. A. Torralba, R. Fergus, and W. Freeman. 80 million tiny images: a large dataset for non-parametric object and scene recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30(11): 1958-1970, 2008.
30. K. Van De Sande, T. Gevers, and C. Snoek. Evaluation of color descriptors for object and scene recognition. In Proc. IEEE CVPR, page 1, 2008.
31. V. Vapnik. The nature of statistical learning theory. Springer Verlag, 2000.
32. A. Vedaldi, V. Gulshan, M. Varma, and A. Zisserman. Multiple kernels for object detection. In Proc. of the Intl. Conf. on Computer Vision (ICCV), 2009.
33. L. Von Ahn and L. Dabbish. Labeling images with a computer game. In Proc. of the SIGCHI Conf. on Human Factors in Computing Systems, pages 319-326, 2004.
34. K. Q. Weinberger, M. Slaney, and R. Van Zwol. Resolving tag ambiguity. In Proc. ACM Multimedia, pages 111-120, New York, NY, USA, 2008.
35. R. Yan, J. Tesic, and J. R. Smith. Model-shared subspace boosting for multi-label classification. In Proc. ACM KDD, pages 834-843, 2007.