Picture tags and world knowledge: Learning tag relations from visual semantic sources

MM 2013 - Proceedings of the 2013 ACM Multimedia Conference

Volumn , Issue , 2013, Pages 967-976

  Xie, Lexing ^a   He, Xuming ^a  

^a AUSTRALIAN NATIONAL UNIVERSITY   (Australia)

Author keywords

Folksonomy; Knowledge graph; Social media

Indexed keywords

ESTIMATION ALGORITHM; FOLKSONOMIES; KNOWLEDGE DATABASE; KNOWLEDGE GRAPHS; NATURAL LANGUAGES; SEMANTIC KNOWLEDGE; SOCIAL MEDIA; VISUAL SEMANTICS;

ALGORITHMS;

SEMANTICS;

EID: 84887420405     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2502081.2502113     Document Type: Conference Paper

References (50)

1. ILSVRC, 2012. http://www.image-net.org/challenges/LSVRC/2012.
2. Project webpage, 2013. http://users.cecs.anu.edu.au/~xlx/proj/tagnet.
3. M. Ames and M. Naaman. Why we tag: motivations for annotation in mobile and online media. CHI '07, pages 971-980, 2007.
4. K. Atkinson. Official 12Dicts package. http://wordlist.sourceforge.net, retrieved March 2012.
5. S. Auer, C. Bizer, G. Kobilarov, J. Lehmann, R. Cyganiak, and Z. Ives. Dbpedia: A nucleus for a web of open data. The Semantic Web, pages 722-735, 2007.
6. L. Backstrom and J. Leskovec. Supervised random walks: predicting and recommending links in social networks. WSDM '11, pages 635-644, 2011.
7. K. Barnard, P. Duygulu, D. Forsyth, N. De Freitas, D. Blei, and M. Jordan. Matching words and pictures. The Journal of Machine Learning Research, 3:1107-1135, 2003.
8. A. Berg, T. Berg, H. Daume, J. Dodge, A. Goyal, X. Han, A. Mensch, M. Mitchell, A. Sood, K. Stratos, et al. Understanding and predicting importance in images. In CVPR, pages 3562-3569. IEEE, 2012.
9. K. Bischo, C. S. Firan, W. Nejdl, and R. Paiu. Can all tags be used for search? CIKM '08, pages 193-202, 2008.
10. N. Chen, Q.-Y. Zhou, and V. Prasanna. Understanding web images by object relation network. WWW '12, pages 291-300, 2012.
11. M. Choi, A. Torralba, and A. Willsky. A tree-based context model for object recognition. IEEE Trans. on Pattern Analysis and Machine Intelligence, 34(2), 2012.
12. T. Chua, J. Tang, R. Hong, H. Li, Z. Luo, and Y. Zheng. NUS-WIDE: A real-world web image database from national university of singapore. In ACM CIVR, 2009.
13. J. Deng, W. Dong, R. Socher, L. Li, K. Li, and L. Fei-Fei. Imagenet: A large-scale hierarchical image database. In IEEE CVPR, pages 248-255. Ieee, 2009.
14. J. Deng, S. Satheesh, A. Berg, and L. Fei-Fei. Fast and balanced: Efficient label tree learning for large scale object recognition. In NIPS, 2011.
15. T. Deselaers and V. Ferrari. Visual and semantic similarity in imagenet. In CVPR, pages 1777-1784. IEEE, 2011.
16. J. Dodge, A. Goyal, X. Han, A. Mensch, M. Mitchell, K. Stratos, K. Yamaguchi, Y. Choi, I. Hal Daume, and A. Berg. Detecting visual text. In North American Chapter of the Association for Computational Linguistics (NAACL), 2012.
17. C. Fellbaum. Wordnet. Theory and Applications of Ontology: Computer Applications, pages 231-243, 2010.
18. G. H. Golub and C. D. Meyer Jr. Using the qr factorization and group inversion to compute, differentiate, and estimate the sensitivity of stationary probabilities for markov chains. SIAM J. Algebraic Discrete Methods, 7(2):273-281, Apr. 1986.
19. M. Gomez-Rodriguez, J. Leskovec, and A. Krause. Inferring networks of difuusion and inuence. ACM Trans. Knowl. Discov. Data, 5(4):21:1-21:37, Feb. 2012.
20. T. L. Griths, M. Steyvers, and A. Firl. Google and the mind predicting uency with pagerank. Psychological Science, 18(12):1069-1076, 2007.
21. C. Havasi, R. Speer, and J. Alonso. ConceptNet 3: A exible, multilingual semantic network for common sense knowledge. In Recent Advances in Natural Language Processing, pages 270-29, 2007.
22. J.-W. Jeong, X.-J. Wang, and D.-H. Lee. Towards measuring the visualness of a concept. CIKM '12, pages 2415-2418, 2012.
23. L. Kennedy, M. Naaman, S. Ahern, R. Nair, and T. Rattenbury. How ickr helps us make sense of the world: context and content in community-contributed media collections. In ACM Multimedia, pages 631-640, 2007.
24. Y. Koren, R. Bell, and C. Volinsky. Matrix factorization techniques for recommender systems. Computer, 42(8):30-37, 2009.
25. S. Kullback and R. Leibler. On information and sufficiency. The Annals of Mathematical Statistics, 22(1):79-86, 1951.
26. A. Langville and C. Meyer. Google's PageRank and beyond: The science of search engine rankings. Princeton University Press, 2009.
27. L.-j. Li, H. Su, E. P. Xing, and L. Fei-fei. Object Bank : A High-Level Image Representation for Scene Classification & Semantic Feature Sparsification. In NIPS, pages 1-9, 2010.
28. X. Li, C. G. M. Snoek, and M. Worring. Learning social tag relevance by neighbor voting. IEEE Trans. Multi., 11(7):1310-1322, Nov. 2009.
29. D. Liu, X.-S. Hua, L. Yang, M. Wang, and H.-J. Zhang. Tag ranking. WWW '09, pages 351-360, 2009.
30. T. Malisiewicz and A. Efros. Beyond categories: The visual memex model for reasoning about object relationships. In NIPS, 2009.
31. T. Mitchell, S. Shinkareva, A. Carlson, K. Chang, V. Malave, R. Mason, and M. Just. Predicting human brain activity associated with the meanings of nouns. science, 320(5880):1191-1195, 2008.
32. J. Morales and J. Nocedal. Remark on \Algorithm 778: L-BFGS-B: Fortran subroutines for large-scale bound constrained optimization". ACM Transactions on Mathematical Software (TOMS), 38(1):7, 2011.
33. M. Naphade, J. Smith, J. Tesic, S. Chang, W. Hsu, L. Kennedy, A. Hauptmann, and J. Curtis. Large-scale concept ontology for multimedia. Multimedia, IEEE, 13(3):86-91, 2006.
34. S. Overell, B. Sigurbjornsson, and R. van Zwol. Classifying tags using open content resources. WSDM, 2009.
35. K. B. Petersen and M. S. Pedersen. The matrix cookbook, oct 2008. Version 20081110.
36. G. Qi, X. Hua, Y. Rui, J. Tang, T. Mei, and H. Zhang. Correlative multi-label video annotation. In ACM Multimedia, pages 17-26, 2007.
37. G.-J. Qi, C. Aggarwal, and T. Huang. Towards semantic knowledge propagation from text corpus to web images. WWW '11, pages 297-306, 2011.
38. P. Quelhas, F. Monay, J.-M. Odobez, D. Gatica-Perez, and T. Tuytelaars. A thousand words in a scene. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29:1575-1589, 2007.
39. T. Rattenbury, N. Good, and M. Naaman. Towards automatic extraction of event and place semantics from ickr tags. SIGIR, pages 103-110. ACM, 2007.
40. B. Sigurbjö̈rnsson and R. van Zwol. Flickr tag recommendation based on collective knowledge. WWW'08, pages 327-336. ACM, 2008.
41. D. Stern, R. Herbrich, and T. Graepel. Matchbox: large scale online bayesian recommendations. In Proc. World wide web, pages 111-120. ACM, 2009.
42. F. Suchanek, G. Kasneci, and G. Weikum. Yago: A core of semantic knowledge. In World Wide Web, pages 697-706. ACM, 2007.
43. J. Tang, S. Yan, R. Hong, G.-J. Qi, and T.-S. Chua. Inferring semantic concepts from community-contributed images and noisy tags. In ACM Multimedia, pages 223-232, 2009.
44. H. Tong, C. Faloutsos, and J. Pan. Fast random walk with restart and its applications. In ICDM. IEEE, 2006.
45. K. Van De Sande, T. Gevers, and C. Snoek. Evaluating color descriptors for object and scene recognition. Pattern Analysis and Machine Intelligence IEEE Trans., 32(9):1582-1596, 2010.
46. M. Wang, K. Yang, X.-S. Hua, and H.-J. Zhang. Visual tag dictionary: interpreting tags with visual words. In Workshop on Web-scale multimedia corpus, 2009.
47. X.-J. Wang, Z. Xu, L. Zhang, C. Liu, and Y. Rui. Towards indexing representative images on the web. In ACM Multimedia, pages 1229-1238, 2012.
48. K. Q. Weinberger, M. Slaney, and R. Van Zwol. Resolving tag ambiguity. In ACM Multimedia, pages 111-120, 2008.
49. J. Weston, S. Bengio, and N. Usunier. Wsabie: Scaling up to large vocabulary image annotation. In Proc. IJCAI, pages 2764-2770. AAAI Press, 2011.
50. K. Yanai and K. Barnard. Image region entropy: A measure of "visualness" of web images associated with one concept. In Proc. ACM Multimedia, pages 419{422, 2005.