Tag refinement in an image folksonomy using visual similarity and tag co-occurrence statistics

Signal Processing: Image Communication

Volumn 25, Issue 10, 2010, Pages 761-773

  Lee, Sihyoung ^a   De Neve, Wesley ^a   Ro, Yong Man ^a  

^a Korea Advanced Institute of Science and Technology (KAIST)   (South Korea)

Author keywords

Co occurrence; Folksonomy; Recommendation; Refinement; Visual similarity

Indexed keywords

CO-OCCURRENCE; FOLKSONOMY; RECOMMENDATION; REFINEMENT; VISUAL SIMILARITY;

CLASSIFICATION (OF INFORMATION);

SEMANTIC WEB;

EID: 78649475650     PISSN: 09235965     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.image.2010.10.002     Document Type: Article

References (51)

1. S. Wunsch-Vincent, G. Vickery, OECD study on the participative web: user generated content, Technical Report, OECD, Available on 〈 http://www.oecd.org/dataoecd/57/14/38393115.pdf 〉, April 2007.
2. Flickr 〈 http://www.flickr.com/ 〉.
3. Facebook 〈 http://www.facebook.com/ 〉.
4. Flickr blog, '4,000,000' 〈 http://blog.flickr.net/en/2009/10/12/ 4000000000/ 〉, October 2009.
5. Facebook statistics 〈 http://www.facebook.com/press/info.php? statistics 〉, January 2010.
6. T. Vander Wal, Folksonomy coinage and definition 〈 http://www.vanderwal.net/ 〉, February 2007.
7. M. Ames, M. Naaman, Why we tag: motivations for annotation in mobile and online media, in: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2007, pp. 971980.
8. S. Lindstaedt, R. Morzinger, R. Sorschag, V. Pammer, and G. Thallinger Automatic image annotation using visual content and folksonomies Multimedia Tools and Applications 42 1 2009 97 113
9. T. Chua, J. Tang, R. Hong, H. Li, Z. Luo, Y. Zheng, NUS-WIDE: a real-world web image database from National University of Singapore, in: Proceedings of ACM International Conference on Image and Video Retrieval, 2009, pp. 19.
10. P. Lamere Social tagging and music information retrieval Journal of New Music Research 37 2 2008 101 114
11. R. Datta, W. Ge, J. Li, and J.Z. Wang Toward bridging the annotation-retrieval gap in image search IEEE Multimedia 14 3 2007 24 35
12. L. Wu, L. Yang, N. Yu, X. Hua, Learning to tag, in: Proceedings of ACM WWW, 2009, pp. 361370.
13. WordNet 〈 http://wordnet.princeton.edu/ 〉.
14. ConceptNet 〈 http://web.media.mit.edu/∼hugo/conceptnet/ 〉.
15. Wikipedia 〈 http://www.wikipedia.org/ 〉.
16. D. Liu, M. Wang, L. Yang, X. Hua, H.J. Zhang, Tag quality improvement for social images, in: Proceedings of International Conference on Multimedia and Expo, 2009, pp. 350353.
17. Photosynth 〈 http://photosynth.net/ 〉.
18. Z. Stone, T. Zickler, T. Darrell, Autotagging facebook: social network context improves photo annotation, in: Proceedings of Computer Vision and Pattern Recognition Workshop on Internet Vision, 2008, pp. 18.
19. A. Gallagher, T. Chen, Understanding images of groups of people, in: Proceedings of Computer Vision and Pattern Recognition, 2009, pp. 256263.
20. T. Rattenbury, N. Good, M. Naaman, Towards automatic extraction of event and place semantics from flickr tags, in: Proceedings of ACM SIGIR, 2007, pp. 103110.
21. Technical Standardization Committee on AV & IT Storage Systems and Equipment, Exchangeable image file format for digital still cameras: Exif Version 2.2, Technical Report, Japan Electronics and Information Technology Industries Association, April 2002.
22. A.C. Gallagher, C. Neustaedter, L. Cao, J. Luo, T. Chen, Image annotation using personal calendars as context, in: Proceedings of ACM Multimedia, 2008, pp. 681684.
23. X. Li, C.G.M. Snoek, and M. Worring Learning social tag relevance by neighbor voting IEEE Transactions on Multimedia 11 7 2009 1310 1322
24. C. Cusano, G. Ciocca, R. Schettini, Image annotation using SVM, in: Proceedings of Internet Imaging IV, vol. 5304, 2007, pp. 330338.
25. E. Chang, G. Kingshy, G. Sychay, and G. Wu CBSA: content-based soft annotation for multimodal image retrieval using bayes point machines IEEE Transactions on Circuits and Systems for Video Technology 13 1 2003 26 38
26. C.B. Yang, M. Dong, J. Hua, Region-based image annotation using asymmetrical support vector machine-based multiple-instance learning, in: Proceedings of Computer Vision and Pattern Recognition, 2006, pp. 20572063.
27. M. Zhu, and A. Badii Semantic-associative visual content labelling and retrieval: a multimodal approach Signal processing: Image communication 22 6 2007 569 582
28. Y. Mori, H. Takahashi, R. Oka, Image-to-word transformation based on dividing and vector quantizing images with words, in: Proceedings of International Workshop on Multimedia Intelligent Storage and Retrieval Management, 1999, pp. 405409.
29. V. Lavrenko, R. Manmatha, J. Jeon, A model for learning the semantics of pictures, in: Proceedings of 17th Annual Conference on Neural Information Processing Systems, 2003, pp. 553560.
30. B. Wang, Z. Li, N. Yu, M. Li, Image annotation in a progressive way, in: Proceedings of International Conference on Multimedia and Expo, 2007, pp. 811814.
31. S.L. Feng, R. Manmatha, V. Lavrenko, Multiple bernoulli relevance models for image and video annotation, in: Proceedings of Computer Vision and Pattern Recognition, 2004, pp. 10021009.
32. B. Sigurbjornsson, R. van Zwol, Flickr tag recommendation based on collective knowledge, in: Proceedings of ACM WWW, 2008, pp. 327336.
33. C. Fellbaum WordNet: An Electronic Lexical Database 1998 The MIT Press
34. S.G. Sevil, O. kucuktunc, P. Duygulu, F. Can, Automatic tag expansion using visual similarity for photo sharing websites, Multimedia Tools and Applications 49 (1) (2009) 8199.
35. K. Weinberger, M. Slaney, R. van Zwol, Resolving tag ambiguity, in: Proceedings of ACM Multimedia, 2008, pp. 111120.
36. L. Ahn, L. Dabbish, Labeling images with a computer game, in: Proceedings of SIGCHI Conference on Human Factors in Computing System, 2004, pp. 319326.
37. M.J. Huiskes, M.S. Lew, The MIR flickr retrieval evaluation, in: Proceedings of ACM International Conference on Multimedia Information Retrieval, 2008, pp. 3943.
38. W. Zhao, and C. Ngo Scale-rotation invariant pattern entropy for keypoint-based near-duplicate detection IEEE Transactions on Image Processing 18 2 2009 412 423
39. K. Konstantinidis, A. Gasteratos, and I. Andreadis Image retrieval based on fuzzy color histogram processing Optics Communications 248 4-6 2005 375 386
40. B.S. Manjunath, P. Salembier, and T. Sikora Introduction to MPEG-7: Multimedia Content Description Interface 2002 Wiley
41. D.G. Lowe Distinctive image features from scale-invariant keypoints International Journal of Computer Vision 60 2 2004 91 110
42. H. Bay, T. Tuytelaars, L. Van Gool, SURF: speeded up robust features, in: Proceedings of the 9th European Conference on Computer Vision, 2006, pp. 404417.
43. M. Heikkila, and M. Pietikainen A texture-based method for modeling the background and detecting moving objects IEEE Transactions on Pattern Analysis and Machine Intelligence 28 4 2006 657 662
44. D. Zhang, and G. Lu Shape-based image retrieval using generic Fourier descriptor Signal Processing: Image Communication 17 10 2002 825 848
45. R. Jaschke, L. Marinho, A. Hotho, L. Schmidt-Thieme, G. Stumme, Tag recommendations in folksonomies, in: Lecture Notes in Artificial Intelligence, vol. 4072, 2007, pp. 506514.
46. T. Pedersen, S. Patwardhan, J. Michelizzi, WordNet::Similaritymeasuring the relatedness of concepts, in: Proceedings of Joint International Conference on Artificial Intelligence, 2004, pp. 10241025.
47. S. Lee, W. De Neve, Y.M. Ro, and K.N. Plataniotis MAP-based image tag recommendation using a visual folksonomy Pattern Recognition Letters 31 9 2010 976 982
48. Y. Jin, L. Khan, L. Wang, M. Awad, Image annotations by combining multiple evidence & WordNet, in: Proceedings of ACM Multimedia, 2005, pp. 706715.
49. D. Liu, X.-S. Hua, L. Yang, M. Wang, H.-J. Zhang, Tag ranking, in: Proceedings of WWW, 2009, pp. 351360.
50. T. Deselaers, D. Keysers, and H. Ney Features for image retrieval: an experimental comparison Information Retrieval 11 2 2008 77 107
51. K. Jarvelin, and J. Kekalainen Cumulated gain-based evaluation of IR techniques ACM Transactions on Information Systems 20 4 2002 422 446