New trends and ideas in visual concept detection: The MIR flickr retrieval evaluation initiative

MIR 2010 - Proceedings of the 2010 ACM SIGMM International Conference on Multimedia Information Retrieval

Volumn , Issue , 2010, Pages 527-536

  Huiskes, Mark J ^a   Thomee, Bart ^a   Lew, Michael S ^a  

^a LEIDEN UNIVERSITY   (Netherlands)

Author keywords

Benchmarking; Classification; Content based image retrieval; Image collections; Trends; Visual concept detection

Indexed keywords

CONTENT BASED IMAGE RETRIEVAL; CONTENT-BASED; CREATIVE COMMONS; DESCRIPTORS; HIGH QUALITY; IMAGE COLLECTIONS; NUMBER OF STATE; ORIGINAL IMAGES; PHOTOGRAPHIC IMAGE; RELEVANCE FEEDBACK METHOD; RETRIEVAL EVALUATION; SMALL SAMPLES; VISUAL CONCEPT;

BENCHMARKING; CLASSIFIERS; CONTENT BASED RETRIEVAL; FEEDBACK; IMAGE PROCESSING; METADATA; PHOTOGRAPHY;

INFORMATION RETRIEVAL;

EID: 77952328425     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1743384.1743475     Document Type: Conference Paper

References (36)

1. Von Ahn, L. and Dabbish, L. 2004. Labeling images with a computer game. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vienna, Austria, April 24 - 29, 2004). CHI '04. ACM, New York, NY, 319-326. DOI= http://doi.acm.org/10.1145/985692.985733
2. Aly, M., Welinder P., Munich, M. and Perona, P. 2009. Scaling Object Recognition: Benchmark of Current State of the Art Techniques. In First IEEE Workshop on Emergent Issues in Large Amounts of Visual Data, IEEE International Conference on Computer Vision (ICCV) 2009, Kyoto, Japan.
3. Angeletou, S., Sabou, M., and Motta, E. 2009. Improving Folksonomies using Formal Knowledge: A Case Study on Search, 4th Asian Semantic Web Conference, Shanghai, China.
4. Borthaku, D. 2007. The Hadoop distributed file system: Architecture and design. From: lucene.apache.org/hadoop.
5. Chang, C.-C. and Lin, C.-J. 2001. LIBSVM: a library for support vector machines.
6. Chang, F., Dean, J., Ghemawat, S., Hsieh, W. C., Wallach, D. A.,Burrows, M., Chandra, T., Fikes, A., and Gruber, R. E. 2006. Bigtable: A distributed storage system for structured data. Seventh Symposium on Operating System Design and Implementation (OSDI).
7. Everingham, M., Zisserman, A., Williams, C. K. I., & Van Gool, L. 2006. The Pascal Visual Object Classes Challenge 2006 (VOC 2006) results (Technical report).
8. Van Gemert, J.C., Veenman, C.J., Smeulders, A.W.M., Geusebroek, J-.M. 2010. Visual Word Ambiguity. IEEE Transactions on Pattern Analysis and Machine Intelligence (in press).
9. George, D. and Hawkins, J. 2009. Towards a mathematical theory of cortical micro-circuits. PLoS computational biology, Vol.5, No.10, e1000532.
10. Grubinger, M., Clough, P.D., Müller, H. and Deselaers, T. 2006. The IAPR Benchmark: A New Evaluation Resource for Visual Information Systems, International Conference on Language Resources and Evaluation, Genoa, Italy.
11. Hare, J.S and Lewis, P.H. 2010. Automatically Annotating the MIR Flickr Dataset. In Proceedings of the 2nd ACM international Conference on Multimedia information Retrieval (MIR '10).
12. Hörster, E. and Lienhart, R. 2008. Deep networks for image retrieval on large-scale databases. In Proceeding of the 16th ACM international Conference on Multimedia (Vancouver, British Columbia, Canada, October 26 - 31, 2008). MM '08. ACM, New York, NY, 643-646. DOI= http://doi.acm.org/10.1145/ 1459359.1459449
13. Huiskes, M.J. 2006. Image Searching and Browsing by active aspect-based relevance learning. In Proceedings of CIVR06, LNCS 4071, 211-220. Springer.
14. Huiskes, M.J. and Lew, M. S. 2008. The MIR Flickr retrieval evaluation. In Proceeding of the 1st ACM international Conference on Multimedia information Retrieval (Vancouver, British Columbia, Canada, October 30 - 31, 2008). MIR '08. ACM, New York, NY, 39-43. DOI= http://doi.acm.org/10.1145/1460096.1460104
15. Huiskes, M. J. and Lew, M. S. 2008. Performance evaluation of relevance feedback methods. In Proceedings of the 2008 international Conference on Content-Based Image and Video Retrieval (Niagara Falls, Canada, July 07 - 09, 2008). CIVR '08. ACM, New York, NY, 239-248. DOI= http://doi.acm.org/10.1145/ 1386352.1386387
16. Huiskes, M.J. and Lew, M.S. 2009. Hierarchical Annotation for Large Image Collections, Theseus/ImageCLEF workshop on visual information retrieval evaluation, Corfu, Greece.
17. Lazebnik, S., Schmid, C., and Ponce, J. 2006. Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories. In Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume2 (June 17 - 22, 2006). CVPR. IEEE Computer Society, Washington, DC, 2169-2178. DOI= http://dx.doi.org/10.1109/CVPR.2006.68
18. Li, X., Snoek, C. G., and Worring, M. 2008. Learning tag relevance by neighbor voting for social image retrieval. In Proceeding of the 1st ACM international Conference on Multimedia information Retrieval (Vancouver, British Columbia, Canada, October 30 - 31, 2008). MIR '08. ACM, New York, NY, 180-187. DOI= http://doi.acm.org/10.1145/1460096.1460126
19. Manjunath, B.S., Ohm, J., Vasudevan, V.V. and Yamada, A. 1998. Color and texture descriptors. IEEE Transactions on Circuits and Systems for Video Technology, 11:703-715.
20. Moosmann, F., Nowak, E. and Jurie, F. 2008. Randomized clustering forests for image classification. IEEE Transactions on Pattern Analysis and Machine Intelligence 9:1632-1646.
21. Noh, T., Park, S., Yoon, H., Lee, S., and Park, S. 2009. An automatic translation of tags for multimedia contents using folksonomy networks. In Proceedings of the 32nd international ACM SIGIR Conference on Research and Development in information Retrieval (Boston, MA, USA, July 19 - 23, 2009). SIGIR '09. ACM, New York, NY, 492-499. DOI= http://doi.acm.org/10.1145/1571941. 1572026
22. Nowak, S. and Dunker, P. 2009. Overview of the CLEF 2009 Large Scale - Visual Concept Detection and Annotation Task. In CLEF working notes 2009, Corfu, Greece.
23. Nowak, S. and Dunker, P. 2010. Performance measures for multilabel evaluation. In Proceedings of the 2nd ACM international Conference on Multimedia information Retrieval (MIR '10).
24. Nowak, S. 2010. Reliable Annotations via Crowdsourcing? In Proceedings of the 2nd ACM international Conference on Multimedia information Retrieval (MIR '10).
25. Van de Sande, K.E.A., Gevers, T. and Smeulders, A.W.M. 2009. The University of Amsterdam's Concept Detection System at ImageCLEF 2009. CLEF working notes 2009, Corfu, Greece.
26. Van de Sande, K.E.A., Gevers, T. and Snoek, C.G.M. 2010. Evaluating Color Descriptors for Object and Scene Recognition, IEEE Transactions on Pattern Analysis and Machine Intelligence (in press).
27. Serre, T., Wolf, L. Bileschi, S., Riesenhuber, M. and Poggio, T. 2007. Robust Object recognition with cortex-like mechanisms. IEEE Transactions on Pattern Analysis and Machine Intelligence 29(3), 411-426.
28. Sivic, J. and Zisserman, A. 2003. Video Google: A text retrieval approach to object matching in videos. In IEEE International Conference on Computer Vision (ICCV), 1470-1477.
29. Smeaton, A. F., Over, P., and Kraaij, W. 2006. Evaluation campaigns and TRECVid. In Proceedings of the 8th ACM international Workshop on Multimedia information Retrieval (Santa Barbara, California, USA, October 26 - 27, 2006). MIR '06. ACM, New York, NY, 321-330. DOI= http://doi.acm.org/10.1145/1178677. 1178722
30. Torralba, A., Fergus, R., and Freeman, W. T. 2008. 80 Million Tiny Images: A Large Data Set for Nonparametric Object and Scene Recognition. IEEE Trans. Pattern Anal. Mach. Intell. 30, 11 (Nov. 2008), 1958-1970. DOI= http://dx.doi.org/10.1109/TPAMI.2008.128
31. Torralba, A. Fergus, R. Weiss, Y. 2008. Small codes and large image databases for recognition. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2008, 1-8, Anchorage, AK.
32. Uijlings, J. R., Smeulders, A. W., and Scha, R. J. 2009. Realtime bag of words, approximately. In Proceedings of the ACM international Conference on Image and Video Retrieval (Santorini, Fira, Greece, July 08 - 10, 2009). CIVR '09. ACM, New York, NY, 1-8. DOI= http://doi.acm.org/10.1145/1646396.1646405
33. Ulges, A., Schulze, C., Keysers, D., and Breuel, T. 2008. Identifying relevant frames in weakly labeled videos for training concept detectors. In Proceedings of the 2008 international Conference on Content-Based Image and Video Retrieval (Niagara Falls, Canada, July 07 - 09, 2008). CIVR '08. ACM, New York, NY, 9-16. DOI= http://doi.acm.org/10.1145/1386352.1386358
34. Verbeek, J., Guillaumin, M., Mensink, T. and Schmid, C. 2010. Image Annotation with TagProp on the MIRFLICKR set. In Proceedings of the 2nd ACM international Conference on Multimedia information Retrieval (MIR '10).
35. Yang, J. and Hauptmann, A. G. 2008. (Un)Reliability of video concept detection. In Proceedings of the 2008 international Conference on Content-Based Image and Video Retrieval (Niagara Falls, Canada, July 07 - 09, 2008). CIVR '08. ACM, New York, NY, 85-94. DOI= http://doi.acm.org/10.1145/1386352.1386367
36. Zhang, J., Marszaiek, M., Lazebnik, S. and Schmid, C. 2007. Local Features and Kernels for Classification of Texture and Objecs. Categories: A Comprehensive Study. IJCV, 73(2): 213-238.