New strategies for image annotation: Overview of the photo annotation task at ImageCLEF 2010

CEUR Workshop Proceedings

Volumn 1176, Issue , 2010, Pages

  Nowak, Stefanie ^a   Huiskes, Mark ^b  

^a FRAUNHOFER IDMT   (Germany)

^b LEIDEN UNIVERSITY   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

IMAGE ANNOTATION; MULTI LABEL CLASSIFICATION; MULTI-MODAL APPROACH; PHOTO ANNOTATIONS; TEXTUAL INFORMATION; VISUAL CONCEPT; VISUAL CONFIGURATIONS; VISUAL INFORMATION;

CLASSIFICATION (OF INFORMATION);

EID: 84922041490     PISSN: 16130073     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. Nowak, S., Dunker, P.: Overview of the CLEF 2009 Large-Scale Visual Concept Detection and Annotation Task. In Peters, C., Tsikrika, T., Müller, H., Kalpathy-Cramer, J., Jones, J., Gonzalo, J., Caputo, B., eds.: Multilingual Information Access Evaluation Vol. II Multimedia Experiments: Proceedings of the 10thWorkshop of the Cross-Language Evaluation Forum (CLEF 2009), Revised Selected Papers. Lecture Notes in Computer Science, Corfu, Greece (2010)
2. Huiskes, M.J., Lew, M.S.: The MIR Flickr Retrieval Evaluation. In: Proc. of the ACM International Conference on Multimedia Information Retrieval. (2008)
3. Nowak, S., Dunker, P.: A Consumer Photo Tagging Ontology: Concepts and Annotations. In: THESEUS/ImageCLEF Pre-Workshop 2009, Co-located with the Cross-Language Evaluation Forum (CLEF) Workshop and 13th European Conference on Digital Libraries ECDL, Corfu, Greece, 2009. (2009)
4. Nowak, S., Rüger, S.: How reliable are Annotations via Crowdsourcing: a Study about Inter-annotator Agreement for Multi-label Image Annotation. In: MIR '10: Proceedings of the International Conference on Multimedia Information Retrieval, New York, NY, USA, ACM (2010) 557-566
5. Nowak, S., Lukashevich, H., Dunker, P., Rüger, S.: Performance Measures for Multilabel Evaluation: a Case Study in the Area of Image Classification. In: MIR '10: Proceedings of the International Conference on Multimedia Information Retrieval, New York, NY, USA, ACM (2010) 35-44
6. Nowak, S., Llorente, A., Motta, E., Rüger, S.: The Effect of Semantic Relatedness Measures on Multi-label Classification Evaluation. In: ACM International Conference on Image and Video Retrieval, CIVR. (July 2010)
7. Daróczy, B., Petrás, I., Benczúr, A.A., Nemeskey, D., Pethes, R.: SZTAKI @ ImageCLEF 2010. In: Working Notes of CLEF 2010, Padova, Italy. (2010)
8. Sahbi, H., Li, X.: TELECOM ParisTech at ImageCLEF 2010 Photo Annotation Task: Combining Tags and Visual Features for Learning-Based Image Annotation. In: Working Notes of CLEF 2010, Padova, Italy. (2010)
9. Li, W., Min, J., Jones, G.J.F.: A Text-Based Approach to the ImageCLEF 2010 Photo Annotation Task. In: Working Notes of CLEF 2010, Padova, Italy. (2010)
10. Mbanya, E., Hentschel, C., Gerke, S., Liu, M., Nürnberger, A., Ndjiki-Nya, P.: Augmenting Bag-of-Words-Category Specific Features and Concept Reasoning. In: Working Notes of CLEF 2010, Padova, Italy. (2010)
11. Dimitrovski, I., Kocev, D., Loskovska, S., Dzeroski, S.: Detection of Visual Concepts and Annotation of Images using Predictive Clustering Trees. In: Working Notes of CLEF 2010, Padova, Italy. (2010)
12. Zhang, D., Liu, B., Sun, C., Wang, X.: Random Sampling Image to Class Distance for Photo Annotation. In: Working Notes of CLEF 2010, Padova, Italy. (2010)
13. van de Sande, K.E.A., Gevers, T.: The University of Amsterdam's Concept Detection System at ImageCLEF 2010. In: Working Notes of CLEF 2010, Padova, Italy. (2010)
14. Mensink, T., Csurka, G., Perronnin, F., Sánchez, J., Verbeek, J.: LEAR and XRCE's participation to Visual Concept Detection Task-ImageCLEF 2010. In: Working Notes of CLEF 2010, Padova, Italy. (2010)
15. Batal, R.A., Mulhem, P.: MRIM-LIG at ImageCLEF 2010 Visual Concept Detection and Annotation task. In: Working Notes of CLEF 2010, Padova, Italy. (2010)
16. Paris, S., Glotin, H.: Linear SVM for LSIS Pyramidal Multi-Level Visual only Concept Detection in CLEF 2010 Challenge. In: Working Notes of CLEF 2010, Padova, Italy. (2010)
17. Motohashi, N., Izawa, R., Takagi, T.: Meiji University at the ImageCLEF2010 Visual Concept Detection and Annotation Task:Working notes. In:Working Notes of CLEF 2010, Padova, Italy. (2010)
18. Rasche, C., Vertan, C.: A Novel Structural-Description Approach for Image Retrieval. In: Working Notes of CLEF 2010, Padova, Italy. (2010)
19. Fakeri-Tabrizi, A., Tollari, S., Usunier, N., Amini, M.R., Gallinari, P.: UPMC/LIP6 at Image CLEF annotation 2010. In: Working Notes of CLEF 2010, Padova, Italy. (2010)
20. Stanek, M., Maier, O.: The Wroclaw University of Technology Participation at ImageCLEF 2010 Photo Annotation Track. In: Working Notes of CLEF 2010, Padova, Italy. (2010)
21. Alonso, O., Mizzaro, S.: Can we get rid of TREC assessors? Using Mechanical Turk for relevance assessment. In: SIGIR 2009 Workshop on the Future of IR Evaluation. (2009)
22. Hsueh, P., Melville, P., Sindhwani, V.: Data Quality from Crowdsourcing: a Study of Annotation Selection Criteria. In: Proceedings of the NAACL HLT 2009 Workshop on Active Learning for Natural Language Processing. (2009)
23. Bodoff, D.: Test theory for evaluating reliability of IR test collections. Information Processing & Management 44(3) (2008) 1117-1145