Crowdsourcing for social multimedia at MediaEval 2013: Challenges, data set, and evaluation

CEUR Workshop Proceedings

Volumn 1043, Issue , 2013, Pages

  Loni, Babak ^a   Larson, Martha ^a   Bozzon, Alessandro ^a   Gottlieb, Luke ^b  

^a DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

^b INTERNATIONAL COMPUTER SCIENCE INSTITUTE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

METADATA; SOCIAL NETWORKING (ONLINE);

AMAZON MECHANICAL TURKS; COMPUTATION TECHNIQUES; CONTROL MECHANISM; CROWDSOURCING PLATFORMS; MULTIMEDIA CONTENTS; MULTIMEDIA TASKS; VISUAL FEATURE; WEB-BASED PHOTOS;

QUALITY CONTROL;

EID: 84924785744     PISSN: 16130073     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (3)

1. P. G. Ipeirotis, F. Provost, and J. Wang. Quality management on amazon mechanical turk. In Proceedings of the ACM SIGKDD Workshop on Human Computation, HCOMP '10, pages 64-67, 2010.
2. B. Loni, M. Menendez, M. Georgescu, L. Galli, C. Massari, I. S. Altingovde, D. Martinenghi, M. Melenhorst, R. Vliegendhart, and M. Larson. Fashion-focused creative commons social dataset. In Proceedings of the 4th ACM Multimedia Systems Conference, MMSys '13, pages 72-77, 2013.
3. S. Nowak and S. Rüger. How reliable are annotations via crowdsourcing: a study about inter-annotator agreement for multi-label image annotation In Proceedings of the international conference on Multimedia information retrieval, MIR '10, pages 557-566, 2010.