BATC - A benchmark for aggregation techniques in crowdsourcing

SIGIR 2013 - Proceedings of the 36th International ACM SIGIR Conference on Research and Development in Information Retrieval

Volumn , Issue , 2013, Pages 1079-1080

  Hung, Nguyen Quoc Viet ^a   Tam, Nguyen Thanh ^a   Tran, Lam Ngoc ^a   Aberer, Karl ^a  

^a EPFL   (Switzerland)

Author keywords

Aggregate technique; Benchmark; Crowdsourcing

Indexed keywords

AGGREGATION TECHNIQUES; BENCHMARKING TOOLS; CROWDSOURCING; HUMAN KNOWLEDGE; NEW APPLICATIONS; PERFORMANCE CHARACTERISTICS; PRACTICAL GUIDELINES; SOFTWARE DEVELOPER;

BENCHMARKING; INFORMATION RETRIEVAL; RESEARCH; TOOLS;

AGGREGATES;

EID: 84883094853     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2484028.2484199     Document Type: Conference Paper

References (9)

1. L. von Ahn. "Human computation,". In: Design Automation Conference. 2009.
2. A. Doan et al. "Crowdsourcing systems on the World-Wide Web,". In: Commun. ACM (2011).
3. P. G. Ipeirotis et al. "Quality management on Amazon Mechanical Turk,". In: HCOMP. 2010.
4. D. Karger et al. "Iterative learning for reliable crowdsourcing systems,". In: NIPS (2011).
5. F. Khattak et al. "Quality Control of Crowd Labeling through Expert Evaluation,". In: NIPS 2nd Workshop (2011).
6. K. Lee et al. "The social honeypot project: protecting online communities from spammers,". In: WWW. 2010.
7. V. Raykar et al. "Supervised learning from multiple experts: Whom to trust when everyone lies a bit,". In: ICML (2009).
8. J. Vuurens et al. "How much spam can you take? an analysis of crowdsourcing results to increase accuracy,". In: SIGIR. 2011.
9. J. Whitehill et al. "Whose vote should count more: Optimal integration of labels from labelers of unknown expertise,". In: NIPS (2009).