BudgetFIx: Budget limited crowdsourcing for interdependent task allocation with quality guarantees

13th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2014

Volumn 1, Issue , 2014, Pages 477-484

  Tran Thanh, Long ^a   Huynh, Trung Dong ^a   Rosenfeld, Avi ^b   Ramchun, Sarvapali ^a   Jennings, Nicholas R ^a  

^a UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

^b JERUSALEM COLLEGE OF TECHNOLOGY   (Israel)

Author keywords

Budgeted task allocation; Crowdsourcing; Find fix verify; Performance guarantees

Indexed keywords

EID: 84910155070     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (17)

1. O. Amir, D.G. Rand, and Y. Gal. Economic games on the internet: The effect of $1 stakes. PloS one, 7(2), 2012.
2. J.-Y. Audibert, S. Bubeck, and R. Munos. Best arm identification in multi-armed bandits. COLT, pages 41-53, 2010.
3. Amos Azaria, Yonatan Aumann, and Sarit Kraus. Automated agents for reward determination for human work in crowdsourcing applications. Autonomous Agents and Multi-Agent Systems, pages 1-22, 2013.
4. M. S. Bernstein, G. Little, R. C. Miller, B. Hartmann, M. S. Ackerman, D. R. Karger, D. Crowell, and K. Panovich. Soylent: a word processor with a crowd inside. In UIST, pages 313-322, 2010.
5. P. Dai, C. H. Lin, Mausam, and D. S. Weld. POMDP-based control of workflows for crowdsourcing. Artificial Intelligence (AU), 202:52-85, 2013.
6. R. Flesch. A new readability yardstick. Journal of Applied Psychology, 32(3):221-233, 1948.
7. C.-J. Ho and J. Wortman-Vaughan. Online task assignment in crowdsourcing markets. In AAA1, pages 45-51, 2012.
8. E. Kamar, S. Hacker, and E. Horvitz. Combining human and machine intelligence in large-scale crowdsourcing. AAMAS, pages 467-474, 2012.
9. D. R. Karger, S. Oh, and D. Shah. Budget-optimal task allocation for reliable crowdsourcing systems. CoRR, abs/1110.3564, 2011.
10. J. P. Kincaid, R. P. Fishburne, R. L. Rogers, and B. S. Chissom. Derivation of New Readability Formulas (Automated Readability Index, Fog Count and Flesch Reading Ease Formula) for Navy Enlisted Personnel. Technical report, February 1975.
11. C. H. Lin, Mausam, and D. S. Weld. Dynamically switching between synergistic workflows for crowdsourcing. AAAI, pages 87-93, 2012.
12. G. Little, L. B. Chilton, M. Goldman, and R. C Miller. Turkit: tools for iterative tasks on mechanical turk. KDD-HCOMP, pages 29-30, 2009.
13. E. Simpson, S. Roberts, I. Psorakis, A. Smith, and Chris Lintott. Bayesian combination of multiple imperfect classifiers. NIPS, 2011.
14. R. Stranders, S. Ramchurn, B. Shi, and N. R. Jennings. Collabmap: Augmenting maps using the wisdom of crowds. In HCOMP, 2011.
15. L. Tran-Thanh, S. Stein, A. Rogers, and N. R. Jennings. Efficient crowdsourcing of unknown experts using multi-armed bandits. In ECAI, pages 768-773, 2012.
16. L. Tran-Thanh, M. Venanzi, A. Rogers, and N. R. Jennings. Efficient budget allocation with accuracy guarantees for crowdsourcing classification tasks. AAMAS, pages 901-908, 2013.
17. P. Welinder, Branson S., S. Belongie, and P. Perona. The multidimensional wisdom of crowds. NIPS, pages 2424-2432, 2010.