Scaling-Up the Crowd: Micro-Task Pricing Schemes forWorker Retention and Latency Improvement

Proceedings of the 2nd AAAI Conference on Human Computation and Crowdsourcing, HCOMP 2014

Volumn , Issue , 2014, Pages 50-58

  Difallah, Djellel Eddine ^a   Catasta, Michele ^b   Demartini, Gianluca ^a   Cudré Mauroux, Philippe ^a  

^a UNIVERSITY OF FRIBOURG   (Switzerland)

^b EPFL   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; CROWDSOURCING; ECONOMICS;

CONDITION; CROWDSOURCING PLATFORMS; HUMAN INTELLIGENCE; MICROTASKS; MONETARY REWARDS; PRICING METHODS; PRICING SCHEME; RETENTION RATE; SCALING-UP; WORKERS';

COSTS;

EID: 85072829610     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (24)

1. Arthur, D. 2001. The employee recruitment and retention handbook. AMACOM Div American Mgmt Assn.
2. Bartlett, C., and Ghoshal, S. 2013. Building competitive advantage through people. Sloan Mgmt. Rev 43(2).
3. Carvalho, V. R.; Lease, M.; and Yilmaz, E. 2011. Crowdsourcing for search evaluation. In ACM Sigir forum, volume 44, 17-22. ACM.
4. Chandler, D., and Horton, J. J. 2011. Labor Allocation in Paid Crowdsourcing: Experimental Evidence on Positioning, Nudges and Prices. In Human Computation.
5. Demartini, G.; Difallah, D. E.; and Cudré-Mauroux, P. 2012. Zencrowd: leveraging probabilistic reasoning and crowdsourcing techniques for large-scale entity linking. In Proceedings of the 21st international conference on World Wide Web, 469-478. ACM.
6. Demartini, G.; Difallah, D. E.; and Cudré-Mauroux, P. 2013. Large-scale linked data integration using probabilistic reasoning and crowdsourcing. The VLDB Journal 22(5):665-687.
7. Difallah, D. E.; Demartini, G.; and Cudré-Mauroux, P. 2013. Pick-a-crowd: tell me what you like, and i'll tell you what to do. In Proceedings of the 22nd international conference on World Wide Web, 367-374. International World Wide Web Conferences Steering Committee.
8. Faradani, S.; Hartmann, B.; and Ipeirotis, P. G. 2011. What's the Right Price? Pricing Tasks for Finishing on Time. In Human Computation.
9. Franklin, M. J.; Kossmann, D.; Kraska, T.; Ramesh, S.; and Xin, R. 2011. CrowdDB: answering queries with crowdsourcing. In Proceedings of the 2011 ACM SIGMOD International Conference on Management of data, SIGMOD '11, 61-72. New York, NY, USA: ACM.
10. Hosseini, M.; Cox, I. J.; Milić-Frayling, N.; Kazai, G.; and Vinay, V. 2012. On aggregating labels from multiple crowd workers to infer relevance of documents. In Advances in information retrieval. Springer. 182-194.
11. Huselid, M. A. 1995. The impact of human resource management practices on turnover, productivity, and corporate financial performance. Academy of management journal 38(3):635-672.
12. Ipeirotis, P. G. 2010. Analyzing the amazon mechanical turk marketplace. XRDS: Crossroads, The ACM Magazine for Students 17(2):16-21.
13. Irani, L. C., and Silberman, M. 2013. Turkopticon: Interrupting worker invisibility in amazon mechanical turk. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 611-620. ACM.
14. Lasecki, W. S.; Marcus, A.; Tzeszotarski, J. M.; and Bigham, J. P. 2014. Using Microtask Continuity to Improve Crowdsourcing. In Carnegie Mellon University Human-Computer Interaction Institute - Technical Reports - CMU-HCII-14-100.
15. Lazebnik, S.; Schmid, C.; Ponce, J.; et al. 2004. Semi-local affine parts for object recognition. In British Machine Vision Conference (BMVC'04), 779-788.
16. Mao, A.; Kamar, E.; Chen, Y.; Horvitz, E.; Schwamb, M. E.; Lintott, C. J.; and Smith, A. M. 2013. Volunteering Versus Work for Pay: Incentives and Tradeoffs in Crowdsourcing. In HCOMP.
17. Mao, A.; Kamar, E.; and Horvitz, E. 2013. Why Stop Now? Predicting Worker Engagement in Online Crowdsourcing. In First AAAI Conference on Human Computation and Crowdsourcing.
18. Michaels, E.; Handfield-Jones, H.; and Axelrod, B. 2001. The war for talent. Harvard Business Press.
19. Ross, J.; Irani, L.; Silberman, M.; Zaldivar, A.; and Tomlinson, B. 2010. Who are the crowdworkers?: shifting demographics in mechanical turk. In CHI'10 Extended Abstracts on Human Factors in Computing Systems, 2863-2872. ACM.
20. Singer, Y., and Mittal, M. 2013. Pricing Mechanisms for Crowdsourcing Markets. In Proceedings of the 22Nd International Conference on World Wide Web, WWW '13, 1157-1166. Republic and Canton of Geneva, Switzerland: International World Wide Web Conferences Steering Committee.
21. Wang, J.; Kraska, T.; Franklin, M. J.; and Feng, J. 2012. Crowder: Crowdsourcing entity resolution. Proceedings of the VLDB Endowment 5(11):1483-1494.
22. Wang, J.; Ipeirotis, P. G.; and Provost, F. 2013. Quality-Based Pricing for Crowdsourced Workers. In NYU Stern Research Working Paper - CBA-13-06.
23. Yan, T.; Kumar, V.; and Ganesan, D. 2010. Crowdsearch: Exploiting crowds for accurate real-time image search on mobile phones. In Proceedings of the 8th International Conference on Mobile Systems, Applications, and Services, MobiSys '10, 77-90. New York, NY, USA: ACM.
24. Yannakoudakis, H.; Briscoe, T.; and Medlock, B. 2011. A new dataset and method for automatically grading esol texts. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies-Volume 1, 180-189. Association for Computational Linguistics.