Experiments on motivational feedback for crowdsourced workers

Proceedings of the 7th International Conference on Weblogs and Social Media, ICWSM 2013

Volumn , Issue , 2013, Pages 341-350

  Lee, Tak Yeon ^a   Dugan, Casey ^b   Geyer, Werner ^b   Ratchford, Tristan ^b   Rasmussen, Jamie ^b   Shami, N Sadat ^c   Lupushor, Stela ^c  

^a UNIVERSITY OF MARYLAND   (United States)

^b IBM T J WATSON RESEARCH CENTER   (United States)

^c IBM   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EXPERIMENTS; INDUSTRY;

CROWDSOURCING; GAMIFICATION; LONGITUDINAL EFFECT; WORKERS';

SOCIAL NETWORKING (ONLINE);

EID: 84900388998     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (30)

1. Brabham, D.C. 2008. Moving the crowd at iStockphoto: The composition of the crowd and motivations for participation in a crowdsourcing application. First Monday, 13, 6, 1-22.
2. Brabham, D.C. 2010. Moving the crowd at Threadless: Motivations for participation in a crowdsourcing application. Information, Communication & Society, 13, 8, 1122-1145.
3. Clauset, A., Shalizi, C.R. and Newman, M.E.J. 2009. Power-Law Distributions in Empirical Data. SIAM Rev. 51, 4 (November 2009), 661-703.
4. Chandler, D. and Kapelner, A. 2010. Breaking monotony with meaning: Motivation in crowdsourcing markets. University of Chicago mimeo
5. Chandler D. and Horton, J.J. 2011. Labor Allocation in Paid Crowdsourcing: Experimental Evidence on Positioning, Nudges and Prices. In proceeding of: Human Computation, Papers from the 2011 AAAI Workshop, San Francisco, California, USA, August 8, 2011
6. Cosley, D., Lam, S.K., Albert, I., Konstan, J., & Riedl, J. (2003). Is Seeing Believing? How Recommender Systems Influence Users' Opinions. In Proceedings of CHI 2003 Conference on Human Factors in Computing Systems, Fort Lauderdale, FL, pp. 585-592.
7. Deci, E. L., and Ryan, R. M. 1985. Intrinsic motivation and self-determination in human behavior, Springer
8. Deterding, S., Dixon, D., Khaled, R. and Nacke L. 2011. From game design elements to gamefulness: defining "gamification". In Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments (MindTrek '11). ACM, New York, NY, USA, 9-15.
9. Dow, S., Kulkarni, A., Klemmer, S. and Hartmann, B. 2012. Shepherding the crowd yields better work. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work (CSCW '12). ACM, New York, NY, USA, 1013-1022.
10. Fogg, B.J. 2009. A behavior model for persuasive design. In Proceedings of the 4th International Conference on Persuasive Technology (Persuasive '09). ACM, New York, NY, USA
11. Gneezy, U. and Rustichini, A. 2000. Pay enough or don't pay at all. Q. J. Econ., 115, (2000), 791-810.
12. Gibbons, R. 1996. Incentives and Careers in Organizations. Incentive, No. 5705, 1-37. Cambridge University Press.
13. Hackman, J., and Oldham, G. R. 1980. Work redesign, Addison-Wesley, Reading Mass.
14. Heyman, J. and Ariely, D. 2004. Effort for Payment: A Tale of Two Markets. Psychological Science, 15, (11, 2004), 787-793.
15. Howe, J. 2006. The Rise of Crowdsourcing, Wired, 14, 6.
16. Ipeirotis, P.G. 2010. Analyzing the Amazon Mechanical Turk marketplace. XRDS 17, 2 (December 2010), 16-21.
17. Kaufmann, N., Schulze, T. and Veit, D. 2011. More than fun and money. Worker Motivation in Crowdsourcing - A Study on Mechanical Turk. In Proceedings of the Seventeenth Americas Conference on Information Systems. (Aug. 2011)
18. Kinnaird, P., Dabbish, L. and Kiesler, S. 2012. Workflow transparency in a microtask marketplace. In Proceedings of the 17th ACM international conference on Supporting group work (GROUP '12). ACM, New York, NY, USA, 281-284
19. Kruskal, W.H. and Wallis, W.A. 1952. Use of ranks in one-criterion variance analysis. Journal of the American Statistical Association 47 (260): 583-621
20. Leimeister, J., Huber, M., Bretschneider, U., and Krcmar, H. 2009. Leveraging Crowdsourcing: Activation-Supporting Components for IT-Based Ideas Competition, Journal of Management Information Systems, 26, (2009) 197-224
21. Mason, W. and Watts, D.J. 2009. Financial incentives and the "performance of crowds". In Proceedings of the ACM SIGKDD Workshop on Human Computation (HCOMP '09), ACM, New York, NY, USA, 77-85.
22. Nielson, J. Participation Inequality: Encouraging More Users to Contribute. Retrieved Feb 12, 2013, from Nielsen Normal Group. http://www.nngroup.com/articles/participation-inequality/
23. Preece, J. and Shneiderman, B. 2009. The Reader-to-Leader Framework: Motivating Technology-Mediated Social Participation. AIS Transactions on Human-Computer Interaction (1) 1, pp. 13-32
24. Quinn, A.J. and Bederson, B.B. 2011. Human computation: a survey and taxonomy of a growing field. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 1403-1412.
25. Rogstadius, J., Kostakos, V., Kittur, A., Smus, B., Laredo, J. and Vukovic, M. 2011. An Assessment of Intrinsic and Extrinsic Motivation on Task Performance in Crowdsourcing Markets. In Proc. ICWSM11, Barcelona, Spain.
26. Shaw, A.D., Horton, J.J., and Chen, D.L. 2011. Designing incentives for inexpert human raters. In Proceedings of the ACM 2011 conference on Computer supported cooperative work (CSCW '11). ACM, New York, NY, USA, 275-284.
27. Farzan, R., DiMicco, J., Millen, D. R, Brownholtz, B., Dugan, C., and Geyer, W., R. When the experiment is over: Deploying an incentive system to all the users. Persuasive Technology 2008.
28. von Ahn, L. Games with a purpose. 2006. IEEE Computer Magazine, 39(6): 96-98, 2006
29. von Ahn, L. and Dabbish, L. 2004. Labeling images with a computer game. In Proc. SIGCHI Conf. on Human Factors in Computing Systems (Vienna, April 24-29). ACM, New York, 319-326, 2004.
30. von Ahn, L. and Dabbish, L. 2008. General Techniques for Designing Games with a Purpose. Communications of the ACM, August 2008. pp 58-67.