A community rather than a union: Understanding self-organization phenomenon on MTurk and how it impacts turkers and requesters

Conference on Human Factors in Computing Systems - Proceedings

Volumn Part F127655, Issue , 2017, Pages 2210-2216

  Wang, Xinyi ^a   Zhu, Haiyi ^a   Li, Yangyun ^a   Cui, Yu ^a   Konstan, Joseph ^a  

^a UNIVERSITY OF MINNESOTA   (United States)

Author keywords

Amazon Mechanical Turk; Crowdsourcing; Online community; Self organization; Work quality; Working condition

Indexed keywords

CROWDSOURCING; HUMAN ENGINEERING; SOCIAL NETWORKING (ONLINE); WEBSITES;

AMAZON MECHANICAL TURKS; ON-LINE COMMUNITIES; SELF ORGANIZATIONS; WORK QUALITY; WORKING CONDITION;

ONLINE SYSTEMS;

EID: 85019596547     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/3027063.3053150     Document Type: Conference Paper

References (16)

1. Benjamin B Bederson and Alexander J Quinn. 2011. Web workers unite! addressing challenges of online laborers. In CHI'11 Extended Abstracts on Human Factors in Computing Systems. ACM, 97-106.
2. Adam J Berinsky, Gregory A Huber, and Gabriel S Lenz. 2012. Evaluating online labor markets for experimental research: Amazon. com's Mechanical Turk. Political Analysis 20, 3(2012), 351-368.
3. Daren C Brabham. 2010. Moving the crowd at Threadless: Motivations for participation in a crowdsourcing application. Information, Communication and Society 13, 8(2010), 1122-1145.
4. Michael Buhrmester, Tracy Kwang, and Samuel D Gosling. 2011. Amazon's Mechanical Turk a new source of inexpensive, yet high-quality, data? Perspectives on psychological science 6, 1(2011), 3-5.
5. Anhai Doan, Raghu Ramakrishnan, and Alon Y Halevy. 2011. Crowdsourcing systems on the worldwide web. Commun. ACM 54, 4(2011), 86-96.
6. Enrique Estellés-Arolas and Fernando González-Ladrón-De-Guevara. 2012. Towards an integrated crowdsourcing definition. Journal of Information science 38, 2(2012), 189-200.
7. Jeff Howe. 2006. The rise of crowdsourcing. Wired magazine 14, 6(2006), 1-4.
8. Lilly C Irani and M. Silberman. 2013. Turkopticon: Interrupting worker invisibility in amazon mechanical turk. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 611-620.
9. Aniket Kittur, Ed H Chi, and Bongwon Suh. 2008. Crowdsourcing user studies with Mechanical Turk. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 453-456.
10. John Le, Andy Edmonds, Vaughn Hester, and Lukas Biewald. 2010. Ensuring quality in crowdsourced search relevance evaluation: The effects of training question distribution. In SIGIR 2010 workshop on crowdsourcing for search evaluation. 21-26.
11. Gabriele Paolacci, Jesse Chandler, and Panagiotis G Ipeirotis. 2010. Running experiments on amazon mechanical turk. Judgment and Decision making 5, 5(2010), 411-419.
12. M. Silberman, Joel Ross, Lilly Irani, and Bill Tomlinson. 2010b. Sellers' problems in human computation markets. In Proceedings of the ACM SIGKDD workshop on Human Computation. ACM, 18-21.
13. M. Six Silberman, Lilly Irani, and R. Ross. 2010a. Ethics and tactics of professional crowdwork. XRDS 17, 2(December 2010), 39-43. (2010).
14. Gang Wang, Konark Gill, Manish Mohanlal, Haitao Zheng, and Ben Y Zhao. 2013. Wisdom in the social crowd: an analysis of quora. In Proceedings of the 22nd international conference on World Wide Web. ACM, 1341-1352.
15. Ming Yin, Mary L Gray, Siddharth Suri, and Jennifer Wortman Vaughan. 2016. The communication network within the crowd. In Proceedings of the 25th International Conference on World Wide Web. International World Wide Web Conferences Steering Committee, 1293-1303.
16. Haiyi Zhu, Steven P Dow, Robert E Kraut, and Aniket Kittur. 2014. Reviewing versus doing: Learning and performance in crowd assessment. In Proceedings of the 17th ACM conference on Computer supported cooperative work and social computing. ACM, 1445-1455.