Intervention strategies for increasing engagement in crowdsourcing: Platform, predictions, and experiments

IJCAI International Joint Conference on Artificial Intelligence

Volumn 2016-January, Issue , 2016, Pages 3861-3867

  Segal, Avi ^a   Gal, Ya'akov Kobi ^a   Kamar, Ece ^b   Horvitz, Eric ^b   Bowyer, Alex ^c   Miller, Grant ^c  

^a BEN GURION UNIVERSITY OF THE NEGEV   (Israel)

^b MICROSOFT RESEARCH   (United States)

^c UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

CROWDSOURCING; LEARNING SYSTEMS;

CITIZEN SCIENCE; INTERVENTION STRATEGY; REAL-TIME PREDICTION; USER DATA;

ARTIFICIAL INTELLIGENCE;

EID: 85006096933     PISSN: 10450823     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (20)

1. Ashton Anderson, Daniel Huttenlocher, Jon Kleinberg, and Jure Leskovec. Steering user behavior with badges. In Proceedings of the 22nd international conference on World Wide Web, pages 95-106, 2013.
2. Ashton Anderson, Daniel Huttenlocher, Jon Kleinberg, and Jure Leskovec. Engaging with massive online courses. In Proceedings of the 23rd international conference on World wide Web, pages 687-698. ACM, 2014.
3. Alexandra Eveleigh, Charlene Jennett, Ann Blandford, Philip Brohan, and Anna L Cox. Designing for dabblers and deterring drop-outs in citizen science. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems, pages 2985-2994. ACM, 2014.
4. John Joseph Horton and Lydia B Chilton. The labor economics of paid crowdsourcing. In Proceedings of the 11th ACM conference on Electronic commerce, pages 209-218. ACM, 2010.
5. Eric Horvitz and Johnson Apacible. Learning and reasoning about interruption. In Proceedings of the 5th international conference on Multimodal interfaces, pages 20-27. ACM, 2003.
6. Panagiotis G Ipeirotis, Foster Provost, and Jing Wang. Quality management on amazon mechanical turk. In Proceedings of the ACM SIGKDD workshop on human computation, pages 64-67. ACM, 2010.
7. Panagiotis G Ipeirotis. Analyzing the amazon mechanical turk marketplace. XRDS: Crossroads, The ACM Magazine for Students, 17(2):16-21, 2010.
8. Ece Kamar, Yaakov Kobi Gal, and Barbara J Grosz. Modeling information exchange opportunities for effective human-computer teamwork. Artificial Intelligence, 195:528-550, 2013.
9. Kimberly Ling, Gerard Beenen, Pamela Ludford, Xiaoqing Wang, Klarissa Chang, Xin Li, Dan Cosley, Dan Frankowski, Loren Terveen, Al Mamunur Rashid, et al. Using social psychology to motivate contributions to online communities. Journal of Computer-Mediated Communication, 10(4):00-00, 2005.
10. Andrew Mao, Ece Kamar, and Eric Horvitz. Why stop now predicting worker engagement in online crowdsourcing. In First AAAI Conference on Human Computation and Crowdsourcing, 2013.
11. Jennifer Preece and Ben Shneiderman. The reader-to-leader framework: Motivating technology-mediated social participation. AIS Transactions on Human-Computer Interaction, 1(1):13-32, 2009.
12. M Jordan Raddick, Georgia Bracey, Pamela L Gay, Chris J Lintott, Phil Murray, Kevin Schawinski, Alexander S Szalay, and Jan Vandenberg. Galaxy zoo: Exploring the motivations of citizen science volunteers. Astronomy Education Review, 9(1):010103, 2010.
13. Jeff Reed, M Jordan Raddick, Andrea Lardner, and Karen Carney. An exploratory factor analysis of motivations for participating in zooniverse, a collection of virtual citizen science projects. In System Sciences (HICSS), 2013 46th Hawaii International Conference on, pages 610-619. IEEE, 2013.
14. Jakob Rogstadius, Vassilis Kostakos, Aniket Kittur, Boris Smus, Jim Laredo, and Maja Vukovic. An assessment of intrinsic and extrinsic motivation on task performance in crowdsourcing markets. In Intl. Conf. on Weblogs and Social Media, 2011.
15. Henry Sauermann and Chiara Franzoni. Crowd science user contribution patterns and their implications. Proceedings of the National Academy of Sciences, 112(3):679-684, 2015.
16. Saiph Savage, Andres Monroy-Hernandez, and Tobias Hollerer. Botivist: Calling volunteers to action using online bots. arXiv preprint arXiv:1509.06026, 2015.
17. Avi Segal, Ya'akov Kobi Gal, Robert J Simpson, Victoria Victoria Homsy, Mark Hartswood, Kevin R Page, and Marina Jirotka. Improving productivity in citizen science through controlled intervention. In Proceedings of the 24th International Conference on World Wide Web, pages 331-337, 2015.
18. Tammar Shrot, Avi Rosenfeld, Jennifer Golbeck, and Sarit Kraus. Crisp: an interruption management algorithm based on collaborative filtering. In Proceedings of the SIGCHI conference on human factors in computing systems, pages 3035-3044. ACM, 2014.
19. Robert Simpson, Kevin R Page, and David De Roure. Zooniverse: observing the world's largest citizen science platform. In Proceedings of the companion publication of the 23rd international conference on World wide web companion, pages 1049-1054, 2014.
20. Long Tran-Thanh, Trung Dong Huynh, Avi Rosenfeld, Sarvapali D. Ramchurn, and Nicholas R. Jennings. Crowdsourcing complex workflows under budget constraints. In AAAI, 2015.