Exploring the use of crowdsourcing to support empirical studies in software engineering

ESEM 2010 - Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement

Volumn , Issue , 2010, Pages

  Stolee, Kathryn T ^a   Elbaum, Sebastian ^a  

^a UNIVERSITY OF NEBRASKA LINCOLN   (United States)

Author keywords

crowdsourcing; empirical studies

Indexed keywords

CROWDSOURCING; EMPIRICAL STUDIES;

ENGINEERING;

SOFTWARE ENGINEERING;

EID: 78149255521     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1852786.1852832     Document Type: Conference Paper

References (16)

1. Julie S. Downs, Mandy B. Holbrook, Steve Sheng, and Lorrie Faith Cranor. Are your participants gaming the system?: screening Mechanical Turk workers. In Proceedings of the 28th international conference on Human factors in computing systems, 2010.
2. Brynn M. Evans and Ed H. Chi. Towards a model of understanding social search. In Proceedings of the 2008 ACM conference on Computer supported cooperative work, 2008.
3. Martin Fowler and Kent Beck. Refactoring: Improving the Design of Existing Code. Addison-Wesley, 1999.
4. Jeffrey Heer and Michael Bostock. Crowdsourcing graphical perception: using Mechanical Turk to assess visualization design. In Proceedings of the 28th international conference on Human factors in computing systems, 2010.
5. Jeff Howe. The rise of crowdsourcing. Wired Magazine, 14(06):17-23, 2006.
6. M. Cameron Jones and Elizabeth F. Churchill. Conversations in Developer Communities: A Preliminary Analysis of the Yahoo! Pipes Community. In Proceedings of the Fourth International Conference on Communities and Technologies, 2009.
7. Aniket Kittur, Ed H. Chi, and Bongwon Suh. Crowdsourcing user studies with Mechanical Turk. In Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, 2008.
8. Greg Little, Lydia B. Chilton, Max Goldman, and Robert C. Miller. Turkit: tools for iterative tasks on Mechanical Turk. In Proceedings of the ACM SIGKDD Workshop on Human Computation, 2009.
9. W. Mason and D.J. Watts. Financial Incentives and the Performance of Crowds. In Proceedings of the ACM SIGKDD Workshop on Human Computation, pages 77-85. ACM, 2009.
10. Amazon Mechanical Turk. https://www.mturk.com/mturk/welcome, June 2010.
11. Yahoo! Pipes. http://pipes.yahoo.com/, July 2009.
12. Joel Ross, Lilly Irani, M. Six Silberman, Andrew Zaldivar, and Bill Tomlinson. Who are the crowdworkers?: shifting demographics in Mechanical Turk. In Proceedings of the 28th of the international conference extended abstracts on Human factors in computing systems, 2010.
13. Christopher Scaffidi, Mary Shaw, and Brad Myers. Estimating the numbers of end users and end user programmers. In Symposium on Visual Languages and Human Centric Computing, 2005.
14. Rion Snow, Brendan O'Connor, Daniel Jurafsky, and Andrew Y. Ng. Cheap and fast - but is it good?: evaluating non-expert annotations for natural language tasks. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, 2008.
15. Kathryn T. Stolee. Analysis and transformation of pipe-like web mashups for end user programmers. Master's Thesis, University of Nebraska - Lincoln, June 2010.
16. Survey Vault. http://www.surveyvault.co.uk/, July 2010.