Task lockouts induce crowdworkers to switch to other activities

Conference on Human Factors in Computing Systems - Proceedings

Volumn 18, Issue , 2015, Pages 1785-1790

  Gould, Sandy J J ^a   Cox, Anna L ^a   Brumby, Duncan P ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

Crowdworking; Data quality; Interface lockouts; Interruptions; Task switching

Indexed keywords

DATA HANDLING; HUMAN COMPUTER INTERACTION; HUMAN ENGINEERING;

AMAZON MECHANICAL TURKS; CROWDWORKING; DATA PROCESSING TECHNIQUES; DATA QUALITY; INTERRUPTIONS; LOW QUALITIES; POOR PERFORMANCE; TASK SWITCHING;

LOCKS (FASTENERS);

EID: 84940515843     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2702613.2732709     Document Type: Conference Paper

References (13)

1. Buhrmester, M., Kwang, T., and Gosling, S.D. Amazon's Mechanical Turk A New Source of Inexpensive, Yet High-Quality, Data? Perspectives on Psychological Science 6, 1 (2011), 3-5.
2. Chandler, J., Mueller, P., and Paolacci, G. Nonnaïveté among Amazon Mechanical Turk workers: Consequences and solutions for behavioral researchers. Behavior Research Methods 46, 1 (2014), 112-130.
3. Dandurand, F., Shultz, T.R., and Onishi, K.H. Comparing online and lab methods in a problem-solving experiment. Behavior Research Methods 40, 2 (2008), 428-434.
4. Downs, J.S., Holbrook, M.B., Sheng, S., and Cranor, L.F. Are your participants gaming the system?: screening mechanical turk workers. Proc CHI '10, ACM (2010), 2399-2402.
5. Germine, L., Nakayama, K., Duchaine, B.C., Chabris, C.F., Chatterjee, G., and Wilmer, J.B. Is the Web as good as the lab? Comparable performance from Web and lab in cognitive/perceptual experiments. Psychonomic Bulletin & Review 19, 5 (2012), 847-857.
6. Goodman, J.K., Cryder, C.E., and Cheema, A. Data Collection in a Flat World: The Strengths and Weaknesses of Mechanical Turk Samples. Journal of Behavioral Decision Making 26, 3 (2013), 213-224.
7. Hsieh, G., Kraut, R.E., and Hudson, S.E. Why Pay?: Exploring How Financial Incentives Are Used for Question & Answer. Proc CHI '10, ACM (2010), 305-314.
8. Kapelner, A. and Chandler, D. Preventing Satisficing in online surveys. CrowdConf, (2010).
9. Komarov, S., Reinecke, K., and Gajos, K.Z. Crowdsourcing Performance Evaluations of User Interfaces. Proc CHI '13, ACM (2013), 207-216.
10. Mason, W. and Suri, S. Conducting behavioral research on Amazon's Mechanical Turk. Behavior Research Methods 44, 1 (2012), 1-23.
11. Mason, W. and Watts, D.J. Financial incentives and the "performance of crowds." SIGKDD Explor. Newsl. 11, 2 (2010), 100-108.
12. Paolacci, G., Chandler, J., and Ipeirotis, P.G. Running experiments on Amazon Mechanical Turk. Judgment and Decision Making 5, 5 (2010), 411-419.
13. Rzeszotarski, J.M. and Kittur, A. CrowdScape: interactively visualizing user behavior and output. Proceedings of the 25th annual ACM symposium on User interface software and technology, ACM (2012), 55-62.