Turkomatic: Automatic recursive task and workflow design for Mechanical Turk

Conference on Human Factors in Computing Systems - Proceedings

Volumn , Issue , 2011, Pages 2053-2058

  Kulkarni, Anand ^a   Can, Matthew ^b   Hartmann, Björn ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Crowdsourcing; Human computation; Mechanical Turk

Indexed keywords

COMPLEX TASK; CROWDSOURCING PLATFORMS; HUMAN COMPUTATION; MECHANICAL TURKS; TASK DECOMPOSITION; TASK DESIGN; WORK-FLOWS; WORKERS'; WORKFLOW DESIGNS;

CROWDSOURCING;

EID: 79957932772     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1979742.1979865     Document Type: Conference Paper

References (11)

1. Bernstein, M., Little, G., Miller, R.C., Hartmann, B., Ackerman, M., Karger, D.R., Crowell, D., and Panovich, K. Soylent: A Word Processor with a Crowd Inside. UIST 2010.
2. Bigham, J.P., Jayant, C., Ji, H., Little, G., Miller, A., Miller, R.C., Miller, R., Tatrowicz, A., White, B., White, S., and Yeh, T. VizWiz: Nearly Real-time Answers to Visual Questions. UIST 2010.
3. Huang, E., Zhang, H., Parkes, D.C., Gajos, K.Z., and Chen, Y. Toward automatic task design: A progress report. KDD-HCOMP'10. ACM, 2010.
4. Ipeirotis, P. Analyzing the Amazon Mechanical Turk Marketplace. Working paper, http://hdl.handle.net/2451/29801. 2010.
5. Little, G., Chilton, L.B., Goldman, M., and Miller, R.C. TurKit: Tools for Iterative Tasks on Mechanical Turk. KDD-HCOMP. 2009.
6. Little, G., Chilton, L.B., Goldman, M., and Miller, R.C. TurKit: Human Computation Algorithms on Mechanical Turk. UIST 2010.
7. Little, G., Chilton, L.B., Goldman, M., and Miller, R.C. Exploring Iterative and Parallel Human Computation Processes. KDD-HCOMP'10. ACM, 2010.
8. Quinn, A.J. and Bederson, B.B. A Taxonomy of Distributed Human Computation. UMD TR 2009.
9. Sheng, V.S, Provost, F., and Ipeirotis, P.G. Get Another Label? Improving Data Quality and Data Mining Using Multiple, Noisy Labelers. KDD 2008.
10. Sorokin, A. and Forsyth, D. Utility data annotation with Amazon Mechanical Turk. CVPRW 2008, 1-8.
11. von Ahn, L. Games with a Purpose. IEEE Computer (2006).