Workers' task choice in crowdsourcing and human computation markets

International Conference on Information Systems, ICIS 2012

Volumn 4, Issue , 2012, Pages 3551-3561

  Schulze, Thimo ^a   Schader, Martin ^a   Krug, Simone ^a  

^a UNIVERSITY OF MANNHEIM   (Germany)

Author keywords

Person job fit; Structural equation modeling; Survey; Task selection process

Indexed keywords

CROWDSOURCING; HARD PROBLEMS; HUMAN COMPUTATION; PERSON-JOB FIT; STRUCTURAL EQUATION MODELING; STRUCTURAL MODELING; TASK SELECTION; WORKERS';

INFORMATION SYSTEMS; SURVEYING;

COMMERCE;

EID: 84886474393     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (37)

1. von Ahn, L. 2006. "Games with a purpose, " IEEE Computer (39:6), pp. 92-94.
2. von Ahn, L., Maurer, B., McMillen, C., Abraham, D., and Blum, M. 2008. "reCAPTCHA: Human-Based Character Recognition Via Web Security Measures, " Science (321:5895), pp. 1465-1468.
3. Bigham, J. P., Jayant, C., Ji, H., Little, G., Miller, A., Miller, R. C., Tatarowicz, A., White, B., White, S., and Yeh, T. 2010. "VizWiz: nearly real-time answers to visual questions, " In Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A), Raleigh, North Carolina, ACM.
4. Cable, D. M. and DeRue, D. S. 2002. "The convergent and discriminant validity of subjective fit perceptions., " Journal of Applied Psychology (87:5), pp. 875-884.
5. Caldwell, D. F. and O'Reilly, C. A. 1990. "Measuring person-job fit with a profile-comparison process., " Journal of Applied Psychology (75:6), pp. 648-657.
6. Chandler, D. and Kapelner, A. 2010. "Breaking Monotony with Meaning: Motivation in Crowdsourcing Markets, " Working Paper.
7. Chesbrough, H. 2003. Open Innovation: The New Imperative for Creating and Profiting from Technology, (1st ed), Harvard Business School Publishing Corp.
8. Chilton, L. B., Horton, J. J., Miller, R. C., and Azenkot, S. 2010. "Task search in a human computation market, " In Proceedings of the ACM SIGKDD Workshop on Human Computation, Washington DC, USA, ACM, pp. 1-9.
9. Chin, W. W. 1998. "The partial least squares approach to structural equation modeling, " In George A. (Ed). Modern methods for business research. Methodology for business and management, pp. 295-336. Mahwah, NJ, US. Lawrence Erlbaum Associates Publishers.
10. Difallah, D. E., Demartini, G., and Cudré-Mauroux, P. 2012. "Mechanical Cheat: Spamming Schemes and Adversarial Techniques on Crowdsourcing Platforms, " In CrowdSearch 2012 workshop at WWW 2012, Lyon, France.
11. Edwards, J. A. and Billsberry, J. 2012. "Testing a multidimensional theory of person-environment fit, " Journal of managerial issues (22:4), pp. 476-493.
12. Edwards, J. R. 1991. "Person-job fit: A conceptual integration, literature review, and methodological critique., " International review of industrial and organizational psychology (Vol. 6), pp. 283-357.
13. Hackman, J. and Oldham, G. R. 1980. Work redesign, Addison-Wesley, Reading Mass.
14. Horton, J. J. and Chilton, L. B. 2010. "The labor economics of paid crowdsourcing, " In Proceedings of the 11th ACM conference on Electronic commerce, Cambridge, Massachusetts, USA, ACM, pp. 209-218.
15. Horton, J. J., Rand, D., and Zeckhauser, R. 2011. "The online laboratory: conducting experiments in a real labor market, " Experimental Economics (14:3), pp. 399-425.
16. Howe, J. 2008. Crowdsourcing: Why the Power of the Crowd Is Driving the Future of Business, Crown Publishing Group.
17. Huang, E., Zhang, H., Parkes, D. C., Gajos, K. Z., and Chen, Y. 2010. "Toward automatic task design: a progress report, " In Proceedings of the ACM SIGKDD Workshop on Human Computation, Washington DC, USA, ACM, pp. 77-85.
18. Geiger, D., Seedorf, S., Schulze, T., Nickerson, R., and Schader, M. 2011. "Managing the Crowd: Towards a Taxonomy of Crowdsourcing Processes, " In Proceedings of the 17th Americas Conference on Information Systems (AMCIS), Detroit, MI.
19. Ipeirotis, P. G. 2010, December. "Analyzing the Amazon Mechanical Turk marketplace, " XRDS: Crossroads, The ACM Magazine for Students (17), pp. 16-21.
20. Kaufmann, N., Schulze, T., and Veit, D. 2011. "More than fun and money. Worker Motivation in Crowdsourcing-A Study on Mechanical Turk, " In Proceedings of the 17th Americas Conference on Information Systems (AMCIS), Detroit, MI.
21. Khanna, S., Ratan, A., Davis, J., and Thies, W. 2010. "Evaluating and Improving the Usability of Mechanical Turk for Low-Income Workers in India, " In ACM DEV'10, London, United Kingdom.
22. Kristof-Brown, A. L. 2006. "Perceived Applicatn Fit:: Distinguishing between recruiters' Perceptions of Person-Job and Person-Organization fit, " Personnel Psychology (53:3), pp. 643-671.
23. Lakhani, K. R. and Wolf, R. G. 2005. "Why hackers do what they do: Understanding motivation and effort in free/open source software projects, " In Perspectives on free and open source software, MIT Press.
24. Leimeister, J. M., Huber, M., Bretschneider, U., and Krcmar, H. 2009. "Leveraging Crowdsourcing: Activation-Supporting Components for IT-Based Ideas Competition, " Journal of Management Information Systems (26:1), pp. 197-224.
25. Lyons, B. D. and Marler, J. H. 2011. "Got image? Examining organizational image in web recruitment, " Journal of Managerial Psychology (26:1), pp. 58-76.
26. MacKenzie, S. B., Podsakoff, P. M., and Podsakoff, N. P. 2011. "Construct measurement and validation procedures in MIS and behavioral research: integrating new and existing techniques, " MIS Quarterly (35:2), pp. 293-334.
27. Mason, W. and Watts, D. J. 2009. "Financial incentives and the 'performance of crowds', " In Proceedings of the ACM SIGKDD Workshop on Human Computation-HCOMP '09, Paris, France.
28. Moore, G. C. and Benbasat, I. 1991. "Development of an Instrument to Measure the Perceptions of Adopting an Information Technology Innovation, " Information Systems Research (2:3), pp. 192-222.
29. Paolacci, G., Chandler, J., and Ipeirotis, P. G. 2010. "Running Experiments on Amazon Mechanical Turk, " Judgment and Decision Making (5:5), pp. 411-419.
30. Petter, S., Straub, D., and Rai, A. 2008. "Specifying Formative Constructs in Information Systems Research, " Management Information Systems Quarterly (31:4), pp. 623-656.
31. Quinn, A. J. and Bederson, B. B. 2011. "Human Computation: A Survey and Taxonomy of a Growing Field, " In CHI 2011, May 7-12, 2011, Vancouver, BC, Canada.
32. Rogstadius, J., Kostakos, V., Kittur, A., Smus, B., Laredo, J., and Vukovic, M. 2011. "An Assessment of Intrinsic and Extrinsic Motivation on Task Performance in Crowdsourcing Markets, " In Proceedings of the AAAI Conference on Weblogs and Social Media, Barcelona, Spain.
33. Ross, J., Irani, L., Silberman, M. S., Zaldivar, A., and Tomlinson, B. 2010. "Who are the crowdworkers?: shifting demographics in mechanical turk, " In Proceedings of the 28th of the international conference extended abstracts on Human factors in computing systems, Atlanta, Georgia, USA, ACM, pp. 2863-2872.
34. Schulze, T., Seedorf, S., Geiger, D., Kaufmann, N., and Schader, M. 2011. "Exploring Task Properties in Crowdsourcing-An Empirical Study on Mechanical Turk, " In 19th European Conference on Information Systems (ECIS), 9-11 June 2011, Helsinki, Finland.
35. Sekiguchi, T. 2004. "Person-organization fit and person-job fit in employee selection: A review of the literature, " Osaka Keidai Ronshu (54:6), pp. 179-196.
36. Silberman, M. S., Ross, J., Irani, L., and Tomlinson, B. 2010. "Sellers' problems in human computation markets, " In Proceedings of the ACM SIGKDD Workshop on Human Computation, Washington DC, USA, ACM, pp. 18-21.
37. Yampolskiy, R. V. 2011. "AI-Complete, AI-Hard, or AI-Easy: Classification of Problems in Artificial Intelligence, " Working Paper.